Argghh! The comment bug

Written By: - Date published: 1:44 pm, October 18th, 2015 - 10 comments
Categories: admin, The Standard - Tags: ,

I have spent a few hours been chasing the bug that has been causing people to go into moderation automatically. Found it, killed it, and I thought I’d share it with you.

It was in Wordfence, a great security program for the site.  Essentially it is one of the main plugins to block out irritating behaviours by bots treating the site as their own personal space. Because there are a lot of bots running around the net probing for security holes, reading content, and generally being a pain in the arse when trying to predict the computing resources required to operate the site.

Since we run the site on less than $300 per month funded by voluntary welcome donations (see here), I spend a lot of time keeping robot free loaders out of the site.

Our direct1 human traffic this year is about 80 gigabytes per month to mainly NZ resident humans. Our welcome and expected2 bot traffic averages about 150 gigabytes of traffic per month. And we routinely provide about another 70-80 gigabytes of traffic to various bots who follow our rules.

Crawler rules

Otherwise we’d have to provide systems that are capable of handling many times our legitimate traffic.

But there are other rules in the system designed to block bots and humans from trying to take over our site and use it for purposes nefarious – like spam and free advertising. A lot of those are focused around getting logins as admins and authors, or placing comments as new or existing commenters on the site. These are known as spambots.

So Wordfence and other systems provide preventative measures for those as well. Some of the Wordfence security options are here

Login rules

One of the reasons3 that we have run this site for many years without requiring logins is because it removes a major potential security issue. These days the only logins in active use are those of the authors and a few people who got them before I turned off access to obtaining them in 2011.

We handle robots leaving spam comments with some subtle programs that bank on human vs robot behaviours. The odd robot spam or troll that gets past those has to have an approved comment by a moderator before they can post freely.

However there are the odd persons who leave comments purporting to be by other people. Usually we know because of gravator differences because they have the wrong ’email’.

And then there is this behaviour that Wordfence protects against.

Hold anonymous comments using member emails for moderation
In WordPress it’s possible for someone who is not a member on your website to post a comment and to specify an email address of a real member on your site. This behavior is suspicious and may be incorporated into a more sophisticated attack. So we suggest that you leave this option enabled which will hold those comments for moderation before they’re published.

Thats ok – good security. It isn’t particularly relevant to our site however. Many of our authors comment without logging in because it is faster. Not having a special page generated for you is a whole lot slower than getting a cached page (apart from the replies tab). Our longer term commenters who have actual logins have mostly long since forgotten their passwords 🙂

I never noticed this option. It was added in an upgrade after I did the Wordfence setup years ago. It was off by default as are all new features. And it never got triggered when I did plugin upgrade testing.

However somehow this one button amonst the hundreds that control this site turned on and caused a week of nuisance for moderators and commenters  ! ^&*%^*^%&%^$$!!!!!

Looking at the errors at wordfence, I see this.

Hi All,

We have released a fix that addresses a bug introduced with the release that went out 15 hours ago. The issue is that if a Wordfence options checkbox is unchecked and is different from the default setting, the release resets the Wordfence setting to the default setting of checked.

Arggghhhhh… The joys of upgrades and testing..

 


 

  1. Not counting the graphics. Those are mostly served up from a content delivery network, in our case Cloudfront from Amazon.
  2. Legitimate googlebots and some other selected web search crawlers, Cloudfront, backup and synchronising systems, Internet Archive (Wayback Engine) and the National Library web harvesting (see Kiwiblogblog is not completely dead).
  3. See the privacy section of the policy.

10 comments on “Argghh! The comment bug ”

  1. r0b 1

    Hah! Thanks for tracking it down, and as usual for the work that goes on behind the scenes…

    • lprent 1.1

      More for the moderators than anyone else in this case. They were having to release the comments from moderation. And we usually get a lot of comments each day.

      Right now we’re inching towards our first million published comments accumulated over the last 8 and bit years.

      For me it was mostly a matter of finding enough clean and uninterrupted time to check everything that may have introduced this problem

  2. Thank you – I never realised the value of having realtime comments as much – it is just hard to converse when the lag is there – such an important feature that supports the Standard community – thanks again.
    Edit It works!!! thanks the gods it works 🙂 and thanks to the mods who let my comments through – a pain I know, but appreciated.

  3. Stephen 3

    Man, you do great work, LP. Long may you continue.

  4. wyndham 4

    Lyn. Alas, every post that I open carries the heading “No Comments” irrespective of the fact that there may be umpteen comments from a variety of folk. The only way I can open these comments is to click on “No Comments”. Is this in my PC or is it at your end ?

    • lprent 4.1

      Sounds like the caching, either server or client side. I will have a look at it after I get the tabs for the feeds working.

      But in the meantime, try Shift + F5 to force a reload and see if it fixes it. If it does then it is likely to be client side and probably related to date time.

      You don’t see comments for anything?

  5. Lanthanide 5

    Lynn, have you considered Patreon?

    Potentially to cover existing server support, as well as a pot of money to be split between authors in some sort of manner (may be difficult).

    • lprent 5.1

      Interesting. The reason that I went the other way; reducing cost, was because of the scarce resource we have – our time. There was no time to do structured work hours work. Instead we tend to do everything async, as and when there was a block of time.

      Just to give an idea, while I could make a call to someone during the day, if I didn’t get them first time then I didn’t leave messages. When I’m working, I don’t answer phone calls. Same for email. I keep an eye on it, but I can’t answer non-work things in a timely manner when I’m programming. It takes a mind dump to become human again, and then usually about 30 minutes to get back into the groove.

      I’m probably a bit extreme because of what I work on. But most of the people who author and moderate here seem to have the same kinds of time pressures. So the idea of doing the business kinds of things to run a voluntary blog in our “spare time” isn’t something that we can do. We don’t have the kinds of block time required, and the local market isn’t big.

      But something run for creatives who have the same issues.. That has more possibilities.

  6. infused 6

    Teach you for upgrading too quick…

CommentsOpinions

Recent Comments

Recent Posts

FeedsPartyGovtMedia

  • Acknowledgement to Kīngi Tuheitia speech

    E te māngai o te Whare Pāremata, kua riro māku te whakaputa i te waka ki waho moana. E te Pirimia tēnā koe.Mr Speaker, it is my privilege to take this adjournment kōrero forward.  Prime Minister – thank you for your leadership. Taupiri te maunga Waikato te awa Te Wherowhero ...
    BeehiveBy beehive.govt.nz
    1 hour ago
  • Interim fix to GST adjustment rules to support businesses

    Inland Revenue can begin processing GST returns for businesses affected by a historic legislative drafting error, Revenue Minister Simon Watts says. “Inland Revenue has become aware of a legislative drafting error in the GST adjustment rules after changes were made in 2023 which were meant to simplify the process. This ...
    BeehiveBy beehive.govt.nz
    4 hours ago
  • Strong uptake for cervical screening self-test

    More than 80 per cent of New Zealand women being tested have opted for a world-leading self-test for cervical screening since it became available a year ago. Minister of Health Dr Shane Reti and Associate Minister Casey Costello, in her responsibility for Women’s Health, say it’s fantastic to have such ...
    BeehiveBy beehive.govt.nz
    5 hours ago
  • Ministry for Regulation’s first Strategic Intentions document sets ambitious direction

    Regulation Minister David Seymour welcomes the Ministry for Regulation’s first Strategic Intentions document, which sets out how the Ministry will carry out its work and deliver on its purpose. “I have set up the Ministry for Regulation with three tasks. One, to cut existing red tape with sector reviews. Two, ...
    BeehiveBy beehive.govt.nz
    6 hours ago
  • Māori Education Advisory Group established

    The Education Minister has established a Māori Education Ministerial Advisory Group made up of experienced practitioners to help improve outcomes for Māori learners. “This group will provide independent advice on all matters related to Māori education in both English medium and Māori medium settings. It will focus on the most impactful ways we can lift ...
    BeehiveBy beehive.govt.nz
    7 hours ago
  • First of five new Hercules aircraft takes flight

    Defence Minister Judith Collins today welcomed the first of five new C-130J-30 Hercules to arrive in New Zealand at a ceremony at the Royal New Zealand Air Force’s Base Auckland, Whenuapai. “This is an historic day for our New Zealand Defence Force (NZDF) and our nation. The new Hercules fleet ...
    BeehiveBy beehive.govt.nz
    8 hours ago
  • Have your say on suicide prevention

    Today, September 10 is World Suicide Prevention Day, a time to reflect on New Zealand’s confronting suicide statistics, Mental Health Minister Matt Doocey says. “Every death by suicide is a tragedy – a tragedy that affects far too many of our families and communities in New Zealand. We must do ...
    BeehiveBy beehive.govt.nz
    8 hours ago
  • Action to grow the rural health workforce

    Scholarships awarded to 27 health care students is another positive step forward to boost the future rural health workforce, Associate Health Minister Matt Doocey says. “All New Zealanders deserve timely access to quality health care and this Government is committed to improving health outcomes, particularly for the one in five ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Pharmac delivering more for Kiwis following major funding boost

    Associate Health Minister with responsibility for Pharmac David Seymour has welcomed the increased availability of medicines for Kiwis resulting from the Government’s increased investment in Pharmac. “Pharmac operates independently, but it must work within the budget constraints set by the Government,” says Mr Seymour. “When our Government assumed office, New ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Sport Minister congratulates NZ’s Paralympians

    Sport & Recreation Minister Chris Bishop has congratulated New Zealand's Paralympic Team at the conclusion of the Paralympic Games in Paris.  “The NZ Paralympic Team's success in Paris included fantastic performances, personal best times, New Zealand records and Oceania records all being smashed - and of course, many Kiwis on ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Government progresses response to Abuse in Care recommendations

    A Crown Response Office is being established within the Public Service Commission to drive the Government’s response to the Royal Commission into Abuse in Care. “The creation of an Office within a central Government agency was a key recommendation by the Royal Commission’s final report.  “It will have the mandate ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Passport wait times back on-track

    Minister of Internal Affairs Brooke van Velden says passport processing has returned to normal, and the Department of Internal Affairs [Department] is now advising customers to allow up to two weeks to receive their passport. “I am pleased that passport processing is back at target service levels and the Department ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New appointments to the FMA board

    Commerce and Consumer Affairs Minister has today announced three new appointments and one reappointment to the Financial Markets Authority (FMA) board. Tracey Berry, Nicholas Hegan and Mariette van Ryn have been appointed for a five-year term ending in August 2029, while Chris Swasbrook, who has served as a board member ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • District Court judges appointed

    Attorney-General Hon Judith Collins today announced the appointment of two new District Court judges. The appointees, who will take up their roles at the Manukau Court and the Auckland Court in the Accident Compensation Appeal Jurisdiction, are: Jacqui Clark Judge Clark was admitted to the bar in 1988 after graduating ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government makes it faster and easier to invest in New Zealand

    Associate Minister of Finance David Seymour is encouraged by significant improvements to overseas investment decision timeframes, and the enhanced interest from investors as the Government continues to reform overseas investment. “There were about as many foreign direct investment applications in July and August as there was across the six months ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New Zealand to join Operation Olympic Defender

    New Zealand has accepted an invitation to join US-led multi-national space initiative Operation Olympic Defender, Defence Minister Judith Collins announced today. Operation Olympic Defender is designed to coordinate the space capabilities of member nations, enhance the resilience of space-based systems, deter hostile actions in space and reduce the spread of ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Government commits to ‘stamping out’ foot and mouth disease

    Biosecurity Minister Andrew Hoggard says that a new economic impact analysis report reinforces this government’s commitment to ‘stamp out’ any New Zealand foot and mouth disease incursion. “The new analysis, produced by the New Zealand Institute of Economic Research, shows an incursion of the disease in New Zealand would have ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Improving access to finance for Kiwis

    5 September 2024  The Government is progressing further reforms to financial services to make it easier for Kiwis to access finance when they need it, Commerce and Consumer Affairs Minister Andrew Bayly says.  “Financial services are foundational for economic success and are woven throughout our lives. Without access to finance our ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Prime Minister pays tribute to Kiingi Tuheitia

    As Kiingi Tuheitia Pootatau Te Wherowhero VII is laid to rest today, Prime Minister Christopher Luxon has paid tribute to a leader whose commitment to Kotahitanga will have a lasting impact on our country. “Kiingi Tuheitia was a humble leader who served his people with wisdom, mana and an unwavering ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Resource Management reform to make forestry rules clearer

    Forestry Minister Todd McClay today announced proposals to reform the resource management system that will provide greater certainty for the forestry sector and help them meet environmental obligations.   “The Government has committed to restoring confidence and certainty across the sector by removing unworkable regulatory burden created by the previous ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • More choice and competition in building products

    A major shake-up of building products which will make it easier and more affordable to build is on the way, Building and Construction Minister Chris Penk says. “Today we have introduced legislation that will improve access to a wider variety of quality building products from overseas, giving Kiwis more choice and ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Joint Statement between the Republic of Korea and New Zealand 4 September 2024, Seoul

    On the occasion of the official visit by the Right Honourable Prime Minister Christopher Luxon of New Zealand to the Republic of Korea from 4 to 5 September 2024, a summit meeting was held between His Excellency President Yoon Suk Yeol of the Republic of Korea (hereinafter referred to as ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Comprehensive Strategic Partnership the goal for New Zealand and Korea

    Prime Minister Christopher Luxon held a bilateral meeting today with the President of the Republic of Korea, Yoon Suk Yeol. “Korea and New Zealand are likeminded democracies and natural partners in the Indo Pacific. As such, we have decided to advance discussions on elevating the bilateral relationship to a Comprehensive ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • International tourism continuing to bounce back

    Results released today from the International Visitor Survey (IVS) confirm international tourism is continuing to bounce back, Tourism and Hospitality Minister Matt Doocey says. The IVS results show that in the June quarter, international tourism contributed $2.6 billion to New Zealand’s economy, an increase of 17 per cent on last ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government confirms RMA reforms to drive primary sector efficiency

    The Government is moving to review and update national level policy directives that impact the primary sector, as part of its work to get Wellington out of farming. “The primary sector has been weighed down by unworkable and costly regulation for too long,” Agriculture Minister Todd McClay says.  “That is ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Weak grocery competition underscores importance of cutting red tape

    The first annual grocery report underscores the need for reforms to cut red tape and promote competition, Commerce and Consumer Affairs Minister Andrew Bayly says. “The report paints a concerning picture of the $25 billion grocery sector and reinforces the need for stronger regulatory action, coupled with an ambitious, economy-wide ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government moves to lessen burden of reliever costs on ECE services

    Associate Education Minister David Seymour says the Government has listened to the early childhood education sector’s calls to simplify paying ECE relief teachers. Today two simple changes that will reduce red tape for ECEs are being announced, in the run-up to larger changes that will come in time from the ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Over 2,320 people engage with first sector regulatory review

    Regulation Minister David Seymour says there has been a strong response to the Ministry for Regulation’s public consultation on the early childhood education regulatory review, affirming the need for action in reducing regulatory burden. “Over 2,320 submissions have been received from parents, teachers, centre owners, child advocacy groups, unions, research ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government backs women in horticulture

    “The Government is empowering women in the horticulture industry by funding an initiative that will support networking and career progression,” Associate Minister of Agriculture, Nicola Grigg says.  “Women currently make up around half of the horticulture workforce, but only 20 per cent of leadership roles which is why initiatives like this ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government to pause freshwater farm plan rollout

    The Government will pause the rollout of freshwater farm plans until system improvements are finalised, Agriculture Minister Todd McClay, Environment Minister Penny Simmonds and Associate Environment Minister Andrew Hoggard announced today. “Improving the freshwater farm plan system to make it more cost-effective and practical for farmers is a priority for this ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Milestone reached for fixing the Holidays Act 2003

    Minister for Workplace Relations and Safety Brooke van Velden says yesterday Cabinet reached another milestone on fixing the Holidays Act with approval of the consultation exposure draft of the Bill ready for release next week to participants.  “This Government will improve the Holidays Act with the help of businesses, workers, and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New priorities to protect future of conservation

    Toitū te marae a Tāne Mahuta me Hineahuone, toitū te marae a Tangaroa me Hinemoana, toitū te taiao, toitū te tangata. The Government has introduced clear priorities to modernise Te Papa Atawhai - The Department of Conservation’s protection of our natural taonga. “Te Papa Atawhai manages nearly a third of our ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Faster 110km/h speed limit to accelerate Kāpiti

    A new 110km/h speed limit for the Kāpiti Expressway Road of National Significance (RoNS) has been approved to reduce travel times for Kiwis travelling in and out of Wellington, Transport Minister Simeon Brown says. “Boosting economic growth and productivity is a key part of the Government’s plan to rebuild the economy. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • IVL increase to ensure visitors contribute more to New Zealand

    The International Visitor Conservation and Tourism Levy (IVL) will be raised to $100 to ensure visitors contribute to public services and high-quality experiences while visiting New Zealand, Minister for Tourism and Hospitality Matt Doocey and Minister of Conservation Tama Potaka say. “The Government is serious about enabling the tourism sector ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Delivering priority connections for the West Coast

    A record $255 million for transport investment on the West Coast through the 2024-27 National Land Transport Programme (NLTP) will strengthen the region’s road and rail links to keep people connected and support the region’s economy, Transport Minister Simeon Brown says.  “The Government is committed to making sure that every ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Road and rail reliability a focus for Wellington

    A record $3.3 billion of transport investment in Greater Wellington through the 2024-27 National Land Transport Programme (NLTP) will increase productivity and reduce travel times, Transport Minister Simeon Brown says.  “Delivering infrastructure to increase productivity and economic growth is a priority for our Government. We're focused on delivering transport projects ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Record investment to boost economic and housing growth in the Waikato

    A record $1.9 billion for transport investment in the Waikato through the 2024-27 National Land Transport Programme (NLTP) will create a more efficient, safe, and resilient roading network that supports economic growth and productivity, Transport Minister Simeon Brown says.  “With almost a third of the country’s freight travelling into, out ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Building reliable and efficient roading for Taranaki

    A record $808 million for transport investment in Taranaki through the 2024-27 National Land Transport Programme (NLTP) will support economic growth and productivity, Transport Minister Simeon Brown says.  “Taranaki’s roads carry a high volume of freight from primary industries and it’s critical we maintain efficient connections across the region to ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Supporting growth and resilience in Otago and Southland

    A record $1.4 billion for transport investment in Otago and Southland through the 2024-27 National Land Transport Programme (NLTP) will create a more resilient and efficient network that supports economic growth and productivity, Transport Minister Simeon Brown says.  “Transport is a critical enabler for economic growth and productivity in Otago ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Delivering connected and resilient roading for Northland

    A record $991 million for transport investment in Northland through the 2024-27 National Land Transport Programme (NLTP) will strengthen the region’s connections and support economic growth and productivity, Transport Minister Simeon Brown says. “We are committed to making sure that every transport dollar is spent wisely on the projects and ...
    BeehiveBy beehive.govt.nz
    1 week ago

Page generated in The Standard by Wordpress at 2024-09-10T05:12:01+00:00