web analytics

Argghh! The comment bug

Written By: - Date published: 1:44 pm, October 18th, 2015 - 10 comments
Categories: admin, The Standard - Tags: ,

I have spent a few hours been chasing the bug that has been causing people to go into moderation automatically. Found it, killed it, and I thought I’d share it with you.

It was in Wordfence, a great security program for the site.  Essentially it is one of the main plugins to block out irritating behaviours by bots treating the site as their own personal space. Because there are a lot of bots running around the net probing for security holes, reading content, and generally being a pain in the arse when trying to predict the computing resources required to operate the site.

Since we run the site on less than $300 per month funded by voluntary welcome donations (see here), I spend a lot of time keeping robot free loaders out of the site.

Our direct1 human traffic this year is about 80 gigabytes per month to mainly NZ resident humans. Our welcome and expected2 bot traffic averages about 150 gigabytes of traffic per month. And we routinely provide about another 70-80 gigabytes of traffic to various bots who follow our rules.

Crawler rules

Otherwise we’d have to provide systems that are capable of handling many times our legitimate traffic.

But there are other rules in the system designed to block bots and humans from trying to take over our site and use it for purposes nefarious – like spam and free advertising. A lot of those are focused around getting logins as admins and authors, or placing comments as new or existing commenters on the site. These are known as spambots.

So Wordfence and other systems provide preventative measures for those as well. Some of the Wordfence security options are here

Login rules

One of the reasons3 that we have run this site for many years without requiring logins is because it removes a major potential security issue. These days the only logins in active use are those of the authors and a few people who got them before I turned off access to obtaining them in 2011.

We handle robots leaving spam comments with some subtle programs that bank on human vs robot behaviours. The odd robot spam or troll that gets past those has to have an approved comment by a moderator before they can post freely.

However there are the odd persons who leave comments purporting to be by other people. Usually we know because of gravator differences because they have the wrong ’email’.

And then there is this behaviour that Wordfence protects against.

Hold anonymous comments using member emails for moderation
In WordPress it’s possible for someone who is not a member on your website to post a comment and to specify an email address of a real member on your site. This behavior is suspicious and may be incorporated into a more sophisticated attack. So we suggest that you leave this option enabled which will hold those comments for moderation before they’re published.

Thats ok – good security. It isn’t particularly relevant to our site however. Many of our authors comment without logging in because it is faster. Not having a special page generated for you is a whole lot slower than getting a cached page (apart from the replies tab). Our longer term commenters who have actual logins have mostly long since forgotten their passwords 🙂

I never noticed this option. It was added in an upgrade after I did the Wordfence setup years ago. It was off by default as are all new features. And it never got triggered when I did plugin upgrade testing.

However somehow this one button amonst the hundreds that control this site turned on and caused a week of nuisance for moderators and commenters  ! ^&*%^*^%&%^$$!!!!!

Looking at the errors at wordfence, I see this.

Hi All,

We have released a fix that addresses a bug introduced with the release that went out 15 hours ago. The issue is that if a Wordfence options checkbox is unchecked and is different from the default setting, the release resets the Wordfence setting to the default setting of checked.

Arggghhhhh… The joys of upgrades and testing..

 


 

  1. Not counting the graphics. Those are mostly served up from a content delivery network, in our case Cloudfront from Amazon.
  2. Legitimate googlebots and some other selected web search crawlers, Cloudfront, backup and synchronising systems, Internet Archive (Wayback Engine) and the National Library web harvesting (see Kiwiblogblog is not completely dead).
  3. See the privacy section of the policy.

10 comments on “Argghh! The comment bug ”

  1. r0b 1

    Hah! Thanks for tracking it down, and as usual for the work that goes on behind the scenes…

    • lprent 1.1

      More for the moderators than anyone else in this case. They were having to release the comments from moderation. And we usually get a lot of comments each day.

      Right now we’re inching towards our first million published comments accumulated over the last 8 and bit years.

      For me it was mostly a matter of finding enough clean and uninterrupted time to check everything that may have introduced this problem

  2. Thank you – I never realised the value of having realtime comments as much – it is just hard to converse when the lag is there – such an important feature that supports the Standard community – thanks again.
    Edit It works!!! thanks the gods it works 🙂 and thanks to the mods who let my comments through – a pain I know, but appreciated.

  3. Stephen 3

    Man, you do great work, LP. Long may you continue.

  4. wyndham 4

    Lyn. Alas, every post that I open carries the heading “No Comments” irrespective of the fact that there may be umpteen comments from a variety of folk. The only way I can open these comments is to click on “No Comments”. Is this in my PC or is it at your end ?

    • lprent 4.1

      Sounds like the caching, either server or client side. I will have a look at it after I get the tabs for the feeds working.

      But in the meantime, try Shift + F5 to force a reload and see if it fixes it. If it does then it is likely to be client side and probably related to date time.

      You don’t see comments for anything?

  5. Lanthanide 5

    Lynn, have you considered Patreon?

    Potentially to cover existing server support, as well as a pot of money to be split between authors in some sort of manner (may be difficult).

    • lprent 5.1

      Interesting. The reason that I went the other way; reducing cost, was because of the scarce resource we have – our time. There was no time to do structured work hours work. Instead we tend to do everything async, as and when there was a block of time.

      Just to give an idea, while I could make a call to someone during the day, if I didn’t get them first time then I didn’t leave messages. When I’m working, I don’t answer phone calls. Same for email. I keep an eye on it, but I can’t answer non-work things in a timely manner when I’m programming. It takes a mind dump to become human again, and then usually about 30 minutes to get back into the groove.

      I’m probably a bit extreme because of what I work on. But most of the people who author and moderate here seem to have the same kinds of time pressures. So the idea of doing the business kinds of things to run a voluntary blog in our “spare time” isn’t something that we can do. We don’t have the kinds of block time required, and the local market isn’t big.

      But something run for creatives who have the same issues.. That has more possibilities.

  6. infused 6

    Teach you for upgrading too quick…

Recent Comments

Recent Posts

  • The Duke of Edinburgh
    Prime Minister Jacinda Ardern today expressed New Zealand’s sorrow at the death of His Royal Highness The Prince Philip, Duke of Edinburgh. “Our thoughts are with Her Majesty The Queen at this profoundly sad time.  On behalf of the New Zealand people and the Government, I would like to express ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Five Country Ministerial Communiqué
    We, the Home Affairs, Interior, Security and Immigration Ministers of Australia, Canada, New Zealand, the United Kingdom and the United States of America (the ‘Five Countries’) met via video conference on 7/8 April 2021, just over a year after the outbreak of the COVID-19 global pandemic. Guided by our shared ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Inspiring creativity through cultural installations and events
    Arts, Culture and Heritage Minister Carmel Sepuloni has today announced the opening of the first round of Ngā Puninga Toi ā-Ahurea me ngā Kaupapa Cultural Installations and Events. “Creating jobs and helping the arts sector rebuild and recover continues to be a key part of the Government’s COVID-19 response,” Carmel ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Drug-testing law to be made permanent
    Interim legislation that is already proving to keep people safer from drugs will be made permanent, Health Minister Andrew Little says. Research by Victoria University, on behalf of the Ministry of Health, shows that the Government’s decision in December to make it legal for drug-checking services to operate at festivals ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Better rules proposed for freedom camping
    Public consultation launched on ways to improve behaviour and reduce damage Tighter rules proposed for either camping vehicles or camping locations Increased penalties proposed, such as $1,000 fines or vehicle confiscation Rental companies may be required to collect fines from campers who hire vehicles Public feedback is sought on proposals ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government backs Air New Zealand as Trans-Tasman bubble opens
    The Government is continuing to support Air New Zealand while aviation markets stabilise and the world moves towards more normal border operations. The Crown loan facility made available to Air New Zealand in March 2020 has been extended to a debt facility of up to $1.5 billion (an additional $600 ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Building gifted for new community hub in Richmond red zone
    Christchurch’s Richmond suburb will soon have a new community hub, following the gifting of a red-zoned property by Land Information New Zealand (LINZ) to the Richmond Community Gardens Trust. The Minister for Land Information, Damien O’Connor said that LINZ, on behalf of the Crown, will gift a Vogel Street house ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Pacific languages funding reopens
      Minister for Pacific Peoples Aupito William Sio says the reopening of the Ministry for Pacific Peoples’ (MPP) Languages Funding in 2021 will make sure there is a future for Pacific languages. “Language is the key to the wellbeing for Pacific people. It affirms our identity as Pasifika and ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • ERANZ speech April 2021
    It is a pleasure to be here tonight.  Thank you Cameron for the introduction and thank you for ERANZ for also hosting this event. Last week in fact, we had one of the largest gatherings in our sector, Downstream 2021. I have heard from my officials that the discussion on ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Strengthening Māori knowledge in science and innovation
    Research, Science and Innovation Minister Megan Woods has today announced the 16 projects that will together get $3.9 million through the 2021 round of Te Pūnaha Hihiko: Vision Mātauranga Capability Fund, further strengthening the Government’s commitment to Māori knowledge in science and innovation.  “We received 78 proposals - the highest ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Government delivers next phase of climate action
    The Government is delivering on a key election commitment to tackle climate change, by banning new low and medium temperature coal-fired boilers and partnering with the private sector to help it transition away from fossil fuels. This is the first major announcement to follow the release of the Climate Commission’s ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Continued investment in Central Otago schools supports roll growth
    Six projects, collectively valued at over $70 million are delivering new schools, classrooms and refurbished buildings across Central Otago and are helping to ease the pressure of growing rolls in the area, says Education Minister Chris Hipkins. The National Education Growth Plan is making sure that sufficient capacity in the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Two more Christchurch schools complete
    Two more schools are now complete as part of the Christchurch Schools Rebuild Programme, with work about to get under way on another, says Education Minister Chris Hipkins. Te Ara Koropiko – West Spreydon School will welcome students to their new buildings for the start of Term 2. The newly ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Independent experts to advise Government on post-vaccination future
    The Government is acting to ensure decisions on responding to the next phase of the COVID-19 pandemic are informed by the best available scientific evidence and strategic public health advice. “New Zealand has worked towards an elimination strategy which has been successful in keeping our people safe and our economy ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Supporting Māori success with Ngārimu Awards
    Six Māori scholars have been awarded Ngārimu VC and the 28th (Māori) Battalion Memorial scholarships for 2021, Associate Education Minister and Ngārimu Board Chair, Kelvin Davis announced today. The prestigious Manakura Award was also presented for the first time since 2018. “These awards are a tribute to the heroes of the 28th ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Global partnerships propel space tech research
    New Zealand’s aerospace industry is getting a boost through the German Aerospace Centre (DLR), to grow the capability of the sector and potentially lead to joint space missions, Research, Science and Innovation Minister Megan Woods has announced. 12 New Zealand organisations have been chosen to work with world-leading experts at ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government backs more initiatives to boost food and fibre workforce
    The Government is backing more initiatives to boost New Zealand’s food and fibre sector workforce, Agriculture Minister Damien O’Connor announced today. “The Government and the food and fibres sector have been working hard to fill critical workforce needs.  We've committed to getting 10,000 more Kiwis into the sector over the ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Minister welcomes Bill to remove Subsequent Child Policy
    Minister for Social Development and Employment Carmel Sepuloni has welcomed the first reading of the Social Security (Subsequent Child Policy Removal) Amendment Bill in the House this evening. “Tonight’s first reading is another step on the way to removing excessive sanctions and obligations for people receiving a Main Benefit,” says ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Mental Health Amendment Bill passes first reading
    The Government has taken a significant step towards delivering on its commitment to improve the legislation around mental health as recommended by He Ara Oranga – the report of the Government Inquiry into Mental Health and Addiction, Health Minister Andrew Little says. The Mental Health (Compulsory Assessment and Treatment) Amendment ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Whenua Māori Rating Amendment Bill passes third reading
    Local Government Minister Nanaia Mahuta has welcomed the Local Government (Rating of Whenua Māori) Amendment Bill passing its third reading today. “After nearly 100 years of a system that was not fit for Māori and did not reflect the partnership we have come to expect between Māori and the Crown, ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Trans-Tasman bubble to start 19 April
    New Zealand’s successful management of COVID means quarantine-free travel between New Zealand and Australia will start on Monday 19 April, Prime Minister Jacinda Ardern announced today. Prime Minister Jacinda Ardern and COVID-19 Response Minister Chris Hipkins confirmed the conditions for starting to open up quarantine free travel with Australia have ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Ngāti Hinerangi Claims Settlement Bill passes Third Reading
    Minister for Treaty of Waitangi Negotiations Andrew Little welcomed ngā uri o Ngāti Hinerangi to Parliament today to witness the third reading of their Treaty settlement legislation, the Ngāti Hinerangi Claims Settlement Bill. “I want to acknowledge ngā uri o Ngāti Hinerangi and the Crown negotiations teams for working tirelessly ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Independent group announced to advise on firearms matters
    Minister of Police Poto Williams has announced the members of the Ministers Arms Advisory Group, established to ensure balanced advice to Government on firearms that is independent of Police. “The Ministers Arms Advisory Group is an important part of delivering on the Government’s commitment to ensure we maintain the balance ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Kiri Allan to take leave of absence
    Kiri Allan, Minister of Conservation and Emergency Management will undertake a leave of absence while she undergoes medical treatment for cervical cancer, Prime Minister Jacinda Ardern announced today. “I consider Kiri not just a colleague, but a friend. This news has been devastating. But I also know that Kiri is ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Excellent progress at new Waikeria prison build
    Excellent progress has been made at the new prison development at Waikeria, which will boost mental health services and improve rehabilitation opportunities for people in prison, Corrections Minister Kelvin Davis says. Kelvin Davis was onsite at the new build to meet with staff and see the construction first-hand, following a ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Expert panel proposes criminal limits for drug driving
    To reduce the trauma of road crashes caused by drug impaired drivers, an Independent Expert Panel on Drug Driving has proposed criminal limits and blood infringement thresholds for 25 impairing drugs, Minister of Police Poto Williams and Transport Minister Michael Wood announced today. The Land Transport (Drug Driving) Amendment Bill ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Covid-19 immigration powers to be extended
    Temporary COVID-19 immigration powers will be extended to May 2023, providing continued flexibility to support migrants, manage the border, and help industries facing labour shortages, Immigration Minister Kris Faafoi announced today. “Over the past year, we have had to make rapid decisions to vary visa conditions, extend expiry dates, and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Covid-19 imgration powers to be extended
    Temporary COVID-19 immigration powers will be extended to May 2023, providing continued flexibility to support migrants, manage the border, and help industries facing labour shortages, Immigration Minister Kris Faafoi announced today. “Over the past year, we have had to make rapid decisions to vary visa conditions, extend expiry dates, and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • More support for mums and whānau struggling with alcohol and other drugs
    The Government is expanding its Pregnancy and Parenting Programme so more women and whānau can access specialist support to minimise harm from alcohol and other drugs, Health Minister Andrew Little says. “We know these supports help improve wellbeing and have helped to reduce addiction, reduced risk for children, and helped ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Ahuwhenua Trophy Competition Field Day – Tātaiwhetū Trust at Tauarau Marae, Rūātoki
    *** Please check against delivery *** It’s an honour to be here in Rūātoki today, a rohe with such a proud and dynamic history of resilience, excellence and mana. Tūhoe moumou kai, moumou taonga, moumou tangata ki te pō. The Ahuwhenua Trophy competition is the legacy of a seed planted ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Crown accounts again better than forecast
    The economic recovery from COVID-19 continues to be reflected in the Government’s books, which are again better than expected. The Crown accounts for the eight months to the end of February 2021 showed both OBEGAL and the operating balance remain better than forecast in the Half Year Economic and Fiscal ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • FIFA Women’s World Cup to open in New Zealand
    Sport and Recreation Minister Grant Robertson and Economic Development Minister Stuart Nash have welcomed confirmation New Zealand will host the opening ceremony and match, and one of the semi-finals, of the FIFA Women’s World Cup in 2023. Grant Robertson says matches will be held in Auckland, Hamilton, Wellington and Dunedin, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • 1 April changes raise incomes for 1.4 million New Zealanders
    Changes to the minimum wage, main benefit levels and superannuation rates that come into force today will raise the incomes for around 1.4 million New Zealanders. “This Government is committed to raising the incomes for all New Zealanders as part of laying the foundations for a better future,” Minister for ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Dunedin Hospital – Whakatuputupu approved for fast track consenting process
    The New Dunedin Hospital – Whakatuputupu has been approved for consideration under the fast track consenting legislation.  The decision by Environment Minister David Parker signifies the importance of the project to the health of the people of Otago-Southland and to the economy of the region.  “This project ticks all the ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Next steps for Auckland light rail
    Transport Minister Michael Wood is getting Auckland light rail back on track with the announcement of an establishment unit to progress this important city-shaping project and engage with Aucklanders. Michael Wood said the previous process didn’t involve Aucklanders enough.                       ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Tourism fund to prioritise hard-hit regions
    The Minister of Tourism is to re-open a government fund that supports councils to build infrastructure for visitors, with a specific focus on regions hardest hit by the loss of overseas tourists. “Round Five of the Tourism Infrastructure Fund will open for applications next month,” said Stuart Nash. It ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Governance Group to lead next phase of work on a potential new public media entity
    A Governance Group of eight experts has been appointed to lead the next phase of work on a potential new public media entity, Minister for Broadcasting and Media Kris Faafoi announced today.  “The Governance Group will oversee the development of a business case to consider the viability of a new ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New funding to keep tamariki and rangatahi Māori active
    Minister for Māori Development Willie Jackson today helped launch a new fund to provide direct financial support for tamariki and rangatahi Māori throughout the South Island who is experiencing financial hardship and missing out on physical activity opportunities. “Through Te Kīwai Fund, we can offer more opportunities for Māori to ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Single tāne, sole parent dads supported into papakāinga housing
    Six whānau in Pāpāmoa receive the keys to their brand-new rental homes today, in stage four of a papakāinga project providing safe and affordable housing in the regions. Minister for Māori Development, Willie Jackson congratulates Mangatawa Pāpāmoa Blocks Incorporated on the opening of three affordable rentals and three social housing ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Speech to Disarmament and Security Centre
    Kia ora tatou. It’s great to be here today and to get a conversation going on the disarmament issues of greatest interest to you, and to the Government. I’m thrilled to be standing here as a dedicated Minister for Disarmament and Arms Control, which I hope reinforces for you all ...
    BeehiveBy beehive.govt.nz
    2 weeks ago