web analytics

Argghh! The comment bug

Written By: - Date published: 1:44 pm, October 18th, 2015 - 10 comments
Categories: admin, The Standard - Tags: ,

I have spent a few hours been chasing the bug that has been causing people to go into moderation automatically. Found it, killed it, and I thought I’d share it with you.

It was in Wordfence, a great security program for the site.  Essentially it is one of the main plugins to block out irritating behaviours by bots treating the site as their own personal space. Because there are a lot of bots running around the net probing for security holes, reading content, and generally being a pain in the arse when trying to predict the computing resources required to operate the site.

Since we run the site on less than $300 per month funded by voluntary welcome donations (see here), I spend a lot of time keeping robot free loaders out of the site.

Our direct1 human traffic this year is about 80 gigabytes per month to mainly NZ resident humans. Our welcome and expected2 bot traffic averages about 150 gigabytes of traffic per month. And we routinely provide about another 70-80 gigabytes of traffic to various bots who follow our rules.

Crawler rules

Otherwise we’d have to provide systems that are capable of handling many times our legitimate traffic.

But there are other rules in the system designed to block bots and humans from trying to take over our site and use it for purposes nefarious – like spam and free advertising. A lot of those are focused around getting logins as admins and authors, or placing comments as new or existing commenters on the site. These are known as spambots.

So Wordfence and other systems provide preventative measures for those as well. Some of the Wordfence security options are here

Login rules

One of the reasons3 that we have run this site for many years without requiring logins is because it removes a major potential security issue. These days the only logins in active use are those of the authors and a few people who got them before I turned off access to obtaining them in 2011.

We handle robots leaving spam comments with some subtle programs that bank on human vs robot behaviours. The odd robot spam or troll that gets past those has to have an approved comment by a moderator before they can post freely.

However there are the odd persons who leave comments purporting to be by other people. Usually we know because of gravator differences because they have the wrong ’email’.

And then there is this behaviour that Wordfence protects against.

Hold anonymous comments using member emails for moderation
In WordPress it’s possible for someone who is not a member on your website to post a comment and to specify an email address of a real member on your site. This behavior is suspicious and may be incorporated into a more sophisticated attack. So we suggest that you leave this option enabled which will hold those comments for moderation before they’re published.

Thats ok – good security. It isn’t particularly relevant to our site however. Many of our authors comment without logging in because it is faster. Not having a special page generated for you is a whole lot slower than getting a cached page (apart from the replies tab). Our longer term commenters who have actual logins have mostly long since forgotten their passwords 🙂

I never noticed this option. It was added in an upgrade after I did the Wordfence setup years ago. It was off by default as are all new features. And it never got triggered when I did plugin upgrade testing.

However somehow this one button amonst the hundreds that control this site turned on and caused a week of nuisance for moderators and commenters  ! ^&*%^*^%&%^$$!!!!!

Looking at the errors at wordfence, I see this.

Hi All,

We have released a fix that addresses a bug introduced with the release that went out 15 hours ago. The issue is that if a Wordfence options checkbox is unchecked and is different from the default setting, the release resets the Wordfence setting to the default setting of checked.

Arggghhhhh… The joys of upgrades and testing..

 


 

  1. Not counting the graphics. Those are mostly served up from a content delivery network, in our case Cloudfront from Amazon.
  2. Legitimate googlebots and some other selected web search crawlers, Cloudfront, backup and synchronising systems, Internet Archive (Wayback Engine) and the National Library web harvesting (see Kiwiblogblog is not completely dead).
  3. See the privacy section of the policy.

10 comments on “Argghh! The comment bug ”

  1. r0b 1

    Hah! Thanks for tracking it down, and as usual for the work that goes on behind the scenes…

    • lprent 1.1

      More for the moderators than anyone else in this case. They were having to release the comments from moderation. And we usually get a lot of comments each day.

      Right now we’re inching towards our first million published comments accumulated over the last 8 and bit years.

      For me it was mostly a matter of finding enough clean and uninterrupted time to check everything that may have introduced this problem

  2. Thank you – I never realised the value of having realtime comments as much – it is just hard to converse when the lag is there – such an important feature that supports the Standard community – thanks again.
    Edit It works!!! thanks the gods it works 🙂 and thanks to the mods who let my comments through – a pain I know, but appreciated.

  3. Stephen 3

    Man, you do great work, LP. Long may you continue.

  4. wyndham 4

    Lyn. Alas, every post that I open carries the heading “No Comments” irrespective of the fact that there may be umpteen comments from a variety of folk. The only way I can open these comments is to click on “No Comments”. Is this in my PC or is it at your end ?

    • lprent 4.1

      Sounds like the caching, either server or client side. I will have a look at it after I get the tabs for the feeds working.

      But in the meantime, try Shift + F5 to force a reload and see if it fixes it. If it does then it is likely to be client side and probably related to date time.

      You don’t see comments for anything?

  5. Lanthanide 5

    Lynn, have you considered Patreon?

    Potentially to cover existing server support, as well as a pot of money to be split between authors in some sort of manner (may be difficult).

    • lprent 5.1

      Interesting. The reason that I went the other way; reducing cost, was because of the scarce resource we have – our time. There was no time to do structured work hours work. Instead we tend to do everything async, as and when there was a block of time.

      Just to give an idea, while I could make a call to someone during the day, if I didn’t get them first time then I didn’t leave messages. When I’m working, I don’t answer phone calls. Same for email. I keep an eye on it, but I can’t answer non-work things in a timely manner when I’m programming. It takes a mind dump to become human again, and then usually about 30 minutes to get back into the groove.

      I’m probably a bit extreme because of what I work on. But most of the people who author and moderate here seem to have the same kinds of time pressures. So the idea of doing the business kinds of things to run a voluntary blog in our “spare time” isn’t something that we can do. We don’t have the kinds of block time required, and the local market isn’t big.

      But something run for creatives who have the same issues.. That has more possibilities.

  6. infused 6

    Teach you for upgrading too quick…

Recent Comments

Recent Posts

  • Cost of Government Southern Response proactive package released
    The Government has announced the proactive package for some Southern Response policyholders could cost $313 million if all those eligible apply. In December, the Minister Responsible for the Earthquake Commission, David Clark announced a proactive package for SRES claimants who settled their claims before October 2014. It trailed the judgment ...
    BeehiveBy beehive.govt.nz
    16 hours ago
  • New support to reduce emissions from public building and construction projects
    Government agencies are getting new support to reduce carbon emissions generated by construction of new buildings, with the release of practical guidance to shape decisions on public projects. The Ministers for Building and Construction and for Economic Development say a new Procurement Guide will help government agencies, private sector suppliers, ...
    BeehiveBy beehive.govt.nz
    20 hours ago
  • He Whenua Taurikura: New Zealand’s first Hui on Countering Terrorism and Violent Extremism
    The Prime Minister has opened New Zealand’s first hui on Countering Terrorism and Violent Extremism, which is being held in Christchurch over the next two days. The hui delivers on one of the recommendations from the report of the Royal Commission of Inquiry into the terrorist attack on Christchurch masjidain ...
    BeehiveBy beehive.govt.nz
    21 hours ago
  • Speech to inaugural Countering Terrorism Hui
    E aku nui, e aku rahi, Te whaka-kanohi mai o rātou mā, Ru-ruku-tia i runga i te ngākau whakapono, Ru-ruku-tia i runga i te ngākau aroha, Waitaha, Ngāti Mamoe, Ngai Tahu, nāu rā te reo pohiri. Tena tātou katoa. Ki te kotahi te kakaho ka whati, ki te kapuia, e ...
    BeehiveBy beehive.govt.nz
    21 hours ago
  • Campaign shines a light on elder abuse
    A new campaign is shining a spotlight on elder abuse, and urging people to protect older New Zealanders. Launched on World Elder Abuse Awareness Day, the Office for Seniors’ campaign encourages friends, whānau and neighbours to look for the signs of abuse, which is often hidden in plain sight. “Research suggests ...
    BeehiveBy beehive.govt.nz
    24 hours ago
  • Farewelling sports administrator and philanthropist Sir Eion Edgar
    Sport and Recreation Minister Grant Robertson today expressed his sorrow at the passing of Sir Eion Edgar – a leading sports administrator and celebrated philanthropist who has made a significant impact both within and beyond the sport sector. “Sir Eion’s energy, drive and generosity has been truly immense. He leaves ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government to apologise for Dawn Raids
    The Government will make a formal apology for the wrongs committed during the Dawn Raids of the 1970’s. Between 1974 and 1976, a series of rigorous immigration enforcement policies were carried out that resulted in targeted raids on the homes of Pacific families. The raids to find, convict and deport overstayers ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Humanitarian support for Bangladesh and Myanmar
    Foreign Affairs Minister Nanaia Mahuta today announced that New Zealand is providing NZ $8.25 million in humanitarian assistance to support refugees and their host populations in Bangladesh and to support humanitarian need of internally displaced and conflict affected people in Myanmar.  “Nearly four years after 900,000 Rohingya crossed the border ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Poroporoaki: Dame Georgina Kamiria Kirby
    E Te Kōkō Tangiwai, Te Tuhi Mareikura, Te Kākākura Pokai kua riro i a matou. He toka tū moana ākinga ā tai, ākinga ā hau, ākinga ā ngaru tūātea.  Haere atu rā ki te mūrau a te tini, ki te wenerau a te mano.  E tae koe ki ngā rire ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Feedback sought on future of housing and urban development
    New Zealanders are encouraged to have their say on a long-term vision for housing and urban development to guide future work, the Housing Minister Megan Woods has announced. Consultation starts today on a Government Policy Statement on Housing and Urban Development (GPS-HUD), which will support the long-term direction of Aotearoa ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Clean car package to drive down emissions
    New rebates for electric and plug-in hybrid vehicles start July 1 with up to $8,625 for new vehicles and $3,450 for used. Electric vehicle chargers now available every 75km along most state highways to give Kiwis confidence. Low Emission Transport Fund will have nearly four times the funding by 2023 ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Progress towards simpler process for changing sex on birth certificates
    The Government is taking the next step to support transgender, non-binary and intersex New Zealanders, by progressing the Births, Deaths, Marriages and Relationships Registration Bill, Minister of Internal Affairs, Jan Tinetti announced today. “This Government understands that self-identification is a significant issue for transgender, non-binary and intersex New Zealanders, and ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Crown speeds up engagement with takutai moana applicants
    The Crown is taking a new approach to takutai moana applications to give all applicants an opportunity to engage with the Crown and better support the Māori-Crown relationship, Treaty of Waitangi Negotiations Minister Andrew Little says. Following discussions with applicant groups, the Crown has reviewed the existing takutai moana application ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Alcohol and Other Drug Treatment (AODT) Court opens
    The Minister of Justice, Kris Faafoi, and the Minister for Courts, Aupito William Sio, have welcomed the opening of a new Alcohol and Other Drug Treatment (AODT) Court in Hamilton. The AODT Court (Te Whare Whakapiki Wairua) addresses situations where substance abuse and offending are intertwined. “New Zealanders have told ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • EU and UK FTAs top of list for first ministerial trip since COVID-19
    Trade and Export Growth Minister Damien O’Connor today announced details of his planned visit to the United Kingdom and European Union next week, where he will hold trade and agriculture discussions to further New Zealand’s economic recovery from COVID-19. The visit will add political weight to ongoing negotiations with both the EU ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Arihia Bennett to chair Royal Commission Ministerial Advisory Group
    Te Rūnanga o Ngāi Tahu chief executive Arihia Bennett MNZM has been appointed chair of the newly appointed Ministerial Advisory Group on the Government’s Response to the Royal Commission of Inquiry into the terrorist attack on Christchurch mosques. “Twenty-eight people from diverse backgrounds across Aotearoa have been selected for the ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Speech to the New Zealand Medical Association General Practitioners' Conference, Rotorua
    Ki ngā pou maha o te whare hauora o Aotearoa, kei te mihiTo the pillars of our health system I acknowledge/thank you Ki te ope hapai hauora o roto o tēnei rūma, kei te mihi To our health force here in the room today, I acknowledge/thank you He taura tangata, ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Karangahape Road upgrades are streets ahead
    The upgrades to Karangahape Road makes the iconic street more pedestrian and cycle-friendly, attractive and environmentally sustainable, Transport Minister Michael Wood and Auckland Mayor Phil Goff said at the formal celebration of the completion of the Karangahape Road Enhancements project. The project included widening footpaths supporting a better outdoor dining ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech to APEC business event
    E ngā tumu herenga waka, ākina ā ngaru, ākina ā tai ka whakatere ngā waka ki te whakapapa pounamu, otirā, ki Tamaki o ngā waka Tena koutou katoa… To the great leaders assembled, who guided your waka through turbulent times, challenging waters and you continue to navigate your respective waka ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Pause on Quarantine Free Travel with Victoria extended
    Following an assessment of the COVID-19 outbreak in greater Melbourne, New Zealand’s Quarantine Free Travel pause with Victoria will continue for a further seven days, COVID-19 Response Minister Chris Hipkins says. There are now 93 cases associated with the outbreak in greater Melbourne, spread over four clusters. Contact tracing efforts ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Supplier Diversity Aotearoa Summit: Navigate 2021
    *** Check with delivery *** A mihi to all who have contributed to making today a success – starting with you! As you have explored and navigated government procurement today you will hopefully have reflected on the journey of our people so far – and how you can make a ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Pukemiro School to close
    Pukemiro Primary School near Huntly will close following years of declining roll numbers, Education Minister Chris Hipkins announced today. “I’ve consulted with the School Commissioner, and this decision acknowledges the fact that the few remaining students from last term are now settled at other nearby schools. “I want to thank ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Govt acts to protect NZers from harmful content
    New Zealanders will be better protected from harmful or illegal content as a result of work to design a modern, flexible and coherent regulatory framework, Minister of Internal Affairs Jan Tinetti announced today. New Zealand currently has a content regulatory system that is comprised of six different arrangements covering some ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Consultation on exemption of new builds from proposed tax rules
    The Government has today confirmed new builds will be exempt from planned changes to the tax treatment of residential investment property.  Public consultation is now open on details of the proposals, which stop interest deductions being claimed for residential investment properties other than new builds.   “The Government’s goal is to ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Speech for Predator Free 2050 Conference
    Introduction E ngā mana E ngā reo E ngā iwi Tēnā koutou katoa   Ka huri ki ngā mana whenua o te rohe nei. Tēnā koutou He mihi hoki ki a tatou kua tau mai nei i raro i te kaupapa o te rā Ko Ayesha Verrall toku ingoa No ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New stock exchange to help grow small businesses
    A new share trading market, designed as a gateway to the NZX for small-to-medium-sized enterprises (SMEs), has been granted a licence by the Government. Commerce and Consumer Affairs Minister, David Clark said Catalist Markets Ltd will provide a simpler and more affordable ‘stepping stone’ for SMEs to raise capital. “This ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Visa extensions provide certainty to employers and 10,000 visa holders
    Changes to onshore visas will provide employers and visa holders with more certainty, Immigration Minister Kris Faafoi has announced. Around 10,000 Working Holiday visas and Supplementary Seasonal Employment (SSE) work visas due to expire between 21 June 2021 and 31 December 2021 will be extended for another six months to ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Border class exceptions approved for more farm workers and vets
    The Government has approved border class exceptions for an additional 200 dairy workers and 50 veterinarians to enter New Zealand, Agriculture Minister Damien O’Connor announced today.  “It is clear from conversations with the dairy and veterinarian sectors that they are facing workforce pressures. These border exceptions will go a long ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • More freezers and South Island hub to support vaccine roll-out
    A South Island hub and 17 new ultra-low temperature freezers will help further prepare New Zealand for the ramp up of the vaccination programme in the second half of this year, COVID-19 Response Minister Chris Hipkins says. The new freezers arrived in New Zealand on 27 May. They’re currently being ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Speech at the release of Climate Change Commission's final advice
    Good morning – and thank you Prime Minister. Over the last three and half years we have been putting in place the foundations for a low-carbon Aotearoa that will be a catalyst for job creation, innovation, and prosperity for decades to come. In that future, many of our everyday tasks ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Achievable blueprint for addressing climate change released
    Report says Government making good progress on emissions reduction, but more action required Meeting climate targets achievable and affordable with existing technology Economic cost of delaying action higher than taking action now Benefits from climate action include health improvements and lower energy bills All Ministers to help meet climate targets ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Speech to release of Climate Commission final report
    A few years ago in a speech in Auckland, I compared climate change to the nuclear free movement of roughly four decades ago. And I did so for a few reasons. Firstly, because the movement of the 1980s represented a life or death situation for the Pacific, and so does ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Appointment of Judge of the High Court
    Auckland Barrister Michael Robinson has been appointed a Judge of the High Court, Attorney‑General David Parker announced today. Justice Robinson graduated with a BA and an LLB (Hons) from the University of Auckland in 1996, and commenced practice as a solicitor with Brookfields in Auckland.  In 1998 he travelled to London ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Government takes action to improve protections for subcontractors
    The Construction Contracts (Retention Money) Amendment Bill – which provides greater financial protection for subcontractors, has passed its first reading today. The Bill amends the retention provisions in the Construction Contracts Act 2002 (CCA) to provide increased confidence and transparency for subcontractors that retention money they are owed is safe. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • 1 million more Pfizer doses to arrive in July
    Pfizer has scheduled delivery of an estimated 1 million doses of vaccine to New Zealand during July, COVID1-9 Response Minister Chris Hipkins said today. “These consignments will double the total number of Pfizer doses we have received this year to more than 1,900,000 – enough to fully vaccinate almost 1 ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Long-term home of the Independent Children’s Monitor identified
    The Independent Children’s Monitor (Te Mana Whakamaru Tamariki Motuhake), which is currently located within the Ministry of Social Development (MSD), will become its own departmental agency within Government. “Following the recommendations of several reviews, Cabinet agreed in 2019 to build a significantly expanded independent monitor for children in care,” Carmel ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Racing Integrity Board members announced
    The new Racing Integrity Board will be up and running from July 1 to ensure high standards of animal welfare, integrity and professionalism in the racing industry. Racing Minister Grant Robertson today announced the appointments to the new Board: Sir Bruce Robertson KNZM – Chair Kristy McDonald ONZM QC Penelope ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Govt crackdown on organised crime continues
    A major operation against multiple organised crime groups with international links will make a significant dent in drug harm and violent offending linked to organised crime networks, Police Minister Poto Williams says. “I want to take an opportunity to congratulate the Police for their role in Operation Trojan Shield. This ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Farm planning framework supports farmers into the future
    A new framework, agreed between Government and industry, will make it easier for farmers and growers to integrate future greenhouse gas emissions and freshwater regulatory requirements into their farm planning, Agriculture Minister Damien O’Connor said. “The Good Farm Planning Principles Guide out today, provides guidance for how farmers can organise ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Enhanced Task Force Green Approved for Canterbury
    The Government has activated Enhanced Taskforce Green (ETFG) in response to the Canterbury floods. The Minister of Social Development and Employment, Hon Carmel Sepuloni says $500,000 will be made available to help with the clean-up. The flooding in Canterbury has been a significant and adverse event damaging farmland, homes, roads ...
    BeehiveBy beehive.govt.nz
    1 week ago