web analytics

Why you’re getting auto-moderated

Written By: - Date published: 12:49 pm, June 13th, 2011 - 20 comments
Categories: admin, The Standard - Tags:

There has been a repeated question over the last few days coming up in comments about auto-moderation. For instance prism asks

Some were wondering what initiates moderation. I have just used Latin quotation – quid pro quo and the system may not know that one. ‘Lickspiitle’ politicians might be new. Mentioning Matthew Hooton? (Okayed in a few minutes.)

Right now the most common reason for auto-moderation is coming from akismet‘s servers are getting hammered in the battle against spam. It is affecting the rate at which comments are getting automatically moderated on this site.

Normally we’d get akismet to check  300-600 comments in a day for spamness. This includes both the actual user comments and the bot comments.  But if you look at the graph above, it shows the numbers of spam comments that akismet has processed from this site over the past 60 days. You’ll notice that just under a week ago we went from having less than 50 spam per day to having more 600-900. With the legitimate comments on top, it means that we have massively increased the number of spam being passed to be checked. Part of this appears to be because it counts resubmitted comments (more on that shortly), but the base load of comments arriving appears to have increased markedly.

I’m seeing the same pattern in several other sites that I have admin access to. I suspect that over the last 7 days the number of comments being processed at akismet’s server has gone up about 10 fold or more. Most sites get the same amount of spam comments, but will only have a fraction of our daily comments. Their server system is struggling under the load.

How does all this relate to auto-moderation? Well, when our akismet plugin is unable to get a timely answer from the akismet servers, it will pop the comment into auto-moderation. You’ll see this showing as it being moderated. The akismet plugin will automatically resubmit the comments shortly after and will keep doing so until it gets an answer (also increasing the load on their servers). Most comments are clearing within a couple of minutes automatically.

So for the moment, you’ll have to just put up with it. If it persists past this week, then I’ll start manually tagging IP ranges in .htaccess to not accept comments from (as I have already done for trackbacks and pings).

20 comments on “Why you’re getting auto-moderated ”

  1. Portion Control 1

    Thank you Lyn I thought it was just because I’m a new commenter but I did notice that my comments are coming through very quickly so your moderators are working really hard. Bugger these spam artists.

    • lprent 1.1

      If you’re a first time commentator by e-mail address, then your messages will get held until one is approved manually by a moderator. After that happens your comment don’t require manual releases. This prevents the bots that almost look human from getting free access.

      (Always amazes me how often idiot humans will leave a troll 101 style comment as their first. We send them straight to the spam filter. Eventually they figure out that they need to read the comments to find out what is acceptable.) 

      The auto-moderation I was describing above happens after you’ve had a comment approved.

  2. Jum 2

    Just wait until the gummint gets to work on its Labour Supporters’ list and we will get to see what it really means to have a fascist, authoritarian state.

    PS And that post took 3 attempts to get it through. We have no idea in New Zealand what it is like to not have a voice, but Key and Co will soon let us know.

    • lprent 2.1

      Probably because you used several of my manual words that I use to filter out trolls – “gummint”, and “fascist”.

      There is a selection of standard words that experience has shown me to be strongly associated with trolls, and which they appear to be helpless to resist using. Don’t talk like a troll and it is easier to leave comments that show up fast.

  3. ianmac 3

    Suppose the huge increase of Spam was the reason for Clear.net to put blocks from certain sources. I phoned them but I didn’t really understand the Philipino operator who hadn’t seen the edict.

    • lprent 3.1

      Likely. There is something new out there. There have been a few botnets taken out recently and the whole net has gotten quieter. But we seem to have something new tuning out there.

    • Deadly_NZ 3.2

      Don’t waste your time with the Telstra help line they are hopeless

      • M 3.2.1

        Amen to that Deadly – try writing a strongly worded email from their site as I did and got a person in NZ phoning me (I had been overcharged twice and got a penalty as well) as the poor person in Manila or wherever was not qualified to give me a yes.

        Do not take no from someone who is not qualified to give you a yes.

        Luckily I have kept the cell phone number of the guy who signed me up and I got on to him and he also gave Telstra accounts the hurry-up.

        Good luck

  4. prism 4

    Thanks lprent – you put in great work required to keep the blog going. Good to know that individuals count even when you’re one of the biggest in NZ.

    • lprent 4.1

      Probably the biggest by one measure – page views. But the winter slowdown is finally happening – well apart from the last couple of days.

      But that personal service (especially to spoiled brat trolls like schroedinger at 5 who can’t do whatever they want) seems to work pretty well.

  5. schroedinger 5

    Yeah, like awesome. No relationship with trying to clamp down on inconvenient comments eh.

    • ianupnorth 5.1

      In my experience the inconvenient commentators usually get scared off by robust arguments and strong fact.

      Exactly where is Monty these days anyway?

      • lprent 5.1.1

        I had a burst earlier this year of banning people until after the election if I had banned them too often previously. I think that he was one of them. I was having to expend too much time and effort moderating, as were the other mods. I wasn’t feeling too shit hot health wise (heart attack in Feb) and figured it was time to reduce the workload on the site.

        Behavior improved markedly. As is common when I escalate the moderation, the number of pageviews, comments and commentators started rising more rapidly. Of course some of that could be because it is election year. We will find out in march/April next year after the election and the slowness of summer.

        • Deadly_NZ 5.1.1.1

          Ahhh but did millsey cop it as`well?

          • lprent 5.1.1.1.1

            From memory he caught a weeks ban for going over the edge after I had warned a couple of times. Pretty sure I have seen him back after that.

    • McFlock 5.2

      I guess you won’t know if there’s anything in that until you sniff the box, eh?
       
      “Schroedinger’s crap” sounds like a phrase to keep in one’s hip pocket.

  6. Deadly_NZ 6

    Dunno if you would call this Crap lol.
    http://www.schrodinger.com/

  7. Vicky32 7

    I am glad to know why it’s happening, so no probs… 🙂

  8. schroedinger 8

    I consider myself on notice. seriously. yeah.

  9. lprent 9

    Damn – it is still rising…

Recent Comments

Recent Posts

  • Tokelau Language Week reminds us to stay united and strong
    Staying strong in the face of challenges and being true to our heritage and languages are key to preserving our cultural identity and wellbeing, is the focus of the 2020 Tokelau Language Week. Minister for Pacific Peoples, Aupito William Sio, says this year’s theme, ‘Apoapo tau foe, i nā tāfea ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020
    New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020 Hon David Parker’s response following Thomas Piketty and Esther Duflo. Good morning, good afternoon, and good evening, wherever in the world you might be. I first acknowledge the excellent thought provoking speeches of Thomas Piketty and Esther ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Kaipara Moana restoration takes next step
    A Memorandum of Understanding has been signed today at Waihāua Marae between the Crown, local iwi and councils to protect, restore and enhance the mauri of Kaipara Moana in Northland. Environment Minister David Parker signed the document on behalf of the Crown along with representatives from Ngā Maunga Whakahī, Ngāti ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • New Zealand and Uruguay unite on reducing livestock production emissions
    Agriculture Minister Damien O’Connor and Uruguayan Minister of Livestock, Agriculture and Fisheries Carlos María Uriarte have welcomed the launch of a three-year project that will underpin sustainable livestock production in Uruguay, Argentina, and Costa Rica.  The project called ‘Innovation for pasture management’ is led by Uruguay’s National Institute of Agricultural ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • 3100 jobs created through marae upgrades
    Hundreds of marae throughout the country will be upgraded through investments from the Provincial Growth Fund’s refocused post COVID-19 funding to create jobs and put money into the pockets of local tradespeople and businesses, Regional Economic Development Minister Shane Jones and Māori Development Minister Nanaia Mahuta have announced. “A total ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Health volunteers recognised in annual awards
    Health Minister Chris Hipkins has announced 9 teams and 14 individuals are the recipients of this year’s Minister of Health Volunteer Awards.  “The health volunteer awards celebrate and recognise the thousands of dedicated health sector volunteers who give many hours of their time to help other New Zealanders,” Mr Hipkins ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Community COVID-19 Fund supports Pacific recovery
    The Minister for Pacific Peoples, Aupito William Sio says a total of 264 groups and individuals have successfully applied for the Pacific Aotearoa Community COVID-19 Recovery Fund, that will support Pacific communities drive their own COVID-19 recovery strategies, initiatives, and actions. “I am keen to see this Fund support Pacific ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Community benefits from Māori apprenticeships
    Up to 50 Māori apprentices in Wellington will receive paid training to build houses for their local communities, thanks to a $2.75 million investment from the Māori Trades and Training Fund, announced Employment Minister Willie Jackson today. “This funding will enable Ngāti Toa Rangatira Incorporated to provide its Ngā Kaimahi ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Training fund supports Māori jobseekers
    Rapidly growing sectors will benefit from a $990,000 Māori Trades and Training Fund investment which will see Wellington jobseekers supported into work, announced Employment Minister Willie Jackson today. “This funding will enable Sapphire Consultants Ltd. to help up to 45 Māori jobseekers into paid training initiatives over two years through ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Ruakura Inland Port development vital infrastructure for Waikato
    The Government is investing $40 million to develop an inland port at Ruakura which will become a freight super-hub and a future business, research and residential development for the Waikato, Urban Development and Transport Minister Phil Twyford, and Māori Development Minister Nanaia Mahuta announced today. The funding has been has ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Appointments made to Defence Expert Review Group
    Defence Minister Ron Mark announced today the establishment of an Expert Review Group to review a number of aspects of the New Zealand Defence Force’s (NZDF) structure, information management and record-keeping processes.  The Expert Review Group’s work arises out of the first recommendation from the Report of the Government’s Inquiry ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • No active community cases of COVID-19
    There are no active community cases of COVID-19 remaining in the country after the last people from the recent outbreak have recovered from the virus, Health Minister Chris Hipkins said today. “This is a big milestone. New Zealanders have once again through their collective actions squashed the virus. The systems ...
    BeehiveBy beehive.govt.nz
    3 weeks ago