web analytics

Why you’re getting auto-moderated

Written By: - Date published: 12:49 pm, June 13th, 2011 - 20 comments
Categories: admin, The Standard - Tags:

There has been a repeated question over the last few days coming up in comments about auto-moderation. For instance prism asks

Some were wondering what initiates moderation. I have just used Latin quotation – quid pro quo and the system may not know that one. ‘Lickspiitle’ politicians might be new. Mentioning Matthew Hooton? (Okayed in a few minutes.)

Right now the most common reason for auto-moderation is coming from akismet‘s servers are getting hammered in the battle against spam. It is affecting the rate at which comments are getting automatically moderated on this site.

Normally we’d get akismet to check  300-600 comments in a day for spamness. This includes both the actual user comments and the bot comments.  But if you look at the graph above, it shows the numbers of spam comments that akismet has processed from this site over the past 60 days. You’ll notice that just under a week ago we went from having less than 50 spam per day to having more 600-900. With the legitimate comments on top, it means that we have massively increased the number of spam being passed to be checked. Part of this appears to be because it counts resubmitted comments (more on that shortly), but the base load of comments arriving appears to have increased markedly.

I’m seeing the same pattern in several other sites that I have admin access to. I suspect that over the last 7 days the number of comments being processed at akismet’s server has gone up about 10 fold or more. Most sites get the same amount of spam comments, but will only have a fraction of our daily comments. Their server system is struggling under the load.

How does all this relate to auto-moderation? Well, when our akismet plugin is unable to get a timely answer from the akismet servers, it will pop the comment into auto-moderation. You’ll see this showing as it being moderated. The akismet plugin will automatically resubmit the comments shortly after and will keep doing so until it gets an answer (also increasing the load on their servers). Most comments are clearing within a couple of minutes automatically.

So for the moment, you’ll have to just put up with it. If it persists past this week, then I’ll start manually tagging IP ranges in .htaccess to not accept comments from (as I have already done for trackbacks and pings).

20 comments on “Why you’re getting auto-moderated ”

  1. Portion Control 1

    Thank you Lyn I thought it was just because I’m a new commenter but I did notice that my comments are coming through very quickly so your moderators are working really hard. Bugger these spam artists.

    • lprent 1.1

      If you’re a first time commentator by e-mail address, then your messages will get held until one is approved manually by a moderator. After that happens your comment don’t require manual releases. This prevents the bots that almost look human from getting free access.

      (Always amazes me how often idiot humans will leave a troll 101 style comment as their first. We send them straight to the spam filter. Eventually they figure out that they need to read the comments to find out what is acceptable.) 

      The auto-moderation I was describing above happens after you’ve had a comment approved.

  2. Jum 2

    Just wait until the gummint gets to work on its Labour Supporters’ list and we will get to see what it really means to have a fascist, authoritarian state.

    PS And that post took 3 attempts to get it through. We have no idea in New Zealand what it is like to not have a voice, but Key and Co will soon let us know.

    • lprent 2.1

      Probably because you used several of my manual words that I use to filter out trolls – “gummint”, and “fascist”.

      There is a selection of standard words that experience has shown me to be strongly associated with trolls, and which they appear to be helpless to resist using. Don’t talk like a troll and it is easier to leave comments that show up fast.

  3. ianmac 3

    Suppose the huge increase of Spam was the reason for Clear.net to put blocks from certain sources. I phoned them but I didn’t really understand the Philipino operator who hadn’t seen the edict.

    • lprent 3.1

      Likely. There is something new out there. There have been a few botnets taken out recently and the whole net has gotten quieter. But we seem to have something new tuning out there.

    • Deadly_NZ 3.2

      Don’t waste your time with the Telstra help line they are hopeless

      • M 3.2.1

        Amen to that Deadly – try writing a strongly worded email from their site as I did and got a person in NZ phoning me (I had been overcharged twice and got a penalty as well) as the poor person in Manila or wherever was not qualified to give me a yes.

        Do not take no from someone who is not qualified to give you a yes.

        Luckily I have kept the cell phone number of the guy who signed me up and I got on to him and he also gave Telstra accounts the hurry-up.

        Good luck

  4. prism 4

    Thanks lprent – you put in great work required to keep the blog going. Good to know that individuals count even when you’re one of the biggest in NZ.

    • lprent 4.1

      Probably the biggest by one measure – page views. But the winter slowdown is finally happening – well apart from the last couple of days.

      But that personal service (especially to spoiled brat trolls like schroedinger at 5 who can’t do whatever they want) seems to work pretty well.

  5. schroedinger 5

    Yeah, like awesome. No relationship with trying to clamp down on inconvenient comments eh.

    • ianupnorth 5.1

      In my experience the inconvenient commentators usually get scared off by robust arguments and strong fact.

      Exactly where is Monty these days anyway?

      • lprent 5.1.1

        I had a burst earlier this year of banning people until after the election if I had banned them too often previously. I think that he was one of them. I was having to expend too much time and effort moderating, as were the other mods. I wasn’t feeling too shit hot health wise (heart attack in Feb) and figured it was time to reduce the workload on the site.

        Behavior improved markedly. As is common when I escalate the moderation, the number of pageviews, comments and commentators started rising more rapidly. Of course some of that could be because it is election year. We will find out in march/April next year after the election and the slowness of summer.

        • Deadly_NZ 5.1.1.1

          Ahhh but did millsey cop it as`well?

          • lprent 5.1.1.1.1

            From memory he caught a weeks ban for going over the edge after I had warned a couple of times. Pretty sure I have seen him back after that.

    • McFlock 5.2

      I guess you won’t know if there’s anything in that until you sniff the box, eh?
       
      “Schroedinger’s crap” sounds like a phrase to keep in one’s hip pocket.

  6. Deadly_NZ 6

    Dunno if you would call this Crap lol.
    http://www.schrodinger.com/

  7. Vicky32 7

    I am glad to know why it’s happening, so no probs… 🙂

  8. schroedinger 8

    I consider myself on notice. seriously. yeah.

  9. lprent 9

    Damn – it is still rising…

Recent Comments

Recent Posts

  • Celebrating the Entry Into Force of the Treaty on the Prohibition of Nuclear Weapons
    [Opening comments, welcome and thank you to Auckland University etc] It is a great pleasure to be here this afternoon to celebrate such an historic occasion - the entry into force of the Treaty on the Prohibition of Nuclear Weapons. This is a moment many feared would never come, but ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Supporting disabled people to stay connected
    The Government is providing $3 million in one-off seed funding to help disabled people around New Zealand stay connected and access support in their communities, Minister for Disability Issues, Carmel Sepuloni announced today. The funding will allow disability service providers to develop digital and community-based solutions over the next two ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Voluntary saliva testing offered to quarantine workers from Monday
    Border workers in quarantine facilities will be offered voluntary daily COVID-19 saliva tests in addition to their regular weekly testing, COVID-19 Response Minister Chris Hipkins said today. This additional option will be rolled out at the Jet Park Quarantine facility in Auckland starting on Monday 25 January, and then to ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Next steps in firearms buy-back
    The next steps in the Government’s ambitious firearms reform programme to include a three-month buy-back have been announced by Police Minister Poto Williams today.  “The last buy-back and amnesty was unprecedented for New Zealand and was successful in collecting 60,297 firearms, modifying a further 5,630 firearms, and collecting 299,837 prohibited ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New Public Housing Plan announced
    The Government has released its Public Housing Plan 2021-2024 which outlines the intention of where 8,000 additional public and transitional housing places announced in Budget 2020, will go. “The Government is committed to continuing its public house build programme at pace and scale. The extra 8,000 homes – 6000 public ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Prime Minister congratulates President Joe Biden on his inauguration
    Prime Minister Jacinda Ardern has congratulated President Joe Biden on his inauguration as the 46th President of the United States of America. “I look forward to building a close relationship with President Biden and working with him on issues that matter to both our countries,” Jacinda Ardern said. “New Zealand ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Jobs for Nature funding will create training and employment opportunities
    A major investment to tackle wilding pines in Mt Richmond will create jobs and help protect the area’s unique ecosystems, Biosecurity Minister Damien O’Connor says. The Mt Richmond Forest Park has unique ecosystems developed on mineral-rich geology, including taonga plant species found nowhere else in the country. “These special plant ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Pre-departure testing extended to all passengers to New Zealand
    To further protect New Zealand from COVID-19, the Government is extending pre-departure testing to all passengers to New Zealand except from Australia, Antarctica and most Pacific Islands, COVID-19 Response Minister Chris Hipkins said today. “The change will come into force for all flights arriving in New Zealand after 11:59pm (NZT) on Monday ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Bay Cadets learn skills to protect environment
    Bay Conservation Cadets launched with first intake Supported with $3.5 million grant Part of $1.245b Jobs for Nature programme to accelerate recover from Covid Cadets will learn skills to protect and enhance environment Environment Minister David Parker today welcomed the first intake of cadets at the launch of the Bay ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Cook Islanders to resume travel to New Zealand
    The Prime Minister of New Zealand Jacinda Ardern and the Prime Minister of the Cook Islands Mark Brown have announced passengers from the Cook Islands can resume quarantine-free travel into New Zealand from 21 January, enabling access to essential services such as health. “Following confirmation of the Cook Islands’ COVID ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Supporting communities and landowners to grow employment opportunities
    Jobs for Nature funding is being made available to conservation groups and landowners to employ staff and contractors in a move aimed at boosting local biodiversity-focused projects, Conservation Minister Kiritapu Allan has announced. It is estimated some 400-plus jobs will be created with employment opportunities in ecology, restoration, trapping, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Border exception for some returning international tertiary students
    The Government has approved an exception class for 1000 international tertiary students, degree level and above, who began their study in New Zealand but were caught offshore when border restrictions began. The exception will allow students to return to New Zealand in stages from April 2021. “Our top priority continues ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Tiwai deal gives time for managed transition
    Today’s deal between Meridian and Rio Tinto for the Tiwai smelter to remain open another four years provides time for a managed transition for Southland. “The deal provides welcome certainty to the Southland community by protecting jobs and incomes as the region plans for the future. The Government is committed ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New member for APEC Business Advisory Council
    Prime Minister Jacinda Ardern has appointed Anna Curzon to the APEC Business Advisory Council (ABAC). The leader of each APEC economy appoints three private sector representatives to ABAC. ABAC provides advice to leaders annually on business priorities. “ABAC helps ensure that APEC’s work programme is informed by business community perspectives ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Govt’s careful economic management recognised
    The Government’s prudent fiscal management and strong policy programme in the face of the COVID-19 global pandemic have been acknowledged by the credit rating agency Fitch. Fitch has today affirmed New Zealand’s local currency rating at AA+ with a stable outlook and foreign currency rating at AA with a positive ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Additional actions to keep COVID-19 out of NZ
    The Government is putting in place a suite of additional actions to protect New Zealand from COVID-19, including new emerging variants, COVID-19 Response Minister Chris Hipkins said today. “Given the high rates of infection in many countries and evidence of the global spread of more transmissible variants, it’s clear that ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 19 projects will clean up and protect waterways
    $36 million of Government funding alongside councils and others for 19 projects Investment will clean up and protect waterways and create local jobs Boots on the ground expected in Q2 of 2021 Funding part of the Jobs for Nature policy package A package of 19 projects will help clean up ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand Government acknowledges 175th anniversary of Battle of Ruapekapeka
    The commemoration of the 175th anniversary of the Battle of Ruapekapeka represents an opportunity for all New Zealanders to reflect on the role these conflicts have had in creating our modern nation, says Associate Minister for Arts, Culture and Heritage Kiri Allan. “The Battle at Te Ruapekapeka Pā, which took ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Better care for babies with tongue-tie
    Babies born with tongue-tie will be assessed and treated consistently under new guidelines released by the Ministry of Health, Associate Minister of Health Dr Ayesha Verrall announced today. Around 5% to 10% of babies are born with a tongue-tie, or ankyloglossia, in New Zealand each year. At least half can ...
    BeehiveBy beehive.govt.nz
    3 weeks ago