web analytics

Why you’re getting auto-moderated

Written By: - Date published: 12:49 pm, June 13th, 2011 - 20 comments
Categories: admin, The Standard - Tags:

There has been a repeated question over the last few days coming up in comments about auto-moderation. For instance prism asks

Some were wondering what initiates moderation. I have just used Latin quotation – quid pro quo and the system may not know that one. ‘Lickspiitle’ politicians might be new. Mentioning Matthew Hooton? (Okayed in a few minutes.)

Right now the most common reason for auto-moderation is coming from akismet‘s servers are getting hammered in the battle against spam. It is affecting the rate at which comments are getting automatically moderated on this site.

Normally we’d get akismet to check  300-600 comments in a day for spamness. This includes both the actual user comments and the bot comments.  But if you look at the graph above, it shows the numbers of spam comments that akismet has processed from this site over the past 60 days. You’ll notice that just under a week ago we went from having less than 50 spam per day to having more 600-900. With the legitimate comments on top, it means that we have massively increased the number of spam being passed to be checked. Part of this appears to be because it counts resubmitted comments (more on that shortly), but the base load of comments arriving appears to have increased markedly.

I’m seeing the same pattern in several other sites that I have admin access to. I suspect that over the last 7 days the number of comments being processed at akismet’s server has gone up about 10 fold or more. Most sites get the same amount of spam comments, but will only have a fraction of our daily comments. Their server system is struggling under the load.

How does all this relate to auto-moderation? Well, when our akismet plugin is unable to get a timely answer from the akismet servers, it will pop the comment into auto-moderation. You’ll see this showing as it being moderated. The akismet plugin will automatically resubmit the comments shortly after and will keep doing so until it gets an answer (also increasing the load on their servers). Most comments are clearing within a couple of minutes automatically.

So for the moment, you’ll have to just put up with it. If it persists past this week, then I’ll start manually tagging IP ranges in .htaccess to not accept comments from (as I have already done for trackbacks and pings).

20 comments on “Why you’re getting auto-moderated”

  1. Portion Control 1

    Thank you Lyn I thought it was just because I’m a new commenter but I did notice that my comments are coming through very quickly so your moderators are working really hard. Bugger these spam artists.

    • lprent 1.1

      If you’re a first time commentator by e-mail address, then your messages will get held until one is approved manually by a moderator. After that happens your comment don’t require manual releases. This prevents the bots that almost look human from getting free access.

      (Always amazes me how often idiot humans will leave a troll 101 style comment as their first. We send them straight to the spam filter. Eventually they figure out that they need to read the comments to find out what is acceptable.) 

      The auto-moderation I was describing above happens after you’ve had a comment approved.

  2. Jum 2

    Just wait until the gummint gets to work on its Labour Supporters’ list and we will get to see what it really means to have a fascist, authoritarian state.

    PS And that post took 3 attempts to get it through. We have no idea in New Zealand what it is like to not have a voice, but Key and Co will soon let us know.

    • lprent 2.1

      Probably because you used several of my manual words that I use to filter out trolls – “gummint”, and “fascist”.

      There is a selection of standard words that experience has shown me to be strongly associated with trolls, and which they appear to be helpless to resist using. Don’t talk like a troll and it is easier to leave comments that show up fast.

  3. ianmac 3

    Suppose the huge increase of Spam was the reason for Clear.net to put blocks from certain sources. I phoned them but I didn’t really understand the Philipino operator who hadn’t seen the edict.

    • lprent 3.1

      Likely. There is something new out there. There have been a few botnets taken out recently and the whole net has gotten quieter. But we seem to have something new tuning out there.

    • Deadly_NZ 3.2

      Don’t waste your time with the Telstra help line they are hopeless

      • M 3.2.1

        Amen to that Deadly – try writing a strongly worded email from their site as I did and got a person in NZ phoning me (I had been overcharged twice and got a penalty as well) as the poor person in Manila or wherever was not qualified to give me a yes.

        Do not take no from someone who is not qualified to give you a yes.

        Luckily I have kept the cell phone number of the guy who signed me up and I got on to him and he also gave Telstra accounts the hurry-up.

        Good luck

  4. prism 4

    Thanks lprent – you put in great work required to keep the blog going. Good to know that individuals count even when you’re one of the biggest in NZ.

    • lprent 4.1

      Probably the biggest by one measure – page views. But the winter slowdown is finally happening – well apart from the last couple of days.

      But that personal service (especially to spoiled brat trolls like schroedinger at 5 who can’t do whatever they want) seems to work pretty well.

  5. schroedinger 5

    Yeah, like awesome. No relationship with trying to clamp down on inconvenient comments eh.

    • ianupnorth 5.1

      In my experience the inconvenient commentators usually get scared off by robust arguments and strong fact.

      Exactly where is Monty these days anyway?

      • lprent 5.1.1

        I had a burst earlier this year of banning people until after the election if I had banned them too often previously. I think that he was one of them. I was having to expend too much time and effort moderating, as were the other mods. I wasn’t feeling too shit hot health wise (heart attack in Feb) and figured it was time to reduce the workload on the site.

        Behavior improved markedly. As is common when I escalate the moderation, the number of pageviews, comments and commentators started rising more rapidly. Of course some of that could be because it is election year. We will find out in march/April next year after the election and the slowness of summer.

        • Deadly_NZ 5.1.1.1

          Ahhh but did millsey cop it as`well?

          • lprent 5.1.1.1.1

            From memory he caught a weeks ban for going over the edge after I had warned a couple of times. Pretty sure I have seen him back after that.

    • McFlock 5.2

      I guess you won’t know if there’s anything in that until you sniff the box, eh?
       
      “Schroedinger’s crap” sounds like a phrase to keep in one’s hip pocket.

  6. Deadly_NZ 6

    Dunno if you would call this Crap lol.
    http://www.schrodinger.com/

  7. Vicky32 7

    I am glad to know why it’s happening, so no probs… 🙂

  8. schroedinger 8

    I consider myself on notice. seriously. yeah.

  9. lprent 9

    Damn – it is still rising…

Recent Comments

Recent Posts

  • Advancing New Zealand’s trade agenda focus of Europe meetings
    World Trade Organisation reform, agricultural trade and a free trade agreement with the United Kingdom will be the focus of Minister for Trade and Export Growth David Parker’s visit to Europe this week. David Parker leaves on Tuesday for a series of meetings in the UK and Switzerland that aim ...
    BeehiveBy beehive.govt.nz
    12 hours ago
  • Minister of Defence to visit counterparts in US and Canada
    The Minister of Defence, Ron Mark, departed today for the United States and Canada where he will meet with his counterparts.  While in Canada Minister Mark will meet with his counterpart, Minister of National Defence Harjit Sajjan.  “New Zealand and Canada are close friends, and share an instinctive like-mindedness on ...
    BeehiveBy beehive.govt.nz
    15 hours ago
  • Government to deliver family carers $2000 pay rise, expand scheme to spouses this year
    The Coalition Government is delivering this year the changes to Funded Family Care the disability sector has long-asked for, says Associate Minister of Health Jenny Salesa. “Today we are announcing the details of our big changes to Funded Family Care, including an annual average pay boost of $2,246.40 for funded ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Ko te reo kua mū: Piri Sciascia
    Minister for Māori Development Nanaia Mahuta joins te ao Māori in their sorrow as they learn of the loss of one of the great orators and spokespersons of a generation – Piri Sciascia.  “The son of Pōrangahau was a staunch advocate for Māori development and served his people for over ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Minister opens new ecosanctuary at Cape Farewell
    A new ecosanctuary with a predator proof fence on Golden Bay’s Cape Farewell, which will restore a safe home for sea birds, rare native plants, giant snails, and geckos, was officially opened today by the Minister of Conservation Eugenie Sage. “There has been a fantastic community effort supported by the ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Pacific partners work together to provide additional support to Australia
    The NZDF continues to support the Australian Defence Force (ADF) as it battles fires in Victoria and New South Wales, including by transporting Republic of Fiji Military engineers from Nadi to Australia, announced Defence Minister Ron Mark. On Saturday morning a NZDF Boeing 757 will depart New Zealand to uplift ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Kaikōura $10.88 million boost in tourism & business
    The Provincial Growth Fund (PGF) is investing $10.88 million to boost business and tourism opportunities in Kaikōura, Parliamentary Undersecretary for Regional Economic Development, Fletcher Tabuteau announced today. As part of the Kaikōura Marina Development Programme, the following two projects will receive PGF funding: A $9.88 million investment to begin the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Govt accounts in surplus, debt remains low
    The Government’s books are in good shape with the accounts in surplus and expenses close to forecast, Finance Minister Grant Robertson says. The Treasury today released the Crown accounts for the five months to November. The operating balance before gains and losses (OBEGAL) was above forecast by $0.7 billion resulting ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Auckland focus for first Police graduation of 2020
    The number of Police on the Auckland frontline is increasing with the graduation today of a special locally-trained wing of new constables. Police Minister Stuart Nash says the graduation of eighteen officers from Recruit Wing 333-5 means that more than 1900 new Police have been deployed since the Coalition Government ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Wairarapa gets $7.11m PGF water boost
    The Provincial Growth Fund is putting $7.11 million into creating a sustainable water supply for Wairarapa, Parliamentary Under-Secretary for Regional Economic Development Fletcher Tabuteau announced today. The following two projects will receive Provincial Growth Fund (PGF) funding: A $7 million investment in Wairarapa Water Limited for the pre-construction development of ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Progress with new Police station in Mahia
    Community safety and crime prevention in the East Coast community of Mahia has moved forward with the opening of a new Police station to serve the growing coastal settlement. Police Minister Stuart Nash has officially opened the new station, which was relocated almost 20 kilometres along the coast from the nearby ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Plans to protect the future of whitebaiting announced
    With several native whitebait species in decline the Minister of Conservation Eugenie Sage has today released proposals to standardise and improve management of whitebait across New Zealand. “The need for action for a healthy whitebait fishery has never been greater,” Eugenie Sage said.  “Four of the six whitebait species are ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New resource for schools to increase awareness and understanding of climate change
    A new Ministry of Education resource available for schools in 2020 will increase awareness and understanding of climate change, Education Minister Chris Hipkins said today. “The resource, Climate Change – prepare today, live well tomorrow, will help students understand the effects of climate change at a local, national and global ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Getting more out of our most productive firms
    Finance Minister Grant Robertson has approved the terms of reference for an Inquiry into the economic contribution of New Zealand's frontier firms. Frontier firms are the most productive firms in the domestic economy within their own industry. “These firms are important as they diffuse new technologies and business practices into ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • NZDF sends more support to Australia
    The New Zealand Defence Force (NZDF) is sending an Environmental Health Team, a Primary Health Care Team and a Chaplain to Australia, boosting New Zealand support for the Australian Defence Force (ADF) as it battles bush fires in Victoria and New South Wales, Defence Minister Ron Mark announced today. The ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Zealand joins partners in calling for full investigation into air crash in Iran
    Acting Prime Minister and Minister of Foreign Affairs Rt Hon Winston Peters says that developments suggesting a surface-to-air missile is responsible for the downing of the Ukrainian International Airlines flight in Iran is disastrous news. “New Zealand offers its deepest sympathies to the families of the 176 victims. It is ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Staying connected to Australian agriculture
    Agriculture Minister, Damien O’Connor, says the Ministry for Primary Industries is continuing to stay connected to federal authorities in Australia as devastating fires affect the country.  “The Ministry is using an existing trans-Tasman forum for discussions on the agricultural impact of the fires and the future recovery phase,” says Damien ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Investment in schools – a commitment to communities
    Thousands of school-age children, their teachers and wider communities are benefiting from the Government’s multi-million dollar investment upgrading and renewing schools, Education Minister Chris Hipkins said today. “We want New Zealand to be the best place to be a child and that means learning in warm, comfortable and modern classrooms,” ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand Defence Force sends support to Australia
    Minister of Defence Ron Mark today announced New Zealand is sending three Royal New Zealand Air Force NH90 helicopters and crew, and two NZ Army Combat Engineer Sections as well as a command element to support the Australian Defence Force efforts in tackling the Australian fires.  The New Zealand Defence Force ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Better access to books for blind and low vision citizens on World Braille Day
    "Today is World Braille Day and I am delighted to announce that an international treaty giving blind and low vision New Zealanders access to books and literary works comes into force today,” Minister for Disability Issues Carmel Sepuloni announced today. “Today the Marrakesh Treaty and the associated amendments to the ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand to send further firefighter support to Australia
    The New Zealand Government is sending a further 22 firefighters to help fight the Australian fires. “The devastation caused by these fires is taking a substantial toll on our Australian neighbours and we will continue to do what we can to assist as they deal with this extremely dynamic, dangerous ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Reducing the cost of education
    Twenty-two more schools have opted into the Government’s policy of providing $150 per child to schools who don’t ask parents for donations– bringing the total number of schools in the policy to 1,585. The Ministry of Education has accepted late opt ins past the November 14 deadline from schools that ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Road deaths lower in 2019, but still more work to do
    “As we enter the new decade, my thoughts are with the families, friends and communities of the 353 people who lost their lives in road crashes last year. While the number of deaths is lower than in 2018 (377), this is still a staggering loss of life,” Duty Minister Iain ...
    BeehiveBy beehive.govt.nz
    3 weeks ago