web analytics

Peak traffic

Written By: - Date published: 9:31 pm, November 10th, 2008 - 16 comments
Categories: admin - Tags: , , ,



Some comments on Sunday about this site performing well induced me to have a look at the traffic over the last week. I was extremely surprised at how much load the system can now take without stalling. From the WordPress blog stats, It turns out that the traffic for the week was 34.6% higher in page views compared to the week before. It was a staggering 61.9% higher than it was two weeks before. It makes me more confident about running the site at a technical level towards the 2011 (or earlier) election.

I’d love to take credit for this (and I will in part). However the reason people read the site is largely because of the content, both from our posters and our knowledgeable and informed commentators*. This is a completely voluntary site run on a very loose cooperative arrangement – it just shows what kind of talent is there to be tapped from the grass-roots. A special mention for Julie Fairey from The Hand Mirror for her election evening coverage who kept everyone coming back for more. Despite being offline for comments for 19 hours, it is still in our top ten days for traffic.

However that is just the visible portion of the site. We’re reliant on a number of technical supports.

Webfarm also deserves a strong mention. Their systems have been utterly reliable since I moved the site there in Feburary. Currently the site runs on virtual private server with 512MB of RAM running Fedora Linux with unlimited local traffic costing $159+GST per month.

However, my biggest kudo’s has to go to the open source people at WordPress, Fedora project, K2 theme and the wordpress plugin authors without whom this system would have failed dramatically under the load. The site now runs without any code kludges apart from some css styles for the display. It is quite a different site from what was running last year and failing under load.

* Well almost all commentators – I specifically exclude the annoying, largely incoherent, and definitely anti-social trolls. To a man, they seem to mainly be act supporters** hyped on their badly self-assessed intelligence, in love with their own egos, and who take the credo of individualism to the point of being incapable of meaningful social interaction with others. It is the one area that I pity John Key in – he is going to have to deal with adult versions of these clowns. He also doesn’t have the “send to spam” button. However he has done well with an early ban.

** But not all act supporters are trolls

16 comments on “Peak traffic ”

  1. Pascal's bookie 1

    “He also doesn’t have the “send to spam’ button. However he has done well with an early ban.”


  2. Go Lprent

    This is the first site that I view in the morning. It will become more and more important in the future as a number of campaigns heat up.

    The goal will be to elect a progressive administration next term. There is amongst parts of the community a euphoria about the Key administration but it appears that they do not understand that Obama is a leftie progressive and Key is a right wing troll posing as a “Labour lite” Helen.

    Over the next few months the reality will start to become obvious and support will flood back.

    I am sad to see Helen go. If she hung around I am sure that many people would work to have her returned as PM.

  3. Lew 3

    mickysavage: Obama is only a `leftie progressive’ in the context of two-party post-Reagan USian politics. A close examination of policies will reveal that he’s about as far left as National – maybe not quite so far. I grant, however, that ideas of `left’ and `right’ are blunt objects with which to beat a candidate into shape more than they are precision tools with which to measure them. And the whole affair is skewed by a statist Bush Jr administration which pissed off (US types of) liberals, conservatives and libertarians alike.


  4. Mike Collins 4

    I too thought Julie’s coverage was good. I was reading it the following day. Must have been tough to do bearing in mind the results were probably not to her liking.

  5. burt 5


    Great post. Most excellent analysis. You certainly have nailed the issue.

  6. lprent 6

    MC: I’d definitely say that Julie wouldn’t have liked the results. As you say, it made the effort all the more difficult. She would have also had to contend with posting on a site that was definitely under strain. My logs show close to a 0% idle system for much of the night.

    burt: Have you been reading my spam queue? There is a particular type of spambot that shows up with almost those exact words. However they usually have a link attached pointing to something like “MILF anal” (I don’t even want to know what that is) or “online blackjack” or “insurancesitesearch”. There are alternatives in the wording – usually something like “Excellent post. I might not agree fully with what you say”

    Oh well. Got up to send the better half off to a sinking island in PNG.

  7. Very interesting, thanks for the insight. I know what it is like having to move hosting providers, have had to do it a couple of times due to reliability issues. The current provider I am using is awesome, only costs me $29.95 a month too, and has taken a few hammerings over the years.

    I too work for an entirely voluntary organisation, and fund all the website related costs out of my own pocket, just as other key members fund things like advertising, printing etc out of their own pockets, and also put in a lot of unpaid time on top of a paid job.

    I dont have the headache of having to manage forums and comments as you do however. You have my sympathies on that one!

    Peter Jenkins
    webmaster for Sensible Sentencing Trust

  8. Tane 8

    Lynn, you forgot all the granny porn links. Honestly, what is it with those?

  9. John Stevens 9

    Where is your post on JK being the most expensive limo user in the past year? Getting a bit slack boys.

    ‘John Key, who pinned his campaign on slashing bureaucratic excess, spent more on chauffeur-driven limousines than any politician – including the prime minister – last year.’

  10. He’s only used them somewhere between 5% and 10% more than Helen Clarke, that’s not exactly a big deal in my books. Still stoked on those BMW’s though, i’m very glad they chose them, nice cars indeed.

  11. Bugger!! sorry previous comment in moderation!! Miss spelled Helen Clark;s name too, brain freeze moment! (im up way to early!)

  12. P.I. 12

    [Tane: And that’s you banned…. hmm, appears you’ve already been permanently banned under a different name.]

    [lprent: some people never learn]

  13. lprent 13

    granny porn

    Yeah, there is a some very strange spam in that queue…..

  14. lprent 14

    Peter J:

    he current provider I am using is awesome, only costs me $29.95 a month too, and has taken a few hammerings over the years.

    I looked at a few like that (mainly offshore). All our traffic is local so an offshore solution wasn’t all that enticing. It just added 200 msec latency.

    But the real problem is that it is very hard to run a database server the size of this one with appropriate off site backups and all of the site tuning without having console access. We’re getting literally thousands of comments per week, and a considerable number of posts per day. The lurker population is immense – over 50x the commentator population.

    What is astonishing is that the traffic doesn’t appear to ever fall off. It goes up, plateaus, and a few weeks later goes up again. I thought it’d fall post-election and so far it hasn’t by much.

  15. Thanks lprent, I enjoyed it. No I didn’t like the results much, but then I’m pretty used to that, from my years in student politics and then in the Alliance party!

    Thanks for the opportunity 🙂

    [lprent: I’ll leave the login in place. If you get something that doesn’t fit on The Hand Mirror, but will here then feel free to post. (Alliance! wanders away shaking his head)…]

Links to post

Recent Comments

Recent Posts

  • Economic boost for Southland marae
    The Government is investing $9 million to upgrade a significant community facility in Invercargill, creating economic stimulus and jobs, Infrastructure Minister Grant Robertson and Te Tai Tonga MP Rino Tirikatene have announced.  The grant for Waihƍpai RĆ«naka Inc to make improvements to Murihiku Marae comes from the $3 billion set ...
    BeehiveBy beehive.govt.nz
    5 hours ago
  • Celebrating the Entry Into Force of the Treaty on the Prohibition of Nuclear Weapons
    [Opening comments, welcome and thank you to Auckland University etc] It is a great pleasure to be here this afternoon to celebrate such an historic occasion - the entry into force of the Treaty on the Prohibition of Nuclear Weapons. This is a moment many feared would never come, but ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Supporting disabled people to stay connected
    The Government is providing $3 million in one-off seed funding to help disabled people around New Zealand stay connected and access support in their communities, Minister for Disability Issues, Carmel Sepuloni announced today. The funding will allow disability service providers to develop digital and community-based solutions over the next two ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Voluntary saliva testing offered to quarantine workers from Monday
    Border workers in quarantine facilities will be offered voluntary daily COVID-19 saliva tests in addition to their regular weekly testing, COVID-19 Response Minister Chris Hipkins said today. This additional option will be rolled out at the Jet Park Quarantine facility in Auckland starting on Monday 25 January, and then to ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Next steps in firearms buy-back
    The next steps in the Government’s ambitious firearms reform programme to include a three-month buy-back have been announced by Police Minister Poto Williams today.  “The last buy-back and amnesty was unprecedented for New Zealand and was successful in collecting 60,297 firearms, modifying a further 5,630 firearms, and collecting 299,837 prohibited ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Jobs for Nature projects target iconic ecosystems
    Upscaling work already underway to restore two iconic ecosystems will deliver jobs and a lasting legacy, Conservation Minister Kiri Allan says.  “The Jobs for Nature programme provides $1.25 billion over four years to offer employment opportunities for people whose livelihoods have been impacted by the COVID-19 recession. “Two new projects ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • New Public Housing Plan announced
    The Government has released its Public Housing Plan 2021-2024 which outlines the intention of where 8,000 additional public and transitional housing places announced in Budget 2020, will go. “The Government is committed to continuing its public house build programme at pace and scale. The extra 8,000 homes – 6000 public ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Prime Minister congratulates President Joe Biden on his inauguration
    Prime Minister Jacinda Ardern has congratulated President Joe Biden on his inauguration as the 46th President of the United States of America. “I look forward to building a close relationship with President Biden and working with him on issues that matter to both our countries,” Jacinda Ardern said. “New Zealand ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Jobs for Nature funding will create training and employment opportunities
    A major investment to tackle wilding pines in Mt Richmond will create jobs and help protect the area’s unique ecosystems, Biosecurity Minister Damien O’Connor says. The Mt Richmond Forest Park has unique ecosystems developed on mineral-rich geology, including taonga plant species found nowhere else in the country. “These special plant ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Pre-departure testing extended to all passengers to New Zealand
    To further protect New Zealand from COVID-19, the Government is extending pre-departure testing to all passengers to New Zealand except from Australia, Antarctica and most Pacific Islands, COVID-19 Response Minister Chris Hipkins said today. “The change will come into force for all flights arriving in New Zealand after 11:59pm (NZT) on Monday ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Bay Cadets learn skills to protect environment
    Bay Conservation Cadets launched with first intake Supported with $3.5 million grant Part of $1.245b Jobs for Nature programme to accelerate recover from Covid Cadets will learn skills to protect and enhance environment Environment Minister David Parker today welcomed the first intake of cadets at the launch of the Bay ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Cook Islanders to resume travel to New Zealand
    The Prime Minister of New Zealand Jacinda Ardern and the Prime Minister of the Cook Islands Mark Brown have announced passengers from the Cook Islands can resume quarantine-free travel into New Zealand from 21 January, enabling access to essential services such as health. “Following confirmation of the Cook Islands’ COVID ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Supporting communities and landowners to grow employment opportunities
    Jobs for Nature funding is being made available to conservation groups and landowners to employ staff and contractors in a move aimed at boosting local biodiversity-focused projects, Conservation Minister Kiritapu Allan has announced. It is estimated some 400-plus jobs will be created with employment opportunities in ecology, restoration, trapping, ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Border exception for some returning international tertiary students
    The Government has approved an exception class for 1000 international tertiary students, degree level and above, who began their study in New Zealand but were caught offshore when border restrictions began. The exception will allow students to return to New Zealand in stages from April 2021. “Our top priority continues ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Tiwai deal gives time for managed transition
    Today’s deal between Meridian and Rio Tinto for the Tiwai smelter to remain open another four years provides time for a managed transition for Southland. “The deal provides welcome certainty to the Southland community by protecting jobs and incomes as the region plans for the future. The Government is committed ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New member for APEC Business Advisory Council
    Prime Minister Jacinda Ardern has appointed Anna Curzon to the APEC Business Advisory Council (ABAC). The leader of each APEC economy appoints three private sector representatives to ABAC. ABAC provides advice to leaders annually on business priorities. “ABAC helps ensure that APEC’s work programme is informed by business community perspectives ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Govt’s careful economic management recognised
    The Government’s prudent fiscal management and strong policy programme in the face of the COVID-19 global pandemic have been acknowledged by the credit rating agency Fitch. Fitch has today affirmed New Zealand’s local currency rating at AA+ with a stable outlook and foreign currency rating at AA with a positive ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Additional actions to keep COVID-19 out of NZ
    The Government is putting in place a suite of additional actions to protect New Zealand from COVID-19, including new emerging variants, COVID-19 Response Minister Chris Hipkins said today. “Given the high rates of infection in many countries and evidence of the global spread of more transmissible variants, it’s clear that ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 19 projects will clean up and protect waterways
    $36 million of Government funding alongside councils and others for 19 projects Investment will clean up and protect waterways and create local jobs Boots on the ground expected in Q2 of 2021 Funding part of the Jobs for Nature policy package A package of 19 projects will help clean up ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand Government acknowledges 175th anniversary of Battle of Ruapekapeka
    The commemoration of the 175th anniversary of the Battle of Ruapekapeka represents an opportunity for all New Zealanders to reflect on the role these conflicts have had in creating our modern nation, says Associate Minister for Arts, Culture and Heritage Kiri Allan. “The Battle at Te Ruapekapeka Pā, which took ...
    BeehiveBy beehive.govt.nz
    3 weeks ago