web analytics

Damn you readers :) Upgrades again

Written By: - Date published: 7:47 pm, February 10th, 2015 - 31 comments
Categories: admin, humour, Satire, The Standard - Tags: ,

Dolphin Over World 2010Well ok, after the election I figured that I could shift the site to some slower storage with a whole lot of redundancy in a RAID6 array of slower drives. We’d have a lot fewer readers than our peak for about six months after post election, right?

Nope – wrong. I will be pulling the site offline for a few hours tonight at about midnight to put the whole site back on mirrored RAID1 faster solid state drives.

Too many of you have been moaning that the site has been running slowly.

Well you are probably aware of what I am like by now. I like numbers and realistic triggers as prompts for action. When I shifted the site to this configuration, I set a trigger.

It said that when we passed 400 thousand page views for a 30 day period I’d look at efficiency improvements. The bottleneck at present is disk access, mainly when the backups run every hour and the search engine updates every 13 minutes. But that spreads out into the post edits and all those comments you leave. Not to mention people simply reading the site. I shove gigabytes of RAM as file and page and object memcaches, as well as great caches on the database, but the system still spends a lot of time hitting those disks.

So when I just looked at this (it wasn’t that way yesterday damnit) ….

Last 30 days

Double damnit. More than 400k page views for 30 days and still climbing. That means late night work

Just ignore the Unique Visits, it is a rather meaningless figure because it appears to depend more on the tool used to measure it than anything real. Google Analytics thinks with the same parameters that it is about 120k. Sitemeter usually thinks it is higher. Whereas all of the tracking tools agree within a few thousand what the page views are after they discard all of the bots. It is a much more useful measure.

So why was that value of 400k page views the significiant trigger? Well if you look at the monthly figures for last year (I put the values in this one to make it clearer)…

lastyear

 

We only went over 400k page views in May only just before the election. 

Damn you readers. I bloody well know it is you because we don’t use the steroid site enhancers of some other sites. I can see you buggers causing me late night work……

 

…. I’m going to keep an eyeball on you just like philu*….

eye-target

 

* Except without the side effects

side effects

😈

31 comments on “Damn you readers :) Upgrades again ”

  1. lprent 1

    And triple damnit I left out the real message. I will probably start about 2330 and finish at 0130. If it doesn’t work first shot as it should, then I will chop and leave it back at my starting point. I have another busy busy day at the paid work in the morning.

  2. Macro 2

    Hehehe.

    I shan’t be causing any pv’s tomorrow – off over to Perth for a few months. But will be looking in when I can. 🙂

    Hope the upgrade goes smoothly for you.

    • lprent 2.1

      It should do. It is pretty minor.

      1. Shut down the site.
      2. Install two 120GB SSDs from different suppliers.
      3. Clear their partitions.
      4. Mirror them with mdamd.
      5 Mount and partition the ‘single’ drive.
      6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).
      7. Bind mount the partition directories in the appropriate spaces using fstab.
      8. Start the site

      Voila!. A hell of a lot easier than what I do during the day….

      • Weepus beard 2.1.1

        6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).

        2.98GB of which is Pete George’s cries from the soapbox.

        • lprent 2.1.1.1

          Umm typo there. 5.2GB.

          Nope. I’m sure that he couldn’t outwrite Penny Bright. I have to prune her missives back periodically when they start getting somewhat ‘extensive’..

  3. Marksman33 3

    Lost you from No2 onwards, pays to be a luddite methinks, all the best with that.

  4. Sacha 4

    Blame the beige badger, I say.

    • Pete George 4.1

      Or those moaning about the beige badger.

      The decline of The Daily Blog and the rise and fall of On The Left will likely have impacted here.

      It also helps that there’s a Little hope now on the left. People prefer to follow positives.

      • Draco T Bastard 4.1.1

        People prefer to follow positives.

        Which would be why nobody follows you. You really are the most negative person on this site.

        • fender 4.1.1.1

          Yeah it was a close call between PG and Brett Dale, But Dale came second due to the hoverboard…

      • Sacha 4.1.2

        now, now. not moaning.
        baiting or berating the beige badger, perhaps. between yawns.

      • framu 4.1.3

        The case highlighted a serious environmental problem. Due to the abundance of food preservatives and plastics entering the food chain, people were slowly turning into potentially indestructible ‘living dolls’. Indeed, several exhumations showed that cadavers were not decomposing. Human decay rates were slowing to that of discarded bubble wrap or a Wombles lunch box.

  5. adam 5

    Just for you Iprent.

    Thanks for all the work you do, it’s marvellous and very much appreciated.

    • lprent 5.1

      I do it for myself. Where else would I have a chance to get be a cranky old man in public?

      Ummm.. Coming to think of it, I’m a programmer. I do it all of the time. Even when I was sort of young.

    • fender 5.2

      +1

      lprent rulz…

    • Skinny 5.3

      + 1
      Well done Lprent your tolerance to our ramblings is much appreciated 🙂

    • Colonial Rawshark 5.4

      +1 Absolutely…

      And no one will mind if you pull the site down a few minutes earlier so that you can get some shuteye a few minutes earlier too…

  6. Ovid 6

    Good luck with the upgrade, Lynn. I’ll see you on the other side.

  7. gsays 7

    kia ora lprent,
    i want to echo above comments, i am very appreciative of the work you do and that it allows the standard community to exsist.

    i have learnt a lot in the time i have been visiting.

    (i must confess to not really knowing what all that work is that you detailed although i do know what a gig is. rock’n’roll!)

  8. lprent 8

    Ok all back again. There is an odd dmesg that I will have to look at (may have been there before). But everything seems to be OK.

    Seems faster, but I won’t really know until it goes under load in the morning.

    Longest part of the task was that one of the power cables wasn’t the right one on the supply. Took me a while to find the correct one and plug it into the power supply. I wish they’d standardise those connectors.

    • tc 8.1

      Top work and aren’t connectors a pain in the proverbial, like our PM there’s the standard and one he came up with the help of others he’s calling a standard.

      Damm annoying when it’s power, you expect it with comms connectors so well done lp.

    • I reckon it’s faster now. By my estimate, old page loads took over 2 seconds, now it’s less than 1 second.

      • lprent 8.2.1

        That is what I am seeing with the cores. They are spiking a lot faster, presumably because they aren’t doing waits while assembling the non-cached parts of the page.

        It certainly seems faster on my laptop connected via cellphone. But that varies a lot anyway, so it isn’t a good test.

        Inside the cave at work it seems to flick from ‘H’ (low speed) to ‘4G’ according to the external weather.

        What I do notice is that saving comments seems a lot faster.

  9. Murray Rawshark 9

    Thanks for keeping it all running.

  10. One Anonymous Bloke 10

    Thanks Lprent. We’ll do our best to break this one too 😈

  11. NZJester 11

    I’m wondering if most of this spike of activity on this site is the fault of a certain person whose initials are MS and part of the reason some people are going to have to go back to the polling booths.

  12. Colonial Rawshark 12

    ABP Branch video: Bill Binney NSA whistleblower talks about the future of freedom

    The Andersons Bay Peninsula branch of the Labour Party (Dunedin South) is showing a video tonight of Bill Binney, former NSA Technical Director ‘for the world’, and current day whistleblower, followed by a general discussion on the implications for NZ.

    Labour Party building corner of Macandrew St and King Edward St, South Dunedin, 8:15pm tonight.

    All welcome. That includes you too, spooks 😛

Recent Comments

Recent Posts

  • COVID-19 vaccine slated for possible approval next week
    The green light for New Zealand’s first COVID-19 vaccine could be granted in just over a week, Prime Minister Jacinda Ardern said today. “We’re making swift progress towards vaccinating New Zealanders against the virus, but we’re also absolutely committed to ensuring the vaccines are safe and effective,” Jacinda Ardern said. ...
    BeehiveBy beehive.govt.nz
    13 hours ago
  • New ACC Board members announced.
    The Minister for ACC is pleased to announce the appointment of three new members to join the Board of ACC on 1 February 2021. “All three bring diverse skills and experience to provide strong governance oversight to lead the direction of ACC” said Hon Carmel Sepuloni. Bella Takiari-Brame from Hamilton ...
    BeehiveBy beehive.govt.nz
    15 hours ago
  • Economic boost for Southland marae
    The Government is investing $9 million to upgrade a significant community facility in Invercargill, creating economic stimulus and jobs, Infrastructure Minister Grant Robertson and Te Tai Tonga MP Rino Tirikatene have announced.  The grant for Waihōpai Rūnaka Inc to make improvements to Murihiku Marae comes from the $3 billion set ...
    BeehiveBy beehive.govt.nz
    24 hours ago
  • Celebrating the Entry Into Force of the Treaty on the Prohibition of Nuclear Weapons
    [Opening comments, welcome and thank you to Auckland University etc] It is a great pleasure to be here this afternoon to celebrate such an historic occasion - the entry into force of the Treaty on the Prohibition of Nuclear Weapons. This is a moment many feared would never come, but ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Supporting disabled people to stay connected
    The Government is providing $3 million in one-off seed funding to help disabled people around New Zealand stay connected and access support in their communities, Minister for Disability Issues, Carmel Sepuloni announced today. The funding will allow disability service providers to develop digital and community-based solutions over the next two ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Voluntary saliva testing offered to quarantine workers from Monday
    Border workers in quarantine facilities will be offered voluntary daily COVID-19 saliva tests in addition to their regular weekly testing, COVID-19 Response Minister Chris Hipkins said today. This additional option will be rolled out at the Jet Park Quarantine facility in Auckland starting on Monday 25 January, and then to ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Next steps in firearms buy-back
    The next steps in the Government’s ambitious firearms reform programme to include a three-month buy-back have been announced by Police Minister Poto Williams today.  “The last buy-back and amnesty was unprecedented for New Zealand and was successful in collecting 60,297 firearms, modifying a further 5,630 firearms, and collecting 299,837 prohibited ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Jobs for Nature projects target iconic ecosystems
    Upscaling work already underway to restore two iconic ecosystems will deliver jobs and a lasting legacy, Conservation Minister Kiri Allan says.  “The Jobs for Nature programme provides $1.25 billion over four years to offer employment opportunities for people whose livelihoods have been impacted by the COVID-19 recession. “Two new projects ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New Public Housing Plan announced
    The Government has released its Public Housing Plan 2021-2024 which outlines the intention of where 8,000 additional public and transitional housing places announced in Budget 2020, will go. “The Government is committed to continuing its public house build programme at pace and scale. The extra 8,000 homes – 6000 public ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Prime Minister congratulates President Joe Biden on his inauguration
    Prime Minister Jacinda Ardern has congratulated President Joe Biden on his inauguration as the 46th President of the United States of America. “I look forward to building a close relationship with President Biden and working with him on issues that matter to both our countries,” Jacinda Ardern said. “New Zealand ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Jobs for Nature funding will create training and employment opportunities
    A major investment to tackle wilding pines in Mt Richmond will create jobs and help protect the area’s unique ecosystems, Biosecurity Minister Damien O’Connor says. The Mt Richmond Forest Park has unique ecosystems developed on mineral-rich geology, including taonga plant species found nowhere else in the country. “These special plant ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Pre-departure testing extended to all passengers to New Zealand
    To further protect New Zealand from COVID-19, the Government is extending pre-departure testing to all passengers to New Zealand except from Australia, Antarctica and most Pacific Islands, COVID-19 Response Minister Chris Hipkins said today. “The change will come into force for all flights arriving in New Zealand after 11:59pm (NZT) on Monday ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Bay Cadets learn skills to protect environment
    Bay Conservation Cadets launched with first intake Supported with $3.5 million grant Part of $1.245b Jobs for Nature programme to accelerate recover from Covid Cadets will learn skills to protect and enhance environment Environment Minister David Parker today welcomed the first intake of cadets at the launch of the Bay ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Cook Islanders to resume travel to New Zealand
    The Prime Minister of New Zealand Jacinda Ardern and the Prime Minister of the Cook Islands Mark Brown have announced passengers from the Cook Islands can resume quarantine-free travel into New Zealand from 21 January, enabling access to essential services such as health. “Following confirmation of the Cook Islands’ COVID ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Supporting communities and landowners to grow employment opportunities
    Jobs for Nature funding is being made available to conservation groups and landowners to employ staff and contractors in a move aimed at boosting local biodiversity-focused projects, Conservation Minister Kiritapu Allan has announced. It is estimated some 400-plus jobs will be created with employment opportunities in ecology, restoration, trapping, ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Border exception for some returning international tertiary students
    The Government has approved an exception class for 1000 international tertiary students, degree level and above, who began their study in New Zealand but were caught offshore when border restrictions began. The exception will allow students to return to New Zealand in stages from April 2021. “Our top priority continues ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Tiwai deal gives time for managed transition
    Today’s deal between Meridian and Rio Tinto for the Tiwai smelter to remain open another four years provides time for a managed transition for Southland. “The deal provides welcome certainty to the Southland community by protecting jobs and incomes as the region plans for the future. The Government is committed ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New member for APEC Business Advisory Council
    Prime Minister Jacinda Ardern has appointed Anna Curzon to the APEC Business Advisory Council (ABAC). The leader of each APEC economy appoints three private sector representatives to ABAC. ABAC provides advice to leaders annually on business priorities. “ABAC helps ensure that APEC’s work programme is informed by business community perspectives ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Govt’s careful economic management recognised
    The Government’s prudent fiscal management and strong policy programme in the face of the COVID-19 global pandemic have been acknowledged by the credit rating agency Fitch. Fitch has today affirmed New Zealand’s local currency rating at AA+ with a stable outlook and foreign currency rating at AA with a positive ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Additional actions to keep COVID-19 out of NZ
    The Government is putting in place a suite of additional actions to protect New Zealand from COVID-19, including new emerging variants, COVID-19 Response Minister Chris Hipkins said today. “Given the high rates of infection in many countries and evidence of the global spread of more transmissible variants, it’s clear that ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 19 projects will clean up and protect waterways
    $36 million of Government funding alongside councils and others for 19 projects Investment will clean up and protect waterways and create local jobs Boots on the ground expected in Q2 of 2021 Funding part of the Jobs for Nature policy package A package of 19 projects will help clean up ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • New Zealand Government acknowledges 175th anniversary of Battle of Ruapekapeka
    The commemoration of the 175th anniversary of the Battle of Ruapekapeka represents an opportunity for all New Zealanders to reflect on the role these conflicts have had in creating our modern nation, says Associate Minister for Arts, Culture and Heritage Kiri Allan. “The Battle at Te Ruapekapeka Pā, which took ...
    BeehiveBy beehive.govt.nz
    3 weeks ago