web analytics

Damn you readers :) Upgrades again

Written By: - Date published: 7:47 pm, February 10th, 2015 - 31 comments
Categories: admin, humour, Satire, The Standard - Tags: ,

Dolphin Over World 2010Well ok, after the election I figured that I could shift the site to some slower storage with a whole lot of redundancy in a RAID6 array of slower drives. We’d have a lot fewer readers than our peak for about six months after post election, right?

Nope – wrong. I will be pulling the site offline for a few hours tonight at about midnight to put the whole site back on mirrored RAID1 faster solid state drives.

Too many of you have been moaning that the site has been running slowly.

Well you are probably aware of what I am like by now. I like numbers and realistic triggers as prompts for action. When I shifted the site to this configuration, I set a trigger.

It said that when we passed 400 thousand page views for a 30 day period I’d look at efficiency improvements. The bottleneck at present is disk access, mainly when the backups run every hour and the search engine updates every 13 minutes. But that spreads out into the post edits and all those comments you leave. Not to mention people simply reading the site. I shove gigabytes of RAM as file and page and object memcaches, as well as great caches on the database, but the system still spends a lot of time hitting those disks.

So when I just looked at this (it wasn’t that way yesterday damnit) ….

Last 30 days

Double damnit. More than 400k page views for 30 days and still climbing. That means late night work

Just ignore the Unique Visits, it is a rather meaningless figure because it appears to depend more on the tool used to measure it than anything real. Google Analytics thinks with the same parameters that it is about 120k. Sitemeter usually thinks it is higher. Whereas all of the tracking tools agree within a few thousand what the page views are after they discard all of the bots. It is a much more useful measure.

So why was that value of 400k page views the significiant trigger? Well if you look at the monthly figures for last year (I put the values in this one to make it clearer)…

lastyear

 

We only went over 400k page views in May only just before the election. 

Damn you readers. I bloody well know it is you because we don’t use the steroid site enhancers of some other sites. I can see you buggers causing me late night work……

 

…. I’m going to keep an eyeball on you just like philu*….

eye-target

 

* Except without the side effects

side effects

😈

31 comments on “Damn you readers :) Upgrades again ”

  1. lprent 1

    And triple damnit I left out the real message. I will probably start about 2330 and finish at 0130. If it doesn’t work first shot as it should, then I will chop and leave it back at my starting point. I have another busy busy day at the paid work in the morning.

  2. Macro 2

    Hehehe.

    I shan’t be causing any pv’s tomorrow – off over to Perth for a few months. But will be looking in when I can. 🙂

    Hope the upgrade goes smoothly for you.

    • lprent 2.1

      It should do. It is pretty minor.

      1. Shut down the site.
      2. Install two 120GB SSDs from different suppliers.
      3. Clear their partitions.
      4. Mirror them with mdamd.
      5 Mount and partition the ‘single’ drive.
      6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).
      7. Bind mount the partition directories in the appropriate spaces using fstab.
      8. Start the site

      Voila!. A hell of a lot easier than what I do during the day….

      • Weepus beard 2.1.1

        6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).

        2.98GB of which is Pete George’s cries from the soapbox.

        • lprent 2.1.1.1

          Umm typo there. 5.2GB.

          Nope. I’m sure that he couldn’t outwrite Penny Bright. I have to prune her missives back periodically when they start getting somewhat ‘extensive’..

  3. Marksman33 3

    Lost you from No2 onwards, pays to be a luddite methinks, all the best with that.

  4. Sacha 4

    Blame the beige badger, I say.

    • Pete George 4.1

      Or those moaning about the beige badger.

      The decline of The Daily Blog and the rise and fall of On The Left will likely have impacted here.

      It also helps that there’s a Little hope now on the left. People prefer to follow positives.

      • Draco T Bastard 4.1.1

        People prefer to follow positives.

        Which would be why nobody follows you. You really are the most negative person on this site.

        • fender 4.1.1.1

          Yeah it was a close call between PG and Brett Dale, But Dale came second due to the hoverboard…

      • Sacha 4.1.2

        now, now. not moaning.
        baiting or berating the beige badger, perhaps. between yawns.

      • framu 4.1.3

        The case highlighted a serious environmental problem. Due to the abundance of food preservatives and plastics entering the food chain, people were slowly turning into potentially indestructible ‘living dolls’. Indeed, several exhumations showed that cadavers were not decomposing. Human decay rates were slowing to that of discarded bubble wrap or a Wombles lunch box.

  5. adam 5

    Just for you Iprent.

    Thanks for all the work you do, it’s marvellous and very much appreciated.

    • lprent 5.1

      I do it for myself. Where else would I have a chance to get be a cranky old man in public?

      Ummm.. Coming to think of it, I’m a programmer. I do it all of the time. Even when I was sort of young.

    • fender 5.2

      +1

      lprent rulz…

    • Skinny 5.3

      + 1
      Well done Lprent your tolerance to our ramblings is much appreciated 🙂

    • Colonial Rawshark 5.4

      +1 Absolutely…

      And no one will mind if you pull the site down a few minutes earlier so that you can get some shuteye a few minutes earlier too…

  6. Ovid 6

    Good luck with the upgrade, Lynn. I’ll see you on the other side.

  7. gsays 7

    kia ora lprent,
    i want to echo above comments, i am very appreciative of the work you do and that it allows the standard community to exsist.

    i have learnt a lot in the time i have been visiting.

    (i must confess to not really knowing what all that work is that you detailed although i do know what a gig is. rock’n’roll!)

  8. lprent 8

    Ok all back again. There is an odd dmesg that I will have to look at (may have been there before). But everything seems to be OK.

    Seems faster, but I won’t really know until it goes under load in the morning.

    Longest part of the task was that one of the power cables wasn’t the right one on the supply. Took me a while to find the correct one and plug it into the power supply. I wish they’d standardise those connectors.

    • tc 8.1

      Top work and aren’t connectors a pain in the proverbial, like our PM there’s the standard and one he came up with the help of others he’s calling a standard.

      Damm annoying when it’s power, you expect it with comms connectors so well done lp.

    • I reckon it’s faster now. By my estimate, old page loads took over 2 seconds, now it’s less than 1 second.

      • lprent 8.2.1

        That is what I am seeing with the cores. They are spiking a lot faster, presumably because they aren’t doing waits while assembling the non-cached parts of the page.

        It certainly seems faster on my laptop connected via cellphone. But that varies a lot anyway, so it isn’t a good test.

        Inside the cave at work it seems to flick from ‘H’ (low speed) to ‘4G’ according to the external weather.

        What I do notice is that saving comments seems a lot faster.

  9. Murray Rawshark 9

    Thanks for keeping it all running.

  10. One Anonymous Bloke 10

    Thanks Lprent. We’ll do our best to break this one too 😈

  11. NZJester 11

    I’m wondering if most of this spike of activity on this site is the fault of a certain person whose initials are MS and part of the reason some people are going to have to go back to the polling booths.

  12. Colonial Rawshark 12

    ABP Branch video: Bill Binney NSA whistleblower talks about the future of freedom

    The Andersons Bay Peninsula branch of the Labour Party (Dunedin South) is showing a video tonight of Bill Binney, former NSA Technical Director ‘for the world’, and current day whistleblower, followed by a general discussion on the implications for NZ.

    Labour Party building corner of Macandrew St and King Edward St, South Dunedin, 8:15pm tonight.

    All welcome. That includes you too, spooks 😛

Recent Comments

Recent Posts

  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020
    New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020 Hon David Parker’s response following Thomas Piketty and Esther Duflo. Good morning, good afternoon, and good evening, wherever in the world you might be. I first acknowledge the excellent thought provoking speeches of Thomas Piketty and Esther ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Kaipara Moana restoration takes next step
    A Memorandum of Understanding has been signed today at Waihāua Marae between the Crown, local iwi and councils to protect, restore and enhance the mauri of Kaipara Moana in Northland. Environment Minister David Parker signed the document on behalf of the Crown along with representatives from Ngā Maunga Whakahī, Ngāti ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand and Uruguay unite on reducing livestock production emissions
    Agriculture Minister Damien O’Connor and Uruguayan Minister of Livestock, Agriculture and Fisheries Carlos María Uriarte have welcomed the launch of a three-year project that will underpin sustainable livestock production in Uruguay, Argentina, and Costa Rica.  The project called ‘Innovation for pasture management’ is led by Uruguay’s National Institute of Agricultural ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 3100 jobs created through marae upgrades
    Hundreds of marae throughout the country will be upgraded through investments from the Provincial Growth Fund’s refocused post COVID-19 funding to create jobs and put money into the pockets of local tradespeople and businesses, Regional Economic Development Minister Shane Jones and Māori Development Minister Nanaia Mahuta have announced. “A total ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Health volunteers recognised in annual awards
    Health Minister Chris Hipkins has announced 9 teams and 14 individuals are the recipients of this year’s Minister of Health Volunteer Awards.  “The health volunteer awards celebrate and recognise the thousands of dedicated health sector volunteers who give many hours of their time to help other New Zealanders,” Mr Hipkins ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community COVID-19 Fund supports Pacific recovery
    The Minister for Pacific Peoples, Aupito William Sio says a total of 264 groups and individuals have successfully applied for the Pacific Aotearoa Community COVID-19 Recovery Fund, that will support Pacific communities drive their own COVID-19 recovery strategies, initiatives, and actions. “I am keen to see this Fund support Pacific ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community benefits from Māori apprenticeships
    Up to 50 Māori apprentices in Wellington will receive paid training to build houses for their local communities, thanks to a $2.75 million investment from the Māori Trades and Training Fund, announced Employment Minister Willie Jackson today. “This funding will enable Ngāti Toa Rangatira Incorporated to provide its Ngā Kaimahi ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Training fund supports Māori jobseekers
    Rapidly growing sectors will benefit from a $990,000 Māori Trades and Training Fund investment which will see Wellington jobseekers supported into work, announced Employment Minister Willie Jackson today. “This funding will enable Sapphire Consultants Ltd. to help up to 45 Māori jobseekers into paid training initiatives over two years through ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruakura Inland Port development vital infrastructure for Waikato
    The Government is investing $40 million to develop an inland port at Ruakura which will become a freight super-hub and a future business, research and residential development for the Waikato, Urban Development and Transport Minister Phil Twyford, and Māori Development Minister Nanaia Mahuta announced today. The funding has been has ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Appointments made to Defence Expert Review Group
    Defence Minister Ron Mark announced today the establishment of an Expert Review Group to review a number of aspects of the New Zealand Defence Force’s (NZDF) structure, information management and record-keeping processes.  The Expert Review Group’s work arises out of the first recommendation from the Report of the Government’s Inquiry ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • No active community cases of COVID-19
    There are no active community cases of COVID-19 remaining in the country after the last people from the recent outbreak have recovered from the virus, Health Minister Chris Hipkins said today. “This is a big milestone. New Zealanders have once again through their collective actions squashed the virus. The systems ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Clean energy upgrade for more public buildings
    More public buildings will be supported by the Government to upgrade to run on clean energy, the Minister for Climate Change James Shaw announced today. Minister Shaw announced that Lincoln and Auckland universities will receive support through the Clean-Powered Public Service Fund to replace fossil fuel boilers. Southern, Taranaki, and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Schools back donations scheme for the second year
    More schools have opted in to the donations scheme for 2021, compared to 2020 when the scheme was introduced. “The families of more than 447,000 students will be better off next year, with 94% of eligible schools and kura opting into the scheme,” Education Minister Chris Hipkins said. “This is ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruapehu cycle trails gets PGF boost
    The spectacular Mountains to Sea cycle trail in Ruapehu District will receive $4.6 million in funding from the Provincial Growth Fund for two additional trails, Regional Economic Development Minister Shane Jones announced today. “This is an exciting development for the local community, and one that will provide significant economic opportunities ...
    BeehiveBy beehive.govt.nz
    3 weeks ago