web analytics

Damn you readers :) Upgrades again

Written By: - Date published: 7:47 pm, February 10th, 2015 - 31 comments
Categories: admin, humour, Satire, The Standard - Tags: ,

Dolphin Over World 2010Well ok, after the election I figured that I could shift the site to some slower storage with a whole lot of redundancy in a RAID6 array of slower drives. We’d have a lot fewer readers than our peak for about six months after post election, right?

Nope – wrong. I will be pulling the site offline for a few hours tonight at about midnight to put the whole site back on mirrored RAID1 faster solid state drives.

Too many of you have been moaning that the site has been running slowly.

Well you are probably aware of what I am like by now. I like numbers and realistic triggers as prompts for action. When I shifted the site to this configuration, I set a trigger.

It said that when we passed 400 thousand page views for a 30 day period I’d look at efficiency improvements. The bottleneck at present is disk access, mainly when the backups run every hour and the search engine updates every 13 minutes. But that spreads out into the post edits and all those comments you leave. Not to mention people simply reading the site. I shove gigabytes of RAM as file and page and object memcaches, as well as great caches on the database, but the system still spends a lot of time hitting those disks.

So when I just looked at this (it wasn’t that way yesterday damnit) ….

Last 30 days

Double damnit. More than 400k page views for 30 days and still climbing. That means late night work

Just ignore the Unique Visits, it is a rather meaningless figure because it appears to depend more on the tool used to measure it than anything real. Google Analytics thinks with the same parameters that it is about 120k. Sitemeter usually thinks it is higher. Whereas all of the tracking tools agree within a few thousand what the page views are after they discard all of the bots. It is a much more useful measure.

So why was that value of 400k page views the significiant trigger? Well if you look at the monthly figures for last year (I put the values in this one to make it clearer)…

lastyear

 

We only went over 400k page views in May only just before the election. 

Damn you readers. I bloody well know it is you because we don’t use the steroid site enhancers of some other sites. I can see you buggers causing me late night work……

 

…. I’m going to keep an eyeball on you just like philu*….

eye-target

 

* Except without the side effects

side effects

😈

31 comments on “Damn you readers :) Upgrades again”

  1. lprent 1

    And triple damnit I left out the real message. I will probably start about 2330 and finish at 0130. If it doesn’t work first shot as it should, then I will chop and leave it back at my starting point. I have another busy busy day at the paid work in the morning.

  2. Macro 2

    Hehehe.

    I shan’t be causing any pv’s tomorrow – off over to Perth for a few months. But will be looking in when I can. 🙂

    Hope the upgrade goes smoothly for you.

    • lprent 2.1

      It should do. It is pretty minor.

      1. Shut down the site.
      2. Install two 120GB SSDs from different suppliers.
      3. Clear their partitions.
      4. Mirror them with mdamd.
      5 Mount and partition the ‘single’ drive.
      6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).
      7. Bind mount the partition directories in the appropriate spaces using fstab.
      8. Start the site

      Voila!. A hell of a lot easier than what I do during the day….

      • Weepus beard 2.1.1

        6. Copy the 5.4GB of the site on to the drive (3GB files, 2.2GB database).

        2.98GB of which is Pete George’s cries from the soapbox.

        • lprent 2.1.1.1

          Umm typo there. 5.2GB.

          Nope. I’m sure that he couldn’t outwrite Penny Bright. I have to prune her missives back periodically when they start getting somewhat ‘extensive’..

  3. Marksman33 3

    Lost you from No2 onwards, pays to be a luddite methinks, all the best with that.

  4. Sacha 4

    Blame the beige badger, I say.

    • Pete George 4.1

      Or those moaning about the beige badger.

      The decline of The Daily Blog and the rise and fall of On The Left will likely have impacted here.

      It also helps that there’s a Little hope now on the left. People prefer to follow positives.

      • Draco T Bastard 4.1.1

        People prefer to follow positives.

        Which would be why nobody follows you. You really are the most negative person on this site.

        • fender 4.1.1.1

          Yeah it was a close call between PG and Brett Dale, But Dale came second due to the hoverboard…

      • Sacha 4.1.2

        now, now. not moaning.
        baiting or berating the beige badger, perhaps. between yawns.

      • framu 4.1.3

        The case highlighted a serious environmental problem. Due to the abundance of food preservatives and plastics entering the food chain, people were slowly turning into potentially indestructible ‘living dolls’. Indeed, several exhumations showed that cadavers were not decomposing. Human decay rates were slowing to that of discarded bubble wrap or a Wombles lunch box.

  5. adam 5

    Just for you Iprent.

    Thanks for all the work you do, it’s marvellous and very much appreciated.

    • lprent 5.1

      I do it for myself. Where else would I have a chance to get be a cranky old man in public?

      Ummm.. Coming to think of it, I’m a programmer. I do it all of the time. Even when I was sort of young.

    • fender 5.2

      +1

      lprent rulz…

    • Skinny 5.3

      + 1
      Well done Lprent your tolerance to our ramblings is much appreciated 🙂

    • Colonial Rawshark 5.4

      +1 Absolutely…

      And no one will mind if you pull the site down a few minutes earlier so that you can get some shuteye a few minutes earlier too…

  6. Ovid 6

    Good luck with the upgrade, Lynn. I’ll see you on the other side.

  7. gsays 7

    kia ora lprent,
    i want to echo above comments, i am very appreciative of the work you do and that it allows the standard community to exsist.

    i have learnt a lot in the time i have been visiting.

    (i must confess to not really knowing what all that work is that you detailed although i do know what a gig is. rock’n’roll!)

  8. lprent 8

    Ok all back again. There is an odd dmesg that I will have to look at (may have been there before). But everything seems to be OK.

    Seems faster, but I won’t really know until it goes under load in the morning.

    Longest part of the task was that one of the power cables wasn’t the right one on the supply. Took me a while to find the correct one and plug it into the power supply. I wish they’d standardise those connectors.

    • tc 8.1

      Top work and aren’t connectors a pain in the proverbial, like our PM there’s the standard and one he came up with the help of others he’s calling a standard.

      Damm annoying when it’s power, you expect it with comms connectors so well done lp.

    • I reckon it’s faster now. By my estimate, old page loads took over 2 seconds, now it’s less than 1 second.

      • lprent 8.2.1

        That is what I am seeing with the cores. They are spiking a lot faster, presumably because they aren’t doing waits while assembling the non-cached parts of the page.

        It certainly seems faster on my laptop connected via cellphone. But that varies a lot anyway, so it isn’t a good test.

        Inside the cave at work it seems to flick from ‘H’ (low speed) to ‘4G’ according to the external weather.

        What I do notice is that saving comments seems a lot faster.

  9. Murray Rawshark 9

    Thanks for keeping it all running.

  10. One Anonymous Bloke 10

    Thanks Lprent. We’ll do our best to break this one too 😈

  11. NZJester 11

    I’m wondering if most of this spike of activity on this site is the fault of a certain person whose initials are MS and part of the reason some people are going to have to go back to the polling booths.

  12. Colonial Rawshark 12

    ABP Branch video: Bill Binney NSA whistleblower talks about the future of freedom

    The Andersons Bay Peninsula branch of the Labour Party (Dunedin South) is showing a video tonight of Bill Binney, former NSA Technical Director ‘for the world’, and current day whistleblower, followed by a general discussion on the implications for NZ.

    Labour Party building corner of Macandrew St and King Edward St, South Dunedin, 8:15pm tonight.

    All welcome. That includes you too, spooks 😛

Recent Comments

Recent Posts

  • Relativity adjustment for Waikato-Tainui and Ngāi Tahu
    An adjustment payment has been made to Waikato-Tainui and Ngāi Tahu under the relativity mechanisms in their 1995 and 1997 Treaty of Waitangi settlements, Minister for Treaty of Waitangi Negotiations Andrew Little announced today. The latest payments to Waikato-Tainui and Ngāi Tahu are $2,700,000 and $2,600,000 respectively to ensure the ...
    BeehiveBy beehive.govt.nz
    11 hours ago
  • Auckland rail upgrades pick up steam
    Deputy Prime Minister Winston Peters and Transport Minister Phil Twyford today kicked off the start of the Auckland NZ Upgrade Programme rail projects which will support over 400 jobs and help unlock our biggest city. Both ministers marked the start of enabling works on the third main rail line project ...
    BeehiveBy beehive.govt.nz
    13 hours ago
  • PGF support for Wairoa creates jobs
    The Provincial Growth Fund (PGF) investment of $3.78 million in Wairoa will create much needed economic stimulus and jobs, Under-Secretary for Regional Economic Development Fletcher Tabuteau announced today. PGF projects announced today include: $200,000 loan to Nuhaka Kiwifruit Holdings Ltd (operated by Pine Valley Orchard Ltd) to increase the productivity ...
    BeehiveBy beehive.govt.nz
    14 hours ago
  • Public and Māori housing to trial renewable energy technology
    Tenants in public and Māori housing may be benefiting from their own affordable renewable energy in future – a fund to trial renewable energy technology for public and Māori housing has today been announced by Energy and Resources Minister Megan Woods and Associate Minister for Housing (Māori Housing) Nanaia Mahuta. ...
    BeehiveBy beehive.govt.nz
    15 hours ago
  • $2.7m for Hokianga infrastructure
    Hokianga will receive $2.7 million to redevelop four of its wharves and upgrade its water supply, Regional Economic Development Minister Shane Jones has announced. Far North District Council will receive $1.8 million from the Provincial Growth Fund for the work on the wharves. “The work will include the construction of ...
    BeehiveBy beehive.govt.nz
    15 hours ago
  • New fund to support housing and construction sector
    A $350 million Residential Development Response Fund is being established to support the residential construction sector and to minimise the economic impact from COVID-19, the Housing Minister Dr Megan Woods has announced. “The Residential Development Response Fund will help to progress stalled or at-risk developments that support our broader housing ...
    BeehiveBy beehive.govt.nz
    16 hours ago
  • Government investment to boost Auckland’s community recycling network
    As part of a broader plan to divert waste from landfill, the Government today announced $10.67 million for new infrastructure as part of the Resource Recovery Network across the Auckland region. “This key investment in Auckland’s community recycling network is part of the Government’s Infrastructure Reference Group ‘shovel ready’ projects ...
    BeehiveBy beehive.govt.nz
    16 hours ago
  • Te Papa transformation starts at Cameron Road
    The Government is investing $45 million in the first stage of an ambitious urban development project for Tauranga that will employ up to 250 people and help the region grow, Urban Development Minister Phil Twyford announced today. Phil Twyford says the funding has been allocated out of the $3 billion ...
    BeehiveBy beehive.govt.nz
    16 hours ago
  • Low-emissions options for heavy transport a step closer
    Getting low-emission trucks on the road is a step closer with investment in infrastructure to support hydrogen vehicles, the Energy and Resources Minister Megan Woods has announced. The Infrastructure Reference Group has provisionally approved $20 million for New Plymouth company Hiringa Energy to establish a nationwide network of hydrogen-fuelling stations. ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • New training centre to upskill workers
    A new trades training centre to upskill the local workforce will be built in the South Waikato town of Tokoroa through funding from the Government’s COVID-19 Response and Recovery Fund, Education Minister Chris Hipkins and Regional Economic Development Minister Shane Jones have announced. The Government will contribute $10.84 million from ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Subsequent children legislation to change
    The Government has agreed to repeal part of the Oranga Tamariki Act subsequent children provisions, Minister for Children Tracey Martin announced today. “There are times when children need to go into care for their safety – the safety and care of children must always be paramount,” Minister Martin said. “But ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Funding to expand mental health support for Pacific peoples
    A $1.5 million boost to grow primary mental health and addiction services for Pacific peoples in Auckland, Hamilton and Canterbury will lead to better outcomes for Pacific communities, Associate Health Minister Jenny Salesa says.  Pasifika Futures has received funding to expand services through The Fono, Aotearoa New Zealand’s largest by ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Funding boost for sustainable food and fibre production
    Twenty-two projects to boost the sustainability and climate resilience of New Zealand’s food and fibres sector have been announced today by Agriculture Minister Damien O’Connor. The $18m funding will deliver practical knowledge to help farmers and growers use their land more sustainably, meet environmental targets, remain prosperous, and better understand ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Mature Workers Toolkit launched on business.govt.nz
    Employment Minister Willie Jackson welcomes an initiative that assists employers to get mature workers into New Zealand small businesses. The disadvantages that older people face in the workplace was highlighted in the whole of Government Employment Strategy.  In order to address this, a Mature Workers Toolkit has been developed and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Trans-Tasman cooperation in a COVID-19 world
    New Zealand and Australia reaffirmed today the need for the closest possible collaboration as they tackle a global environment shaped by COVID-19, Foreign Affairs Minister Winston Peters said. “In these challenging times, our close collaboration with Australia is more vital than ever,” said Mr Peters. Mr Peters and his Australian ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Pike recovery efforts now in unexplored territory
    The recovery and forensic examination of the loader driven by survivor Russell Smith means the underground team are now moving into an area of the Pike River Mine that has not been seen since the explosion, Minister Responsible for Pike River Re-entry Andrew Little said. “The fifth and last robot ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government confirms CovidCard trial to go ahead
    The Government has confirmed a community-wide trial of CovidCard technology as it explores options for COVID-19 contact tracing. “Effective contact tracing is a vital part of the COVID-19 response,” Minister of Health Chris Hipkins said. “While manual processes remain the critical component for contact tracing, we know digital solutions can ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Enhanced process for iwi aquaculture assets
    The government is proposing changes to aquaculture legislation to improve the process for allocating and transferring aquaculture assets to iwi. Fisheries Minister Stuart Nash has introduced the Maori Commercial Aquaculture Claims Settlement Amendment Bill to Parliament. It proposes a limited new discretionary power for Te Ohu Kaimoana Trustee Limited (ToKM). ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Bill introduced to fix National’s Family Court reform failures
    The Minister of Justice has today introduced the Family Court (Supporting Children in Court) Legislation Bill – the next step in the ongoing programme of work to fix the failed 2014 Family Court reforms led by then Justice Minister Judith Collins.  The Bill arises from the report of the Independent ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • DOC takes action to adapt to climate change
    A new Department of Conservation (DOC) action plan tackles the impacts of climate change on New Zealand’s biodiversity and DOC managed infrastructure including tracks, huts and cultural heritage. Minister of Conservation Eugenie Sage says extreme weather events around the country have really brought home our vulnerability to changing weather patterns. ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Reduced international Antarctic season commences
    A heavily scaled back international Antarctic season will commence this week, Foreign Affairs Minister Winston Peters and Research, Science and Innovation Minister Megan Woods have confirmed. “Antarctica is the only continent that is COVID-19 free,” Mr Peters said. “Throughout the global pandemic, essential operations and long-term science have continued at ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New high performance sports hub for Upper Hutt
    The Government is providing up to $30 million to help fund the NZ Campus of Innovation and Sport in Upper Hutt - an investment that will create 244 jobs. “The sports hub is designed to be a world-leading shared service for a range of sports, offering the level of facilities ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Govt keeps projects on road to completion
    Transport Minister Phil Twyford announced today transport projects currently in construction will continue at pace due to extra Government support for transport projects to mitigate the impact of COVID-19. To keep the $16.9 billion 2018-21 National Land Transport Programme going the Government has allocated funding from the COVID Response and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • First project utilising $50 million ‘shovel ready’ fund for rural broadband announced
    $50 million for further rural broadband digital connectivity has been allocated from the $3 billion infrastructure fund in the COVID Response and Recovery Fund has been announced by Shane Jones, Minister for Infrastructure and Kris Faafoi, Minister for Broadcasting, Communications and Digital Media. The investment will go to boosting broadband ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Ultra-fast Broadband programme hits major milestone with more than one million connections
    The Minister for Broadcasting, Communications and Digital Media has congratulated the Ultra-fast Broadband (UFB) programme on its major milestone of connecting more than 1 million New Zealand households and businesses to UFB. “This milestone has been 10 years in the making and demonstrates the popularity of the UFB network. “Uptake ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Vaping legislation passes
    Landmark legislation passed today puts New Zealand on track to saving thousands of lives and having a smokefree generation sooner rather than later, Associate Health Minister, Jenny Salesa says. The Smokefree Environments and Regulated Products (Vaping) Amendment Bill regulates vaping products and heated tobacco devices. “There has long been concern ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government repeals discriminatory law
    A discriminatory law that has been a symbol of frustration for many people needing and providing care and support, has been scrapped by the Government. “Part 4A of the New Zealand Public Health and Disability Amendment Bill (No 2) was introduced under urgency in 2013 by a National Government,” Associate ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • More competitive fuel market on the way
    Kiwi motorists are set to reap the benefits of a more competitive fuel market following the passing of the Fuel Industry Bill tonight, Energy and Resources Minister Megan Woods says.  “This Act is where the rubber meets the road in terms of our response to the recommendations made in the ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government delivers on rental reforms promise
    The Government has delivered on its promise to New Zealanders to modernise tenancy laws with the passing of the Residential Tenancies Amendment (RTA) Bill 2020 today, says Associate Minister of Housing (Public Housing), Kris Faafoi. “The Residential Tenancies Act 1986 was out-dated and the reforms in the RTA modernise our ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New rules in place to restore healthy rivers
    New rules to protect and restore New Zealand’s freshwater passed into law today. Environment Minister David Parker and Agriculture Minister Damien O’Connor welcomed the gazetting of the new national direction on freshwater management. “These regulations deliver on the Government’s commitment to stop further degradation, show material improvements within five years and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Foreign Minister announces new Consul-General in Los Angeles
    Foreign Affairs Minister Winston Peters has announced the appointment of Jeremy Clarke-Watson as New Zealand’s new Consul-General in Los Angeles. “New Zealand and the United States share a close and dynamic partnership, based on a long history of shared values and democratic traditions,” Mr Peters said. “Mr Clarke-Watson is a ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Rental reforms provide greater support for victims of family violence
    Victims of family violence can end a tenancy with two days’ notice Landlords can terminate tenancies with 14 days’ notice if tenants assault them Timeframe brought forward for limiting rent increases to once every 12 months Extension of time Tenancy Tribunal can hear cases via phone/video conference Reform of New ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Apprenticeships support kicks off today
    Two employment schemes – one new and one expanded – going live today will help tens of thousands of people continue training on the job and support thousands more into work, the Government has announced. Apprenticeship Boost, a subsidy of up to $12,000 per annum for first year apprentices and ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Infrastructure to transform Omokoroa
    The Government is funding a significant infrastructure package at Omokoroa which will create 150 new jobs and help transform the Western Bay of Plenty peninsula, Urban Development Minister Phil Twyford announced today. Phil Twyford says the Government is investing $14 million towards the $28 million roading and water package. This ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Bill passes for managed isolation charges
    The Bill allowing the Government to recover some costs for managed isolation and quarantine passed its third reading today, with charges coming into force as soon as regulations are finalised. Putting regulations into force is the next step. “The COVID-19 Public Health Response Amendment Bill and its supporting regulations will ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Unemployment drop shows Govt plan to protect jobs and support businesses is working
    Today’s unemployment data shows the Government’s plan to protect jobs and cushion the blow for businesses and households against the economic impact of COVID-19 was the right decision, Finance Minister Grant Robertson says. Stats NZ said today that New Zealand’s unemployment rate in the June quarter – which includes the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New role to champion reading for children
    A new role of New Zealand Reading Ambassador for children and young people is being established, Prime Minister and Minister for Arts, Culture and Heritage Jacinda Ardern and Minister for Internal Affairs and for Children, Tracey Martin announced today. The Reading Ambassador, announced at a Celebration of Reading event at ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Funding boost for Community Law Centres
    Community Law Centres will receive a funding boost to meet the increased need for free legal services due to COVID-19, Justice Minister Andrew Little said. The $3.5m funding is for the next three financial years and is additional to the almost $8 million for Community Law Centres announced in Budget ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New Zealand joins initiative to boost women’s role in global trade
    New Zealand has joined Canada and Chile in a new trade initiative aimed at increasing women’s participation in global trade. Trade and Export Growth Minister David Parker, together with Canada’s Minister for Small Business, Export Promotion and International Trade Mary Ng, Chile’s Minister of Foreign Affairs Andrés Allamand, and Chile’s Vice ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Government provides $2.2m to heritage buildings for quake strengthening
    Building owners around New Zealand have benefited from the latest round of Heritage EQUIP funding with grants totalling $2,230,166. “The Heritage EQUIP grants for seismic strengthening assist private building owners to get the professional advice they need to go ahead with their projects or support them to carry out the ...
    BeehiveBy beehive.govt.nz
    3 days ago