Maintenance during the weekend

Written By: - Date published: 9:32 pm, May 27th, 2010 - 27 comments
Categories: admin - Tags:


During the weekend, amongst the other chores, the system will get an operating system upgrade. I’ll also be doing a general check for filesystem errors and look for stray files accumulating after its first 30 odd days of operation.

In theory, this should only result in a few minutes of outage. In practice it will probably have the usual unexpected issues and take a bit longer. So don’t get alarmed if the site disappears for a while on saturday midday (one of our lowest loading times in reasonable hours).

I was hoping to upgrade to WordPress 3.0 at the same time (the beta works great), but the final release hasn’t come out yet. So that will have to wait.

I have to say that so far I’m really happy with this new server. The only hassle has been some moron in San Antonio, Texas flooding us with ping backs. I’ve now blocked anything that has a similar profile, and barred some of the more persistent ping back offenders worldwide. By doing it when they touch the web server rather than after they access the sites code, there has been a noticeable reduction load.

27 comments on “Maintenance during the weekend”

  1. infused 1

    You will have to pickup on my other comment. I always like your comments regarding the server. I assume this is a vm of some kind?

    I like the reverse dns 😛 That aside, why the need for a checkdisk? Why is the server crashing on high cpu load?

    Why 21 hops?

    All for keeping jobs in nz, but you source your server from overseas 😀 Good one 😀

    SSH is nice and open btw.

    • Ryan 1.1

      Hmm… so they’re outsourcing their web hosting? Do as I say, not as I do.

      • Marty G 1.1.1

        outsourcing is when a company takes part of its activities and gets another company overseas to do it.

        We were always going to need to buy server from somewhere. This was the best, most reliable deal. Free trade baby.

    • lprent 1.2

      Shifting from the other post…

      This site has been running on effectively a single shared CPU with 256MB of RAM in a virtual server container up until this year (in 2008, I bumped it up from 128MB). I bumped it to 512 at the end of last year. Now it is on 2GB and multi-core Xeons quite different

      Last time I looked at hits (we usually look at page impressions instead) was at the start of last year when it was getting a million or so per week. Traffic has jumped since then.

      Count the number of links per page, including in the comments. It’d be rare when a post + comments don’t have at least 20 links in it. Some of the posts with hundreds of comments will have a lot more, especially the climate change ones.

      As I said you’re looking at a system in IIS that runs well when given heaps of resources which I couldn’t afford

      Try running IIS6 + windows of your choice in 256MB with a active dynamic website on top of it. Don’t even think of putting IIS7 on it you can’t push the required OS into that.

      • Ryan 1.2.1

        Why are you running WordPress on a Windows server?

        • lprent

          I’m not. Infused was asking me why I wasn’t running it on IIS.

          But you’re right – WordPress is a bit crippled on IIS. Found that out when I ran it in a Dual CPU windows 2003 server at home for a while Bloody thing was a pain in the arse,

  2. infused 2

    False. My company does outsourcing. We outsource IT. We don’t outsource it overseas.

    • lprent 2.1

      We looked at local, in fact we ran local until the start of 2009. But basically we needed better knowledgeable support.

      Had a look at NZ sourcing when we did this new server. Could finally get the type of support we needed here at a reasonable price.

      But there was a wee clause in the contracts which on further investigation essentially said that if they got a complaint about the site from a lawyer that we’d have to remove the offending material or have the site taken down. That was regardless of the validity of the complaint. The redress was to go to court to prove the complaint was invalid – taking quite a few months. That wasn’t acceptable.

      There are similar clauses where we are now. However you’d have to apply in the legalese of the state that it is in – ie hiring a lawyer there rather than having local lawyer mate do it. That makes the cost of a nuisance complaint somewhat higher.

      • infused 2.1.1

        I don’t think that’s a good enough excuse. There are pleanty of NZ hosters that would not have held you to ransom like that.

        • lprent

          Yeah – find one? For about $250 per month. How many minutes of legal advice is that?

          I am quite specific about the type of questions of ask the hosters. They are the various ‘legal’ threats that we have had over the years.

          Think it through…

        • Marty G

          to get a site kicked off the new zealand servers we looked at all you have to do is claim it’s saying something defamatory.

          simply doesn’t meet our needs because the right would just make false complaints and keep us offline.

          • infused

            Seriously. Get a good host and that wouldn’t happen.

            I know, been there done that.

            Without much effort you can find the site I run. Probably the busuinesses I run too.

            The site I run most probably host the most questionable material in NZ.

            • lprent

              It isn’t a question of the content. We’re almost always well within the legal bounds. What I’m concerned about are nuisance complaints that have no basis, but will force the hosting company to expend legal resources and time. We’ll get them because there are a awful lot of people around who’d prefer that this site didn’t exist.

              In my opinion, based on the way that the right have previously behaved about this site, if we were hosted locally then there would be one or more attempts to close us down or stifle what we have to say coming up towards the next election.

              But I can’t see a good reason to expose friends and hosts to that, if all it takes to prevent that it is a minor payment every month and offshore hosting.

              If the site gets big enough and makes sufficient money that we can afford to set up the site on our own link and hardware, then we will resite here. In that case we’d force the complainants to put anything that is questionable in front of a court for determination. We would also be looking for costs plus damages if they fail to make a case, in fact I’d be interested in appealing low awards so we get some case law on nuisance complaints.

  3. infused 3

    Well, my site, has 2xdual core xeons @ 3.0ghz (4 cores), 2gb memory.

    Here are some stats:

    Feb 2010 747912 157.52 GB
    Mar 2010 820433 149.09 GB
    Apr 2010 639627 129.30 GB
    May 2010 510310 100.70 GB

    I\’m strugging to find why your server is stressing so hard, since the requirements under linux are probably 50% less.

    This is a Windows 2008 R2 server as well.

    Also, why host overseas? Keen to know. Since you support keeping everything here. Castle as well? sheesh.

    • lprent 3.1

      Replied above. It is more the legal question. But I’ve found the tech support for linux to be better as well.

      Your volumes are somewhat higher. I think that we’re hitting about 80-100GB at present (with a cap of 750GB).

      Your hits are well below (I’d have to look them up). Have a look at the front page sometime and figure out how many links that there are. It is all of those thumbnails. Of course most of the links are serviced with a 304 because I tuned the site that way (my .htaccess is pretty specific).

      However the pages themselves is highly dynamic. Every time a comment is changed then so is the main page. That is why comments are locked after a month. It minimizes bot traffic, and we tell the well-behaved bots what pages to fetch with what frequencies..

      • infused 3.1.1

        Ah lprent, you don’t bite. A couple of questions.

        1) I believe you’re wrong about NZ hosting. Most of the people I know, know more about Linux than Windows (bare in mind, I’m talking about sys admins, not average joe).

        2) Stored procedures? Maybe it’s time to move the DB to a seperate server

        At the end of the day, I believe if you guys are going to be preaching about keeping it in NZ, you should move your server and show your support. DPF has his here. I’m sure someone is willing to host it. I bet I could. If I can, I bet many others can. In the ISP arena, NZ has some huge talent. You should really explore it.

        My server was donated for free, my hosting is donated for free. My site is operated for free, with no ads. 100mbit, no limits on data. You need to ask around.

        • lprent

          DPF has a mate that runs his servers under some kind of special arrangement. You can see the companies ad on the site.

          We could probably talk our way into something. But really none of us has the time in real life to chase that kind of arrangement.

          It is simpler in my already cluttered life to pay a few hours of work value than it is to spend more hours running around looking for a cheaper local deal or sponsorship. Same with everyone else who writes here. We’re far more interested in writing posts than cozying up to anyone.

          It took us more than a year to find the time to put advertising on the site – and that was with the advertiser wanting us to do it. None of us had the time.

          There are no stored procedures. It is running on a bog standard WordPress system with our own theme and a pile of plugins.

          Besides, if you remember – what was the reaction when we did site on a donated system at the start of 2008? We had bozos like you running around saying that the sky had fallen. In fact I can probably find your exact comments at the time.

          I had Whaleoil going off and attacking the company that I had used to work for. Why? Because they were acting as my secondary DNS (and I theirs), when I wasn’t even working there. With a pile of fools on wingnut sites crowing in behind in the usual braying pack of mindless lynchers.

          I’d prefer The Standard to stay quite independent, not beholden to anyone who can be pressured, and out of easy legal targeting range. The wingnuts taught me that during that episode – they would literally do damn near any underhanded tactics to get the site down. It is easier and safer for the site to run off shore than dealing with the fuckwits attacking friends and allies here.

          You notice that with the exception of Whale (who finally had a totally justifiable defamation suit against him, and an even more justifiable court action now) that the same attacks are not mounted against the sites on the right? That is because the left tend to be fundamentally more civilized and committed to open debate.

          Basically, I’d have to say that right and especially the wingnuts are fundamentally uncivilized as a group when it comes to freedom of speech for people other than themselves. Sort of a mutual bully sub-society.

  4. Jim Nald 4

    I’d like to make a donation but not via online.
    I’d be happy for you to send your bank account number to my email.
    I might as well donate what I would have subscribed or intermittently pay re newspapers.

    captcha: pay
    (yes, you are psychic)
    (forgot to type captcha, trying again .. captcha: standard … yes, The Standard)

    • lprent 4.1

      Always happy to take money for the server. I’ll send you the details for The Standards new bank account after I dig them out again

      • Jim MacDonald 4.1.1

        No need to publicise it and you can just email it through if you prefer.

  5. Brett 5

    Basic stuff I know but have you set you geographic target to New Zealand for google? otherwise it defaults to whatever country your site is hosted in.

    • lprent 5.1

      Yep, it is quite aware of the country that the site is for (you can see it if you look at searches in NZ vs elsewhere). The google bots are very very well behaved – they follow the hints that we give them. So do slurp and bing and most of the majors.

      Unlike others where I had to put limitIPconn on to stop one bloody bot from using over a hundred simultaneous connections at a time to suck data off the site. The site now limits to 16 connections per IP, and another system looks at the number of connections from an IP over a 15 minute period.

  6. jcuknz 6

    All the above is way way over me, I just want the site to stay running, so best wishes for the weekend 🙂

  7. lprent 7

    Upgrade went well. Did it this morning because I’m finishing up at work with a half day which would run through midday. Start at the next project on Monday.

  8. Turn off the TV 8

    Have you tried ??

    Are you using a PHP accelerator of some kind?

    • lprent 8.1

      APC. It was the most stable out of the ones I tested. Made a significant difference to the speed in serving the pages.

Recent Comments

Recent Posts

  • CTU speech – DPM
    Ladies and gentlemen, NZCTU President Richard Wagstaff, members of respective unions – thank you for the invitation to speak to you today. This might be preaching to the choir, but the importance of trade unions in New Zealand’s historical arch is difficult to understate. And it is my belief that ...
    4 hours ago
  • Police Association Annual Conference
    "Let’s start by acknowledging that it has been a huge year. " Police Association Annual Conference James Cook Grand Chancellor Hotel Wellington Nau mai, haere mai. Tēnā koutou, tēnā koutou, ka nui te mihi, ki a koutou katoa. President of the Police Association, Chris Cahill; Members of the Association and ...
    5 hours ago
  • New Zealand announces a further P-3 deployment in support of UN sanctions
    Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark have announced the New Zealand Government’s decision to again deploy a Royal New Zealand Air Force P-3K2 (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea. New ...
    8 hours ago
  • New Zealand deeply concerned at developments in north-east Syria
    Foreign Affairs Minister Winston Peters says New Zealand continues to have serious concerns for peace and stability in north-east Syria. “Recent reports that hundreds of ISIS-affiliated families have fled from a camp are deeply concerning from a humanitarian and security perspective”, Mr Peters says. “While we acknowledge Turkey’s domestic security ...
    8 hours ago
  • Government on high alert for stink bugs
    Biosecurity Minister Damien O’Connor is warning travelling Kiwis to be vigilant as the high-season for the crop-eating brown marmorated stink bug (BMSB) is under way. “We’re on high alert to stop BMSB arriving in NZ. The high season runs until April 30 and we’ve strengthened our measures to stop stink ...
    9 hours ago
  • Better protections for students in halls of residence
    The Government is moving swiftly to change the law to improve the welfare and pastoral care of students living in university halls of residence and other tertiary hostels. Cabinet has agreed to several changes, including creating a new mandatory Code of Practice that sets out the duty of pastoral care ...
    1 day ago
  • New trapping guide for community and expert trappers alike
    The Minister for Conservation Eugenie Sage has launched a new comprehensive trapping guide for community trappers to help them protect our native birds, plants and other wildlife, at Zealandia in Wellington today. ‘A practical guide to trapping’, has been developed by the Department of Conservation (DOC), and was launched during ...
    1 day ago
  • Widening Access to Contraceptives Welcomed
    Associate Health Minister Julie Anne Genter welcomes PHARMAC’s move to improve access to long-acting reversible contraception (LARCs). PHARMAC has today announced it will fund the full cost of Mirena and Jaydess for anyone seeking long term contraception, lifting previous restrictions on access to Mirena. “I welcome women having greater choices ...
    1 day ago
  • Major upgrade for Taranaki Base Hospital
    The Government has approved the next stage of a major redevelopment of Taranaki Base Hospital, which will deliver new and improved facilities for patients. Health Minister Dr David Clark has announced details of a $300 million dollar project to build a new East Wing at the New Plymouth hospital. It ...
    2 days ago
  • Extra support for rural families
    Extra funding will allow Rural Support Trusts to help farming families, says Minister for Rural Communities and Agriculture Damien O’Connor. “I know that rural families are worried about some of the challenges facing them, including the ongoing uncertainty created by the Mycoplasma bovis outbreak. “Those concerns sit alongside ongoing worries ...
    3 days ago
  • Howard Leaque Beekeeper programme graduation
    Thank you for the opportunity to be here to present certificates to the 16 graduates who have completed a beekeeping course delivered by the Howard League.  Let us start by acknowledging Auckland Prison’s Deputy Prison Director Tom Sherlock, and Acting Assistant Regional Commissioner of Corrections Northern Region Scott Walker - ...
    4 days ago
  • Finance Minister to attend APEC meetings
    Finance Minister Grant Robertson leaves this weekend to attend the APEC Finance Ministers meeting in Santiago, Chile. Discussions between APEC Finance Ministers at the meeting will include the effects of the current global economic uncertainty, risks for APEC economies and sustainable development of the region. While at APEC Grant Robertson ...
    4 days ago
  • Pacific languages are a source of strength, they ground us and build confidence
    The Minister for Pacific Peoples Aupito William Sio says for Pacific people, language can be a source of strength. It can help ground us and give us confidence. When we speak them, our languages provide us with an immediate and intimate access to our identity and our story - and ...
    4 days ago
  • Major boost to support disabled people in sport and recreation
    The Coalition Government has announced an action plan to improve the wellbeing of disabled New Zealanders by addressing inequalities in play, active recreation and sport. The initiative includes training to develop a workforce that understands the needs of children and young people with a range of impairments, advocacy for fit ...
    4 days ago
  • More prefab homes to be built as red tape cut
    The construction sector is being freed up to allow more homes to be built more quickly as the Government cuts through some of the red tape of the Building Act.  “Every New Zealander deserves a warm, dry, safe home and old inefficiencies in the Building Act make building slow and ...
    4 days ago
  • Further details of Prince of Wales and Duchess of Cornwall visit to New Zealand
    Prime Minister Jacinda Ardern has welcomed further details on the Prince of Wales and Duchess of Cornwall’s visit to New Zealand next month. Their Royal Highnesses will visit New Zealand from 17-23 November – their third joint visit to New Zealand and first in four years. They arrive in Auckland ...
    4 days ago
  • O’Connor in Thailand to push for RCEP deal
    Minister of State for Trade and Export Growth and Minister of Agriculture, Damien O’Connor, heads to Thailand today to attend the final Regional Comprehensive Economic Partnership (RCEP) Ministerial meeting, as negotiations enter their final stages. “The RCEP Agreement would anchor New Zealand in a regional agreement that covers 16 countries, ...
    4 days ago
  • Young Pacific people can access earning and learning opportunities in Hawke’s Bay, Otago and South...
    Pacific young people living in the Hawke’s Bay, Southland and Otago regions will have access to support services that have proved successful in helping young people find new earning and learning opportunities. “Tupu Aotearoa is about changing Pacific young peoples’ lives. Our young people are talented, they are smart, they ...
    5 days ago
  • Protecting wellbeing – ACC HQSC Trauma Forum
    Introduction As the Minister for ACC I thank you all for the work that you do supporting New Zealanders in their literally most vulnerable moments. From those who hold people’s lives in their hands, to the people who research technique, technology and trends, your work is highly valued. A special ...
    5 days ago
  • NZ economy in good shape – notes prepared for speeches in Christchurch
    Notes prepared for speeches in Christchurch – Wednesday 9 October 2019 Today’s topic, “trends and opportunities for the New Zealand economy,” is certainly one getting a great deal of commentary at the moment. Looking across the media landscape lately you’ll notice we aren’t the only ones having this discussion. There ...
    5 days ago
  • World Mental Health Day a reminder of the importance of mental health work
    Minister of Health Dr David Clark and Associate Minister of Health Peeni Henare say this year’s World Mental Health Day theme is a reminder of why the Government’s work on mental health is so important. “This year the World Federation for Mental Health has made suicide prevention the main theme ...
    5 days ago
  • Cultural Ministers Meeting
    Associate Arts, Culture and Heritage Minister Carmel Sepuloni will represent the government at Australia’s Meeting of Cultural Ministers in Adelaide this week. “This year’s meeting is special because New Zealand is expected to become an International Member of the Meeting of Cultural Ministers at this Australian forum,” Carmel Sepuloni said. “The meeting is an opportunity to ...
    6 days ago
  • 608 claims resolved by GCCRS in first year
    The Greater Christchurch Claims Resolution Service has resolved 608 insurance and EQC claims in its first year in operation, Minister Megan Woods has announced. The government service, which celebrates its first birthday today, provides a one stop shop to help Cantabrians still battling to get their homes repaired or rebuilt ...
    6 days ago
  • NZ economy in good shape
    Today’s topic, “trends and opportunities for the New Zealand economy,” is certainly one getting a great deal of commentary at the moment. Looking across the media landscape lately you’ll notice we aren’t the only ones having this discussion. There has been an increasing amount of attention paid to the outlook ...
    6 days ago
  • NZTA to refocus on safety following review
    The Government is acting swiftly to strengthen NZTA’s regulatory role following a review into the Transport Agency, and Ministry of Transport’s performance as its monitor, Transport Minister Phil Twyford said today. An independent review by Martin Jenkins has found NZTA failed to properly regulate the transport sector under the previous ...
    6 days ago
  • Joint Cooperation Statement on Climate Change between the Netherlands and New Zealand
    The Netherlands and New Zealand have a long-standing and close relationship based on many shared interests and values. We value the rule of law, our democracies, and multilateralism.  And we value our environment – at home and globally. Right now there are major global challenges in all of these areas – ...
    1 week ago
  • Government putting right Holidays Act underpayment in Health
    The Government is putting right a decade’s worth of underpayment to nurses, doctors and other health workers, says Health Minister Dr David Clark.  Initial sampling of District Health Boards payroll records has found that around $550-$650 million is owed to DHB staff to comply with the Holidays Act. It’s expected ...
    1 week ago
  • Government accounts show strong economy
    A strong surplus and low debt show the economy is performing well, and means the Government is in a good position to meet the challenges of global economic uncertainty. “The surplus and low levels of debt show the economy is in good shape. This allows the Government to spend more ...
    1 week ago
  • Ministers approve application to expand Waihi mine
    New applications from mining company OceanaGold to purchase land in Waihi for new tailings ponds associated with its gold mines have been approved. Minister of Finance Grant Robertson and Associate Minister of Finance David Parker considered the applications under the Overseas Investment Act. Earlier this year, applications from OceanaGold to ...
    1 week ago
  • Tuia 250 Voyage flotilla launches with tribute to tangata whenua
    New Zealanders in Tūranganui-a-Kiwa / Poverty Bay will witness Māori, Pākehā and Pacific voyaging traditions come together today as the Tuia 250 Voyage flotilla assembles for the first time, Māori Crown Relations: Te Arawhiti Minister Kelvin Davis says. “Tuia 250 is a national commemoration and an opportunity for honest conversations ...
    1 week ago
  • Visit to advance trade agenda with Europe and the Commonwealth
    Minister for Trade and Export Growth David Parker leaves tomorrow for Dubai, London and Berlin for a series of meetings to advance New Zealand’s trade interests.  In Dubai he will visit New Zealand’s Pavilion at Expo 2020 where construction is underway.  There he will meet Minister of State for International Cooperation, Her ...
    1 week ago
  • More cancer drugs confirmed – even more on horizon
    Confirmation that PHARMAC will fund two new cancer drugs is further evidence of the good progress the Government is making to improve the treatment of New Zealand’s leading cause of death, Health Minister David Clark says. From 1 December PHARMAC will fund alectinib (Alecensa) for ALK positive advanced non-small cell ...
    1 week ago
  • Boost for women in high performance sport
    An additional $2.7 million has been announced for the Government Strategy for Women and Girls in Sport and Active Recreation on the first anniversary of the strategy’s launch. Sport and Recreation Minister Grant Robertson gave the opening address to the first Sport NZ Women + Girls Summit in Wellington today, ...
    1 week ago
  • Parent support to help retain skilled migrants
    As part of its work to ensure businesses can get the skilled workers they need, the Coalition Government is re-opening and re-setting the Parent Category visa programme, Immigration Minister Iain Lees-Galloway says. The move will: support skilled migrants who help fill New Zealand’s skills gaps by providing a pathway for ...
    1 week ago
  • Senior NZDF Officer to lead Peacekeeping Mission in the Sinai Peninsula, Egypt
    Minister of Defence Ron Mark has today announced Major General Evan Williams of the New Zealand Defence Force has been selected as the commander of a significant, longstanding peacekeeping mission in the Middle East. In December, Major General Williams takes over as Force Commander for the Multinational Force and Observers ...
    1 week ago
  • Nurses star as Govt rebuilds health workforces
    A record number of nurses are now working to deliver health services to New Zealanders as the Government’s increased funding and new initiatives rebuild key workforces start to show results, Health Minister Dr David Clark says. •    1458 more DHB nurses since the Government took office •    106 more midwives ...
    1 week ago
  • New agricultural trade envoy appointed
    Farmer and former Nuffield scholar Mel Poulton has been appointed New Zealand’s Special Agricultural Trade Envoy, Minister for Trade and Export Growth, David Parker, and Minister of Agriculture, Damien O’Connor, announced today. The position supports key Government objectives, including raising the value of New Zealand agricultural goods and services. Mel is ...
    1 week ago
  • Pacific and Māori voyaging heritage celebrated for Tuia 250
    New Zealand’s Pacific and Māori voyaging heritage is acknowledged and celebrated today as waka of the Tuia 250 voyage flotilla arrive in Tūranga / Gisborne. “Today we celebrate Tangata Whenua, the first people of Aotearoa, and the triumphs of the voyaging tradition that brought our ancestors here from Polynesia 1000 ...
    2 weeks ago
  • Pacific languages are a root from which prosperity will grow
    “Fijian Language Week starts on Sunday and the theme reminds us how important it is that we each have something to anchor ourselves to, something that can help us pause and feel in control in a rapidly changing world,” says Minister for Pacific Peoples Aupito William Sio. “Family, culture, faith, ...
    2 weeks ago
  • NZ Government establishes innovative, industry-focused Airspace Integration Trials Programme
    The Government is establishing an Airspace Integration Trials Programme to support the safe testing and development of advanced unmanned aircraft and accelerate their integration into the aviation system, Research, Science and Innovation Minister Megan Woods announced today. The Government will work with leading, innovative aviation industry partners to test and ...
    2 weeks ago