Outage

Written By: - Date published: 9:56 am, February 1st, 2012 - 33 comments
Categories: uncategorized - Tags:

There was some maintenance done on the main NZ server last night.

All looked ok when I went to sleep at about 6am, but appears to have started having problems from about 8:30 onwards with intermittently waiting on some network resource.

Problem looks external to my server and the server’s support staff are chasing it at present. It is intermittent so hopefully this post will display.

If it persists for too long, then I’ll switch to a backup server. But I suspect they will find it shortly. In the meantime I’d better head off to work.

 

33 comments on “Outage”

  1. Lanthanide 1

    Reloading pages generally seems to work after a couple of tries.

    • lprent 1.1

      Yeah. top shows the system going into wait (over 90%) and just sitting there for up to a minute, and the suddenly releasing.

      But the network system just stopped completely just then and looked like it restarted.

      Ummm started ok, but looks like we are back to waits

      • lprent 1.1.1

        Looks like the techs have found the system bit that has a problem though…

        • lprent 1.1.1.1

          Mind you, anything has to be better than the day in 2002 (?) that a contractor in the US manager to hammer a metal pole through the main underground power line to the hosting centre that our main server was housed at. Turned out the backup power system fried itself while trying to turn on.

          Or the earlier incident when a hurricane went through Florida and took out power to a hosting centre there.

  2. felix 2

    Gosman crashed the server again?

    • fender 2.1

      lol…way to go gosman
      bombard the site with repative emptyheaded crap like comparing farmland to trademe and trying to impress with his superior knowledge of kindergarden economics, playdough stuff.

    • lprent 2.2

      I don’t think that he has ever managed to crash the server. But computers aren’t too fussed about quality, it is the quantity that they tend to notice…

      All-time comments.
      1: Colonial Viper (13,071)
      2: Draco T Bastard (9,451)
      3: Felix (9,326)
      4: lprent (8,759)
      5. Pascal’s bookie (6,399)

      Out of 371,487 approved comments, of which you contributed 2.51% and CV has did 3.52%

      31: Gosman (2,220)

      Now at this point I’d like to emphasize for any young kiwi’s that it is NOT a contest. If I see any wannabe record breakers they will wind up like

      164: kiwiteen123 (438)

      😈

      • McFlock 2.2.1

        League tables!
        That will help the quality of comments appearing on The Standard! Maybe the administrators could also enter into a charter partnership with a business to improve its performance?

        🙂

        • lprent 2.2.1.1

          No way. I pull them out occasionally to stir people with. However I learnt my lesson from kiwiteen who treated them as an exercise in the unimportance of quantity.

          BTW:
          22. mcflock (2,818)

        • Colonial Viper 2.2.1.2

          I’d back league tables. Currently I’m well ahead of the league – by quantity anyways 😈

          • fender 2.2.1.2.1

            IMO your comments are of a consistently high quality CV
            When are you running for parliament?

  3. lprent 3

    Ok fixed..

    Looks like there was some kind of a configuration problem in apache2.2-common. Pulled the whole of it out and reinstalled. Then fixed the enabled modules. Ummm still getting highish waits

  4. lprent 4

    Ok. Dropped the fastcgi which is where the problem seemed to be happening.

    Site will be somewhat slower until I have a look at it tonight.

    • lprent 4.1

      At present the best guess is that sometime in the past there was a bad upgrade of apache2 which was waiting for restart that I never gave it. There was some moaning in the apache groups back before the election, and I haven’t taken the server down since at least October.

      The maintenance reboot triggered the problem on fastcgi which showed up when the load started winding up for the morning.

      I’ll probably take the whole site down on the weekend and completely reinstall apache2. But I’ll run a clean test on a different machine to see if I can isolate the problem in fastCGI. There is no way that it should start getting 90+% wait time.

      For the moment, I will take it off default apache process mode this evening and move to one of the threaded systems.

      But now I’d better get back to these interprocess named semaphores. Next release is due shortly, and this is the stuff I get paid for 🙂

  5. lprent 5

    The only thing I can see that is a problem is the very very large comment areas. The one that is at almost 600 comments looks like it is giving up before it all sent.

    I’ll (finally) put my fix in later.

  6. Jackal 6

    I don’t seem to be able to log in. All the links including the homepage have been downloading a small document saying:

  7. Jackal 7

    <?php
    /**
    * Front to the WordPress application. This file doesn't do anything, but loads
    * wp-blog-header.php which does and tells WordPress to load the theme.
    *
    * @package WordPress
    */

    /**
    * Tells WordPress to load the WordPress theme and output it.
    *
    * @var bool
    */
    define('WP_USE_THEMES', true);

    /** Loads the WordPress Environment and Template */
    require('./wp-blog-header.php');
    ?

    • lprent 7.1

      Just logged in on my three test identities.

      Try flushing your browser cache. It probably caught a php fragment in it while I was purging and reinstalling apache2-mod-php5.

  8. lprent 8

    Testing old version of ajax edit

  9. The Voice of Reason 9

    Cheers for all the hard work, LP. I’ve got no idea what it is you do to make this site function, might as well be voodoo for all I know, but the results are terrific!
     
    If you compare The Standard with KB, the differences are obvious. KB still looks like it was designed as a school project some time in the early nineties and the comments’ layout is just a context free spew down the page. Actually, so are most of the comments, so perhaps that bit is deliberate!
     
    Anyhoo, thanks again.

    • lprent 9.1

      I get rather slack about it in summer, mostly because my office at home is a bit cramped and way way to hot with a few computers running (and I haven’t been able to squeeze in the air-cond unit (yet)).. And last year I was concerned with other matters during winter – mostly the balance between cigarettes and weight.

      But the layout is mostly from mummybot. I just tweak it for functionality. But I do have to do the tweaks now. If only the weather would turn to a nice wholesome programmer friendly rain and sleet…..

  10. ropata 10

    I thought this news may have had something to do with it … now is a good time to patch the system

    http://www.theinquirer.net/inquirer/news/2142701/hundreds-wordpress-web-sites-hacked

    • lprent 10.1

      Nope. But it is the reason that I tend to upgrade wordpress, plugins, and security updates pretty fast usually within a few days of release after I try them out on the test system.

  11. taxicab 11

    Have you tried to access either of the following today “norightturn , tumeke , maui street ” all blocked by norton quite a coincidence !!

    • lprent 11.1

      That is in that curious operating system called windoze isn’t it?

      However all three of those sites have the words .blogspot.com after it. I suspect that therein lies the coincidence….

  12. taxicab 12

    sites back up now

  13. Drongo 13

    Odgers paid some nerds in Hong Kong to hack in to grab commenters’ IP addresses. She has them now and is emailing them to Slater at the minute. Things should settle down soon.

    • Colonial Viper 13.1

      Nice thing is we can pay those same nerds to counterhack her systems. Should be hilarious.

  14. felix 14

    Hey Lynn, I’ve been having a weird issue the last day or so. If I click on a link in the sidebar comments box, it loads the post instead of the specific comment. However the comment URL does appear in the address bar of the browser and on reload it brings up the comment.

    Possibly related to the other issues? Using XP & Firefox.

Recent Comments

Recent Posts

  • More proof National not delivering for New Zealanders
    The Ministry of Social Development’s latest Household Incomes Report is more hard evidence of the growing poverty in New Zealand, says Leader of the Opposition Andrew Little. “National claims to be delivering for New Zealanders. This report puts the lie ...
    12 hours ago
  • Strong support from medical community for Healthy Homes Bill
    More than a thousand medical professionals, medical students, and other New Zealanders have shown their support for Labour’s Healthy Homes Guarantee Bill, says Leader of the Opposition Andrew Little. ...
    15 hours ago
  • Labour will fund Buller Health Centre
    A Labour Government will fully fund the Buller Integrated Family Health Centre in Westport, confirming its commitment to the people of the West Coast and the role of central government to fund essential public services, says Labour’s Health spokesperson David ...
    16 hours ago
  • National’s affordable promise for Auckland more smoke and mirrors
    The 26,000 additional houses National plans to build in Auckland on public land over the next decade include fewer than 5,000 affordable homes, while more than 60 per cent will be available for speculators to buy, says Leader of the ...
    21 hours ago
  • National out of touch over immigration
    National’s abrupt backflip on their recently-announced changes to immigration shows they never understood the problem and just came up with a confused knee jerk response, says Leader of the Opposition Andrew Little. “Regional communities and businesses were quite right to ...
    2 days ago
  • English out of touch on homelessness
    Bill English’s comments that he doesn’t know why people are complaining about the blowout in the number of homeless families the government is putting up in motels just shows how tired and out of touch National is after nine years, ...
    2 days ago
  • All Kiwis to have same standard of cancer care
    Labour is promising that all New Zealanders will have access to the same level of cancer care no matter where they live in the country, says Leader of the Opposition Andrew Little.   “As someone who has survived cancer I ...
    3 days ago
  • Infrastructure announcement too long coming
    “What took you so long?” is Labour’s response to the Government’s announcement of a new infrastructure investment vehicle. Labour’s Auckland Issues spokesperson Phil Twyford says Labour announced its policy in 2015 to debt-finance infrastructure and service that debt with targeted ...
    3 days ago
  • Time for a breather on immigration
    National has no idea how to house the record number of people entering New Zealand, let alone cope with the pressure on health, education, and transport from this record population growth, says Labour’s Immigration spokesperson Iain Lees-Galloway. ...
    5 days ago
  • Labour to invest $4 billion in education
    Labour’s Education Manifesto will bring positive change across the education sector and is backed by a massive investment, says Labour’s Education Spokesperson Chris Hipkins.  “Labour’s plan will see an extra $4 billion invested over the next four years. It’s organised ...
    5 days ago
  • National’s shame: worst homelessness in the OECD
    National’s legacy is a housing crisis that has given New Zealand the worst homeless rate in the developed world, says Labour’s Housing spokesperson Phil Twyford. ...
    5 days ago
  • Labour taking action on school donations
    Labour will end so-called voluntary school donations for the majority of parents across the country under its $4 billion plan to revitalise the education sector, says Labour Leader Andrew Little. “Labour has always been committed to a world-class free education ...
    5 days ago
  • Labour to work with Queenstown to build more houses
    Labour will work with Queenstown-Lakes District Council, iwi, and the Community Housing Trust to build the modern, affordable housing Queenstown desperately needs, says Leader of the Opposition Andrew Little. ...
    6 days ago
  • Nats blow the Budget on motels after bowling state houses
    National is spending $140,000 a day putting homeless families in motels, the legacy of nine years of selling off and knocking down state houses, says Labour Housing spokesperson Phil Twyford. ...
    6 days ago
  • New revelations in Joanne Harrison report
    The State Services Commission’s report into the treatment of whistle-blowers by Joanne Harrison has revealed new accusations against the convicted fraudster, says Labour MP Sue Moroney.  “The report found that four staff inside the Ministry of Transport who had raised ...
    6 days ago
  • Snafu at Princess Margaret
    Jonathan Coleman has to stop the stalling over a new building for mental health services in Christchurch to replace the quake damaged Princess Margaret Hospital, says Labour’s Health spokesperson David Clark. “The Government must accept that Christchurch is still recovering ...
    6 days ago
  • Labour’s fiscal plan to build a fairer New Zealand
    Labour will re-build our housing, health and education while responsibly managing New Zealand’s finances, says Leader of the Opposition Andrew Little.  “Under Labour’s Fiscal Plan we will deliver big investments in the services we all need and care about, invest ...
    6 days ago
  • Nats show they’re the tax dodgers’ best friends
    The government is taking the knife to IRD at a time when we need a highly skilled department to ensure that multinationals and speculators don’t get away with dodging tax, says Labour’s Revenue spokesperson Michael Wood. ...
    7 days ago
  • Labour secures the future for NZ Super
    A Labour Government will secure the future for New Zealand Superannuation so we can continue to provide superannuation to those retiring at age 65, says Leader of the Opposition Andrew Little. “One of the first things a Labour-led Government will ...
    1 week ago
  • Multinationals must pay fair share of tax
    A Labour Government will crack down on multinational companies that are dodging paying their fair share of tax, says Labour Leader Andrew Little. “New Zealanders are missing out by hundreds of millions according to the IRD because multinational companies can ...
    1 week ago
  • ACT’s approach to children backward and ill informed
    Act’s new deputy leader’s claim that Labour’s support for families could “extend the misery of child poverty and even child abuse” is ill informed and offensive, says Labour’s Deputy Leader Jacinda Ardern. ...
    2 weeks ago
  • Canterbury hatchet job a disgrace
    The Government’s glib acceptance of advice that the Canterbury District Health Board doesn’t need more money is a hatchet job and a disgrace, says Labour’s Health Spokesperson David Clark. “To claim that the DHB was using tactics to leverage more ...
    2 weeks ago
  • Quality for Kiwi kids at ECE
    After more than a decade of rapid growth in the number of children participating in Early Childhood Education (ECE), it’s time to take stock and map out a clear plan for the future, says Labour’s Education spokesperson Chris Hipkins. ...
    2 weeks ago
  • Labour to boost ECE quality
    Labour will ensure kids get the best start in life by boosting funding for Early Childhood Centres to employ 100 per cent qualified and registered teachers, says Leader of the Opposition Andrew Little. ...
    2 weeks ago
  • Labour will stump up a million dollars for Maniototo Hospital
    A Labour led Government will make a million dollars available to rebuild the Maniototo Base hospital in Ranfurly, says the Leader of the Opposition Andrew Little.  “This will be a much needed boost for a long overdue rebuild that has ...
    2 weeks ago
  • No vision for the West Coast
    The West Coast welcomes any Government investment in our region but the lack of any real alternative vision for the West Coast’s economy is disappointing, says Damien O’Connor Labour’s West Coast-Tasman MP.  “The establishment of a Mining Research Unit will ...
    2 weeks ago
  • National’s youth work scheme too little too late
    After nine years, National’s belated attempt to provide work opportunities for unemployed youth should be seen for what it is, a half-hearted, election gimmick from a party that’s ignored the problem till now, says Leader of the Opposition Andrew Little. ...
    2 weeks ago
  • Kiwis won’t fall for Joyce’s spin
    Steven Joyce’s embarrassingly obvious spin on Labour’s Families Package won’t fool anyone, says Labour’s Finance spokesperson Grant Robertson. ...
    2 weeks ago
  • Labour prioritises families and public services
    Labour’s Families Package delivers a bigger income boost to more than 70 per cent of families with children than Budget 2017. By not spending $1.5 billion a year on tax cuts, Labour is able to do more for lower and ...
    2 weeks ago
  • Kiwis can’t sleep in your ghost houses, Nick
    The Government’s housing infrastructure announcement is another Nick Smith special – over-promising with no detail on delivery, says Labour’s Housing spokesperson Phil Twyford. ...
    2 weeks ago
  • Labour helps older New Zealanders and low income families with winter heating bills
    Labour will further boost its commitment to warm, healthy housing with a Winter Energy Payment for superannuitants and people receiving main benefits, says Leader of the Opposition Andrew Little. “Everyone deserves a warm, healthy home to live in. But that’s ...
    2 weeks ago
  • National must rule out retrospective override for Ruataniwha
    National must categorically rule out using retrospective legislation to override the Supreme Court’s decision that the land swap of conservation land flooded by the proposed Ruataniwha Dam was illegal, says Labour’s Shadow Attorney General David Parker. “Having not got their ...
    3 weeks ago
  • Flavell’s failure a win for Māori landowners
    The Māori Development Minister’s admission that his unpopular Ture Whenua Māori Bill won’t pass into law prior to the election is a victory for Māori landowners, but only a change of government will keep the Bill gone for good, says ...
    3 weeks ago
  • Stats confirm growing housing shortfall
    National’s failure to fix the housing shortage has been starkly illustrated by new statistics, says Labour Housing spokesperson Phil Twyford. ...
    3 weeks ago
  • Systemic abuse of kids in state care
    After admitting there was systemic abuse of children in State care the Government must do the right thing and launch an independent inquiry, says Labour’s Deputy Leader Jacinda Ardern. ...
    3 weeks ago
  • Migrant worker exploitation needs sharper focus
    The astonishing number of employers found guilty of exploiting migrants shows that migrant exploitation is a serious problem in New Zealand, says Labour Workplace Relations and Safety spokesperson Iain Lees-Galloway. “A total of 53 companies have been banned from recruiting ...
    3 weeks ago
  • Minister faces questions over dam debacle
    Today’s Supreme Court ruling dismissing an appeal to allow a land swap for the controversial Ruataniwha Dam is a victory for our conservation estate and Hawke’s Bay ratepayers, but leaves the Conservation Minister with serious questions to answer, says Ikaroa-Rāwhiti ...
    3 weeks ago
  • Too little too late on Wellington housing
    The announcement today on social housing in Wellington by the National Government is a pitiful and cynical election ploy, says Labour’s Wellington Central MP Grant Robertson. “In 2012 Housing New Zealand emptied out the Gordon Wilson Flats, taking 130 places ...
    3 weeks ago