web analytics

Outage

Written By: - Date published: 9:56 am, February 1st, 2012 - 33 comments
Categories: uncategorized - Tags:

There was some maintenance done on the main NZ server last night.

All looked ok when I went to sleep at about 6am, but appears to have started having problems from about 8:30 onwards with intermittently waiting on some network resource.

Problem looks external to my server and the server’s support staff are chasing it at present. It is intermittent so hopefully this post will display.

If it persists for too long, then I’ll switch to a backup server. But I suspect they will find it shortly. In the meantime I’d better head off to work.

 


History

33 comments on “Outage”

  1. Lanthanide 1

    Reloading pages generally seems to work after a couple of tries.

    • lprent 1.1

      Yeah. top shows the system going into wait (over 90%) and just sitting there for up to a minute, and the suddenly releasing.

      But the network system just stopped completely just then and looked like it restarted.

      Ummm started ok, but looks like we are back to waits

      • lprent 1.1.1

        Looks like the techs have found the system bit that has a problem though…

        • lprent 1.1.1.1

          Mind you, anything has to be better than the day in 2002 (?) that a contractor in the US manager to hammer a metal pole through the main underground power line to the hosting centre that our main server was housed at. Turned out the backup power system fried itself while trying to turn on.

          Or the earlier incident when a hurricane went through Florida and took out power to a hosting centre there.

  2. felix 2

    Gosman crashed the server again?

    • fender 2.1

      lol…way to go gosman
      bombard the site with repative emptyheaded crap like comparing farmland to trademe and trying to impress with his superior knowledge of kindergarden economics, playdough stuff.

    • lprent 2.2

      I don’t think that he has ever managed to crash the server. But computers aren’t too fussed about quality, it is the quantity that they tend to notice…

      All-time comments.
      1: Colonial Viper (13,071)
      2: Draco T Bastard (9,451)
      3: Felix (9,326)
      4: lprent (8,759)
      5. Pascal’s bookie (6,399)

      Out of 371,487 approved comments, of which you contributed 2.51% and CV has did 3.52%

      31: Gosman (2,220)

      Now at this point I’d like to emphasize for any young kiwi’s that it is NOT a contest. If I see any wannabe record breakers they will wind up like

      164: kiwiteen123 (438)

      😈

      • McFlock 2.2.1

        League tables!
        That will help the quality of comments appearing on The Standard! Maybe the administrators could also enter into a charter partnership with a business to improve its performance?

        🙂

        • lprent 2.2.1.1

          No way. I pull them out occasionally to stir people with. However I learnt my lesson from kiwiteen who treated them as an exercise in the unimportance of quantity.

          BTW:
          22. mcflock (2,818)

        • Colonial Viper 2.2.1.2

          I’d back league tables. Currently I’m well ahead of the league – by quantity anyways 😈

          • fender 2.2.1.2.1

            IMO your comments are of a consistently high quality CV
            When are you running for parliament?

  3. Ok fixed..

    Looks like there was some kind of a configuration problem in apache2.2-common. Pulled the whole of it out and reinstalled. Then fixed the enabled modules. Ummm still getting highish waits

  4. Ok. Dropped the fastcgi which is where the problem seemed to be happening.

    Site will be somewhat slower until I have a look at it tonight.

    • lprent 4.1

      At present the best guess is that sometime in the past there was a bad upgrade of apache2 which was waiting for restart that I never gave it. There was some moaning in the apache groups back before the election, and I haven’t taken the server down since at least October.

      The maintenance reboot triggered the problem on fastcgi which showed up when the load started winding up for the morning.

      I’ll probably take the whole site down on the weekend and completely reinstall apache2. But I’ll run a clean test on a different machine to see if I can isolate the problem in fastCGI. There is no way that it should start getting 90+% wait time.

      For the moment, I will take it off default apache process mode this evening and move to one of the threaded systems.

      But now I’d better get back to these interprocess named semaphores. Next release is due shortly, and this is the stuff I get paid for 🙂

  5. The only thing I can see that is a problem is the very very large comment areas. The one that is at almost 600 comments looks like it is giving up before it all sent.

    I’ll (finally) put my fix in later.

  6. I don’t seem to be able to log in. All the links including the homepage have been downloading a small document saying:

  7. <?php
    /**
    * Front to the WordPress application. This file doesn't do anything, but loads
    * wp-blog-header.php which does and tells WordPress to load the theme.
    *
    * @package WordPress
    */

    /**
    * Tells WordPress to load the WordPress theme and output it.
    *
    * @var bool
    */
    define('WP_USE_THEMES', true);

    /** Loads the WordPress Environment and Template */
    require('./wp-blog-header.php');
    ?

    • lprent 7.1

      Just logged in on my three test identities.

      Try flushing your browser cache. It probably caught a php fragment in it while I was purging and reinstalling apache2-mod-php5.

  8. lprent 8

    Testing old version of ajax edit

  9. The Voice of Reason 9

    Cheers for all the hard work, LP. I’ve got no idea what it is you do to make this site function, might as well be voodoo for all I know, but the results are terrific!
     
    If you compare The Standard with KB, the differences are obvious. KB still looks like it was designed as a school project some time in the early nineties and the comments’ layout is just a context free spew down the page. Actually, so are most of the comments, so perhaps that bit is deliberate!
     
    Anyhoo, thanks again.

    • lprent 9.1

      I get rather slack about it in summer, mostly because my office at home is a bit cramped and way way to hot with a few computers running (and I haven’t been able to squeeze in the air-cond unit (yet)).. And last year I was concerned with other matters during winter – mostly the balance between cigarettes and weight.

      But the layout is mostly from mummybot. I just tweak it for functionality. But I do have to do the tweaks now. If only the weather would turn to a nice wholesome programmer friendly rain and sleet…..

  10. ropata 10

    I thought this news may have had something to do with it … now is a good time to patch the system

    http://www.theinquirer.net/inquirer/news/2142701/hundreds-wordpress-web-sites-hacked

    • lprent 10.1

      Nope. But it is the reason that I tend to upgrade wordpress, plugins, and security updates pretty fast usually within a few days of release after I try them out on the test system.

  11. taxicab 11

    Have you tried to access either of the following today “norightturn , tumeke , maui street ” all blocked by norton quite a coincidence !!

    • lprent 11.1

      That is in that curious operating system called windoze isn’t it?

      However all three of those sites have the words .blogspot.com after it. I suspect that therein lies the coincidence….

  12. taxicab 12

    sites back up now

  13. Drongo 13

    Odgers paid some nerds in Hong Kong to hack in to grab commenters’ IP addresses. She has them now and is emailing them to Slater at the minute. Things should settle down soon.

    • Colonial Viper 13.1

      Nice thing is we can pay those same nerds to counterhack her systems. Should be hilarious.

  14. felix 14

    Hey Lynn, I’ve been having a weird issue the last day or so. If I click on a link in the sidebar comments box, it loads the post instead of the specific comment. However the comment URL does appear in the address bar of the browser and on reload it brings up the comment.

    Possibly related to the other issues? Using XP & Firefox.

Recent Comments

Recent Posts


History

  • Homeownership out of reach for middle income Aucklanders
    New figures show that even middle income Aucklanders are finding themselves unable to afford to buy a first home as National’s housing crisis rolls on, says Labour’s Housing spokesperson Phil Twyford. “New data released by interest.co.nz shows that the lower ...
    7 hours ago
  • More toilet cleaners or more tradespeople?
    The Government is not doing enough to help the construction and trades sector meet its workforce demand, instead steering students towards cleaning toilets, says Labour’s Skills and Training spokesperson Jenny Salesa. ...
    8 hours ago
  • More cracks appear in health funding
    News that the Waikato District Health Board could lose $2.7 million from its budget because it failed to make an elective target is downright disturbing, says Labour’s Acting Health spokesperson Dr David Clark.  “This is a DHB that has tried ...
    13 hours ago
  • Student debt cracks the billion mark
    New figures showing that student loan defaulters have now clocked over $1 billion in debt highlights National's failure to combat spiralling student loan debt, Labour's Education spokesperson Chris Hipkins says. "Threatening to arrest returning student loan borrowers at the ...
    1 day ago
  • Foreign Students just a commodity to National
    National MP Kanwaljit Singh Bakshi has confirmed that his party sees international students as nothing more than a commodity, says Labour's Immigration spokesperson Iain Lees-Galloway. "Mr Bakshi’s appalling comparison of some students to 'faulty fridges' that should be returned to ...
    2 days ago
  • Tolley’s spin on Education spend doesn’t add up
    National’s spin about school funding won’t wash with parents who are paying more and more of the cost of their kids’ education every year, says Labour’s Education spokesperson Chris Hipkins.  “All the spin in the world can’t hide the fact ...
    2 days ago
  • National not facing up to export challenge
    “The latest export data from Statistics New Zealand paints a picture of an economy which is not paying its way in the world, says Labour’s Finance spokesperson Grant Robertson. “Exports fell 9% - led by milk powder exports falling to ...
    2 days ago
  • Correction over Talley’s statement
    Labour’s Workplace Relations spokesperson Iain Lees-Galloway has been advised by AFFCO Ltd that AFFCO is not advertising for staff in the Manawatu through MSD as stated in a press statement released earlier today.  “I have been advised by AFFCO that ...
    5 days ago
  • Minister, cut your losses – withdraw this doomed Bill
    Local Government Minister Sam Lotu-Iiga’s request for a five month extension on the report back date for the Local Government Act 2002 Amendment Bill (No 2) is an admission that the Bill is fundamentally flawed, says Labour’s Local Government Spokesperson ...
    5 days ago
  • Coleman’s cuts create crisis
    Mental health services in New Zealand are in a state of crisis with Youthline saying that calls for extreme depression doubled last year, says Labour’s Associate Health spokesperson Dr David Clark.  “About 150 young Kiwis are missing out on help ...
    5 days ago
  • Government helping Talley’s to break workers
    The Ministry for Social Development appears to be assisting Talley’s-Affco replace experienced workers effectively locked out by the company, say Labour’s Social Development spokesperson Carmel Sepuloni and Workplace Relations spokesperson Iain Lees-Galloway. “MSD is advertising for meat processing workers for ...
    5 days ago
  • Electives lag due to $1.7 billion hole
    The lag in hip and knee replacements is a direct consequence of the Government’s $1.7 billion underfunding of health, says Labour’s Associate Health spokesperson Dr David Clark.  “A comprehensive study by the University of Otago says that the rate of ...
    5 days ago
  • Speech to Master Builders’ Constructive conference
    Today’s all about being Constructive. And that is good because I believe there is a hunger out there for positive solutions. We must be able to believe there can be a better future. ...
    5 days ago
  • Māori Party housing plan complete failure
    The Māori Party’s housing plan to put more Māori into more homes has been a complete failure with fewer than five loans granted per year, says Labour’s Maori Development spokesperson Kelvin Davis. ...
    6 days ago
  • Fund IRD better to go after tax avoiders
    National’s Tax Working Group used the following graph (p30) in 2010 as part of their justification to cut the top tax rate. The big peaks around the top tax threshold were evidence of a suspiciously high number of taxpayers ...
    GreensBy robert.ashe
    6 days ago
  • Pasifika youth ignored by the Government
    The Adolescent Health Research Group’s new report on the wellbeing of young Pacific people shines a spotlight on the Government’s failure  to deliver any “brighter future” for them, says Labour’s Pacific Island Affairs spokesperson Su’a William Sio.  “Their research shows ...
    6 days ago
  • Police in the provinces are dissatisfied
    Police in the cities of Gisborne, Napier and Hastings are a lot more unhappy than their big city cousins says Labour’s Police Spokesman Stuart Nash.     “In fact the top four districts for enjoyable work within NZ Police are ...
    6 days ago
  • Govt action needed after Wheeler holds
    The Reserve Bank Governor’s warning that “excessive house price inflation” is posing a risk to financial stability puts the pressure back on the Government to take action to address the housing crisis, says Labour’s Finance spokesperson Grant Robertson. “Graeme Wheeler’s ...
    6 days ago
  • Minister confirms – new ministry only about abuse
    ...
    1 week ago
  • Silver Ferns Farms decision a tragedy
    The rubber stamping by the Overseas Investment Office of the Shanghai Maling buyout of Silver Fern Farms is a sorry day for the once proud New Zealand meat sector, says Labour’s spokesperson for Primary Industries, Damien O’Connor.  “Generations of Kiwis ...
    1 week ago
  • Benching Nick Smith first step to Kermadec solution
    Side-lining Nick Smith must be the first step in sorting out the Government's Kermadec debacle, says Labour's Fisheries Spokesperson Rino Tirikatene. “Last week Labour called for Nick Smith to be removed from further negotiations with Te Ohu Kaimoana over the ...
    1 week ago
  • Parents, schools, teachers oppose bulk funding
    Overwhelming opposition to the National Government’s school bulk funding proposal is unsurprising and Hekia Parata should now unequivocally rule out proceeding with the idea, Labour’s Education spokesperson Chris Hipkins says. “Bulk funding could only lead to bigger class sizes or ...
    1 week ago
  • MBIE gives up on enforcing the law
      The Government must provide labour inspectors with the resources they need to enforce basic employment law after reports that MBIE is only prosecuting the worst cases, says Labour’s Workplace Relations and Safety spokesperson Iain Lees-Galloway.  “Today’s news that MBIE ...
    1 week ago
  • West Coast population declines amid bleak economic forecast
    Despite the country experiencing record population growth, the number of people living in the West Coast fell, highlighting struggles in the region from low commodity prices and a poor economic forecast, says Labour’s Economic Development spokesperson David Clark. “The latest ...
    1 week ago
  • Recovery roadblocks cause for concern
    Strong pressure on mental health services, a flagging local economy and widespread issues with dodgy earthquake repairs are all causes for concern for people in Canterbury according to a new survey, says Labour’s Canterbury spokesperson Megan Woods. “Today the CDHB’s ...
    1 week ago
  • Motel purchase must not kick people onto the street
    The Government’s purchase of a South Auckland motel to house the homeless must come with a promise that the current long term tenants will not be kicked out onto the streets, says Labour’s Housing spokesperson Phil Twyford. “It is bizarre ...
    1 week ago
  • Not everyone singing along to so-called rock star economy
    The Westpac McDermott Miller Confidence Survey shows there is serious unease about the economy’s ability to deliver benefits to many New Zealanders, despite the Government trumpeting headline figures, says Labour’s Finance spokesperson Grant Robertson. “According to this survey a significantly ...
    1 week ago
  • Youth no better off under National’s “guarantee”
    John Key’s Youth Guarantee is such a spectacular failure that those who undertake the programme are more likely to end up on a benefit and less likely to end up in full-time employment than those who don’t, Leader of the ...
    1 week ago
  • More low-skilled students becoming residents
    New figures showing international students now make up nearly 40 per cent of all principal applicants approved for New Zealand residency and that their skill level has fallen dramatically, are further evidence that National’s immigration system is broken, says Labour’s ...
    2 weeks ago
  • 35% of offshore speculators paying no tax
    Offshore investors are aggressively exploiting tax breaks to pay no tax on their rental properties according to IRD data released by Labour’s Housing spokesperson Phil Twyford. “35% of offshore investors are paying no tax on their properties, and are pocketing ...
    2 weeks ago
  • Friday fish dump stinks
    This government has dumped bad news on a Friday to try to avoid political scrutiny in Parliament, says Labour’s Environment spokesperson David Parker. ...
    2 weeks ago
  • OECD report card: National must try harder
    The OECD report on education shows there’s much more to be done for young Kiwis, Labour’s education spokesperson Chris Hipkins says. ...
    2 weeks ago
  • Kermadec stoush shows Maori Party double-standards
    The Māori Party’s reaction to the trampled Treaty rights and the Government’s lack of consultation on the Kermadec Ocean Sanctuary reeks of the same arrogant mismanagement of the unpopular Maori land reforms, Ikaroa-Rāwhiti MP Meka Whaitiri says. ...
    2 weeks ago
  • Flawed fish dumping calls
    The finding that MPI failed to properly enforce the law even when it had evidence of fish dumping seriously damages the trust and credibility of the Ministry, the industry and this Government, Labour's Fisheries Spokesperson Rino Tirikatene says. ...
    2 weeks ago
  • Sidestepping Smith should be side-lined
    Nick Smith's arrogance and disrespect towards Māori is putting the future of the Kermadec Ocean Sanctuary at risk and he needs to excuse himself from further negotiations with Te Ohu Kaimoana, Labour's Fisheries spokesperson Rino Tirikatene says. ...
    2 weeks ago
  • Government must respond to cash for jobs scam
    Urgent Government action is required to halt  the emerging cash-for-jobs immigration scandal that is taking hold in New Zealand says Labour’s Immigration Spokesperson Iain Lees-Galloway.  “Stories of rogue immigration agents scamming thousands of dollars from migrant workers are just further ...
    2 weeks ago
  • Government dragging its feet on surgical mesh
    Jonathan Coleman is dragging his feet over any action to protect New Zealanders from more disasters with surgical mesh, says Health Spokesperson Annette King.  “The Government’s pathetic response is to claim all will be fixed by a new regime to ...
    2 weeks ago
  • Labour’s baby number app goes gangbusters
    An interactive tool that celebrates Labour’s achievements in health over the decades has become an online hit, says Labour’s Health spokesperson Annette King.  “Since the tool was launched last night, 18 thousand people have used it to find their baby ...
    2 weeks ago
  • Real disposable income falls in last three months
    Kiwis are working harder than ever but real disposable income per person fell in the last quarter thanks to record population increases, Labour’s Finance spokesperson Grant Robertson said. ‘In Budget 2016 the National Government said that what mattered most for ...
    2 weeks ago
  • Baby number app celebrates Labour achievements
    Labour has launched an interactive tool that allows New Zealanders to take a look back at our achievements in health over the decades, says Labour’s Health spokesperson Annette King.  “Today is the 78th anniversary of the Social Security Act 1938, ...
    2 weeks ago
  • Legal experts unpick Māori land reforms
    One of New Zealand’s top law firms has joined the chorus of legal experts heavily critical of the controversial Te Ture Whenua Maori Bill, adding more weight to the evidence that the reforms fall well beneath the robust legal standards ...
    2 weeks ago
  • Industries most reliant on immigration worst offenders
    The industries most reliant on immigration are the worst offenders when it comes to meeting their most basic employment obligations, says Labour’s Immigration spokesperson Iain Lees-Galloway.  “The industries that are most reliant on immigration are Hospitality, Administration, Agriculture, Forestry and ...
    2 weeks ago
  • Time to remove law that discriminates against sole parents
    It’s time to repeal a harmful law that sanctions those who do not name the other parent of their child, Labour’s Social Development Spokesperson Carmel Sepuloni says. “Every week, 17,000 children are missing out because their sole parent is being ...
    2 weeks ago
  • Government handling of Kermadecs threatens Treaty rights
    ...
    2 weeks ago
  • Prime Minister should give Police Minister some backbone
    The Prime Minister should condemn the ridiculously light sentence given to Nikolas Delegat for seriously assaulting a police woman, Labour’s Police spokesman Stuart Nash says. ...
    2 weeks ago
  • Government listens to Labour on family violence
    Labour is pleased the Government has finally acted on strengthening a range of measures against family violence, says Labour’s spokesperson on Family Violence Poto Williams.  “Some of the latest changes including a new family violence offence of non-fatal strangulation is ...
    2 weeks ago
  • Government must rethink paying for police checks
    National’s decision to ignore the concerns of charities will see the voluntary sector face hundreds of thousands of dollars in new costs if the Policing (Cost Recovery) Amendment Bill passes, says Labour's Community and Voluntary Sector spokesperson Poto Williams.  “National’s ...
    2 weeks ago
  • Seven months for families in cars to be housed
    Disturbing new figures show it is now taking the Ministry of Social Development an average of seven months to house families who are living in cars, Leader of the Opposition Andrew Little says.  “John Key made a song and dance ...
    2 weeks ago
  • North Korea test must be condemned
    The nuclear test by North Korea that registered 5.3 on the Richter scale needs to be condemned, says Labour’s Foreign Affairs spokesperson David Shearer. “This test, coming hard on the heels of a missile launch a few days ago, shows ...
    3 weeks ago
  • Tribe footing the bill for Maori Party?
     Waikato-Tainui deserve committed representation, yet the President of the Maori Party is muddying the waters by confusing the core business of the tribe with party politics, says Labour’s Hauraki-Waikato MP Nanaia Mahuta.  “The only way to fix this growing negative ...
    3 weeks ago


History


History


History