web analytics

Oops some people got cached…

Written By: - Date published: 11:56 pm, November 2nd, 2009 - 13 comments
Categories: admin - Tags:



Sorry to anyone who thought that The Standard hadn’t published anything today. The site had in fact been pretty active for a Monday. You got caught by a wee mistake by me*

I moved the site to a more accessible location on the server in preparation for updates in the free time between now and New Years. But I made a screwup in the permissions for the SuperCache directories and siteXML files*. It managed to feed yesterdays pages from the cache to some of our audience today.

Some browsers and proxy caches served up the old cached pages conforming to the site hints. Most requested new pages. I’ll be going back through the logs to figure out what exactly was happening – it should allow me to tweak more performance out of the hardware by shifting caching rules. Of course that will make it more obvious if I ever screw up the same way again.

But it is a lot more productive and transparent than letting it silently disenfranchise readers. After all I’m not a NACT elitist who finds that there are more favors to be gained if everything is kind of opaque and Key-like – like their versions of of the EFA and ETS (reminds me of the Muldoon era of gerrymandered electorates and SMP’s mostly) 😈

Then I would also be able to see the fault myself during testing. There was a lot of testing yesterday. But after it was reported by addicts in the afternoon, I tested on Ubuntu linux, iPhone and Windoze 2000/XP/Vista on linux virtualbox. I also tested on browsers, Firefox, Safari, Seamonkey, Opera, Konquerer, and even Internet Explorer versions 6-8 on appropriate platforms. I also tested on 3 different internet links for possible proxy errors. No errors. That was all that I had on me at the time, so eventually I went to the house of a reader to look at the damn error in the evening..

My only OS/X box is hooked up as a media PC to the TV at home. OS/X doesn’t run in a linux hosted virtualbox legally because of Apples crappy hardware restricted license. So following the prophet Murphy, that seems to be what was affected with both Firefox and Safari getting the problem. I’d be interested if other people had a Groundhog day that wasn’t on a mac…

All fixed now*


The Standard Icon (Hi)* For the techies. I moved the code from a system location to one accessible to my personal login, and linked it back to the original location. I changed the user ownership of all files to my login and apache’s group on the server. The problem was that the existing relevant write and execute permissions for the cache were on the user not the group. They were octal 640 and 740 rather 660 and 770 respectively. So after I changed user ownership to myself wordpress didn’t have permission to write new cache files or to delete the existing ones.


13 comments on “Oops some people got cached… ”

  1. Noko 1

    I thought I was getting cache material, but I was leaning towards blaming Telecom first 😉

    But yeah, I got it on Iceweasel (Firefox clone) on Debian Linux.

  2. lprent 2

    Xtra or a local web proxy was my first thought as well. Xtras more than a decade instability of their DNS system does not exactly Inspire confidence. But it showed on the same mac laptop on orcon as well.

  3. outofbed 3

    me too, I thought everyone went away for the weekend
    (Opera on linux mint)

  4. BLiP 4

    Happened to me but only briefly – I’m running Firefox. Seemed to work after the first couple of reloads.

    Fix the Search thingy? 🙂

  5. lprent 5

    Blip: been trying to. I have now tested 6 search engines. The problem is the 130k and rapidly rising comments that either the engines don’t index or they fall over indexing or they chew too much time indexing.

    I have hopes for a background search engine called sphinx but haven’t had time to finish testing.

    • BLiP 5.1

      Only winding you up, mate. These days I do the “text site:thestandard.org.nz” Google thingywotsit – seems to work alright so long as the bit I’m looking for more than, say, a week old.

      • the sprout 5.1.1

        yeah lynn i was wondering if a good interim kludge might be to just have Search as a google page with the ‘site: standard etc’ preloaded?

        • lprent

          My experiments have indicated that we don’t get a particularly ordered mix. But I’ll try it out again… This search while complete, isn’t exactly the best ordering. Plus it repeats a hell of a lot as the name pops up in all of the tag search pages etc…

          • felix

            Still probably more usable than the current search though.

          • the sprout

            hmm, i see what you mean. on the other hand at least a google search can still easily handle a long string of terms to help refine the output.
            anyway, just a thought. obviously you’ve already thought of that – surprise surprise.

    • rocky 5.2

      I reviewed some search software in one of my previous jobs. Nutch and Sphinx came out on top. Both are stable and reliable, and run at the command line level so there’s no such think as crashing and falling over because of the size. They both index things nicely so searches from the site should be fast 🙂

      • lprent 5.2.1

        I’ll have a look at Nutch.

        The biggest hassle is that I have to get the pages down as a file for sphinx to scan. I stalled looking at the API for a in-memory way of passing the page. There is a plugin wrapper for Sphinx – but it isn’t particularly good.

        However it does seem to be the only way I can maintain a good search engine without crippling the wordpress with the volumes of posts and comments whenever it has to do a reindex

  6. rocky 6

    Nutch is good – you can just give it the URL and tell it to index from the front page.

Recent Comments

Recent Posts

  • Twenty highlights of 2020
    As we welcome in the new year, our focus is on continuing to keep New Zealanders safe and moving forward with our economic recovery. There’s a lot to get on with, but before we say a final goodbye to 2020, here’s a quick look back at some of the milestones ...
    3 weeks ago

  • Jobs for Nature funding will create training and employment opportunities
    A major investment to tackle wilding pines in Mt Richmond will create jobs and help protect the area’s unique ecosystems, Biosecurity Minister Damien O’Connor says. The Mt Richmond Forest Park has unique ecosystems developed on mineral-rich geology, including taonga plant species found nowhere else in the country. “These special plant ...
    BeehiveBy beehive.govt.nz
    18 hours ago
  • Pre-departure testing extended to all passengers to New Zealand
    To further protect New Zealand from COVID-19, the Government is extending pre-departure testing to all passengers to New Zealand except from Australia, Antarctica and most Pacific Islands, COVID-19 Response Minister Chris Hipkins said today. “The change will come into force for all flights arriving in New Zealand after 11:59pm (NZT) on Monday ...
    BeehiveBy beehive.govt.nz
    23 hours ago
  • Bay Cadets learn skills to protect environment
    Bay Conservation Cadets launched with first intake Supported with $3.5 million grant Part of $1.245b Jobs for Nature programme to accelerate recover from Covid Cadets will learn skills to protect and enhance environment Environment Minister David Parker today welcomed the first intake of cadets at the launch of the Bay ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Cook Islanders to resume travel to New Zealand
    The Prime Minister of New Zealand Jacinda Ardern and the Prime Minister of the Cook Islands Mark Brown have announced passengers from the Cook Islands can resume quarantine-free travel into New Zealand from 21 January, enabling access to essential services such as health. “Following confirmation of the Cook Islands’ COVID ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Supporting communities and landowners to grow employment opportunities
    Jobs for Nature funding is being made available to conservation groups and landowners to employ staff and contractors in a move aimed at boosting local biodiversity-focused projects, Conservation Minister Kiritapu Allan has announced. It is estimated some 400-plus jobs will be created with employment opportunities in ecology, restoration, trapping, ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Border exception for some returning international tertiary students
    The Government has approved an exception class for 1000 international tertiary students, degree level and above, who began their study in New Zealand but were caught offshore when border restrictions began. The exception will allow students to return to New Zealand in stages from April 2021. “Our top priority continues ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Tiwai deal gives time for managed transition
    Today’s deal between Meridian and Rio Tinto for the Tiwai smelter to remain open another four years provides time for a managed transition for Southland. “The deal provides welcome certainty to the Southland community by protecting jobs and incomes as the region plans for the future. The Government is committed ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New member for APEC Business Advisory Council
    Prime Minister Jacinda Ardern has appointed Anna Curzon to the APEC Business Advisory Council (ABAC). The leader of each APEC economy appoints three private sector representatives to ABAC. ABAC provides advice to leaders annually on business priorities. “ABAC helps ensure that APEC’s work programme is informed by business community perspectives ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Govt’s careful economic management recognised
    The Government’s prudent fiscal management and strong policy programme in the face of the COVID-19 global pandemic have been acknowledged by the credit rating agency Fitch. Fitch has today affirmed New Zealand’s local currency rating at AA+ with a stable outlook and foreign currency rating at AA with a positive ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Additional actions to keep COVID-19 out of NZ
    The Government is putting in place a suite of additional actions to protect New Zealand from COVID-19, including new emerging variants, COVID-19 Response Minister Chris Hipkins said today. “Given the high rates of infection in many countries and evidence of the global spread of more transmissible variants, it’s clear that ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • 19 projects will clean up and protect waterways
    $36 million of Government funding alongside councils and others for 19 projects Investment will clean up and protect waterways and create local jobs Boots on the ground expected in Q2 of 2021 Funding part of the Jobs for Nature policy package A package of 19 projects will help clean up ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand Government acknowledges 175th anniversary of Battle of Ruapekapeka
    The commemoration of the 175th anniversary of the Battle of Ruapekapeka represents an opportunity for all New Zealanders to reflect on the role these conflicts have had in creating our modern nation, says Associate Minister for Arts, Culture and Heritage Kiri Allan. “The Battle at Te Ruapekapeka Pā, which took ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Better care for babies with tongue-tie
    Babies born with tongue-tie will be assessed and treated consistently under new guidelines released by the Ministry of Health, Associate Minister of Health Dr Ayesha Verrall announced today. Around 5% to 10% of babies are born with a tongue-tie, or ankyloglossia, in New Zealand each year. At least half can ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Prisoner disorder event at Waikeria Prison over
    The prisoner disorder event at Waikeria Prison is over, with all remaining prisoners now safely and securely detained, Corrections Minister Kelvin Davis says. The majority of those involved in the event are members of the Mongols and Comancheros. Five of the men are deportees from Australia, with three subject to ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Pre-departure COVID-19 test for travellers from the UK and the US from 15 January
    Travellers from the United Kingdom or the United States bound for New Zealand will be required to get a negative test result for COVID-19 before departing, and work is underway to extend the requirement to other long haul flights to New Zealand, COVID-19 Response Minister Chris Hipkins confirmed today. “The new PCR test requirement, foreshadowed last ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • PM congratulates New Year Honour recipients
    Prime Minister Jacinda Ardern has added her warm congratulations to the New Zealanders recognised for their contributions to their communities and the country in the New Year 2021 Honours List. “The past year has been one that few of us could have imagined. In spite of all the things that ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • David Parker congratulates New Year 2021 Honours recipients
    Attorney-General and Minister for the Environment David Parker has congratulated two retired judges who have had their contributions to the country and their communities recognised in the New Year 2021 Honours list. The Hon Tony Randerson QC has been appointed a Companion of the New Zealand Order of Merit for ...
    BeehiveBy beehive.govt.nz
    3 weeks ago