web analytics
The Standard

Granny Herald: from flawed data, false conclusions

Written By: - Date published: 11:21 am, March 23rd, 2013 - 17 comments
Categories: john key, national, polls - Tags:

Three of the Herald’s political staff has a crack at trying to explain why National polled 48.5% in the latest Herald-Digipoll. Consensus seems to be that John Key’s an angel sent to earth to do very little but keep enough of the middle class happy enough who’ll never lose. May I humbly suggest an alternative theory – that the Herald-Digipoll is broken.

Danyl at the Dimpost has the most mathematically poll of polls that, crucially, is anchored in reality – ie the last election result. Whereas political commentators and pollsters seem to shamelessly ignore how badly their poll got it wrong at the last election when breathlessly reporting the latest numbers, the Dimpost poll of polls corrects for their error.

What the Dimpost poll shows is that:

a) the Herald Digi-poll consistently over measures National – for example, the final Herald poll before the last election had National on 50.9%, that’s outside the margin of error above the 47.3% they got. The final Herald poll in 2008 had National on 47.9%, they got 44.9%. Statistically, the Herald isn’t just missing the bullseye, it’s missing the dartboard altogether. Only the 3news poll is worse. (in the image below, the light blue line is the Herald trend, the dark one is the poll of polls trend).

Dimpost poll of polls highlighting Herald Digipoll

b) even the Herald poll shows that National has lost a significant amount of support. From a pre-election high of 54.2%, a final pre-election number of 50.9%, to 48.5% today. That’s a big drop. Adjust to the Herald’s 3% over-polling of National at the last two elections, and it signals National is at around 45% – in the range that the Dimpost poll of polls has it. Remember, the Right has a one-seat majority in the House. Losing 2-3% since the election, especially when Banks will never get back in, is no laughing matter for National. If it were to translate into an election result, it would mean National would need New Zealand First (or a very large wasted vote) to govern.

c) more regular polls, like the Roy Morgan show a clear downward trend for National. You can’t possibly draw a trend from the five data points in 17 months that the Herald provides because the statistical noise that results in variation between every poll can’t be sensibly separated from the trend when you have so little to work with. The Roy Morgan has polled 29 times in that period and its trend is clear. (incidentally, the Roy Morgan was also the most accurate for National in 2011).

roy morgan labour greens v nats 3

To look at the Herald poll and conclude that National is now more popular than at the election, you have to ignore the Herald’s record of over-polling National, the fact that National’s support in the Herald poll has fallen significantly since the election, and the fact that more reliable polling trends tell us the opposite.

Only if you make all these logical errors (and there’s a strong incentive to do so because our paper spent a lot of money on the poll, which means its going to be treated as gospel no matter what, goddammit), can you then conclude National’s rule continues unblemished thanks to Bonny Prince Grinny.

But when’s a few fallacies ever stopped Granny?

[Note: none of this should be taken as a ‘if these trends continue’ argument. One current accurate polling, the Left needs Winnie too making him Kingmaker and he would have much more incentive to go with National, and there’s the risk of a Shearer campaign meltdown too. Put National at 40% and I’ll be happier].

17 comments on “Granny Herald: from flawed data, false conclusions”

  1. Tiresias 1

    “Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: “There are three kinds of lies: lies, damned lies and statistics.”
    – Mark Twain’s Own Autobiography

    Presently Labour will only be picking up those sufficiently dismayed by National’s duplicities and incompetence not to want them in Government again. Labour will only start picking up genuine support when it starts presenting an alternative programme worth genuinely supporting, and six-weeks out from an election is far too late to start thinking of doing that.

  2. Bob Tambling 2

    The worry for me then is if the polling trends continue and it looks like Shearer can just get over the line the possibilty of changing the leader will further diminish and Shearer will fight the 2014 election.
    Unfortunetly during the ensuing campaign, Key and the Nats will crucify him and we will be left with a National Government or a very weak LAb /NZF /Green one term Goverment
    I wonder from a Green party prospective (and a leftish pespective) , would it not be better if the Labour Party lost the next election with Shearer as Leader?
    If NZF play a part as may be likely, the Green can’t afford to go into a NZF /Lab/Green Gov.
    Shearer simply won’t cut the mustard and Peters is toxic. It would be a crap government and the well honed National party machine would again tear it to shreds

    The leaves the Greens in an interesting position, the lure of ministerial positions versus the pragmatic long term strategy of the Greens. A one term Lab/Nzf/Green Gov seems to serve no ones interest.
    Labour needs to have a strong leadership team and comitted activists , The reality is they have a diminishing group of activists and a crap leadership.
    The Greens on the other hand have a very strong leadership team and an ever growing group of activists ( let us not forget they are the second biggest party in Wellington).
    Labour? I can’t think of anyone in the present caucus who could take most of the country with them in an election. They need a good clean out and new blood. They don’t appear to be listening to that line of argument.
    In conclusion:
    I am committed to working very hard to getting as many Green MP’s elected as I can in 2014. I am not so sure though if I want those MP’s in a Government with the current infighting mob of the Lab party who it seems “could not pour piss out of a boot if the directions were on the heel”.

  3. tc 4

    The more granny and her shills like Johnno, o’shillivan, rortney etc keep banging the NACT drum the more irrelevant and bias they show themselves to be.

    Labour needs to grow a pair and get out there now however with the mallarfia and their front man it seems it’ll come down to the hollowmen blowing it more so than Labour winning it.

    They could easily blag another term if they weren’t such psychos given the current state of the opposition, thankfully they are what they are.

  4. ghostrider888 5

    article in todays Herald acknowledges the popularity of Key is slipping

  5. pete 6

    “Only the 3news poll is worse.”

    That’s not quite true: all five polls overestimate National’s election results, and the Digipoll isn’t too much worse than Fairfax or Roy Morgan. One News Colmar Brunton, as well as 3 News Reid Research both overestimate by more than the Herald.

    • lprent 6.1

      Points to a systematic flaw in their sampling doesn’t it…

      • pete 6.1.1

        That’s one possible explanation, although some have theorised that National lose a lot of votes close to the election once people actually start looking at their policies.

        There’s also a theory that NZF underpolls because their voters are embarrassed to admit that to callers.

        • lprent 6.1.1.1

          Possible. But less likely than the simpler explanation.

          Canvassing companies are using listed landlines*. When I was analyzing some somewhat larger samples of both door-knock canvassing and phone canvassing across several electorates, there was a statistically significant correlation between people who canvassed right and left and if they had a listed landline.

          For that matter there was an even stronger correlation between age group and having a listed land line – and it looks like if people don’t have a listed phone line in their mid 20’s then they never get one.

          * There is a common myth that goes around about auto-dialing random numbers. Asked a few people who work at or have worked at polling companies. It doesn’t happen and a few minutes thought about number ranges will give an explanation about why. It is cheaper to buy/get a phone list.

  6. Chris 7

    So,will Granny Herald be ramping up lots of little good news, happy smiley,relaxed all singing, dancing reports/photos of our poor excuse for a pm then. Got to keep him relevant.

  7. Centaur 8

    Give Key *some* credit. He may decide to call it quits. It is not as if he actually needs this gig ..

  8. Murray Olsen 9

    I’m not even sure that the margins of error as reported are very meaningful at all. From what I know, they seem to rely on unbiased sampling and the validity of the Central Limit Theorem, which then leads to a percentage presumably taken from 100 times √N/N. The concern about landlines is just one thing that could skew this.

    • lprent 9.1

      They do sample distribution normalising for many of the other factors like age, gender and geological distribution. They don’t adjust for factors like people working during the periods that they phone.

      But they don’t publish their techniques and criteria so it is pretty hard to see why there if it was unbiased sampling there would be any differences between the polls within the confidence limits. But there clearly is.

      • Centaur 9.1.1

        lprent: geological distribution ?
        Such as, where there are proven mineral resources ?

        • lprent 9.1.1.1

          I blame the iPad, it’s overly smart autocorrect, and that I use Geological at least 10x more often than Geographical.

    • Lanthanide 9.2

      No, they’re not. Even assuming they are following absolutely perfect statistical methods and the statistical methods work as advertised by the literature, the margin of error they’re reporting is presumably the 95% confidence interval. Which means 1 out of 20 polls are going to be wrong, but we won’t ever be able to tell which one without some other corroborating information (eg other polls taken at the same time).

      That’s assuming they’re using perfect methods, which of course they aren’t.

Recent Comments

Recent Posts

  • Worker safety top of mind tomorrow and beyond
    Workers’ Memorial Day, commemorated tomorrow, is both a time to reflect and to encourage a better safety culture in all workplaces, says Labour’s spokesperson for Labour Issues Iain Lees-Galloway.“On Worker’s Memorial Day, working people across New Zealand will remember those… ...
    20 hours ago
  • Communities forced to stomach water woes
    Confirmation by Health Minister Jonathan Coleman that he is to wind up a water quality improvement scheme will leave thousands of Kiwis with no alternative but to continue boiling their drinking water, Labour’s Health spokesperson Annette King says. The Drinking… ...
    1 day ago
  • Labour calls for immediate humanitarian aid for Nepal
    The Government should act immediately to help with earthquake relief efforts in Nepal, Labour’s Foreign Affairs spokesperson David Shearer says. “The Nepalese Government is appealing for international assistance following yesterday’s massive quake. The full impact is only now being realised… ...
    1 day ago
  • New holiday reflects significance of Anzac Day
    Anzac Day now has the full recognition that other public holidays have long enjoyed, reflecting the growing significance it has to our sense of identity and pride as a nation, Labour MP David Clark says.“The importance of the 100th Gallipoli… ...
    1 day ago
  • Housing crisis hurting export growth
    If Steven Joyce wants to revive his failing export growth target he needs to make sure the Government gets to grips with the housing crisis, says David Parker, Labour’s Export Growth and Trade spokesperson. “Our exporters are struggling to compete… ...
    4 days ago
  • Gallipoli’s lesson: never forget, never repeat
     A special monument to one of our greatest war heroes should be a priority for the new Pukeahu National War Memorial Park, Labour Leader Andrew Little says.  “This will honour the spirit of Lieutenant Colonel William Malone, who led 760… ...
    4 days ago
  • Minister for who? Women, or Team Key?
    Louise Upston yesterday broke her silence on John Key’s repeated unwanted touching of a woman who works at his local café, to jump to the defence of her Boss. Upston repeated Key’s apology but, according to media reports “she refused… ...
    GreensBy Jan Logie MP
    4 days ago
  • Taxpayer bucks backing US billionaire
    Kiwis will be horrified to know they are backing a Team Oracle subsidiary owned by a US billionaire, Labour’s Sports and Recreation spokesperson Trevor Mallard says. It has been revealed today that a Warkworth boat building company, which is wholly… ...
    5 days ago
  • English’s sins of omission: ‘Nothing left to be done’ on housing
    When Bill English said ‘there is nothing left to be done’ on the Auckland housing crisis he had overlooked a few things – a few things, Labour’s Housing spokesperson Phil Twyford says.  “He’s right if you ignore: ...
    5 days ago
  • Climate change now hurts Kiwis
    Kiwis have twice been given timely and grave warnings on how climate change will hit them in their hip pockets this week, says Climate Change spokesperson Megan Woods.  “The first is the closure of the Sanford mussel plant and the… ...
    5 days ago
  • Clean, green and chocolate!
    Like many people I absolutely love chocolate! But until recently I hadn’t given much thought to how it was grown and produced. Fair trade and ethical food production are core Green Party principles, so yesterday Steffan Browning and I were… ...
    GreensBy Mojo Mathers MP
    5 days ago
  • National admits loan shark law not up to it
    National has admitted new laws to crack down on loan sharks, truck shops and dodgy credit merchants aren’t up to the task of protecting vulnerable consumers, Labour’s Commerce spokesperson Kris Faafoi says. “Paul Goldsmith has acknowledged the laws might just… ...
    5 days ago
  • Power and the Prime Minister
    I’d like to acknowledge the young woman* who has publically told her story. It was a very brave thing to do. She kept her story very simple and focussed on her experience of what happened. It told of unwanted attention… ...
    GreensBy Jan Logie MP
    5 days ago
  • Extra holiday offers time to reflect
    The Mondayisation of Anzac Day provides New Zealanders with an opportunity to spend more time with their families and their communities, Dunedin North Labour MP David Clark says. “This is the first time legislation I introduced, to have Anzac and… ...
    5 days ago
  • More angst and anguish for red zone locals
    Local residents will be bitterly disappointed by the Government’s cherry picking of the Supreme Court’s decision regarding compensation for red zoned property owners, Labour Canterbury Earthquake Recovery spokesperson and Port Hills MP Ruth Dyson says. “Home owners have taken all… ...
    6 days ago
  • Australia shows why we need a sovereign wealth fund now
    Australia has not managed its great mining boom well, says HSBC’s chief economist for Australia and New Zealand, Paul Bloxham. When times are good, governments need to save for the bad times that will inevitably follow, and this can be… ...
    GreensBy Russel Norman MP
    6 days ago
  • Pure Water- pure rip off
    New Zealanders’ rights to fresh water must be protected before commercial allocations are given, but the Government is allowing resources to be taken, says Kelvin Davis MP for Te Tai Tokerau.  “The Government needs to resolve the issue of water… ...
    6 days ago
  • Cabinet paper reveals weak case for Iraq deployment
    A heavily redacted copy of a Cabinet paper on New Zealand’s military deployment to Iraq reveals how weak the case is for military involvement in that conflict, says Labour’s Defence spokesperson Phil Goff.  The paper warns that given the failure… ...
    6 days ago
  • Malaysia’s booty is Kiwis’ lost homeownership dream
    It’s unsurprising the Auckland property market is so overheated when Malaysians are being told they can live large on Kiwi’s hard-earned rent money, Labour’s Housing spokesperson Phil Twyford says. “A Malaysian property website lists nearly 4000 New Zealand houses and… ...
    6 days ago
  • Ministry’s food safety resources slashed to the bone
    The Ministry for Primary Industries’ failure to monitor toxic and illegal chemicals in red meat is a dereliction of duty, Labour’s Primary Industries and Food Safety spokesperson Damien O’Connor says. “MPI compliance officer Gary Orr today admitted National’s much-vaunted super… ...
    6 days ago
  • Ministry must protect organic food industry
    The Ministry for Primary Industries must take urgent action to protect New Zealand’s $150 million organic food and beverage industry by establishing a certification regime, Labour’s Primary Industries spokesperson Damien O’Connor says. “Despite working with Organics Aotearoa on the issue… ...
    7 days ago
  • Tony Abbott, indigenous rights, and refugees
    This week, Tony Abbott has visited Aotearoa New Zealand, bringing with him his racist policies against indigenous Australians and his appalling record on refugee detention camps. Abbott has launched a policy “to close” remote aboriginal communities, which is about as… ...
    GreensBy Catherine Delahunty MP
    1 week ago
  • PM’s housing outburst bizarre
    Labour’s Housing spokesperson Phil Twyford has described the Prime Minister’s latest comments on the Auckland housing crisis as bizarre. “John Key is deep in denial. He must be one of the only people left who are not concerned about the risk… ...
    1 week ago
  • Deflation: Another economic headache linked to housing crisis
    National’s housing crisis is causing even further damage with the second consecutive quarter of deflation a genuine concern the Reserve Bank can do little about, as it focusses on Auckland house prices, says Labour’s Finance spokesperson Grant Robertson. “This is… ...
    1 week ago
  • Pot calling the kettle black over fossil fuel subsidies.
    Over the weekend alongside nine other countries the New Zealand Government has endorsed a statement that supports eliminating inefficient subsidies on fossil fuels. Fossil fuel subsidies are a big driver of increasing emissions. Good on the Government for working internationally… ...
    GreensBy Gareth Hughes MP
    1 week ago
  • At last – a common sense plan for Christchurch
    The Common Sense Plan for Christchurch released by The People’s Choice today is a welcome relief from the shallow debate about rates rises versus asset sales, Labour’s Christchurch MPs say. "Local residents – who have spent weeks trawling through the… ...
    1 week ago
  • National must lead by example on climate change
    The National Government must meet its own climate change obligations before it preaches to the rest of the world, Labour's Climate Change spokesperson Megan Woods says. "Calls today by Climate Change Minister Tim Groser for an end to fossil fuel… ...
    1 week ago
  • Biosecurity rethink a long time
    The Government has opened New Zealand’s borders to biosecurity risks and its rethinking of bag screening at airports is an admission of failure, Labour’s Primary Industries spokesperson Damien O’Connor says. Nathan Guy today announced a review of biosecurity systems in… ...
    2 weeks ago
  • Chinese rail workers must be paid minimum wage
    KiwiRail must immediately stop further Chinese engineers from working here until they can guarantee they are being paid the New Zealand minimum wage, Labour’s MP for Hutt South Trevor Mallard says. The Ministry of Business, Innovation and Employment today released… ...
    2 weeks ago
  • Better consultation needed on Christchurch asset sales
    The Christchurch City Council (CCC) should be promoting wide and genuine public consultation on its draft ten year budget and plan given the serious implications for the city’s future of its proposed asset sales, outlined in the plan. Instead, it… ...
    GreensBy Eugenie Sage MP
    2 weeks ago
  • ‘Healthy Families’ a good start but not enough to tackle obesity relate...
    Today the Government is making a the meal out of the launch of its ‘Healthy Families’ package to promote ‘healthier decisions’ and ‘changing mindsets’ over nutrition, physical activity and obesity. Great! The programme is based on a successful model from… ...
    GreensBy Kevin Hague MP
    2 weeks ago
  • ‘Healthy Families’ a good start but not enough to tackle obesity relate...
    Today the Government is making a the meal out of the launch of its ‘Healthy Families’ package to promote ‘healthier decisions’ and ‘changing mindsets’ over nutrition, physical activity and obesity. Great! The programme is based on a successful model from… ...
    GreensBy Kevin Hague MP
    2 weeks ago
  • No more sweet talk on obesity
    The Government should be looking at broader measures to combat obesity rather than re-hashing pre-announced initiatives, Labour’s Health spokesperson Annette King says.  “While it is encouraging to see the Government finally waking from its slumber and restoring a focus on… ...
    2 weeks ago
  • Government two-faced on zero-hour contracts
    The Government should look to ban zero-hour contracts in its own back yard before getting too high and mighty about other employers using them, Labour’s Health spokesperson Annette King says. “Information collated by Labour shows at least three district health… ...
    2 weeks ago
  • Scrutiny of battlefield deaths should continue
    As New Zealand troops head to Iraq under a shroud of secrecy, the Government is pushing ahead with legislation to remove independent scrutiny of incidents where Kiwi soldiers are killed in hostile action overseas, Labour’s Defence spokesperson Phil Goff says.… ...
    2 weeks ago
  • Damp-free homes a right for tenants
    Labour is urging tenants to use a little known rule which gives them the right to live in damp-free rental homes. Otago University researchers have today highlighted the Housing Improvement Regulations 1947 as a way tenants can force landlords to… ...
    2 weeks ago
  • National must take action on speculators
    The Government must take action on property speculators who are damaging the housing market and shutting families and young people out of the home ownership dream, Labour Leader Andrew Little says.  “There are a number of options the Government could… ...
    2 weeks ago
  • Milk price halves: A $7b economic black hole
    Global milk prices have halved since the peak last year, creating an economic black hole of almost $7 billion that will suck in regions reliant on dairy, crucial industries and the Government’s books, says Labour’s Finance Spokesperson Grant Robertson. “The… ...
    2 weeks ago
  • Kitchen plan set to swallow up health boards’ funds
    The financial impacts of implementing a proposal to outsource hospital food, forced on them by a crown-owned company which is now facing an auditor-general’s inquiry, are being felt by district health boards across the country, Labour’s Health spokesperson Annette King… ...
    2 weeks ago
  • Reserve Bank scathing of Government
    The Reserve Bank’s most scathing critique to date of National’s inability to handle the housing crisis shows the Bank is sick of having to pick up the pieces, Labour Leader Andrew Little says.  “John Key continues to deny there is… ...
    2 weeks ago
  • Time for McDonald’s to upsize work hours
    Labour is calling on McDonald’s to have more respect for their workers and offer them more guaranteed work hours. McDonald’s is proposing to guarantee its workers 80 per cent of their rostered hours, Labour’s spokesperson for Labour Issues Iain Lees-Galloway… ...
    2 weeks ago
  • Brownlee misses the boat on asbestos
    Gerry Brownlee has once again missed an opportunity to improve the lives of Cantabrians post-earthquakes, Labour’s Canterbury Earthquake Recovery spokesperson Ruth Dyson says. A new report from the Royal Society of New Zealand and the Prime Minister’s Chief Science Adviser,… ...
    2 weeks ago
  • Government must come clean on troop deployment and protections
    New Zealanders deserve more than to hear about their troops’ deployment overseas from Australian media, Opposition Leader Andrew Little says. “News from Australia that Kiwi troops are on their way to Iraq this week is another example of the culture… ...
    2 weeks ago
  • Cancer prevention calls gain momentum
    Research showing bowel cancer treatment sucks up more public health dollars than other cancers once again highlights the need for a national screening programme, Labour’s Health spokesperson Annette King says. A study by Otago University, which found colon cancer is… ...
    2 weeks ago
  • Burger King shows zero-hour contracts not needed
    The abandonment of zero-hour contracts by Burger King is further evidence good employers do not need to use them, Labour’s spokesperson on Labour Issues Iain Lees-Galloway says. "Congratulations to the Unite Union and Burger King for settling an employment agreement… ...
    2 weeks ago
  • Kiwis deserve more than reheats
    The Government looks set to rely on regurgitated announcements for this year’s Budget if today’s speech is anything to go by, Labour Leader Andrew Little says. “National has been building up to this Budget for seven long years, promising a… ...
    2 weeks ago
  • Landlords not cashing in on insulation schemes
    The fact so few landlords have taken up the generous taxpayer subsidy for retrofitting shows it is time to legislate minimum standards, says Labour’s Associate Housing spokesperson Poto Williams. “Many landlords aren’t using Government insulation schemes because they don’t want… ...
    2 weeks ago
  • Zero excuses, end zero hour contracts now
    It’s time Workplace Relations Minister Michael Woodhouse cut the weasel words and banned zero hour contracts, Labour Leader Andrew Little says. “Michael Woodhouse today acknowledged zero hour contracts are unfair. ...
    2 weeks ago
  • We’ve reached Peak Key with ‘artificial target’
    John Key’s attempt to redefine his cornerstone promise of two election campaigns as an artificial target suggests his other promises are works of fiction, says Labour’s Finance spokesperson Grant Robertson. “For seven years and two election campaigns, John Key has… ...
    2 weeks ago
  • Top 10 need to know facts on climate change
    All the numbers and stats around climate change can be confusing, so we’ve put together a handy list of the top 10 numbers about climate change that we should all know- and then do something about. You can sign up here to… ...
    GreensBy Frog
    3 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere