web analytics
The Standard

Granny Herald: from flawed data, false conclusions

Written By: - Date published: 11:21 am, March 23rd, 2013 - 17 comments
Categories: john key, national, polls - Tags:

Three of the Herald’s political staff has a crack at trying to explain why National polled 48.5% in the latest Herald-Digipoll. Consensus seems to be that John Key’s an angel sent to earth to do very little but keep enough of the middle class happy enough who’ll never lose. May I humbly suggest an alternative theory – that the Herald-Digipoll is broken.

Danyl at the Dimpost has the most mathematically poll of polls that, crucially, is anchored in reality – ie the last election result. Whereas political commentators and pollsters seem to shamelessly ignore how badly their poll got it wrong at the last election when breathlessly reporting the latest numbers, the Dimpost poll of polls corrects for their error.

What the Dimpost poll shows is that:

a) the Herald Digi-poll consistently over measures National – for example, the final Herald poll before the last election had National on 50.9%, that’s outside the margin of error above the 47.3% they got. The final Herald poll in 2008 had National on 47.9%, they got 44.9%. Statistically, the Herald isn’t just missing the bullseye, it’s missing the dartboard altogether. Only the 3news poll is worse. (in the image below, the light blue line is the Herald trend, the dark one is the poll of polls trend).

Dimpost poll of polls highlighting Herald Digipoll

b) even the Herald poll shows that National has lost a significant amount of support. From a pre-election high of 54.2%, a final pre-election number of 50.9%, to 48.5% today. That’s a big drop. Adjust to the Herald’s 3% over-polling of National at the last two elections, and it signals National is at around 45% – in the range that the Dimpost poll of polls has it. Remember, the Right has a one-seat majority in the House. Losing 2-3% since the election, especially when Banks will never get back in, is no laughing matter for National. If it were to translate into an election result, it would mean National would need New Zealand First (or a very large wasted vote) to govern.

c) more regular polls, like the Roy Morgan show a clear downward trend for National. You can’t possibly draw a trend from the five data points in 17 months that the Herald provides because the statistical noise that results in variation between every poll can’t be sensibly separated from the trend when you have so little to work with. The Roy Morgan has polled 29 times in that period and its trend is clear. (incidentally, the Roy Morgan was also the most accurate for National in 2011).

roy morgan labour greens v nats 3

To look at the Herald poll and conclude that National is now more popular than at the election, you have to ignore the Herald’s record of over-polling National, the fact that National’s support in the Herald poll has fallen significantly since the election, and the fact that more reliable polling trends tell us the opposite.

Only if you make all these logical errors (and there’s a strong incentive to do so because our paper spent a lot of money on the poll, which means its going to be treated as gospel no matter what, goddammit), can you then conclude National’s rule continues unblemished thanks to Bonny Prince Grinny.

But when’s a few fallacies ever stopped Granny?

[Note: none of this should be taken as a ‘if these trends continue’ argument. One current accurate polling, the Left needs Winnie too making him Kingmaker and he would have much more incentive to go with National, and there’s the risk of a Shearer campaign meltdown too. Put National at 40% and I’ll be happier].

17 comments on “Granny Herald: from flawed data, false conclusions”

  1. Tiresias 1

    “Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: “There are three kinds of lies: lies, damned lies and statistics.”
    – Mark Twain’s Own Autobiography

    Presently Labour will only be picking up those sufficiently dismayed by National’s duplicities and incompetence not to want them in Government again. Labour will only start picking up genuine support when it starts presenting an alternative programme worth genuinely supporting, and six-weeks out from an election is far too late to start thinking of doing that.

  2. Bob Tambling 2

    The worry for me then is if the polling trends continue and it looks like Shearer can just get over the line the possibilty of changing the leader will further diminish and Shearer will fight the 2014 election.
    Unfortunetly during the ensuing campaign, Key and the Nats will crucify him and we will be left with a National Government or a very weak LAb /NZF /Green one term Goverment
    I wonder from a Green party prospective (and a leftish pespective) , would it not be better if the Labour Party lost the next election with Shearer as Leader?
    If NZF play a part as may be likely, the Green can’t afford to go into a NZF /Lab/Green Gov.
    Shearer simply won’t cut the mustard and Peters is toxic. It would be a crap government and the well honed National party machine would again tear it to shreds

    The leaves the Greens in an interesting position, the lure of ministerial positions versus the pragmatic long term strategy of the Greens. A one term Lab/Nzf/Green Gov seems to serve no ones interest.
    Labour needs to have a strong leadership team and comitted activists , The reality is they have a diminishing group of activists and a crap leadership.
    The Greens on the other hand have a very strong leadership team and an ever growing group of activists ( let us not forget they are the second biggest party in Wellington).
    Labour? I can’t think of anyone in the present caucus who could take most of the country with them in an election. They need a good clean out and new blood. They don’t appear to be listening to that line of argument.
    In conclusion:
    I am committed to working very hard to getting as many Green MP’s elected as I can in 2014. I am not so sure though if I want those MP’s in a Government with the current infighting mob of the Lab party who it seems “could not pour piss out of a boot if the directions were on the heel”.

  3. tc 4

    The more granny and her shills like Johnno, o’shillivan, rortney etc keep banging the NACT drum the more irrelevant and bias they show themselves to be.

    Labour needs to grow a pair and get out there now however with the mallarfia and their front man it seems it’ll come down to the hollowmen blowing it more so than Labour winning it.

    They could easily blag another term if they weren’t such psychos given the current state of the opposition, thankfully they are what they are.

  4. ghostrider888 5

    article in todays Herald acknowledges the popularity of Key is slipping

  5. pete 6

    “Only the 3news poll is worse.”

    That’s not quite true: all five polls overestimate National’s election results, and the Digipoll isn’t too much worse than Fairfax or Roy Morgan. One News Colmar Brunton, as well as 3 News Reid Research both overestimate by more than the Herald.

    • lprent 6.1

      Points to a systematic flaw in their sampling doesn’t it…

      • pete 6.1.1

        That’s one possible explanation, although some have theorised that National lose a lot of votes close to the election once people actually start looking at their policies.

        There’s also a theory that NZF underpolls because their voters are embarrassed to admit that to callers.

        • lprent 6.1.1.1

          Possible. But less likely than the simpler explanation.

          Canvassing companies are using listed landlines*. When I was analyzing some somewhat larger samples of both door-knock canvassing and phone canvassing across several electorates, there was a statistically significant correlation between people who canvassed right and left and if they had a listed landline.

          For that matter there was an even stronger correlation between age group and having a listed land line – and it looks like if people don’t have a listed phone line in their mid 20’s then they never get one.

          * There is a common myth that goes around about auto-dialing random numbers. Asked a few people who work at or have worked at polling companies. It doesn’t happen and a few minutes thought about number ranges will give an explanation about why. It is cheaper to buy/get a phone list.

  6. Chris 7

    So,will Granny Herald be ramping up lots of little good news, happy smiley,relaxed all singing, dancing reports/photos of our poor excuse for a pm then. Got to keep him relevant.

  7. Centaur 8

    Give Key *some* credit. He may decide to call it quits. It is not as if he actually needs this gig ..

  8. Murray Olsen 9

    I’m not even sure that the margins of error as reported are very meaningful at all. From what I know, they seem to rely on unbiased sampling and the validity of the Central Limit Theorem, which then leads to a percentage presumably taken from 100 times √N/N. The concern about landlines is just one thing that could skew this.

    • lprent 9.1

      They do sample distribution normalising for many of the other factors like age, gender and geological distribution. They don’t adjust for factors like people working during the periods that they phone.

      But they don’t publish their techniques and criteria so it is pretty hard to see why there if it was unbiased sampling there would be any differences between the polls within the confidence limits. But there clearly is.

      • Centaur 9.1.1

        lprent: geological distribution ?
        Such as, where there are proven mineral resources ?

        • lprent 9.1.1.1

          I blame the iPad, it’s overly smart autocorrect, and that I use Geological at least 10x more often than Geographical.

    • Lanthanide 9.2

      No, they’re not. Even assuming they are following absolutely perfect statistical methods and the statistical methods work as advertised by the literature, the margin of error they’re reporting is presumably the 95% confidence interval. Which means 1 out of 20 polls are going to be wrong, but we won’t ever be able to tell which one without some other corroborating information (eg other polls taken at the same time).

      That’s assuming they’re using perfect methods, which of course they aren’t.

Recent Comments

Recent Posts

  • Time for inquiry into petrol margins
    It’s time for an inquiry into petrol companies as margins are once again at the high levels that prompted concerns late last year, says Labour's Energy Spokesperson Stuart Nash. "Over the December January holiday period, petrol importer margins jumped to… ...
    15 hours ago
  • More talk as Auckland congestion worsens
    The main impact of the Government’s agreement with Auckland Council today will be simply to delay still further decisions needed to relieve the city’s traffic congestion, says Labour’s Auckland Issues Spokesperson, Phil Goff. “Government has been aware for more than… ...
    1 day ago
  • Serco inquiry extended
    A two month delay to the Government investigation into prison fight clubs shows the extent of problems within the Serco circus, says Labour’s Corrections spokesperson Kelvin Davis. “My office received a tsunami of complaints so I’m not surprised the terms… ...
    2 days ago
  • Truck Shops ignore consumer laws
    A damning Commerce Commission report out today highlights the failure of the Government to protect poor and vulnerable families from unscrupulous truck shops, says Labour’s Consumer Affairs Spokesperson David Shearer. “The report found that 31 out of 32 firms it… ...
    2 days ago
  • Taihoa at Ihumatao says Labour
    Labour’s housing spokesperson Phil Twyford has called on the Government to rethink its controversial Special Housing Area in Māngere. Auckland Council is today meeting to discuss the development which borders the Otuataua Stonefield Historic Reserve. This project is to get… ...
    2 days ago
  • Figures suggest National deliberately excluded farming
    Figures showing the dairy industry would be categorised as high risk if there were a further five severe injuries within a year, strongly suggests National designed its flawed system to deliberately exclude farming, Labour’s spokesperson for Labour Issues Iain Lees-Galloway… ...
    2 days ago
  • Bleak report on the state of our children
    A damning conclusion by the Children’s Commissioner today that ‘we don’t know if children are better off as a result of state intervention, but the indications are not good’ should make fixing CYFs a top priority for this Government, says… ...
    2 days ago
  • Dodgy data used to justify axing KiwiSaver kickstart
    National’s agenda to run down KiwiSaver has become even clearer from a scathing critique of the Government’s justification for axing the $1000 kickstart, says Labour’s Finance spokesperson Grant Robertson. “Since National came to power they have not only continually undermined… ...
    2 days ago
  • Unsecure website risks Ashley MoBIEson hack
    Experts have raised security concerns that vulnerabilities in MoBIE’s half million-dollar website could lead to a possible Ashley Maddison-style hack, says Labour’s Economic Development spokesperson David Clark. “The real issue here is not what data is immediately available, but what… ...
    2 days ago
  • Democracy still the loser in Canterbury
    The Government has demonstrated once again how arrogant and out of touch it is in denying Cantabrians the same democratic rights as the rest of the country, says Labour’s Environment spokesperson Megan Woods.  “The Environment Canterbury Bill which has been… ...
    2 days ago
  • Waiver cost still a mystery
    The Government still has no idea what it’s going to cost community and voluntary groups to get a waiver from the fees police will charge to carry out checks on their staff and volunteers, says Labour’s Community and Voluntary spokesperson… ...
    3 days ago
  • China exports fall 27 per cent in a year
    Exports to China have fallen by 27 per cent over the last 12 months - showing that the looming economic slowdown should have been expected by the Government, says Labour’s Economic Development Spokesperson David Clark. “The Chinese economic slowdown should… ...
    3 days ago
  • National should support all families for 26 weeks
    Families with multiple babies, and those born prematurely or with disabilities, are the winners from moves to extend paid parental leave to 26 weeks but the Government must give all babies the same head start in life, Labour’s spokesperson for… ...
    3 days ago
  • National’s health and safety shambles puts school camps at risk
    Reports that schools are considering scrapping student camps and tearing out playgrounds highlights just how badly National has managed its health and safety reforms, Labour’s Education spokesperson Chris Hipkins says. “Schools have been left completely in the dark about the… ...
    3 days ago
  • National’s asset stripping agenda hits schools
    National’s fire-sale of school houses and land is short-sighted, mean-spirited, and will have huge unintended consequences that we will pay for in years to come, Labour’s Education spokesperson Chris Hipkins says. Documents obtained by Labour show the Ministry of Education… ...
    3 days ago
  • Takahe massacre supposed to get all New Zealanders involved in conservation
    The Minister’s claim that a  botched cull of one of New Zealand’s rarest birds was a way of getting all New Zealanders involved in conservation is offensive and ludicrous, Labour’s conservation spokesperson Ruth Dyson says.  “An email from Minister Maggie… ...
    3 days ago
  • Serco circus rolls on with revelations of fight club practice
    Further revelations that a Serco prison guard was coaching inmates on fight club techniques confirms a fully independent inquiry needs to take place, says Labour’s Corrections spokesperson Kelvin Davis. “The Minister’s statement today that a guard was coaching sparring techniques… ...
    3 days ago
  • Government targets put ahead of students’ education
    The Government must urgently reassess the way it sets NCEA targets after a new report found they are forcing schools to “credit farm” and are undermining the qualification, Labour’s Education spokesperson Chris Hipkins says. “A PPTA report released today says… ...
    3 days ago
  • ER patients in corridors as health cuts bite
    Patients are being forced to wait for hours on beds in corridors as cash strapped hospitals struggle to keep up with budget cuts, says Labour’s Health spokesperson Annette King. “People coming to the emergency room and being forced to wait… ...
    4 days ago
  • Not too late to fix Health and Safety for New Zealand’s workers
    The Government and its minor party supporters are showing an arrogant disregard for workers’ lives by not agreeing to a cross-party solution to the botched Health and Safety bill, Opposition leader Andrew Little says. “Yesterday I wrote to the Prime… ...
    4 days ago
  • Speech to the New Zealand Council of Infrastructure Development
    Tēnā Kotou Katoa. Thank you so much for having me along to speak today. Can I begin by acknowledging John Rae, the President, and Stephen Selwood, the chief executive of the Council for Infrastructure Development. ...
    4 days ago
  • Reserve Bank points finger at Govt inaction
    In scathing criticism of the Government’s inaction, the Reserve Bank says Auckland housing supply is growing nowhere near fast enough to make a dent the housing shortage, Labour’s Housing spokesperson Phil Twyford says. Reserve Bank deputy governor Grant Spencer today… ...
    4 days ago
  • Chickens come home to roost on climate change
    The Government’s gutting of the Emissions Trading Scheme has caused foresters to leave and emissions to rise, says Labour’s Climate Change spokesperson Megan Woods. “The release of the Environmental Protection Agency’s Facts and Figures Report for 2014 on the ETS… ...
    5 days ago
  • Website adds to long list of big spends at MBIE
    The Ministry of Business, Innovation and Employment’s $560,000 outlay on its new website is further evidence of excessive spending by Steven Joyce on his pet project super ministry, Labour’s Economic Development spokesperson David Clark says.  “Hot on the heels of… ...
    5 days ago
  • Brownlee warned over EQC repairs but ignored them
    Gerry Brownlee was warned that EQC’s underfloor repairs weren’t being done properly by industry experts, the cross party working group and in public but he arrogantly ignored them all, says Labour’s Earthquake Commission spokesperson Clayton Cosgrove.  “Today’s apology and commitment… ...
    5 days ago
  • Serco wants in on state house sell off
    The Government must keep scandal plagued outsourcing company Serco away from our state housing after their disastrous record running Mt Eden prison, Labour’s Housing spokesperson Phil Twyford says. "Today it has emerged that at the same time Serco was under… ...
    6 days ago
  • Come clean on Pasifika education centre
    Minister Peseta Sam Lotu-Iinga needs to come clean and tell the Pasifika communities if he’s working to save the Pasifika Education Centre or shut it down, Labour’s Pasifika spokesperson Su’a William Sio says.  “I’m gutted the Pasifika Education Centre funding… ...
    1 week ago
  • Time for NZTA to work on alternatives to flyover
    The High Court decision rejecting the New Zealand Transport Agency’s attempts to build the Basin Reserve flyover must now mean that NZTA finally works with the community on other options for transport solutions in Wellington, Grant Robertson and Annette King… ...
    1 week ago
  • Shiny new system leads to record truancy
    Record high truancy rates shows the Government’s much-vaunted new attendance system is an abysmal failure, Labour’s Education spokesperson Chris Hipkins says. “Data released today shows truancy rates have spiked more than 15 per cent in 2014 and are now at… ...
    1 week ago
  • Woodhouse wrong about quarries
      The Minister for Workplace Relations and Safety Michael Woodhouse was wrong yesterday when he said limestone quarries were covered by the farcical Health and Safety legislation, says Labour’s Associate Labour spokesperson Sue Moroney.  “He said he ‘understood’ limestone quarries… ...
    1 week ago
  • Taxpayers money spent on culling one of our rarest birds
    It beggars belief that four endangered takahe were killed by incompetent cullers contracted to the Department of Conservation and the Minister must explain this wanton destruction, says Conservation spokesperson Ruth Dyson. “It must not be forgotten that there are only… ...
    1 week ago
  • Housing NZ must immediately move family
    Housing New Zealand must immediately move a Glen Innes family whose son contracted serious and potentially fatal health problems from the appalling condition of their state house, Labour’s Housing spokesperson Phil Twyford says. “Te Ao Marama Wensor and community workers… ...
    1 week ago
  • No understanding of the value of overseas investment
     The Government has now admitted it has absolutely no idea of the actual value of foreign investment in New Zealand, says Labour’s Land Information spokesperson Stuart Nash.  “It is crucial that the Government starts to understand just what this overseas… ...
    1 week ago
  • Another bridges bribe from Simon Bridges
    Simon Bridges is embroiled in another bridges-for-votes controversy after admitting funding for a replacement bridge in Queenstown is “very much about… the 2017 election”, Labour’s Transport spokesperson Phil Twyford says. “The Transport Minister is today reported as telling Queenstown locals… ...
    1 week ago
  • Saudi tender process reeks of SkyCity approach
    The tender process for the $6m investment in a Saudi sheep farm reeks like the SkyCity convention centre deal and once again contravenes the government’s own procurement rules, says Labour’s Export Growth and Trade spokesperson David Parker. “The $6m contract… ...
    1 week ago
  • Maori Party should stand up for workers
    The Government’s proposed Health and Safety Reform Bill does not go far enough to protect those in specific industries with the highest rates of workplace deaths, says Maori Development Spokesperson Nanaia Mahuta. “We are told that Maori workers are more… ...
    1 week ago
  • Minister must explain budget blowout
    Māori Development Minister Te Ururoa Flavell must explain a budget blow out at Te Puni Kokiri, after the organisation spent more than 2.5 million dollars over their budget for contractors, says Labour’s Associate Māori Development spokesperson Peeni Henare.  “For the… ...
    1 week ago
  • Successful effort to raise the issue of GE trees in proposed standard
    Many thousands of people submitted on the proposed National Environmental Standard –  Plantation Forestry (NES-PF).  A vast majority of the public submissions were particularly focussed on the NES having included GE trees in its mandate. People want these provisions removed,… ...
    GreensBy Steffan Browning MP
    1 week ago
  • Fair Share Friday – Thoughts and Reflections
    As part of our Fair Share  campaign, Green MPs have been doing a series of visits to community groups across the country to have conversations about inequality in New Zealand and what communities are experiencing on the ground. I visited… ...
    GreensBy Denise Roche MP
    1 week ago
  • Crucial Auditor General investigation welcomed
    The Auditor General’s decision to investigate the Saudi sheep scandal is important, necessary and welcome, Labour’s Trade and Export Growth spokesperson David Parker says. “The independent functions of the Auditor General are a cornerstone of the New Zealand system of… ...
    2 weeks ago
  • KiwiSaver sign-ups continue to fall
    New KiwiSaver sign-ups in July were 45 per cent below the monthly average, despite John Key saying axing the kickstart “will not make a blind bit of difference to the number of people who join KiwiSaver”, says Labour’s Finance spokesperson… ...
    2 weeks ago
  • Contact bows to pressure
    Contact Energy’s decision to cut its pre-pay rates to be in line with its customers who pay monthly is good news and the company deserves credit for responding so quickly, says Labour’s Consumer Affairs Spokesperson David Shearer.  “Two months ago… ...
    2 weeks ago
  • I’m pushing for a ‘fair go’ for solar
    My Fair Go For Solar Bill was pulled from the Members’ Ballot last week and is set for a vote in Parliament. In this blog post I explain some of the background to the bill and how it aims to… ...
    GreensBy Gareth Hughes MP
    2 weeks ago
  • Key must explain why Health and Safety Bill pulled
    John Key must explain why his Government is delaying the Health and Safety Bill when Pike River families have travelled to Wellington specifically to register their opposition, Opposition Leader Andrew Little says. “Yesterday afternoon John Key suggested the bill may… ...
    2 weeks ago
  • Diving for sustainable scallops
    Last week, there were calls for scallop dredging to be banned in the Marlborough Sounds, following scientific report saying that 70% of the Sounds had been lost from dredging, trawling, and sedimentation from forestry. At the same time we see… ...
    GreensBy Steffan Browning MP
    2 weeks ago
  • Backdown whiff in state house leasing option
    Bill English’s admission that the Government is looking at leasing large numbers of state houses to non-government providers has the whiff of a backdown, Labour’s Housing spokesperson Phil Twyford says. “This is an acknowledgement by Bill English that he has… ...
    2 weeks ago
  • Housing crisis downgrade threatening banking sector
    The out of control Auckland housing market is now threatening the banking sector, with Standard and Poor’s downgrading the credit rating of our banks out of fear of the bubble bursting, Labour’s Finance spokesperson Grant Robertson says. “Today we have… ...
    2 weeks ago
  • Good money after bad for failed experiment
    The National government are throwing good money after bad with their decision to pump even more funding into their failed charter school experiment, Labour’s Education spokesperson Chris Hipkins says.  “There are already major problems with several of the first charter… ...
    2 weeks ago
  • National borrows Labour’s idea on urban development
    Labour's Associate Environment spokesperson Phil Twyford says he welcomes the Government's adoption of Labour's policy for a National Policy Statement on urban development, and has called on the Government to take up Labour's offer to work together on these issues.… ...
    2 weeks ago
  • Toothless OIO never refused a single farmland sale
    The Overseas Investment Office has approved more than 290 consents from foreign investors to buy sensitive land in New Zealand, but has not turned down a single application says Labour’s Land Information spokesperson Stuart Nash  “The Minister of Land information,… ...
    2 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere