web analytics
The Standard

Granny Herald: from flawed data, false conclusions

Written By: - Date published: 11:21 am, March 23rd, 2013 - 17 comments
Categories: john key, national, polls - Tags:

Three of the Herald’s political staff has a crack at trying to explain why National polled 48.5% in the latest Herald-Digipoll. Consensus seems to be that John Key’s an angel sent to earth to do very little but keep enough of the middle class happy enough who’ll never lose. May I humbly suggest an alternative theory – that the Herald-Digipoll is broken.

Danyl at the Dimpost has the most mathematically poll of polls that, crucially, is anchored in reality – ie the last election result. Whereas political commentators and pollsters seem to shamelessly ignore how badly their poll got it wrong at the last election when breathlessly reporting the latest numbers, the Dimpost poll of polls corrects for their error.

What the Dimpost poll shows is that:

a) the Herald Digi-poll consistently over measures National – for example, the final Herald poll before the last election had National on 50.9%, that’s outside the margin of error above the 47.3% they got. The final Herald poll in 2008 had National on 47.9%, they got 44.9%. Statistically, the Herald isn’t just missing the bullseye, it’s missing the dartboard altogether. Only the 3news poll is worse. (in the image below, the light blue line is the Herald trend, the dark one is the poll of polls trend).

Dimpost poll of polls highlighting Herald Digipoll

b) even the Herald poll shows that National has lost a significant amount of support. From a pre-election high of 54.2%, a final pre-election number of 50.9%, to 48.5% today. That’s a big drop. Adjust to the Herald’s 3% over-polling of National at the last two elections, and it signals National is at around 45% – in the range that the Dimpost poll of polls has it. Remember, the Right has a one-seat majority in the House. Losing 2-3% since the election, especially when Banks will never get back in, is no laughing matter for National. If it were to translate into an election result, it would mean National would need New Zealand First (or a very large wasted vote) to govern.

c) more regular polls, like the Roy Morgan show a clear downward trend for National. You can’t possibly draw a trend from the five data points in 17 months that the Herald provides because the statistical noise that results in variation between every poll can’t be sensibly separated from the trend when you have so little to work with. The Roy Morgan has polled 29 times in that period and its trend is clear. (incidentally, the Roy Morgan was also the most accurate for National in 2011).

roy morgan labour greens v nats 3

To look at the Herald poll and conclude that National is now more popular than at the election, you have to ignore the Herald’s record of over-polling National, the fact that National’s support in the Herald poll has fallen significantly since the election, and the fact that more reliable polling trends tell us the opposite.

Only if you make all these logical errors (and there’s a strong incentive to do so because our paper spent a lot of money on the poll, which means its going to be treated as gospel no matter what, goddammit), can you then conclude National’s rule continues unblemished thanks to Bonny Prince Grinny.

But when’s a few fallacies ever stopped Granny?

[Note: none of this should be taken as a ‘if these trends continue’ argument. One current accurate polling, the Left needs Winnie too making him Kingmaker and he would have much more incentive to go with National, and there’s the risk of a Shearer campaign meltdown too. Put National at 40% and I’ll be happier].

17 comments on “Granny Herald: from flawed data, false conclusions”

  1. Tiresias 1

    “Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: “There are three kinds of lies: lies, damned lies and statistics.”
    – Mark Twain’s Own Autobiography

    Presently Labour will only be picking up those sufficiently dismayed by National’s duplicities and incompetence not to want them in Government again. Labour will only start picking up genuine support when it starts presenting an alternative programme worth genuinely supporting, and six-weeks out from an election is far too late to start thinking of doing that.

  2. Bob Tambling 2

    The worry for me then is if the polling trends continue and it looks like Shearer can just get over the line the possibilty of changing the leader will further diminish and Shearer will fight the 2014 election.
    Unfortunetly during the ensuing campaign, Key and the Nats will crucify him and we will be left with a National Government or a very weak LAb /NZF /Green one term Goverment
    I wonder from a Green party prospective (and a leftish pespective) , would it not be better if the Labour Party lost the next election with Shearer as Leader?
    If NZF play a part as may be likely, the Green can’t afford to go into a NZF /Lab/Green Gov.
    Shearer simply won’t cut the mustard and Peters is toxic. It would be a crap government and the well honed National party machine would again tear it to shreds

    The leaves the Greens in an interesting position, the lure of ministerial positions versus the pragmatic long term strategy of the Greens. A one term Lab/Nzf/Green Gov seems to serve no ones interest.
    Labour needs to have a strong leadership team and comitted activists , The reality is they have a diminishing group of activists and a crap leadership.
    The Greens on the other hand have a very strong leadership team and an ever growing group of activists ( let us not forget they are the second biggest party in Wellington).
    Labour? I can’t think of anyone in the present caucus who could take most of the country with them in an election. They need a good clean out and new blood. They don’t appear to be listening to that line of argument.
    In conclusion:
    I am committed to working very hard to getting as many Green MP’s elected as I can in 2014. I am not so sure though if I want those MP’s in a Government with the current infighting mob of the Lab party who it seems “could not pour piss out of a boot if the directions were on the heel”.

  3. tc 4

    The more granny and her shills like Johnno, o’shillivan, rortney etc keep banging the NACT drum the more irrelevant and bias they show themselves to be.

    Labour needs to grow a pair and get out there now however with the mallarfia and their front man it seems it’ll come down to the hollowmen blowing it more so than Labour winning it.

    They could easily blag another term if they weren’t such psychos given the current state of the opposition, thankfully they are what they are.

  4. ghostrider888 5

    article in todays Herald acknowledges the popularity of Key is slipping

  5. pete 6

    “Only the 3news poll is worse.”

    That’s not quite true: all five polls overestimate National’s election results, and the Digipoll isn’t too much worse than Fairfax or Roy Morgan. One News Colmar Brunton, as well as 3 News Reid Research both overestimate by more than the Herald.

    • lprent 6.1

      Points to a systematic flaw in their sampling doesn’t it…

      • pete 6.1.1

        That’s one possible explanation, although some have theorised that National lose a lot of votes close to the election once people actually start looking at their policies.

        There’s also a theory that NZF underpolls because their voters are embarrassed to admit that to callers.

        • lprent 6.1.1.1

          Possible. But less likely than the simpler explanation.

          Canvassing companies are using listed landlines*. When I was analyzing some somewhat larger samples of both door-knock canvassing and phone canvassing across several electorates, there was a statistically significant correlation between people who canvassed right and left and if they had a listed landline.

          For that matter there was an even stronger correlation between age group and having a listed land line – and it looks like if people don’t have a listed phone line in their mid 20’s then they never get one.

          * There is a common myth that goes around about auto-dialing random numbers. Asked a few people who work at or have worked at polling companies. It doesn’t happen and a few minutes thought about number ranges will give an explanation about why. It is cheaper to buy/get a phone list.

  6. Chris 7

    So,will Granny Herald be ramping up lots of little good news, happy smiley,relaxed all singing, dancing reports/photos of our poor excuse for a pm then. Got to keep him relevant.

  7. Centaur 8

    Give Key *some* credit. He may decide to call it quits. It is not as if he actually needs this gig ..

  8. Murray Olsen 9

    I’m not even sure that the margins of error as reported are very meaningful at all. From what I know, they seem to rely on unbiased sampling and the validity of the Central Limit Theorem, which then leads to a percentage presumably taken from 100 times √N/N. The concern about landlines is just one thing that could skew this.

    • lprent 9.1

      They do sample distribution normalising for many of the other factors like age, gender and geological distribution. They don’t adjust for factors like people working during the periods that they phone.

      But they don’t publish their techniques and criteria so it is pretty hard to see why there if it was unbiased sampling there would be any differences between the polls within the confidence limits. But there clearly is.

      • Centaur 9.1.1

        lprent: geological distribution ?
        Such as, where there are proven mineral resources ?

        • lprent 9.1.1.1

          I blame the iPad, it’s overly smart autocorrect, and that I use Geological at least 10x more often than Geographical.

    • Lanthanide 9.2

      No, they’re not. Even assuming they are following absolutely perfect statistical methods and the statistical methods work as advertised by the literature, the margin of error they’re reporting is presumably the 95% confidence interval. Which means 1 out of 20 polls are going to be wrong, but we won’t ever be able to tell which one without some other corroborating information (eg other polls taken at the same time).

      That’s assuming they’re using perfect methods, which of course they aren’t.

Recent Comments

Recent Posts

  • Mainfreight ‘appalled’ by Government’s rail madness
    The Government has been given a serve by New Zealand-based international trucking and logistics firm Mainfreight which says it lacks a national transport strategy, and has treated rail badly, Labour's Transport spokesperson Phil Twyford says. The company has told shareholders it… ...
    15 hours ago
  • National’s Health and Safety Reform Bill: less safety and fewer rights at...
    The New Zealand Council of Trade Unions is embarking on a campaign to fight the changes that weaken the Health and Safety Reform bill. As part of the campaign the CTU has organised vigils with the display of 291 crosses… ...
    GreensBy Denise Roche MP
    17 hours ago
  • All options need to be put on meat sector table
    Farmers must be given every assurance that all potential risks have been considered before Silver Fern Farms opens its door to foreign equity, Labour’s Primary Industries spokesperson Damien O’Connor says. “The ongoing saga involving the meat sector and amalgamation has… ...
    20 hours ago
  • Flag the referendum if 50% or more don’t vote
    Labour has moved to have the second flag referendum canned if the first attracts fewer than half the eligible number of voters, Opposition Leader Andrew Little says. “John Key has already wasted more than $8 million on his vanity project… ...
    20 hours ago
  • 90,000 cars reclassified in botched ACC ratings
    New figures obtained by Labour show the ACC Minister’s botched motor vehicle levy system has resulted in 90,000 vehicles having to be reclassified so far – at a cost of $6 million, Labour’s ACC spokesperson Sue Moroney says. “Nikki Kaye’s… ...
    23 hours ago
  • Brutal health cuts confirmed, crucial services suffer
    Chronic under-funding by National has seen the health budget slashed by $1.7 billion in just five years, Labour’s Health spokesperson Annette King says. A report by Infometrics, commissioned by Labour, shows health funding has been cut in four of the… ...
    2 days ago
  • Meth ring under Serco’s nose
    The news that two Serco inmates have been arrested for helping to run a methamphetamine ring from prison should be the final straw and see their contract cancelled, says Labour’s Corrections Spokesperson Kelvin Davis. “National has stood by Serco despite… ...
    2 days ago
  • Ministers failing women and their own targets
    New figures showing just five Ministers have met the Government’s own reduced targets for appointing women to state sector boards is evidence National is failing Kiwi women, Labour’s Women’s Affairs spokesperson Sue Moroney says. “The Ministry for Women’s 2015 Gender… ...
    2 days ago
  • Charges up for some as funding up for grabs
    A proposal being considered by the Government would see some people having to pay more for health care and district health boards forced to fight amongst themselves to fund regional health services, Labour’s Health spokesperson Annette King says “Information leaked… ...
    2 days ago
  • Stop experimenting on kids
    The trouble with the Charter school model is that it is a publicly funded experiment on children. The National Government has consistently put its desire to open charter schools ahead of the safety of the children in them, ignoring repeated… ...
    GreensBy Catherine Delahunty MP
    3 days ago
  • Bank puts the squeeze on mid Canterbury farmers
    News that an unnamed bank in Ashburton has put a receiver on notice over financially vulnerable farmers will send a chill through rural New Zealand, says Labour’s Finance Spokesperson Grant Robertson. “The Government needs to work with  New Zealand’s banks… ...
    3 days ago
  • Key is trading away New Zealand land and homes
    John Key yesterday admitted what National dishonestly refused to confirm in Parliament last week – he is trading away New Zealand’s right to control who buys our homes and land, says Opposition leader Andrew Little. “The Prime Minister must now… ...
    3 days ago
  • Razor gang takes scalpel to health
    Plans by the Government to take a scalpel to democratically elected health boards are deceitful and underhand, coming just months after an election during which they were never signalled, Labour’s Health spokesperson Annette King says “Leaked documents reveals a radical… ...
    3 days ago
  • Spin lines show a department in chaos
    Corrections Spin Doctors sending their place holder lines to journalists instead of responding to serious allegations shows the scale of chaos at the department over the Serco scandal, says Labour’s Corrections Spokesperson Kelvin Davis. “As more and more serious allegations… ...
    5 days ago
  • Court ruling shows law should never have been passed
    A High Court ruling that a law banning prisoners from voting is inconsistent with a properly functioning democracy should be a wake-up call for the Government, Labour’s Justice spokesperson Jacinda Ardern says. In an unprecedented ruling Justice Paul Heath has… ...
    6 days ago
  • Judicial Review Gamble Pays Off for Problem Gambling Foundation
    Congratulations are due to the Problem Gambling Foundation (PGFNZ) who have won their legal case around how the Ministry of Health decided to award their contracts for problem gambling services to another service provider. Congratulations are due not just for… ...
    GreensBy Denise Roche MP
    6 days ago
  • Environmental Protection Agency appoints GE advocate as new CEO
    This week, the Environmental Protection Authority Amendment Bill passed its first reading in Parliament. The Bill puts protection of the environment into the core purpose of the Environmental Protection Authority. This month, Dr Allan Freeth, the former Chief Executive of… ...
    GreensBy Steffan Browning MP
    6 days ago
  • Charanpreet Dhaliwal death demands genuine health and safety reform
    The killing of a security guard on his first night on the job is exactly the kind of incident that National’s watered-down health and safety bill won’t prevent, says Te Atatu MP Phil Twyford. The coronial inquest into 22-year-old Charanpreet… ...
    6 days ago
  • Arbitrary sanctions hit children hardest
    Increasing numbers of single parents are being penalised under a regime that is overly focussed on sanctions rather than getting more people into work, Labour’s Social Development spokesperson Carmel Sepuloni says. “Figures, obtained through Parliamentary questions show 3000 more sanctions,… ...
    6 days ago
  • Hekia just won’t face the facts
    Hekia Parata’s decision to keep troubled Whangaruru Charter school open despite being presented with a catalogue of failure defies belief, goes against official advice and breaks a Government promise to close these schools if they were failing, says Labour’s Education… ...
    6 days ago
  • No more silent witnesses
    Yesterday I attended the launch of a new initiative developed by and for Asian, Middle eastern and African youth to support young people to name and get support if there is domestic violence at home. The impact on children of… ...
    GreensBy Jan Logie MP
    6 days ago
  • Single Use Plastic Bags campaign – Some wins and some green-washing
    As we near the end of Plastic Free July I’m nearing the conclusion of my Say No To Plastic Bag tour when I will have completed all 30 of my public meetings. The campaign was designed to work with community… ...
    GreensBy Denise Roche MP
    6 days ago
  • Single Use Plastic Bags campaign – Some wins and some green-washing
    As we near the end of Plastic Free July I’m nearing the conclusion of my Say No To Plastic Bag tour when I will have completed all 30 of my public meetings. The campaign was designed to work with community… ...
    GreensBy Denise Roche MP
    6 days ago
  • Minister must take responsibility for problem gambling debacle
    The Government’s handling of the Problem Gambling Foundation’s axing in a cost-cutting exercise has been ham-fisted and harmful to some of the most vulnerable people in society, Associate Health Labour spokesperson David Clark says.“Today’s court ruling overturning the axing of… ...
    7 days ago
  • Labour will not support TPP if it undermines NZ sovereignty
    The Labour Party will not support the Trans Pacific Partnership Agreement unless key protections for New Zealanders are met, Opposition leader Andrew Little says.“Labour supports free trade. However, we will not support a TPP agreement that undermines New Zealand’s sovereignty. ...
    7 days ago
  • Coleman can’t ignore latest warnings
    Resident doctors have advised that a severe staffing shortage at North Shore Hospital is putting patients’ lives at risk, Labour’s Health spokesperson Annette King says. “They say a mismatch between staffing levels and patient workloads at North Shore has… ...
    7 days ago
  • ACC must remove barriers to appeals
    The Government must prioritise removing barriers to justice for ACC claimants following a damning report by Acclaim Otago, Labour’s ACC spokesperson Sue Moroney says. “ACC Minister Nikki Kaye must urgently scrap her flawed plan to remove claimant’s right to redress… ...
    7 days ago
  • Six months’ paid parental leave back on the agenda
    Six months’ paid parental leave is back on the agenda and a step closer to reality for Kiwi parents after Labour’s new Member’s Bill was pulled from today’s ballot, the Bill’s sponsor and Labour MP Sue Moroney says. “My Bill… ...
    7 days ago
  • Sole parents at risk of having no income
    New requirements for sole parents to undertake a reapplication process after a year is likely to mean a large number will face benefit cancellations, but not because they have obtained work, Labour’s Social Development spokesperson Carmel Sepuloni says. “Increasing numbers… ...
    7 days ago
  • Juking the Welfare Stats Again
    Last week the government’s major initiative to combat child poverty (a paltry $25 increase) was exposed for what it is, a lie. The Government, through the Budget this year, claims to be engaging in the child poverty debate, but instead,… ...
    GreensBy Jan Logie MP
    1 week ago
  • OCR rate cut a result of flagging economy
    The Reserve Bank's decision to cut the Official Cash Rate to 3 per cent shows there is no encore for the so-called 'rock star' economy, says Labour's Finance Spokesperson Grant Robertson.   "Today's interest rate cut comes off the back… ...
    1 week ago
  • Reboot to an innovation economy, an Internet economy and a clean economy
    In my short 33 years on this planet we’ve seen phenomenal technological, economic and social change, and it’s realistic to expect the next 33 will see even more, even faster change. You can see it in the non-descript warehouse near… ...
    GreensBy Gareth Hughes MP
    1 week ago
  • Bill that puts the environment into the EPA passes first hurdle
    A Bill that puts the environment squarely into legislation governing the Environmental Protection Authority passed its first reading today, says Meka Whaitiri.  “I introduced this member’s bill as the current law doesn’t actually make protecting the environment a goal of… ...
    1 week ago
  • Key’s KiwiSaver deception exposed
    KiwiSaver statistics released today expose John Key's claim that the cutting of the kickstart payment "will not make a blind bit of difference to the number of people who join KiwiSaver” to be duplicitous, says Labour Finance Spokesperson Grant Robertson.  “Official… ...
    1 week ago
  • Minimum Wage Amendment Bill to protect contractors
    All New Zealanders should be treated fairly at work. Currently, the law allows non-employment relationships to be used to get around the minimum wage. This is unfair, says Labour MP David Parker. “The Minimum Wage (Contractor Remuneration) Amendment Bill, a… ...
    1 week ago
  • Bill raises bar to protect Kiwi farmland
    The Government’s rubber-stamping of every one of the nearly 400 applications from overseas investors to buy New Zealand farm land over the last three years proves tougher laws are needed, Labour MP Phil Goff says. “In the last term of… ...
    1 week ago
  • Costly flag referendum should be dumped
    John Key must ditch the flag referendum before any more taxpayer money is wasted, Opposition Leader Andrew Little says. “Millions of dollars could be saved if the Prime Minister called a halt to this hugely expensive, and highly unpopular, vanity… ...
    1 week ago
  • Nats letting Serco off scot free
    Government members have prevented Parliament’s Law and Order select committee from getting answers out of a senior Serco director about the fight clubs being run at Mt Eden prisons, says Labour’s Corrections Spokesperson Kelvin Davis. “At today’s Law and Order… ...
    1 week ago
  • Charter school experiment turns into shambles
    The National Government’s charter school experiment has descended into chaos and it’s time for Hekia Parata to stop trying to cover up the full extent of the problems, Labour’s Education spokesperson Chris Hipkins says. “The Education Minister must release all… ...
    1 week ago
  • Disconnect between rates and income must be fixed
    Local Government New Zealand’s 10 Point Plan is a chance to stop the widening chasm between the rates some households are charged and their ability to pay, Labour’s Local Government spokesperson Su’a William Sio says. “There is a huge disconnect… ...
    1 week ago
  • Parole and ‘surviving the first year’
    “Intensive psychological treatment and early release to parole is far more effective at reducing reoffending among high risk prisoners than serving out the full prison sentence.” That’s reportedly the finding of Surviving the First Year, a recently-released study into Corrections’… ...
    GreensBy David Clendon MP
    1 week ago
  • Parole and ‘surviving the first year’
    “Intensive psychological treatment and early release to parole is far more effective at reducing reoffending among high risk prisoners than serving out the full prison sentence.” That’s reportedly the finding of Surviving the First Year, a recently-released study into Corrections’… ...
    GreensBy David Clendon MP
    1 week ago
  • If it’s good enough for Lake Taupō…
    Nick Smith supports helping farmers transition away from dairying and agrees we must set nitrogen caps that limit the number of animals on farms. He says this strategy is “world leading”. However we need action and pressure from him, on to… ...
    GreensBy Catherine Delahunty MP
    1 week ago
  • The importance of swamp kauri for climate research
    As early as 2010, international climate scientists were expressing concern at the rate of ancient swamp kauri extraction in Northland. Swamp kauri provides one of the best sources in the world for measuring climate fluctuations over the last 30,000 years.… ...
    GreensBy Eugenie Sage MP
    1 week ago
  • Govt needs to heed warnings on med students
    The Government is being urged to act on advice it has received about the negative impact its seven year study cap will have on hundreds of medical students, Labour’s Health spokesperson Annette King says. “The 7EFTS lifetime limit unfairly disadvantages… ...
    1 week ago
  • Ministers at sea over overseas buyers register
    The Prime Minister and three of his ministers are at odds over the collection of information about offshore speculators buying our houses and seem to be making things up as they go, Labour’s Housing spokesperson Phil Twyford says. “John Key… ...
    1 week ago
  • Time for Key to ditch the King Canute routine
    With the economic mood in New Zealand souring, it is time for John Key to admit reality and drop the King Canute approach, says Labour’s Finance spokesperson Grant Robertson.  “John Key is claiming that 95 per cent of the economy… ...
    1 week ago
  • Botched contract leads to charter school rort
    A botched Government contract has allowed an Auckland charter school to double dip by getting funding for students it has accommodated for free, Labour’s Education spokesperson Chris Hipkins says. “Information received by Labour through written Parliamentary questions show the Ministry… ...
    1 week ago
  • Flawed system costs $3 million and counting
    New figures obtained* by Labour show the Government’s shambolic ACC car registration levy system has cost more than $3 million to implement and the costs are set to escalate, Labour's ACC spokesperson Sue Moroney says. “That’s $3 million that could… ...
    1 week ago
  • Radio NZ facing death by 1000 cuts
    The National Government’s seven year funding freeze on Radio New Zealand has put its vital public broadcasting services in serious jeopardy, Labour’s Broadcasting spokesperson Clare Curran says. "The axing of 20 jobs at our only publicly funded broadcaster shows the… ...
    2 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere