web analytics
The Standard

Granny Herald: from flawed data, false conclusions

Written By: - Date published: 11:21 am, March 23rd, 2013 - 17 comments
Categories: john key, national, polls - Tags:

Three of the Herald’s political staff has a crack at trying to explain why National polled 48.5% in the latest Herald-Digipoll. Consensus seems to be that John Key’s an angel sent to earth to do very little but keep enough of the middle class happy enough who’ll never lose. May I humbly suggest an alternative theory – that the Herald-Digipoll is broken.

Danyl at the Dimpost has the most mathematically poll of polls that, crucially, is anchored in reality – ie the last election result. Whereas political commentators and pollsters seem to shamelessly ignore how badly their poll got it wrong at the last election when breathlessly reporting the latest numbers, the Dimpost poll of polls corrects for their error.

What the Dimpost poll shows is that:

a) the Herald Digi-poll consistently over measures National – for example, the final Herald poll before the last election had National on 50.9%, that’s outside the margin of error above the 47.3% they got. The final Herald poll in 2008 had National on 47.9%, they got 44.9%. Statistically, the Herald isn’t just missing the bullseye, it’s missing the dartboard altogether. Only the 3news poll is worse. (in the image below, the light blue line is the Herald trend, the dark one is the poll of polls trend).

Dimpost poll of polls highlighting Herald Digipoll

b) even the Herald poll shows that National has lost a significant amount of support. From a pre-election high of 54.2%, a final pre-election number of 50.9%, to 48.5% today. That’s a big drop. Adjust to the Herald’s 3% over-polling of National at the last two elections, and it signals National is at around 45% – in the range that the Dimpost poll of polls has it. Remember, the Right has a one-seat majority in the House. Losing 2-3% since the election, especially when Banks will never get back in, is no laughing matter for National. If it were to translate into an election result, it would mean National would need New Zealand First (or a very large wasted vote) to govern.

c) more regular polls, like the Roy Morgan show a clear downward trend for National. You can’t possibly draw a trend from the five data points in 17 months that the Herald provides because the statistical noise that results in variation between every poll can’t be sensibly separated from the trend when you have so little to work with. The Roy Morgan has polled 29 times in that period and its trend is clear. (incidentally, the Roy Morgan was also the most accurate for National in 2011).

roy morgan labour greens v nats 3

To look at the Herald poll and conclude that National is now more popular than at the election, you have to ignore the Herald’s record of over-polling National, the fact that National’s support in the Herald poll has fallen significantly since the election, and the fact that more reliable polling trends tell us the opposite.

Only if you make all these logical errors (and there’s a strong incentive to do so because our paper spent a lot of money on the poll, which means its going to be treated as gospel no matter what, goddammit), can you then conclude National’s rule continues unblemished thanks to Bonny Prince Grinny.

But when’s a few fallacies ever stopped Granny?

[Note: none of this should be taken as a ‘if these trends continue’ argument. One current accurate polling, the Left needs Winnie too making him Kingmaker and he would have much more incentive to go with National, and there’s the risk of a Shearer campaign meltdown too. Put National at 40% and I’ll be happier].

17 comments on “Granny Herald: from flawed data, false conclusions”

  1. Tiresias 1

    “Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: “There are three kinds of lies: lies, damned lies and statistics.”
    – Mark Twain’s Own Autobiography

    Presently Labour will only be picking up those sufficiently dismayed by National’s duplicities and incompetence not to want them in Government again. Labour will only start picking up genuine support when it starts presenting an alternative programme worth genuinely supporting, and six-weeks out from an election is far too late to start thinking of doing that.

  2. Bob Tambling 2

    The worry for me then is if the polling trends continue and it looks like Shearer can just get over the line the possibilty of changing the leader will further diminish and Shearer will fight the 2014 election.
    Unfortunetly during the ensuing campaign, Key and the Nats will crucify him and we will be left with a National Government or a very weak LAb /NZF /Green one term Goverment
    I wonder from a Green party prospective (and a leftish pespective) , would it not be better if the Labour Party lost the next election with Shearer as Leader?
    If NZF play a part as may be likely, the Green can’t afford to go into a NZF /Lab/Green Gov.
    Shearer simply won’t cut the mustard and Peters is toxic. It would be a crap government and the well honed National party machine would again tear it to shreds

    The leaves the Greens in an interesting position, the lure of ministerial positions versus the pragmatic long term strategy of the Greens. A one term Lab/Nzf/Green Gov seems to serve no ones interest.
    Labour needs to have a strong leadership team and comitted activists , The reality is they have a diminishing group of activists and a crap leadership.
    The Greens on the other hand have a very strong leadership team and an ever growing group of activists ( let us not forget they are the second biggest party in Wellington).
    Labour? I can’t think of anyone in the present caucus who could take most of the country with them in an election. They need a good clean out and new blood. They don’t appear to be listening to that line of argument.
    In conclusion:
    I am committed to working very hard to getting as many Green MP’s elected as I can in 2014. I am not so sure though if I want those MP’s in a Government with the current infighting mob of the Lab party who it seems “could not pour piss out of a boot if the directions were on the heel”.

  3. tc 4

    The more granny and her shills like Johnno, o’shillivan, rortney etc keep banging the NACT drum the more irrelevant and bias they show themselves to be.

    Labour needs to grow a pair and get out there now however with the mallarfia and their front man it seems it’ll come down to the hollowmen blowing it more so than Labour winning it.

    They could easily blag another term if they weren’t such psychos given the current state of the opposition, thankfully they are what they are.

  4. ghostrider888 5

    article in todays Herald acknowledges the popularity of Key is slipping

  5. pete 6

    “Only the 3news poll is worse.”

    That’s not quite true: all five polls overestimate National’s election results, and the Digipoll isn’t too much worse than Fairfax or Roy Morgan. One News Colmar Brunton, as well as 3 News Reid Research both overestimate by more than the Herald.

    • lprent 6.1

      Points to a systematic flaw in their sampling doesn’t it…

      • pete 6.1.1

        That’s one possible explanation, although some have theorised that National lose a lot of votes close to the election once people actually start looking at their policies.

        There’s also a theory that NZF underpolls because their voters are embarrassed to admit that to callers.

        • lprent 6.1.1.1

          Possible. But less likely than the simpler explanation.

          Canvassing companies are using listed landlines*. When I was analyzing some somewhat larger samples of both door-knock canvassing and phone canvassing across several electorates, there was a statistically significant correlation between people who canvassed right and left and if they had a listed landline.

          For that matter there was an even stronger correlation between age group and having a listed land line – and it looks like if people don’t have a listed phone line in their mid 20’s then they never get one.

          * There is a common myth that goes around about auto-dialing random numbers. Asked a few people who work at or have worked at polling companies. It doesn’t happen and a few minutes thought about number ranges will give an explanation about why. It is cheaper to buy/get a phone list.

  6. Chris 7

    So,will Granny Herald be ramping up lots of little good news, happy smiley,relaxed all singing, dancing reports/photos of our poor excuse for a pm then. Got to keep him relevant.

  7. Centaur 8

    Give Key *some* credit. He may decide to call it quits. It is not as if he actually needs this gig ..

  8. Murray Olsen 9

    I’m not even sure that the margins of error as reported are very meaningful at all. From what I know, they seem to rely on unbiased sampling and the validity of the Central Limit Theorem, which then leads to a percentage presumably taken from 100 times √N/N. The concern about landlines is just one thing that could skew this.

    • lprent 9.1

      They do sample distribution normalising for many of the other factors like age, gender and geological distribution. They don’t adjust for factors like people working during the periods that they phone.

      But they don’t publish their techniques and criteria so it is pretty hard to see why there if it was unbiased sampling there would be any differences between the polls within the confidence limits. But there clearly is.

      • Centaur 9.1.1

        lprent: geological distribution ?
        Such as, where there are proven mineral resources ?

        • lprent 9.1.1.1

          I blame the iPad, it’s overly smart autocorrect, and that I use Geological at least 10x more often than Geographical.

    • Lanthanide 9.2

      No, they’re not. Even assuming they are following absolutely perfect statistical methods and the statistical methods work as advertised by the literature, the margin of error they’re reporting is presumably the 95% confidence interval. Which means 1 out of 20 polls are going to be wrong, but we won’t ever be able to tell which one without some other corroborating information (eg other polls taken at the same time).

      That’s assuming they’re using perfect methods, which of course they aren’t.

Recent Comments

Recent Posts

  • How many victims missing out on protection?
    Hundreds of domestic abuse victims could be missing out on getting protection orders because they are unable to get legal aid, Labour’s Justice spokesperson Jacinda Ardern says.“In the last two years some 351 people who applied for legal aid for… ...
    20 hours ago
  • Government kicks hardworking whanau
    A major incentive to help young Kiwis and people on low incomes to start saving has been kicked out from under them with the National-led Government ramming through short-sighted legislation under Urgency today, Labour’s Maori Development Spokesperson Nanaia Mahuta says.… ...
    20 hours ago
  • Speculator tax political stunt gone wrong
    Bill English’s admission he doesn’t know whether National’s new speculator tax will have any effect shows last weekend’s announcement by the Prime Minister was a desperate political stunt, says Labour’s Housing spokesperson Phil Twyford. “This Government is so desperate to… ...
    23 hours ago
  • The value of parenting
    This week, as part of the Budget, the government introduced a bill to address child poverty. This bill will require parents receiving income support to look for part-time work once their youngest child is three years of age rather than… ...
    GreensBy Jan Logie MP
    1 day ago
  • Another new tax, another broken promise
    National has unveiled yet another new tax in this budget – a rural broadband levy that will almost certainly result in an immediate price hike for internet and telephone connections across New Zealand, Labour’s ICT spokesperson Clare Curran said “The… ...
    2 days ago
  • Anniversary of Sri Lankan Tamil Massacre
    This is not going to be a happy story but if the Green Party of Aotearoa doesn’t want to know who else will? May 18th marks the anniversary of what is known as the ‘Mullivaikal massacre’ of Tamils in 2009 at… ...
    GreensBy Catherine Delahunty MP
    2 days ago
  • Labour MPs join youth to take part in 40 hour famine
    A team of Labour MPs took part in the 2015 World Vision 40 hour famine and we were told by World Vision and the young people, that it was the first time MPs had joined them and how appreciative they… ...
    2 days ago
  • Rodeo: ‘Family entertainment’ or animal abuse?
    Recently  TVNZ ran a story with confronting footage showing rodeo animals being punched, repeatedly shocked with electronic prods and having their tails violently twisted over their backs. It was clear that significant force was being used behind the scenes to make… ...
    GreensBy Mojo Mathers MP
    2 days ago
  • Budget puts the squeeze on police
    The Government has cut funding to the New Zealand police force in the latest Budget, says Labour’s Police spokesperson Kelvin Davis. “The reduction is a whopping $15.3 million that could put front line officers at risk. ...
    2 days ago
  • Crucial social services take another hit
    The Government looks set to slash half a million dollars of funding for critical social services, including Women’s Refuge and Barnados, says Labour’s Social Development spokesperson Carmel Sepuloni “Taking $500,000 from organisations aimed at improving the lives of vulnerable families… ...
    2 days ago
  • Saying it Loud on Climate in Christchurch
    The Government’s Christchurch consultation meeting on New Zealand’s emission targets was inspiring – not for what was in the Ministry for the Environment’s (MFE’s) defeatist video about the obstacles to changing to a low carbon future, but for what the… ...
    GreensBy Eugenie Sage MP
    2 days ago
  • Budget silent on small business
    The Government has completely ignored one of the most important sectors of the economy – small and medium-sized enterprises – in Budget 2015, Labour’s Small Business spokesperson Jacinda Ardern says. "A stunning 41 per cent of jobs were created by… ...
    2 days ago
  • Thank you John, it’s been bloody marvellous
    The departure of John Campbell is a blow to current affairs investigative journalism, Labour’s Broadcasting Spokesperson Clare Curran says. “Campbell Live stood out in its field. Its axing comes as local broadcasting in New Zealand remains in a state of… ...
    2 days ago
  • KiwiSaver cut shows no long-term plan
    National’s cutting of the KiwiSaver kickstart is incredibly short-term thinking, typical of a Budget that is woefully short on ideas to generate wealth and opportunity, Labour’s Finance spokesperson Grant Robertson says. “New Zealand’s savings rate is far too low. KiwiSaver… ...
    2 days ago
  • National hits the panic button for its 7th Budget
    National has hit the panic button for its 7th Budget in a desperate attempt to look like they’re taking action to reduce our shameful child poverty rates, but they are giving with one hand and taking with the other, Opposition… ...
    3 days ago
  • Panic and back-flips can’t hide twin deficits
    National’s token measures to fight fires they have left burning for seven long years can’t hide a Budget that is long on broken promises, short on vision and fails to reach surplus, says Labour’s Finance spokesperson Grant Robertson. “After being… ...
    3 days ago
  • Auckland land measure seven years too late
    National are so desperate to look like they are doing something about the Auckland housing crisis they have dusted off Labour’s 2008 inventory of government land available for housing and re-announced it, says Labour’s housing spokesperson Phil Twyford. “Despite National… ...
    3 days ago
  • Access to gender reassignment surgery essential
    I was frankly disgusted to hear the Minister for Health say that funding gender reassignment surgeries is a “nutty idea”. A recent study found that in New Zealand 1% of young people identified themselves as transgender, and 3% were unsure… ...
    GreensBy Jan Logie MP
    4 days ago
  • Global milk prices now lowest in 6 years
    The latest fall in the global dairy price has brought it to the lowest level in six years and shows there must be meaningful action in tomorrow’s Budget to diversify the economy, says Labour’s Finance spokesperson Grant Robertson. “Dairy prices… ...
    4 days ago
  • Big risks as CYF checks stopped
    Revelations that Child, Youth and Family is no longer assisting home-based early childhood educators by vetting potential employees should set alarm bells ringing, Labour Children’s spokesperson Jacinda Ardern says. “Doing away with an extra mechanism for checking potential new employees… ...
    5 days ago
  • Housing crisis about real people not numbers
    The Government’s continued failure to tackle the housing crisis is seeing thousands of vulnerable Kiwis being kept off social housing waiting lists, while others, who are on the list, are being forced to live in cars and garages, says Labour’s… ...
    5 days ago
  • Housing crisis about real people not numbers
    The Government’s continued failure to tackle the housing crisis is seeing thousands of vulnerable Kiwis being kept off social housing waiting lists, while others, who are on the list, are being forced to live in cars and garages, says Labour’s… ...
    5 days ago
  • State of origin
    Kiwis are increasingly concerned about the food they give their families. New Zealand consumers have the right to know where their food has come from, particularly when it involves animals, and should be able to expect our Government to label… ...
    GreensBy Steffan Browning MP
    5 days ago
  • Relationships Aotearoa
    It is disturbing that Relationships Aotearoa, a voluntary organisation set up in 1949 to help couples struggling with their relationships following the upheavals of World War II, may be forced to close, says Acting Spokesperson for the Voluntary and Community… ...
    5 days ago
  • An economy that is just working for some is an economy that is not working
    The National Party presents itself as a great manager of the economy, but if the economy is only working for some we really need to question that assertion. Alongside the perpetually elusive surplus, the levels of risk in our economy are… ...
    GreensBy Jan Logie MP
    5 days ago
  • An economy that is just working for some is an economy that is not working
    The National Party presents itself as a great manager of the economy, but if the economy is only working for some we really need to question that assertion. Alongside the perpetually elusive surplus, the levels of risk in our economy are… ...
    GreensBy Jan Logie MP
    5 days ago
  • House prices to a crack $1 million in 17 months
    The average Auckland home is on track to cost $1 million in 17 months’ time if nothing substantial is done to rein in soaring price rises, Labour’s Housing spokesperson Phil Twyford says. “Auckland’s house prices have skyrocketed 63 per cent… ...
    5 days ago
  • Vital support services can’t be left in lurch
    The National Government has big questions to answer about how a provider of services to thousands of vulnerable New Zealanders is set to fold, Labour’s Finance spokesperson Grant Robertson says. Relationships Aotearoa which provides support and counselling to families, individuals… ...
    6 days ago
  • Treasury and IRD on a capital gains tax
    Both the Treasury and IRD have been advising the National Government on the benefits of a capital gains tax. Documents released to the Green Party under an Official Information Act request show that John Key has been selective with the… ...
    GreensBy Russel Norman MP
    6 days ago
  • Charity legislation needs review
    It is unacceptable that the big corporate based charities claim  millions in annual income tax exemptions, while small community based and operated non-profit organisations  struggle to gain official charity status, Labour’s acting spokesperson for the Voluntary and Community Sector Louisa… ...
    6 days ago
  • John’s panic-Key response to housing crisis
    John Key needs to tell New Zealanders what caused his sudden change of heart that led to the Government’s scrambled and last-minute housing measures, Opposition Leader Andrew Little says. “The Prime Minister’s sudden rush of blood to his head followed… ...
    6 days ago
  • Keep our Assets Christchurch Campaign: An update
    I recently presented my submission to keep Christchurch Council assets at the Christchurch City Council’s public hearings on its 10 year plan on 13 May. The hearings are live-streamed and recorded so you can watch them on www.ccc.govt.nz. The Council’s… ...
    GreensBy Eugenie Sage MP
    6 days ago
  • John Key finally admits there’s a housing crisis
    John Key’s weak measures to rein in the astronomical profits property speculators are making are an admission – finally – that there is a housing crisis, Labour Leader Andrew Little says. “But yet again National is tinkering with the housing… ...
    1 week ago
  • Government stifles voices in CYFs review
    The Government’s exclusion of the Māori Women’s Welfare League in a panel on the future of CYFs is a cynical ploy to stifle views, says Labour’s Māori Development Spokesperson Nanaia Mahuta. “It's unbelievable that a significant review on the future… ...
    1 week ago
  • Speech to the Otago Chamber of Commerce
    Thank you very much for the opportunity to be here today. It’s a pleasure as always to be back in the town that raised me. Growing up in St Kilda meant that there was one thing that was a big… ...
    1 week ago
  • Key can’t just be Prime Minister for Parnell
    John Key must show New Zealanders in next week’s Budget that he is more than the Prime Minister for Parnell, and is also the Prime Minister for Pine Hill, Putararu and Palmerston North, Labour’s Finance spokesperson Grant Robertson says. In… ...
    1 week ago
  • Stop the conversions
    This week, some Waikato locals took me and intrepid photographer Amanda Rogers on a tour of some  lakes and waterways in their region, and up to the massive dairy conversions in the upper catchment of the Waikato River. It… ...
    GreensBy Catherine Delahunty MP
    1 week ago
  • More regional jobs go in Corrections reshape
    News that 194 Corrections staff are to lose their jobs will have ramifications not only for them and their families but for the wider community, Labour’s Corrections spokesperson Kelvin Davis says. Prison units at Waikeria, Tongariro and Rimutaka face closure… ...
    1 week ago
  • Government’s climate meetings off to a bumpy start
    On Wednesday, I attended a hui and an evening meeting that the Government had organised in Nelson as part of its climate change consultation tour, to support the Nelson community telling the Government to take meaningful action on climate change.… ...
    GreensBy Steffan Browning MP
    1 week ago
  • Taxpayers the only ones left feeling blue
    Ministry of Social Development bosses could have saved themselves thousands of dollars in consultants’ fees by providing staff with rose-tinted spectacles, Labour’s State Services spokesperson Kris Faafoi says. A report out today reveals the Ministry is spending over half a… ...
    1 week ago
  • Why are the regions still facing restrictions?
    Labour's Housing spokesperson Phil Twyford is questioning why the regions should continue to be saddled with LVR lending restrictions announced by the Reserve Bank today. “Labour has been calling for the regions to be exempted from LVRs for the best… ...
    2 weeks ago
  • The high costs of weak environmental regulation
    Te Waihora/Lake Ellesmere is described on the Department of Conservation website as “Canterbury’s largest and New Zealand’s fifth largest [lake], and an internationally important wildlife area.” But the lake is also polluted by nutrients leaching from farms in the catchment.… ...
    GreensBy Eugenie Sage MP
    2 weeks ago
  • Submissions to Wellington City Council on their Gambling Venues Policy
    Every three years Councils across the country are required to check that their gambling venue policies are still fit for purpose and they can choose to consult on their policy if they are thinking of making changes. Councils don’t have… ...
    GreensBy Denise Roche MP
    2 weeks ago
  • Reserve Bank action shows Govt out of touch and out of ideas
    The Reserve Bank’s unprecedented measures today show it understands the serious risks of the overheating housing market – in complete contrast to John Key’s refusal to acknowledge the crisis, Labour’s Finance spokesperson Grant Robertson says. “The Bank is right to… ...
    2 weeks ago
  • Send us your snaps: 25 Years of the Green Party
    This year we've hit a milestone. We're turning 25.To help celebrate a quarter of a century, please send us your photos from the last 25 years of the Green Party Aotearoa New Zealand! Note: Photos must be jpg, gif or… ...
    2 weeks ago
  • 25 Years of the Green Party
    This year the Green Party sends 25. To help us celebrate a quarter of a century please send us you photos of 25 years of the Green Party!Photos must be jpg,gif or png and smaller than 2MB. If you are… ...
    2 weeks ago
  • Bay growth plan too little too late
    Today’s Bay of Plenty growth study from MBIE is another example of Government spin - lots of talk but little action, says Labour’s Regional Development spokesperson David Cunliffe.  “This is a region that desperately needs to develop the downstream processing… ...
    2 weeks ago
  • Government bows to ACC pressure
     The Government has finally buckled to pressure from Labour and the New Zealand public in making a half billion dollar cut to ACC levies, but the full benefits are two years away,” says Opposition Leader Andrew Little.  “$500 million over… ...
    2 weeks ago
  • False figures cloud Auckland transport facts
    The Prime Minister should apologise and issue a correction after both he and Transport Minister Simon Bridges have been caught out misrepresenting facts on Auckland’s transport spending, Labour’s Housing spokesperson Phil Twyford says. "Both John Key and Simon Bridges have… ...
    2 weeks ago
  • Govt books confirm National can’t post surplus
    The last publication of the Government’s books before the budget shows National will break its promise of seven years and two election campaigns and fail to get the books in order, says Labour’s Finance Spokesperson Grant Robertson. “The Government is… ...
    2 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere