web analytics

Granny Herald: from flawed data, false conclusions

Written By: - Date published: 11:21 am, March 23rd, 2013 - 17 comments
Categories: john key, national, polls - Tags:

Three of the Herald’s political staff has a crack at trying to explain why National polled 48.5% in the latest Herald-Digipoll. Consensus seems to be that John Key’s an angel sent to earth to do very little but keep enough of the middle class happy enough who’ll never lose. May I humbly suggest an alternative theory – that the Herald-Digipoll is broken.

Danyl at the Dimpost has the most mathematically poll of polls that, crucially, is anchored in reality – ie the last election result. Whereas political commentators and pollsters seem to shamelessly ignore how badly their poll got it wrong at the last election when breathlessly reporting the latest numbers, the Dimpost poll of polls corrects for their error.

What the Dimpost poll shows is that:

a) the Herald Digi-poll consistently over measures National – for example, the final Herald poll before the last election had National on 50.9%, that’s outside the margin of error above the 47.3% they got. The final Herald poll in 2008 had National on 47.9%, they got 44.9%. Statistically, the Herald isn’t just missing the bullseye, it’s missing the dartboard altogether. Only the 3news poll is worse. (in the image below, the light blue line is the Herald trend, the dark one is the poll of polls trend).

Dimpost poll of polls highlighting Herald Digipoll

b) even the Herald poll shows that National has lost a significant amount of support. From a pre-election high of 54.2%, a final pre-election number of 50.9%, to 48.5% today. That’s a big drop. Adjust to the Herald’s 3% over-polling of National at the last two elections, and it signals National is at around 45% – in the range that the Dimpost poll of polls has it. Remember, the Right has a one-seat majority in the House. Losing 2-3% since the election, especially when Banks will never get back in, is no laughing matter for National. If it were to translate into an election result, it would mean National would need New Zealand First (or a very large wasted vote) to govern.

c) more regular polls, like the Roy Morgan show a clear downward trend for National. You can’t possibly draw a trend from the five data points in 17 months that the Herald provides because the statistical noise that results in variation between every poll can’t be sensibly separated from the trend when you have so little to work with. The Roy Morgan has polled 29 times in that period and its trend is clear. (incidentally, the Roy Morgan was also the most accurate for National in 2011).

roy morgan labour greens v nats 3

To look at the Herald poll and conclude that National is now more popular than at the election, you have to ignore the Herald’s record of over-polling National, the fact that National’s support in the Herald poll has fallen significantly since the election, and the fact that more reliable polling trends tell us the opposite.

Only if you make all these logical errors (and there’s a strong incentive to do so because our paper spent a lot of money on the poll, which means its going to be treated as gospel no matter what, goddammit), can you then conclude National’s rule continues unblemished thanks to Bonny Prince Grinny.

But when’s a few fallacies ever stopped Granny?

[Note: none of this should be taken as a ‘if these trends continue’ argument. One current accurate polling, the Left needs Winnie too making him Kingmaker and he would have much more incentive to go with National, and there’s the risk of a Shearer campaign meltdown too. Put National at 40% and I’ll be happier].

17 comments on “Granny Herald: from flawed data, false conclusions ”

  1. Tiresias 1

    “Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: “There are three kinds of lies: lies, damned lies and statistics.”
    – Mark Twain’s Own Autobiography

    Presently Labour will only be picking up those sufficiently dismayed by National’s duplicities and incompetence not to want them in Government again. Labour will only start picking up genuine support when it starts presenting an alternative programme worth genuinely supporting, and six-weeks out from an election is far too late to start thinking of doing that.

  2. Bob Tambling 2

    The worry for me then is if the polling trends continue and it looks like Shearer can just get over the line the possibilty of changing the leader will further diminish and Shearer will fight the 2014 election.
    Unfortunetly during the ensuing campaign, Key and the Nats will crucify him and we will be left with a National Government or a very weak LAb /NZF /Green one term Goverment
    I wonder from a Green party prospective (and a leftish pespective) , would it not be better if the Labour Party lost the next election with Shearer as Leader?
    If NZF play a part as may be likely, the Green can’t afford to go into a NZF /Lab/Green Gov.
    Shearer simply won’t cut the mustard and Peters is toxic. It would be a crap government and the well honed National party machine would again tear it to shreds

    The leaves the Greens in an interesting position, the lure of ministerial positions versus the pragmatic long term strategy of the Greens. A one term Lab/Nzf/Green Gov seems to serve no ones interest.
    Labour needs to have a strong leadership team and comitted activists , The reality is they have a diminishing group of activists and a crap leadership.
    The Greens on the other hand have a very strong leadership team and an ever growing group of activists ( let us not forget they are the second biggest party in Wellington).
    Labour? I can’t think of anyone in the present caucus who could take most of the country with them in an election. They need a good clean out and new blood. They don’t appear to be listening to that line of argument.
    In conclusion:
    I am committed to working very hard to getting as many Green MP’s elected as I can in 2014. I am not so sure though if I want those MP’s in a Government with the current infighting mob of the Lab party who it seems “could not pour piss out of a boot if the directions were on the heel”.

  3. tc 4

    The more granny and her shills like Johnno, o’shillivan, rortney etc keep banging the NACT drum the more irrelevant and bias they show themselves to be.

    Labour needs to grow a pair and get out there now however with the mallarfia and their front man it seems it’ll come down to the hollowmen blowing it more so than Labour winning it.

    They could easily blag another term if they weren’t such psychos given the current state of the opposition, thankfully they are what they are.

  4. ghostrider888 5

    article in todays Herald acknowledges the popularity of Key is slipping

  5. pete 6

    “Only the 3news poll is worse.”

    That’s not quite true: all five polls overestimate National’s election results, and the Digipoll isn’t too much worse than Fairfax or Roy Morgan. One News Colmar Brunton, as well as 3 News Reid Research both overestimate by more than the Herald.

    • lprent 6.1

      Points to a systematic flaw in their sampling doesn’t it…

      • pete 6.1.1

        That’s one possible explanation, although some have theorised that National lose a lot of votes close to the election once people actually start looking at their policies.

        There’s also a theory that NZF underpolls because their voters are embarrassed to admit that to callers.

        • lprent 6.1.1.1

          Possible. But less likely than the simpler explanation.

          Canvassing companies are using listed landlines*. When I was analyzing some somewhat larger samples of both door-knock canvassing and phone canvassing across several electorates, there was a statistically significant correlation between people who canvassed right and left and if they had a listed landline.

          For that matter there was an even stronger correlation between age group and having a listed land line – and it looks like if people don’t have a listed phone line in their mid 20’s then they never get one.

          * There is a common myth that goes around about auto-dialing random numbers. Asked a few people who work at or have worked at polling companies. It doesn’t happen and a few minutes thought about number ranges will give an explanation about why. It is cheaper to buy/get a phone list.

  6. Chris 7

    So,will Granny Herald be ramping up lots of little good news, happy smiley,relaxed all singing, dancing reports/photos of our poor excuse for a pm then. Got to keep him relevant.

  7. Centaur 8

    Give Key *some* credit. He may decide to call it quits. It is not as if he actually needs this gig ..

  8. Murray Olsen 9

    I’m not even sure that the margins of error as reported are very meaningful at all. From what I know, they seem to rely on unbiased sampling and the validity of the Central Limit Theorem, which then leads to a percentage presumably taken from 100 times √N/N. The concern about landlines is just one thing that could skew this.

    • lprent 9.1

      They do sample distribution normalising for many of the other factors like age, gender and geological distribution. They don’t adjust for factors like people working during the periods that they phone.

      But they don’t publish their techniques and criteria so it is pretty hard to see why there if it was unbiased sampling there would be any differences between the polls within the confidence limits. But there clearly is.

      • Centaur 9.1.1

        lprent: geological distribution ?
        Such as, where there are proven mineral resources ?

        • lprent 9.1.1.1

          I blame the iPad, it’s overly smart autocorrect, and that I use Geological at least 10x more often than Geographical.

    • Lanthanide 9.2

      No, they’re not. Even assuming they are following absolutely perfect statistical methods and the statistical methods work as advertised by the literature, the margin of error they’re reporting is presumably the 95% confidence interval. Which means 1 out of 20 polls are going to be wrong, but we won’t ever be able to tell which one without some other corroborating information (eg other polls taken at the same time).

      That’s assuming they’re using perfect methods, which of course they aren’t.

Recent Comments

Recent Posts

  • APEC 2021 Women and the Economy Forum prioritises women’s economic empowerment
    Minister for Women Jan Tinetti today chaired the virtual APEC 2021 Women and the Economy Forum, which is working to address outstanding issues for women and girls across the region as it recovers from the COVID-19 pandemic. The forum brought together Ministers and representatives from 21 economies to discuss gender ...
    BeehiveBy beehive.govt.nz
    2 hours ago
  • Upper Hauraki to move to Alert Level 2
    Upper Hauraki will move to Alert Level 2 from 11:59pm tomorrow, 25 September, COVID-19 Response Minister Chris Hipkins confirmed today. After positive cases were detected in the Upper Hauraki area on Sunday, extra Alert Level restrictions were put in place to immediately prevent any wider transmission of the virus.  “We’ve ...
    BeehiveBy beehive.govt.nz
    19 hours ago
  • Report into Aotearoa New Zealand’s export controls system released
    Foreign Affairs Minister Nanaia Mahuta today welcomed the findings of an independent review into Aotearoa New Zealand’s export controls system, which regulates the export of goods to foreign militaries, police forces or paramilitaries. Produced by David Smol, a former Chief Executive of the Ministry of Business, Innovation and Employment, the ...
    BeehiveBy beehive.govt.nz
    22 hours ago
  • New District Court Judge appointed
    Attorney-General David Parker has announced the appointment of Brett Crowley of Wellington as a District Court Judge.  He is currently the Wellington Public Defender and started his career as a staff solicitor working in a range of litigation including criminal defence work. He went to the bar in 1999 specialising ...
    BeehiveBy beehive.govt.nz
    22 hours ago
  • Mental health stocktake shows strong progress
    The first report of the Government’s Implementation Unit has found strong progress has been made since the Mental Health and Addictions Package was announced in 2019. “The report notes most initiatives funded in the Budget 2019 package are on track to deliver what is expected by 2023/24,” Grant Robertson said. ...
    BeehiveBy beehive.govt.nz
    23 hours ago
  • Working together to grow the West Coast
    A project that has been crucial in allowing businesses to continue during the tourism downturn is among a number of initiatives to receive a boost from the Government’s Jobs For Nature programme, Conservation Minister Kiri Allan says. Sustaining South Westland is an extension of an initiative set up last year ...
    BeehiveBy beehive.govt.nz
    23 hours ago
  • Next steps to improve safety in wake of Whakaari White Island tragedy
    The Government is moving to improve safety in light of the Whakaari White Island tragedy and has released proposals to reinforce safety standards in registered adventure activities. The package of proposals includes: Strengthening requirements for how operators, landowners and the regulator manage natural hazard risks Improving how risks are monitored, ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • New Zealand donates more COVID-19 vaccines to COVAX and the Pacific
    Foreign Affairs Minister Hon Nanaia Mahuta and Associate Health Minister Aupito William Sio announced today that New Zealand is donating additional Pfizer vaccines to the Pacific and AstraZeneca vaccines to the COVAX Facility, to support equitable access to COVID-19 vaccines. “New Zealand is donating 708,000 doses of the AstraZeneca COVID-19 vaccine ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Speech to the Property Council of New Zealand
    Kia ora koutou katoa   Is it a pleasure to be able to speak with you today, and to be able to answer some questions you may have. I would like to acknowledge the organisers of this event, the Property Council. The theme of this year’s conference is City Shapers. Together ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Additional MIQ for Christchurch
    An additional hotel will be added to our network of managed isolation and quarantine facilities, COVID-19 Response Minister Chris Hipkins said today. “I have approved and Cabinet is in the final stages of signing off The Quality Hotel Elms in Christchurch as a new managed isolation facility,” Chris Hipkins said. ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ COVID-19 response earns another major digital investment
    Minister for the Digital Economy and Communications Dr David Clark welcomes Amazon’s Web Services’ (AWS) decision to establish a Cloud Region on New Zealand shores, further boosting New Zealand’s growing digital sector, and providing a vote of confidence in the direction of New Zealand’s economic recovery. “Amazon is the second ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New Zealand invests in cutting edge cancer R&D
    Scaling up the manufacture of CAR T-cell cancer therapy for clinical trials Advancing New Zealand’s biomedical manufacturing capability Supporting future international scientific collaborations Transforming cancer care with targeted, affordable solutions Research, Science and Innovation Minister Hon Dr Megan Woods has announced that the fight against COVID-19 will not stop the ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Expert group appointed to lead New Zealand’s future health system
    An outstanding group of people with extensive and wide-ranging governance and health experience have been appointed to lead the Māori Health Authority and Health New Zealand, Health Minister Andrew Little says. “This Government is building a truly national health system to provide consistent, high-quality health services right across the country. This ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Funding to help clean up contaminated sites
    The Government is supporting the clean-up of contaminated sites in Northland, Dunedin and Southland to reduce risk to people’s health and protect the environment. Environment Minister David Parker said the funding announced today, through the Contaminated Sites Remediation Fund, will help us turn previously hazardous sites into safe, usable public ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Predator Free apprenticeships open up new job opportunities
    The expansion of a predator free apprenticeship programme is an opportunity for more people to kick-start a conservation career, Conservation Minister Kiri Allan says. “The Predator Free Apprenticeship Programme is focused on increasing the number of skilled predator control operators in New Zealand through a two-year training programme. “The Trust ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Further NCEA support confirmed for Auckland students
    The number of Learning Recognition Credits for senior secondary school students will be increased for Auckland students, Education Minister Chris Hipkins confirmed today. This recognises the extended time these students will spend in Alert Levels 3 and 4. “It means students in Auckland will have a fair opportunity to attain ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Long-term pathway next step to better mental wellbeing for New Zealanders
    The Government is taking a new approach to support people who experience mental distress, Health Minister Andrew Little says. “Kia Manawanui Aotearoa – Long-term pathway to mental wellbeing (Kia Manawanui) is the first 10-year plan of its kind that targets the cause of mental distress and also sets out how ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Keeping our Police safe to keep our communities safe
    The Government is committed to keeping our frontline police officers safe, so they in turn can keep New Zealanders safe – with one of the largest investments in frontline safety announced by Police Minister Poto Williams at the Police College today.   The $45 million investment includes $15.496 million in ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Clean Vehicles Bill passes first checkpoint
    The Land Transport (Clean Vehicles) Amendment Bill will help New Zealand drive down transport emissions by cleaning up the light vehicle fleet, Transport Minister Michael Wood says. The Bill passed its first reading today and will establish the legislative framework for key parts of the Government’s Clean Car Package, including ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Funding boost supports ongoing Māori COVID-19 response
    The Government is responding to the need by whānau Māori and Māori Health providers to support their ongoing work responding to COVID-19 and to continue increasing rates of Māori vaccination, Associate Minister for Health (Māori Health), Peeni Henare and Minister for Māori Development Willie Jackson announced today.   This increased ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Significant increase to COVID-19 penalties
    Penalties for breaches of COVID-19 orders are set to significantly increase from early November 2021 to better reflect the seriousness of any behaviour that threatens New Zealand’s response to the virus, COVID-19 Response Minister Chris Hipkins said today. “Throughout this Delta outbreak we’ve seen the overwhelming majority of people doing ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Counter-Terrorism Legislation Bill returns to Parliament
    The Counter-Terrorism Legislation Bill has returned to Parliament for its second reading in an important step towards giving enforcement agencies greater power to protect New Zealanders from terrorist activity. “The Bill addresses longstanding gaps in our counter terrorism legislation that seek to protect New Zealanders and make us safer,” Justice ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Joint Statement: New Zealand and Australian Trade Ministers
    Hon Damien O'Connor MP, New Zealand Minister for Trade and Export Growth, and Hon Dan Tehan MP, Australian Minister for Trade, Tourism and Investment, met virtually on Monday 20 September to advance trans-Tasman cooperation under the Australia-New Zealand Closer Economic Relations Trade Agreement (CER). CER is one of the most ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Prime Minister’s Post Cabinet Press Conference/COVID-19 Update opening statement
    ***Please check against delivery***   E te tī, e te tā, nau mai rā [To all, I bid you welcome]   As you will have seen earlier, today there are 22 new community cases to report; three of which are in Whakatiwai in the Hauraki area, and the remainder in ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Major milestones for Māori COVID-19 vaccine rollout as new campaign launches
    Whānau Ora and Associate Health (Māori Health) Minister Peeni Henare acknowledges two major milestones in the rollout of the COVID-19 vaccination programme for Māori. “I am very pleased to announce more than 50 percent of eligible Māori have received their first dose and 25 per cent are now fully vaccinated,” ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government funding to fight infectious diseases
    $36 million for research into Covid-19 and other infectious diseases The investment will improve our readiness for future pandemics Research will focus on prevention, control, and management of infectious diseases The Government’s investing in a new Infectious Diseases Research Platform to boost Aotearoa New Zealand’s Covid-19 response and preparedness for ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Quarantine-free travel with Australia to remain suspended for a further 8 weeks
    Suspension to be reviewed again mid to late November Decision brought forward to enable access from Australia to first tranche of around 3000 rooms in MIQ Air New Zealand working at pace to put on more flights from Australia from October    The suspension of quarantine-free travel (QFT) with Australia has ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Extra support for Ethnic Communities to share vaccination information
    Extra support is being made available to Ethnic Communities to help them share COVID-19 vaccination information within their communities, Minister for Diversity, Inclusion and Ethnic Communities Priyanca Radhakrishnan said. “We know we need to get every eligible person in New Zealand vaccinated. A fund being launched today will allow for ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • School holidays remain unchanged for Auckland region
    School holidays in Auckland will continue to be held at the same time as the rest of the country, starting from Saturday, 2 October, Education Minister Chris Hipkins said today. “I’ve carefully considered advice on the implications of shifting the dates and concluded that on balance, maintaining the status quo ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government continues crackdown on gangs and organised crime
    Operation Tauwhiro extended until March 2022 Since it was launched in February, Operation Tauwhiro has resulted in:   987 firearms seized $4.99 million in cash seized 865 people charged with a firearms-related offence Gangs and organised crime groups will continue to be relentlessly targeted with the extension of Police’s successful ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech to Body Positive 'HIV Treatments Update Seminar 2021'
    E ngā mana E ngā reo E ngā iwi Tēnā koutou katoa Ka huri ki ngā mana whenua o te rohe nei. Tēnā koutou. He mihi hoki ki a tatou kua tau mai nei I raro I te kaupapa o te rā. Nō reira tēnā koutou katoa Acknowledgements It’s a ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Power bill changes bring fairness to charges
    A key recommendation of an independent panel to make electricity charges fairer across all households will be put in place, the Energy and Resources Minister Megan Woods has announced. “Phasing out the regulations on ‘low-use’ electricity plans will create a fairer playing field for all New Zealanders and encourage a ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • NZ economy’s strong momentum will support rebound from Delta outbreak; COVID fund replenished
    The economy showed strong momentum in the period leading up to the recent Delta COVID-19 outbreak, which bodes well for a solid economic rebound, Grant Robertson said. GDP rose 2.8 percent in the June quarter, following on from a 1.4 percent increase in the previous March quarter. This was a ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Projects create benefits into the future
    Making a well-known lake swimmable and helping to halt the decline of the endangered hoiho/yellow-eyed penguins are among a suite of new projects being supported by the Government’s Jobs for Nature programme across the southern South Island, Conservation Minister Kiri Allan says. “It’s no secret that many of our most ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Opening statement for Whāriki Indigenous Small Business Roundtable
      Kei ngā tōpito e wha o te āo e rere ana te mihi maioha ki a koutou nō tawhiti, nō tata mai e tāpiri ana ki tēnei taumata kōrero mo te ao hokohoko arā mā ngā pākihi mo ngā iwi taketake Tēnā koutou, tēnā koutou katoa – Pai Mārire.  ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New members appointed to Kāpuia
    The Government is adding four additional members to Kāpuia, the Ministerial Advisory Group on the Government’s Response to the Royal Commission of Inquiry into the terrorist attack on Christchurch mosques. “I’m looking forward to having Pamela MacNeill, Huia Bramley, Melani Anae and Katherine Dedo  join Kāpuia and contribute to this group’s ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Timeline confirmed for Emissions Reductions Plan
    Cabinet has agreed to begin consulting on the Emissions Reduction Plan in early October and require that the final plan be released by the end of May next year in line with the 2022 Budget, the Minister of Climate Change, James Shaw confirmed today. “Cabinet’s decision allows organisations and communities ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Pay parity pathway for early learning teachers confirmed
    Pay parity conditions and higher funding rates for education and care services will come into force on 1 January, 2022, Minister of Education Chris Hipkins confirmed today. The Government signalled this work in Budget 2021. “From 1 January, 2022, centres opting into the scheme will receive government funding and be ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech to the New Zealand Nurses Organisation Conference 2021
    Kia Ora tatau katoa.   Ka tuku mihi ki nga nēhi, He pou Hauora o Aotearoa, E ora ai tatou.   Whakatau mai  I runga i te kaupapa o te ra Te NZNO conference.   Tena koutou tena koutou Tena tatou katoa   Good morning, and thank you inviting me ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government investment in farmer-led catchment groups sweeps past 150 mark
    171 catchment groups have now been invested in by the Government 31 catchment groups in the Lower North Island are receiving new support More than 5,000 farmers are focussed on restoring freshwater within a generation through involvement in catchment groups  Government investment in on-the-ground efforts by farmers to improve land ...
    BeehiveBy beehive.govt.nz
    2 weeks ago