web analytics

The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.

    L

    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • Farewelling sports administrator and philanthropist Sir Eion Edgar
    Sport and Recreation Minister Grant Robertson today expressed his sorrow at the passing of Sir Eion Edgar – a leading sports administrator and celebrated philanthropist who has made a significant impact both within and beyond the sport sector. “Sir Eion’s energy, drive and generosity has been truly immense. He leaves ...
    BeehiveBy beehive.govt.nz
    9 hours ago
  • Government to apologise for Dawn Raids
    The Government will make a formal apology for the wrongs committed during the Dawn Raids of the 1970’s. Between 1974 and 1976, a series of rigorous immigration enforcement policies were carried out that resulted in targeted raids on the homes of Pacific families. The raids to find, convict and deport overstayers ...
    BeehiveBy beehive.govt.nz
    10 hours ago
  • Humanitarian support for Bangladesh and Myanmar
    Foreign Affairs Minister Nanaia Mahuta today announced that New Zealand is providing NZ $8.25 million in humanitarian assistance to support refugees and their host populations in Bangladesh and to support humanitarian need of internally displaced and conflict affected people in Myanmar.  “Nearly four years after 900,000 Rohingya crossed the border ...
    BeehiveBy beehive.govt.nz
    11 hours ago
  • Feedback sought on future of housing and urban development
    New Zealanders are encouraged to have their say on a long-term vision for housing and urban development to guide future work, the Housing Minister Megan Woods has announced. Consultation starts today on a Government Policy Statement on Housing and Urban Development (GPS-HUD), which will support the long-term direction of Aotearoa ...
    BeehiveBy beehive.govt.nz
    16 hours ago
  • Clean car package to drive down emissions
    New rebates for electric and plug-in hybrid vehicles start July 1 with up to $8,625 for new vehicles and $3,450 for used. Electric vehicle chargers now available every 75km along most state highways to give Kiwis confidence. Low Emission Transport Fund will have nearly four times the funding by 2023 ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Progress towards simpler process for changing sex on birth certificates
    The Government is taking the next step to support transgender, non-binary and intersex New Zealanders, by progressing the Births, Deaths, Marriages and Relationships Registration Bill, Minister of Internal Affairs, Jan Tinetti announced today. “This Government understands that self-identification is a significant issue for transgender, non-binary and intersex New Zealanders, and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Crown speeds up engagement with takutai moana applicants
    The Crown is taking a new approach to takutai moana applications to give all applicants an opportunity to engage with the Crown and better support the Māori-Crown relationship, Treaty of Waitangi Negotiations Minister Andrew Little says. Following discussions with applicant groups, the Crown has reviewed the existing takutai moana application ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Alcohol and Other Drug Treatment (AODT) Court opens
    The Minister of Justice, Kris Faafoi, and the Minister for Courts, Aupito William Sio, have welcomed the opening of a new Alcohol and Other Drug Treatment (AODT) Court in Hamilton. The AODT Court (Te Whare Whakapiki Wairua) addresses situations where substance abuse and offending are intertwined. “New Zealanders have told ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • EU and UK FTAs top of list for first ministerial trip since COVID-19
    Trade and Export Growth Minister Damien O’Connor today announced details of his planned visit to the United Kingdom and European Union next week, where he will hold trade and agriculture discussions to further New Zealand’s economic recovery from COVID-19. The visit will add political weight to ongoing negotiations with both the EU ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Arihia Bennett to chair Royal Commission Ministerial Advisory Group
    Te Rūnanga o Ngāi Tahu chief executive Arihia Bennett MNZM has been appointed chair of the newly appointed Ministerial Advisory Group on the Government’s Response to the Royal Commission of Inquiry into the terrorist attack on Christchurch mosques. “Twenty-eight people from diverse backgrounds across Aotearoa have been selected for the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to the New Zealand Medical Association General Practitioners' Conference, Rotorua
    Ki ngā pou maha o te whare hauora o Aotearoa, kei te mihiTo the pillars of our health system I acknowledge/thank you Ki te ope hapai hauora o roto o tēnei rūma, kei te mihi To our health force here in the room today, I acknowledge/thank you He taura tangata, ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Karangahape Road upgrades are streets ahead
    The upgrades to Karangahape Road makes the iconic street more pedestrian and cycle-friendly, attractive and environmentally sustainable, Transport Minister Michael Wood and Auckland Mayor Phil Goff said at the formal celebration of the completion of the Karangahape Road Enhancements project. The project included widening footpaths supporting a better outdoor dining ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Speech to APEC business event
    E ngā tumu herenga waka, ākina ā ngaru, ākina ā tai ka whakatere ngā waka ki te whakapapa pounamu, otirā, ki Tamaki o ngā waka Tena koutou katoa… To the great leaders assembled, who guided your waka through turbulent times, challenging waters and you continue to navigate your respective waka ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Pause on Quarantine Free Travel with Victoria extended
    Following an assessment of the COVID-19 outbreak in greater Melbourne, New Zealand’s Quarantine Free Travel pause with Victoria will continue for a further seven days, COVID-19 Response Minister Chris Hipkins says. There are now 93 cases associated with the outbreak in greater Melbourne, spread over four clusters. Contact tracing efforts ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Supplier Diversity Aotearoa Summit: Navigate 2021
    *** Check with delivery *** A mihi to all who have contributed to making today a success – starting with you! As you have explored and navigated government procurement today you will hopefully have reflected on the journey of our people so far – and how you can make a ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Pukemiro School to close
    Pukemiro Primary School near Huntly will close following years of declining roll numbers, Education Minister Chris Hipkins announced today. “I’ve consulted with the School Commissioner, and this decision acknowledges the fact that the few remaining students from last term are now settled at other nearby schools. “I want to thank ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Govt acts to protect NZers from harmful content
    New Zealanders will be better protected from harmful or illegal content as a result of work to design a modern, flexible and coherent regulatory framework, Minister of Internal Affairs Jan Tinetti announced today. New Zealand currently has a content regulatory system that is comprised of six different arrangements covering some ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Consultation on exemption of new builds from proposed tax rules
    The Government has today confirmed new builds will be exempt from planned changes to the tax treatment of residential investment property.  Public consultation is now open on details of the proposals, which stop interest deductions being claimed for residential investment properties other than new builds.   “The Government’s goal is to ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech for Predator Free 2050 Conference
    Introduction E ngā mana E ngā reo E ngā iwi Tēnā koutou katoa   Ka huri ki ngā mana whenua o te rohe nei. Tēnā koutou He mihi hoki ki a tatou kua tau mai nei i raro i te kaupapa o te rā Ko Ayesha Verrall toku ingoa No ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • New stock exchange to help grow small businesses
    A new share trading market, designed as a gateway to the NZX for small-to-medium-sized enterprises (SMEs), has been granted a licence by the Government. Commerce and Consumer Affairs Minister, David Clark said Catalist Markets Ltd will provide a simpler and more affordable ‘stepping stone’ for SMEs to raise capital. “This ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Visa extensions provide certainty to employers and 10,000 visa holders
    Changes to onshore visas will provide employers and visa holders with more certainty, Immigration Minister Kris Faafoi has announced. Around 10,000 Working Holiday visas and Supplementary Seasonal Employment (SSE) work visas due to expire between 21 June 2021 and 31 December 2021 will be extended for another six months to ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Border class exceptions approved for more farm workers and vets
    The Government has approved border class exceptions for an additional 200 dairy workers and 50 veterinarians to enter New Zealand, Agriculture Minister Damien O’Connor announced today.  “It is clear from conversations with the dairy and veterinarian sectors that they are facing workforce pressures. These border exceptions will go a long ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • More freezers and South Island hub to support vaccine roll-out
    A South Island hub and 17 new ultra-low temperature freezers will help further prepare New Zealand for the ramp up of the vaccination programme in the second half of this year, COVID-19 Response Minister Chris Hipkins says. The new freezers arrived in New Zealand on 27 May. They’re currently being ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Speech at the release of Climate Change Commission's final advice
    Good morning – and thank you Prime Minister. Over the last three and half years we have been putting in place the foundations for a low-carbon Aotearoa that will be a catalyst for job creation, innovation, and prosperity for decades to come. In that future, many of our everyday tasks ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Achievable blueprint for addressing climate change released
    Report says Government making good progress on emissions reduction, but more action required Meeting climate targets achievable and affordable with existing technology Economic cost of delaying action higher than taking action now Benefits from climate action include health improvements and lower energy bills All Ministers to help meet climate targets ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Speech to release of Climate Commission final report
    A few years ago in a speech in Auckland, I compared climate change to the nuclear free movement of roughly four decades ago. And I did so for a few reasons. Firstly, because the movement of the 1980s represented a life or death situation for the Pacific, and so does ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Appointment of Judge of the High Court
    Auckland Barrister Michael Robinson has been appointed a Judge of the High Court, Attorney‑General David Parker announced today. Justice Robinson graduated with a BA and an LLB (Hons) from the University of Auckland in 1996, and commenced practice as a solicitor with Brookfields in Auckland.  In 1998 he travelled to London ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government takes action to improve protections for subcontractors
    The Construction Contracts (Retention Money) Amendment Bill – which provides greater financial protection for subcontractors, has passed its first reading today. The Bill amends the retention provisions in the Construction Contracts Act 2002 (CCA) to provide increased confidence and transparency for subcontractors that retention money they are owed is safe. ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • 1 million more Pfizer doses to arrive in July
    Pfizer has scheduled delivery of an estimated 1 million doses of vaccine to New Zealand during July, COVID1-9 Response Minister Chris Hipkins said today. “These consignments will double the total number of Pfizer doses we have received this year to more than 1,900,000 – enough to fully vaccinate almost 1 ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Long-term home of the Independent Children’s Monitor identified
    The Independent Children’s Monitor (Te Mana Whakamaru Tamariki Motuhake), which is currently located within the Ministry of Social Development (MSD), will become its own departmental agency within Government. “Following the recommendations of several reviews, Cabinet agreed in 2019 to build a significantly expanded independent monitor for children in care,” Carmel ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Racing Integrity Board members announced
    The new Racing Integrity Board will be up and running from July 1 to ensure high standards of animal welfare, integrity and professionalism in the racing industry. Racing Minister Grant Robertson today announced the appointments to the new Board: Sir Bruce Robertson KNZM – Chair Kristy McDonald ONZM QC Penelope ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Govt crackdown on organised crime continues
    A major operation against multiple organised crime groups with international links will make a significant dent in drug harm and violent offending linked to organised crime networks, Police Minister Poto Williams says. “I want to take an opportunity to congratulate the Police for their role in Operation Trojan Shield. This ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Farm planning framework supports farmers into the future
    A new framework, agreed between Government and industry, will make it easier for farmers and growers to integrate future greenhouse gas emissions and freshwater regulatory requirements into their farm planning, Agriculture Minister Damien O’Connor said. “The Good Farm Planning Principles Guide out today, provides guidance for how farmers can organise ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Enhanced Task Force Green Approved for Canterbury
    The Government has activated Enhanced Taskforce Green (ETFG) in response to the Canterbury floods. The Minister of Social Development and Employment, Hon Carmel Sepuloni says $500,000 will be made available to help with the clean-up. The flooding in Canterbury has been a significant and adverse event damaging farmland, homes, roads ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Connecting rangatahi to the soil
    A Jobs for Nature project to raise 480,000 native plants in nurseries across South Auckland will provide work for communities disproportionately affected by the economic impacts of COVID-19, Acting Conservation Minister Ayesha Verrall says. The Mana in Kaimahi project is being run by Te Whāngai Trust Board and will establish ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Roll out of high-resolution elevation mapping begins
    The first tranche of mapping data from the Provincial Growth Fund (PGF)-LiDAR project is now available to the public from Toitū Te Whenua Land Information New Zealand. LiDAR data, which creates 3D baseline elevation information, will deliver multiple uses over the coming decades to councils and regional industries. “This mapping ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Champions of Pacific education rewarded in Queen’s Birthday Honours
    Minister for Pacific Peoples, Aupito William Sio said the Queen’s Birthday 2021 Honours list show that across Aotearoa New Zealand there were many champions of Pacific education. “Education is so vital to the success of Pacific people that it’s truly fitting that a number of educators have been honoured this ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • PM congratulates Queen’s Birthday Honours recipients
    Prime Minister Jacinda Ardern has added her congratulations to the New Zealanders recognised for their contributions to their communities and the country in the Queen’s Birthday 2021 Honours List. “This group represents decades of services across many areas, and those honoured highlight how many New Zealanders are going above and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Change of status for Rangiriri kura
    A change of status for Te Kura o Rangiriri sees it become a designated character school within the Māori-medium network, Associate Minister of Education Kelvin Davis announced today. “This kura has been providing Māori immersion learning since 2003 in the historic town of Rangiriri, so I’m delighted that it is ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • APEC trade ministers’ unite on COVID-19 vaccine steps and rejuvenating the WTO
    APEC trade ministers today committed to speeding up the cross-border flow of vaccines and related goods to fight the COVID-19 pandemic. This followed the completion of the APEC Ministers Responsible for Trade Meeting chaired by Minister for Trade and Export Growth Damien O’Connor early this morning. “As we face the ...
    BeehiveBy beehive.govt.nz
    1 week ago