web analytics

The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.

    L

    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • Protect seamounts and ban bottom trawling right now
    The Green Party is renewing its call for Minister for the Environment, David Parker to immediately ban bottom trawling on seamounts. ...
    19 hours ago
  • Building Auckland’s transport future
    We’re making sure Auckland has the infrastructure it needs for the future, so Aucklanders can get around safely and efficiently as our biggest city grows. The new, linked-up transport system we’re building will include partially tunnelled light rail between the CBD and the airport, as well as another Waitematā Harbour ...
    21 hours ago
  • Build Auckland light rail for benefit of everyone
    The Government’s decision on light rail in Auckland is the first step towards building the climate friendly, accessible city our communities deserve. ...
    21 hours ago
  • Put our most vulnerable first
    Don’t forget whānau and communities most at risk, says the Green Party, as the Government lays out its three-phase plan for Omicron. ...
    3 days ago
  • Boosting our immunity against Omicron
    With Omicron in the community, it’s vital we all do our bit to help to slow the spread, keep each other safe and protect our health system. One of the most important ways we can reduce the risk of Omicron is to get a booster dose as soon as we’re ...
    3 days ago
  • Equitable response to Omicron vital
    The Green Party supports the Government’s decision to move Aotearoa New Zealand to traffic light level Red at 11.59pm tonight, but says its success will depend on the support that is made available to the most vulnerable. ...
    6 days ago
  • How we’re preparing for Omicron
    As countries around the world experience Omicron outbreaks, we’re taking steps now to ensure we’re as prepared as possible and our communities are protected. ...
    1 week ago
  • What’s Labour achieved so far?
    Quite a bit! This Government was elected to take on the toughest issues facing Aotearoa – and that’s what we’re doing. Since the start of the pandemic, protecting lives and livelihoods has been a priority, but we’ve also made progress on long-term challenges, to deliver a future the next generation ...
    2 weeks ago
  • Tackling the big issues in 2022
    This year, keeping Kiwis safe from COVID will remain a key priority of the Government – but we’re also pushing ahead on some of New Zealand’s biggest long-term challenges. In 2022, we’re working to get more Kiwis into homes, reduce emissions, lift children out of poverty, and ensure people get ...
    2 weeks ago

  • Tupu Tai graduation-It’s time to step up
    Greetings: Kia orana, talofa lava, Noa’ia e mauri, malo e lelei, taloha ni, fakaalofa lahi atu, ni sa bula vinaka, talofa, kia ora, tena koutou katoa.  I would love to begin by acknowledging everyone here in attendance, especially the families and friends of the 2021/22 Tupu Tai cohort, and those ...
    BeehiveBy beehive.govt.nz
    18 hours ago
  • Building and shaping a city: Future-proofing Auckland transport infrastructure
    The Government is bringing Auckland’s transport infrastructure into the future by moving forward with an additional Waitematā Harbour crossing, progressing light rail from Auckland’s CBD to the airport, and creating a linked-up rapid transport network as part of a 30-year plan. Key decisions on additional Waitematā Harbour crossing to be ...
    BeehiveBy beehive.govt.nz
    19 hours ago
  • Penguin rehab and native forest restoration get helping hand
    A long-running penguin rehab facility which has been hard hit by the tourism downturn, and work to restore native forest habitats in the Catlins are being supported through Jobs for Nature funding, Conservation Minister Kiri Allan says. Otago’s Penguin Place and The Hokonui Rūnanga Catlins Biodiversity Project will receive combined ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Resilient economy reflected in Crown accounts
    The Government’s financial accounts continue to reflect a resilient economy that has performed better than expected and puts the country in a strong position to respond to Omicron, Grant Robertson said. The Crown Accounts for the five months to the end of November were more favourable than forecast in the ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government announces three phase public health response to Omicron
    Reducing isolation period for cases and close contacts at Phase Two and Three to 10 and seven days Definition of close contact required to isolate changes to household or household like contacts at Phase Three Increased use of rapid antigen tests with test to return policy put in place for ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New Ambassador to Thailand announced
    Foreign Affairs Minister Nanaia Mahuta today announced the appointment of Jonathan Kings as New Zealand’s next Ambassador to Thailand. “Aotearoa New Zealand has a long-standing relationship with Thailand, celebrating the 65th anniversary of diplomatic representation between our countries in 2021. We also share much in common at regional and multilateral levels ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Government’s Family Package continues to deliver for New Zealanders
    The Families Package helped around 330,000 families in its first year - more than half of all families with children in NZ These families received an estimated $55 per week more from Families Package payments in 2018/19 than in 2017/18, on average Families Package increases to the maximum possible Accommodation ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New Zealand retains top spot in global anti-corruption rankings
    Justice Minister Kris Faafoi has welcomed news of New Zealand’s ongoing position as top in the world anti-corruption rankings. The 2021 Corruption Perceptions Index released by global anti-corruption organisation, Transparency International, ranks New Zealand first equal with Denmark and Finland, with a score of 88 out of 100. “This is an ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Testing improvements see New Zealand well prepared for Omicron
    New Zealand’s PCR testing capacity can be increased by nearly 20,000 tests per day to deal with a surge in cases as part of our wider COVID-19 testing strategy, Associate Minister of Health Dr Ayesha Verrall said. “We have continued to adapt our public health response to safeguard the health ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • 5,000 portable air cleaners for schools on their way
    As schools are preparing to return, Education Minister Chris Hipkins has announced 5,000 air cleaners have been ordered for New Zealand schools. “As we know, along with vaccination, testing, good hygiene and physical distancing, good ventilation is important in minimising the risk of airborne transmission of the virus that causes ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New Zealand to move to Red from 11.59pm today
    All of New Zealand will move to the Red setting of the Covid Protection Framework (CPF) at 11:59pm today as Omicron is potentially now transmitting in the community, Prime Minister Jacinda Ardern says. “Nine COVID-19 cases reported yesterday in the Nelson/Marlborough region are now confirmed as Omicron, and a further ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Mandatory boosters for key workforces progressing well
    More than 5,785 (82%) border workers eligible for a booster vaccination at 6 months have received it so far, COVID-19 Response Minister Chris Hipkins says. “That’s a really strong uptake considering we announced the requirement the week before Christmas, but we need to continue this momentum,” Chris Hipkins said. “We ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • NZ to move to Red
    Nine COVID-19 cases reported yesterday in the Nelson/Marlborough region have now been confirmed as the Omicron variant, and a further case from the same household was confirmed late yesterday. These cases are in a single family that flew to Auckland on 13 January to attend a wedding and other events ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New Zealand to provide further help for Tonga
    Aotearoa New Zealand is giving an additional $2 million in humanitarian funding for Tonga as the country recovers from a volcanic eruption and tsunami last weekend, Foreign Affairs Minister Nanaia Mahuta and Defence Minister Peeni Henare said today. This brings Aotearoa New Zealand’s contribution to $3 million. “This support will ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Quarterly benefit numbers show highest number of exits into work
    The Government’s strong focus on supporting more people into work is reflected in benefit figures released today which show a year-on-year fall of around 21,300 people receiving a main benefit in the December 2021 quarter, Minister for Social Development and Employment Carmel Sepuloni said. “Our response to COVID has helped ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Northland to move to Orange, NZ prepared for Omicron 
    Northland to move to Orange Rest of New Zealand stays at Orange in preparedness for Omicron All of New Zealand to move into Red in the event of Omicron community outbreak – no use of lockdowns Govt planning well advanced – new case management, close contact definition and testing rules ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • RNZAF C-130 Hercules flight departs for Tonga as Navy vessels draw nearer to Tongatapu
    A Royal New Zealand Air Force C-130 Hercules has departed Base Auckland Whenuapai for Tonga carrying aid supplies, as the New Zealand aid effort ramps up, Foreign Affairs Minister Nanaia Mahuta and Defence Minister Peeni Henare said today. “The aircraft is carrying humanitarian aid and disaster relief supplies, including water ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Zealand prepared to send support to Tonga
    New Zealand is ready to assist Tonga in its recovery from Saturday night’s undersea eruption and tsunami, Foreign Affairs Minister Nanaia Mahuta and Defence Minister Peeni Henare said today. “Following the successful surveillance and reconnaissance flight of a New Zealand P-3K2 Orion on Monday, imagery and details have been sent ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Aotearoa New Zealand stands ready to assist people of Tonga
    The thoughts of New Zealanders are with the people of Tonga following yesterday’s undersea volcanic eruption and subsequent tsunami waves, Foreign Affairs Minister Nanaia Mahuta says. “Damage assessments are under way and New Zealand has formally offered to provide assistance to Tonga,” said Nanaia Mahuta. New Zealand has made an ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Record high of new homes consented continues
    In the year ended November 2021, 48,522 new homes were consented, up 26 per cent from the November 2020 year. In November 2021, 4,688 new dwellings were consented. Auckland’s new homes consented numbers rose 25 per cent in the last year. Annual figures for the last nine months show more ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Report trumpets scope for ice cream exports
    Latest research into our premium ice cream industry suggests exporters could find new buyers in valuable overseas markets as consumers increasingly look for tip top quality in food. Economic Development Minister Stuart Nash has released a new report for the Food and Beverage Information Project. The project is run by ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Honouring the legacy of legendary kaumātua Muriwai Ihakara
    Associate Minister for Arts, Culture, and Heritage Kiri Allan expressed her great sadness and deepest condolences at the passing of esteemed kaumātua, Muriwai Ihakara. “Muriwai’s passing is not only a loss for the wider creative sector but for all of Aotearoa New Zealand. The country has lost a much beloved ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Have your say on proposed changes to make drinking water safer
    Associate Minister for the Environment Kiri Allan is urging all New Zealanders to give feedback on proposed changes aimed at making drinking water safer. “The current regulations are not fit for purpose and don’t offer enough protection, particularly for those whose water comes from smaller supplies,” Kiri Allan said. “This ...
    BeehiveBy beehive.govt.nz
    3 weeks ago