web analytics

The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.


    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • Advancing our relationship in India
    Foreign Minister Nanaia Mahuta departs for India tomorrow as she continues to reconnect Aotearoa New Zealand to the world.  The visit will begin in New Delhi where the Foreign Minister will meet with the Vice President Hon Jagdeep Dhankar and her Indian Government counterparts, External Affairs Minister S. Jaishankar and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government Northland housing investment to spark transformational change
    Over $10 million infrastructure funding to unlock housing in Whangārei The purchase of a 3.279 hectare site in Kerikeri to enable 56 new homes Northland becomes eligible for $100 million scheme for affordable rentals Multiple Northland communities will benefit from multiple Government housing investments, delivering thousands of new homes for ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Battle of Ohaeawai remembered
    A memorial event at a key battle site in the New Zealand land wars is an important event to mark the progress in relations between Māori and the Crown as we head towards Waitangi Day, Minister for Te Arawhiti Kelvin Davis said. The Battle of Ohaeawai in June 1845 saw ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • More Police deployed to the frontline
    More Police officers are being deployed to the frontline with the graduation of 54 new constables from the Royal New Zealand Police College today. The graduation ceremony for Recruit Wing 362 at Te Rauparaha Arena in Porirua was the first official event for Stuart Nash since his reappointment as Police ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Further support for upper North Island regions hit by significant weather
    The Government is unlocking an additional $700,000 in support for regions that have been badly hit by the recent flooding and storm damage in the upper North Island. “We’re supporting the response and recovery of Auckland, Waikato, Coromandel, Northland, and Bay of Plenty regions, through activating Enhanced Taskforce Green to ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • The Princess Royal to visit New Zealand
    Prime Minister Chris Hipkins has welcomed the announcement that Her Royal Highness The Princess Royal, Princess Anne, will visit New Zealand this month. “Princess Anne is travelling to Aotearoa at the request of the NZ Army’s Royal New Zealand Corps of Signals, of which she is Colonel in Chief, to ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Government and horticulture sector target $12b in exports by 2035
    A new Government and industry strategy launched today has its sights on growing the value of New Zealand’s horticultural production to $12 billion by 2035, Agriculture Minister Damien O’Connor said. “Our food and fibre exports are vital to New Zealand’s economic security. We’re focussed on long-term strategies that build on ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Cost of living support extended for families and businesses
    25 cents per litre petrol excise duty cut extended to 30 June 2023 – reducing an average 60 litre tank of petrol by $17.25 Road User Charge discount will be re-introduced and continue through until 30 June Half price public transport fares extended to the end of June 2023 saving ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • More Kiwis in work as rising wages match inflation
    The strong economy has attracted more people into the workforce, with a record number of New Zealanders in paid work and wages rising to help with cost of living pressures. “The Government’s economic plan is delivering on more better-paid jobs, growing wages and creating more opportunities for more New Zealanders,” ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government boosts fund for Auckland flooding
    The Government is providing a further $1 million to the Mayoral Relief Fund to help communities in Auckland following flooding, Minister for Emergency Management Kieran McAnulty announced today. “Cabinet today agreed that, given the severity of the event, a further $1 million contribution be made. Cabinet wishes to be proactive ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New Cabinet focused on bread and butter issues
    The new Cabinet will be focused on core bread and butter issues like the cost of living, education, health, housing and keeping communities and businesses safe, Prime Minister Chris Hipkins has announced. “We need a greater focus on what’s in front of New Zealanders right now. The new Cabinet line ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Prime Minister to meet with PM Albanese
    Prime Minister Chris Hipkins will travel to Canberra next week for an in person meeting with Australian Prime Minister, Anthony Albanese. “The trans-Tasman relationship is New Zealand’s closest and most important, and it was crucial to me that my first overseas trip as Prime Minister was to Australia,” Chris Hipkins ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Government makes first payment to Auckland Flooding fund
    The Government is providing establishment funding of $100,000 to the Mayoral Relief Fund to help communities in Auckland following flooding, Minister for Emergency Management Kieran McAnulty announced. “We moved quickly to make available this funding to support Aucklanders while the full extent of the damage is being assessed,” Kieran McAnulty ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government steps up to assist Auckland during flooding
    As the Mayor of Auckland has announced a state of emergency, the Government, through NEMA, is able to step up support for those affected by flooding in Auckland. “I’d urge people to follow the advice of authorities and check Auckland Emergency Management for the latest information. As always, the Government ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Poroporoaki: Titewhai Te Huia Hinewhare Harawira
    Ka papā te whatitiri, Hikohiko ana te uira, wāhi rua mai ana rā runga mai o Huruiki maunga Kua hinga te māreikura o te Nota, a Titewhai Harawira Nā reira, e te kahurangi, takoto, e moe Ka mōwai koa a Whakapara, kua uhia te Tai Tokerau e te kapua pōuri ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Enhanced Task Force Green Approved following Cyclone Hale
    Carmel Sepuloni, Minister for Social Development and Employment, has activated Enhanced Taskforce Green (ETFG) in response to flooding and damaged caused by Cyclone Hale in the Tairāwhiti region. Up to $500,000 will be made available to employ job seekers to support the clean-up. We are still investigating whether other parts ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • General Election to be held on 14 October 2023
    The 2023 General Election will be held on Saturday 14 October 2023, Prime Minister Jacinda Ardern announced today. “Announcing the election date early in the year provides New Zealanders with certainty and has become the practice of this Government and the previous one, and I believe is best practice,” Jacinda ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Prime Minister Jacinda Ardern announces resignation
    Jacinda Ardern has announced she will step down as Prime Minister and Leader of the Labour Party. Her resignation will take effect on the appointment of a new Prime Minister. A caucus vote to elect a new Party Leader will occur in 3 days’ time on Sunday the 22nd of ...
    BeehiveBy beehive.govt.nz
    3 weeks ago