web analytics

The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.

    L

    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • Tokelau Language Week reminds us to stay united and strong
    Staying strong in the face of challenges and being true to our heritage and languages are key to preserving our cultural identity and wellbeing, is the focus of the 2020 Tokelau Language Week. Minister for Pacific Peoples, Aupito William Sio, says this year’s theme, ‘Apoapo tau foe, i nā tāfea ...
    BeehiveBy beehive.govt.nz
    10 hours ago
  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020
    New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020 Hon David Parker’s response following Thomas Piketty and Esther Duflo. Good morning, good afternoon, and good evening, wherever in the world you might be. I first acknowledge the excellent thought provoking speeches of Thomas Piketty and Esther ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Kaipara Moana restoration takes next step
    A Memorandum of Understanding has been signed today at Waihāua Marae between the Crown, local iwi and councils to protect, restore and enhance the mauri of Kaipara Moana in Northland. Environment Minister David Parker signed the document on behalf of the Crown along with representatives from Ngā Maunga Whakahī, Ngāti ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand and Uruguay unite on reducing livestock production emissions
    Agriculture Minister Damien O’Connor and Uruguayan Minister of Livestock, Agriculture and Fisheries Carlos María Uriarte have welcomed the launch of a three-year project that will underpin sustainable livestock production in Uruguay, Argentina, and Costa Rica.  The project called ‘Innovation for pasture management’ is led by Uruguay’s National Institute of Agricultural ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 3100 jobs created through marae upgrades
    Hundreds of marae throughout the country will be upgraded through investments from the Provincial Growth Fund’s refocused post COVID-19 funding to create jobs and put money into the pockets of local tradespeople and businesses, Regional Economic Development Minister Shane Jones and Māori Development Minister Nanaia Mahuta have announced. “A total ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Health volunteers recognised in annual awards
    Health Minister Chris Hipkins has announced 9 teams and 14 individuals are the recipients of this year’s Minister of Health Volunteer Awards.  “The health volunteer awards celebrate and recognise the thousands of dedicated health sector volunteers who give many hours of their time to help other New Zealanders,” Mr Hipkins ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community COVID-19 Fund supports Pacific recovery
    The Minister for Pacific Peoples, Aupito William Sio says a total of 264 groups and individuals have successfully applied for the Pacific Aotearoa Community COVID-19 Recovery Fund, that will support Pacific communities drive their own COVID-19 recovery strategies, initiatives, and actions. “I am keen to see this Fund support Pacific ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community benefits from Māori apprenticeships
    Up to 50 Māori apprentices in Wellington will receive paid training to build houses for their local communities, thanks to a $2.75 million investment from the Māori Trades and Training Fund, announced Employment Minister Willie Jackson today. “This funding will enable Ngāti Toa Rangatira Incorporated to provide its Ngā Kaimahi ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Training fund supports Māori jobseekers
    Rapidly growing sectors will benefit from a $990,000 Māori Trades and Training Fund investment which will see Wellington jobseekers supported into work, announced Employment Minister Willie Jackson today. “This funding will enable Sapphire Consultants Ltd. to help up to 45 Māori jobseekers into paid training initiatives over two years through ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruakura Inland Port development vital infrastructure for Waikato
    The Government is investing $40 million to develop an inland port at Ruakura which will become a freight super-hub and a future business, research and residential development for the Waikato, Urban Development and Transport Minister Phil Twyford, and Māori Development Minister Nanaia Mahuta announced today. The funding has been has ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Appointments made to Defence Expert Review Group
    Defence Minister Ron Mark announced today the establishment of an Expert Review Group to review a number of aspects of the New Zealand Defence Force’s (NZDF) structure, information management and record-keeping processes.  The Expert Review Group’s work arises out of the first recommendation from the Report of the Government’s Inquiry ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • No active community cases of COVID-19
    There are no active community cases of COVID-19 remaining in the country after the last people from the recent outbreak have recovered from the virus, Health Minister Chris Hipkins said today. “This is a big milestone. New Zealanders have once again through their collective actions squashed the virus. The systems ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Clean energy upgrade for more public buildings
    More public buildings will be supported by the Government to upgrade to run on clean energy, the Minister for Climate Change James Shaw announced today. Minister Shaw announced that Lincoln and Auckland universities will receive support through the Clean-Powered Public Service Fund to replace fossil fuel boilers. Southern, Taranaki, and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Schools back donations scheme for the second year
    More schools have opted in to the donations scheme for 2021, compared to 2020 when the scheme was introduced. “The families of more than 447,000 students will be better off next year, with 94% of eligible schools and kura opting into the scheme,” Education Minister Chris Hipkins said. “This is ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Ruapehu cycle trails gets PGF boost
    The spectacular Mountains to Sea cycle trail in Ruapehu District will receive $4.6 million in funding from the Provincial Growth Fund for two additional trails, Regional Economic Development Minister Shane Jones announced today. “This is an exciting development for the local community, and one that will provide significant economic opportunities ...
    BeehiveBy beehive.govt.nz
    3 weeks ago