The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.

    L

    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • Gaza and the Pacific on the agenda with Germany
    Foreign Minister Winston Peters discussed the need for an immediate ceasefire in Gaza, and enhanced cooperation in the Pacific with German Foreign Minister Annalena Baerbock during her first official visit to New Zealand today.    "New Zealand and Germany enjoy shared interests and values, including the rule of law, democracy, respect for the international system ...
    BeehiveBy beehive.govt.nz
    6 hours ago
  • Decision allows for housing growth in Western Bay of Plenty
    The Minister Responsible for RMA Reform, Chris Bishop today released his decision on four recommendations referred to him by the Western Bay of Plenty District Council, opening the door to housing growth in the area. The Council’s Plan Change 92 allows more homes to be built in existing and new ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Speech to New Zealand China Council
    Thank you, John McKinnon and the New Zealand China Council for the invitation to speak to you today.    Thank you too, all members of the China Council. Your effort has played an essential role in helping to build, shape, and grow a balanced and resilient relationship between our two ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Modern insurance law will protect Kiwi households
    The Government is modernising insurance law to better protect Kiwis and provide security in the event of a disaster, Commerce and Consumer Affairs Minister Andrew Bayly announced today. “These reforms are long overdue. New Zealand’s insurance law is complicated and dated, some of which is more than 100 years old. ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government recommits to equal pay
    The coalition Government is refreshing its approach to supporting pay equity claims as time-limited funding for the Pay Equity Taskforce comes to an end, Public Service Minister Nicola Willis says.  “Three years ago, the then-government introduced changes to the Equal Pay Act to support pay equity bargaining. The changes were ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Transforming how our children learn to read
    Structured literacy will change the way New Zealand children learn to read - improving achievement and setting students up for success, Education Minister Erica Stanford says.  “Being able to read and write is a fundamental life skill that too many young people are missing out on. Recent data shows that ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ not backing down in Canada dairy dispute
    Trade Minister Todd McClay says Canada’s refusal to comply in full with a CPTPP trade dispute ruling in our favour over dairy trade is cynical and New Zealand has no intention of backing down. Mr McClay said he has asked for urgent legal advice in respect of our ‘next move’ ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Stronger oversight for our most vulnerable children
    The rights of our children and young people will be enhanced by changes the coalition Government will make to strengthen oversight of the Oranga Tamariki system, including restoring a single Children’s Commissioner. “The Government is committed to delivering better public services that care for our most at-risk young people and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Streamlining Building Consent Changes
    The Government is making it easier for minor changes to be made to a building consent so building a home is easier and more affordable, Building and Construction Minister Chris Penk says.      “The coalition Government is focused on making it easier and cheaper to build homes so we can ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Minister acknowledges passing of Sir Robert Martin (KNZM)
    New Zealand lost a true legend when internationally renowned disability advocate Sir Robert Martin (KNZM) passed away at his home in Whanganui last night, Disabilities Issues Minister Louise Upston says. “Our Government’s thoughts are with his wife Lynda, family and community, those he has worked with, the disability community in ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to New Zealand Institute of International Affairs, Parliament – Annual Lecture: Challenges ...
    Good evening –   Before discussing the challenges and opportunities facing New Zealand’s foreign policy, we’d like to first acknowledge the New Zealand Institute of International Affairs. You have contributed to debates about New Zealand foreign policy over a long period of time, and we thank you for hosting us.  ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Accelerating airport security lines
    From today, passengers travelling internationally from Auckland Airport will be able to keep laptops and liquids in their carry-on bags for security screening thanks to new technology, Transport Minister Simeon Brown says. “Creating a more efficient and seamless travel experience is important for holidaymakers and businesses, enabling faster movement through ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Community hui to talk about kina barrens
    People with an interest in the health of Northland’s marine ecosystems are invited to a public meeting to discuss how to deal with kina barrens, Oceans and Fisheries Minister Shane Jones says. Mr Jones will lead the discussion, which will take place on Friday, 10 May, at Awanui Hotel in ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Kiwi exporters win as NZ-EU FTA enters into force
    Kiwi exporters are $100 million better off today with the NZ EU FTA entering into force says Trade Minister Todd McClay. “This is all part of our plan to grow the economy. New Zealand's prosperity depends on international trade, making up 60 per cent of the country’s total economic activity. ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Mining resurgence a welcome sign
    There are heartening signs that the extractive sector is once again becoming an attractive prospect for investors and a source of economic prosperity for New Zealand, Resources Minister Shane Jones says. “The beginnings of a resurgence in extractive industries are apparent in media reports of the sector in the past ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Ō-Rākau Remembrance Bill passes first reading
    The return of the historic Ō-Rākau battle site to the descendants of those who fought there moved one step closer today with the first reading of Te Pire mō Ō-Rākau, Te Pae o Maumahara / The Ō-Rākau Remembrance Bill. The Bill will entrust the 9.7-hectare battle site, five kilometres west ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government to boost public EV charging network
    Energy Minister Simeon Brown has announced 25 new high-speed EV charging hubs along key routes between major urban centres and outlined the Government’s plan to supercharge New Zealand’s EV infrastructure.  The hubs will each have several chargers and be capable of charging at least four – and up to 10 ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Residential Property Managers Bill to not progress
    The coalition Government will not proceed with the previous Government’s plans to regulate residential property managers, Housing Minister Chris Bishop says. “I have written to the Chairperson of the Social Services and Community Committee to inform him that the Government does not intend to support the Residential Property Managers Bill ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Independent review into disability support services
    The Government has announced an independent review into the disability support system funded by the Ministry of Disabled People – Whaikaha. Disability Issues Minister Louise Upston says the review will look at what can be done to strengthen the long-term sustainability of Disability Support Services to provide disabled people and ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Justice Minister updates UN on law & order plan
    Justice Minister Paul Goldsmith has attended the Universal Periodic Review in Geneva and outlined the Government’s plan to restore law and order. “Speaking to the United Nations Human Rights Council provided us with an opportunity to present New Zealand’s human rights progress, priorities, and challenges, while responding to issues and ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Ending emergency housing motels in Rotorua
    The Government and Rotorua Lakes Council are committed to working closely together to end the use of contracted emergency housing motels in Rotorua. Associate Minister of Housing (Social Housing) Tama Potaka says the Government remains committed to ending the long-term use of contracted emergency housing motels in Rotorua by the ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Trade Minister travels to Riyadh, OECD, and Dubai
    Trade Minister Todd McClay heads overseas today for high-level trade talks in the Gulf region, and a key OECD meeting in Paris. Mr McClay will travel to Riyadh to meet with counterparts from Saudi Arabia and the Gulf Cooperation Council (GCC). “New Zealand’s goods and services exports to the Gulf region ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Education priorities focused on lifting achievement
    Education Minister Erica Stanford has outlined six education priorities to deliver a world-leading education system that sets Kiwi kids up for future success. “I’m putting ambition, achievement and outcomes at the heart of our education system. I want every child to be inspired and engaged in their learning so they ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • NZTA App first step towards digital driver licence
    The new NZ Transport Agency (NZTA) App is a secure ‘one stop shop’ to provide the services drivers need, Transport Minister Simeon Brown and Digitising Government Minister Judith Collins say.  “The NZTA App will enable an easier way for Kiwis to pay for Vehicle Registration and Road User Charges (RUC). ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Supporting whānau out of emergency housing
    Whānau with tamariki growing up in emergency housing motels will be prioritised for social housing starting this week, says Associate Housing Minister Tama Potaka. “Giving these whānau a better opportunity to build healthy stable lives for themselves and future generations is an essential part of the Government’s goal of reducing ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Tribute to Dave O'Sullivan
    Racing Minister Winston Peters has paid tribute to an icon of the industry with the recent passing of Dave O’Sullivan (OBE). “Our sympathies are with the O’Sullivan family with the sad news of Dave O’Sullivan’s recent passing,” Mr Peters says. “His contribution to racing, initially as a jockey and then ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech – Eid al-Fitr
    Assalaamu alaikum, greetings to you all. Eid Mubarak, everyone! I want to extend my warmest wishes to you and everyone celebrating this joyous occasion. It is a pleasure to be here. I have enjoyed Eid celebrations at Parliament before, but this is my first time joining you as the Minister ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Government saves access to medicines
    Associate Health Minister David Seymour has announced Pharmac’s largest ever budget of $6.294 billion over four years, fixing a $1.774 billion fiscal cliff.    “Access to medicines is a crucial part of many Kiwis’ lives. We’ve committed to a budget allocation of $1.774 billion over four years so Kiwis are ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Pharmac Chair appointed
    Hon Paula Bennett has been appointed as member and chair of the Pharmac board, Associate Health Minister David Seymour announced today. "Pharmac is a critical part of New Zealand's health system and plays a significant role in ensuring that Kiwis have the best possible access to medicines,” says Mr Seymour. ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Taking action on Fetal Alcohol Spectrum Disorder
    Hundreds of New Zealand families affected by Fetal Alcohol Spectrum Disorder (FASD) will benefit from a new Government focus on prevention and treatment, says Health Minister Dr Shane Reti. “We know FASD is a leading cause of preventable intellectual and neurodevelopmental disability in New Zealand,” Dr Reti says.  “Every day, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New sports complex opens in Kaikohe
    Regional Development Minister Shane Jones today attended the official opening of Kaikohe’s new $14.7 million sports complex. “The completion of the Kaikohe Multi Sports Complex is a fantastic achievement for the Far North,” Mr Jones says. “This facility not only fulfils a long-held dream for local athletes, but also creates ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Diplomacy needed more than ever
    Foreign Minister Winston Peters’ engagements in Türkiye this week underlined the importance of diplomacy to meet growing global challenges.    “Returning to the Gallipoli Peninsula to represent New Zealand at Anzac commemorations was a sombre reminder of the critical importance of diplomacy for de-escalating conflicts and easing tensions,” Mr Peters ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Anzac Commemorative Address, Buttes New British Cemetery Belgium
    Ambassador Millar, Burgemeester, Vandepitte, Excellencies, military representatives, distinguished guests, ladies and gentlemen – good morning and welcome to this sacred Anzac Day dawn service.  It is an honour to be here on behalf of the Government and people of New Zealand at Buttes New British Cemetery, Polygon Wood – a deeply ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Anzac Commemorative Address – NZ National Service, Chunuk Bair
    Distinguished guests -   It is an honour to return once again to this site which, as the resting place for so many of our war-dead, has become a sacred place for generations of New Zealanders.   Our presence here and at the other special spaces of Gallipoli is made ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Anzac Commemorative Address – Dawn Service, Gallipoli, Türkiye
    Mai ia tawhiti pamamao, te moana nui a Kiwa, kua tae whakaiti mai matou, ki to koutou papa whenua. No koutou te tapuwae, no matou te tapuwae, kua honoa pumautia.   Ko nga toa kua hinga nei, o te Waipounamu, o te Ika a Maui, he okioki tahi me o ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • PM announces changes to portfolios
    Paul Goldsmith will take on responsibility for the Media and Communications portfolio, while Louise Upston will pick up the Disability Issues portfolio, Prime Minister Christopher Luxon announced today. “Our Government is relentlessly focused on getting New Zealand back on track. As issues change in prominence, I plan to adjust Ministerial ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New catch limits for unique fishery areas
    Recreational catch limits will be reduced in areas of Fiordland and the Chatham Islands to help keep those fisheries healthy and sustainable, Oceans and Fisheries Minister Shane Jones says. The lower recreational daily catch limits for a range of finfish and shellfish species caught in the Fiordland Marine Area and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Minister welcomes hydrogen milestone
    Energy Minister Simeon Brown has welcomed an important milestone in New Zealand’s hydrogen future, with the opening of the country’s first network of hydrogen refuelling stations in Wiri. “I want to congratulate the team at Hiringa Energy and its partners K one W one (K1W1), Mitsui & Co New Zealand ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Urgent changes to system through first RMA Amendment Bill
    The coalition Government is delivering on its commitment to improve resource management laws and give greater certainty to consent applicants, with a Bill to amend the Resource Management Act (RMA) expected to be introduced to Parliament next month. RMA Reform Minister Chris Bishop has today outlined the first RMA Amendment ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Overseas decommissioning models considered
    Overseas models for regulating the oil and gas sector, including their decommissioning regimes, are being carefully scrutinised as a potential template for New Zealand’s own sector, Resources Minister Shane Jones says. The Coalition Government is focused on rebuilding investor confidence in New Zealand’s energy sector as it looks to strengthen ...
    BeehiveBy beehive.govt.nz
    2 weeks ago

Page generated in The Standard by Wordpress at 2024-05-04T06:49:12+00:00