The failing polls..

Written By: - Date published: 4:58 pm, October 16th, 2010 - 12 comments
Categories: community democracy, democratic participation, election 2011, labour, polls, telecommunications, vote smart - Tags:

An article in The Economist looks at the failing basis of polling techniques in the USA. It isn’t that much different to the circumstances here.

THEY are used to determine spending on political campaigns, to guide tactical voting and to enthuse or cow voters. News outlets, bloggers and activists cannot get enough of them. Candidates live and die by them. But even pollsters are worried that many of the political polls in individual races unveiled in the run-up to the mid-term elections in November may be inaccurate. “We’re in a dark age for polling,” says Jay Leve, boss of SurveyUSA, a polling firm. “It’s a very uncertain time.”

The immediate problem is the rapid growth in the number of people who have only a mobile phone, and are thus excluded from surveys conducted by landline. About a quarter of Americans are now “cellphone-onlys” (CPOs) in the industry jargon, and this poses both practical and statistical difficulties. They are less likely to answer their phones, and less likely to participate in a survey when they do, says Frank Newport of Gallup, another polling firm. They often retain their telephone numbers, including the area code, when they move from state to state, so it is hard to know where they are. And it costs more to call a mobile phone in the first place.

This is exactly the same problem that is steadily undermining the statistical validity of polls in NZ.  I’ve been involved in doing the numbers and canvassing in Labour for decades, and we see exactly the same issues. The significant difference here is that we are probably a lot further along. As well as the CPO’s we also have an awfully large number of urban centre people whose land-line is unlisted. This is largely the inevitable result of telemarketing – which was why I unlisted my phone number almost 20 years ago.

Pollsters can always “rinse” their data to try to correct such flaws. As Mr Newport of Gallup points out, most firms produced reasonably accurate findings ahead of this year’s primaries. It helps that the sort of people who do not have landlines are also the sort who tend to turn out in relatively low numbers in mid-term elections, notes Scott Keeter of the Pew Centre.

Which isn’t going to last. The CPO’s tend to vote more as they get older. In NZ the percentage of people with listed land-lines is currently pretty static in the over 45’s and starts falling away dramatically in people who are younger to very small percentages in the 20-25 age group. The actual profile is different in different areas. But when I first noticed it over 15 years ago the tipping point was in people in the 30-35 age group.

In the central Auckland electorates the number of households with listed phone numbers is now typically less than 60% and falling rapidly, whereas those in rural or more technically conservative areas can be over 80% but falling slowly.

Furthermore with the advent of caller id onto most phones, you get technophiles like me using it to screen calls. I don’t pick up if I don’t know who the caller is. They can leave a message because they’re probably not important to me.

If I’m doing anything like coding, moderating, or writing a post – I won’t answer even if I know who it is (unless it is family). Anyone that actually knows me also knows that they should e-mail or txt – it is far less disruptive to my work flow and limited leisure time. I hate having to disrupt my concentration. Of course I’m probably somewhat extreme and living around the bleeding edge. But other people are starting to head the same way…

But even if fears of a systematic bias prove unfounded, the fuss about CPOs points to a broader problem for pollsters: the ever-increasing difficulty of persuading Americans to take part in political polls. The proportion of those called who end up taking part in a survey has fallen steadily, from 35% or so in the 1990s to 15% or less now, according to Mr Keeter. Reaching young people is especially difficult. Only old ladies answer the phone, complains Bill McInturff of Public Opinion Strategies, a Republican polling firm.

Of course this isn’t just a problem for the pollsters.

It is also an issue for political parties canvassing to get a feel for voters in particular areas. Canvassing is a good tool for both getting to know the details of your electorate, and for convincing people to get out to vote. Typically you not only activate the person you talk to, but also those to whom they talk about it.

When campaigners of the left are doing their planning in the next few months they need to think about the limits for different canvassing strategies. Phone canvassing is a relatively cheap and effective tool because it allows wider coverage across our rather large electorates of fifty thousand potential voters. But we also need to seek out the pockets of people who are not on a listed land-line.

12 comments on “The failing polls.. ”

  1. M 1

    Canvassing might have to start up in shopping malls to get a true picture of polling trends if CPOs are the way of the future, although I think that many of the younger set are toally apolitical and will only start to make choices when things start to bite them hard – nothing like a bit of discomfort to galvanise opinion and action.

    • lprent 1.1

      It is one of those strange recurring trends in my observation. Every generation in history tends to be apolitical until they start having kids of their own.

      But it isn’t just me. You find the same observation throughout history. I’d look some up, but I’m being repeatably urged to cook dinner (Damnit!!).

    • annaliviaplurabella 1.2

      The shopping malls are the new High Street: with one major differance; they are privately owned by two Australian Companies.
      AMP and Westfield control our high Streets and will not allow canvassing in malls.
      We have done “walk throughs” in Lynn Mall but get hassle from security and management when if we hang around to canvas.

  2. Mac1 2

    My brother has a different technique to deal with invasive polling. He lies through his teeth to the interviewer.

    I was once polled by the local National party. They first asked me whether I knew the name of the departing National MP. I answered correctly.

    The interviewer then asked whether I knew the name of the new National candidate.

    When I asked whether she had already forgotten the name of that illustrious worthy, the interviewer suddenly realised she was in fact talking to the Labour candidate.

  3. The big problem with polling is that it tends to become self fulfilling. And current trends tend to count out the younger and poorer, thereby emphasising the support for the parties supporting the wealthy, that is National and Act.

    In 2008 much of the malaise for Labour was created by the polling suggesting that Labour could not win. Eventually it became true.

    In 2005 the last Colmar Brunton before election day suggested National would win by 6 points, Labour won by 2.

    And the Auckland mayoral polls were pretty screwy. I thought that they were a consequence of odd questions and strange datasets but the answer could be they did not poll those who supported Len in spades, that is the poor and young.

  4. Mac1 4

    Another factor is the type of political polling. I have been polled locally by both major parties and by national organisations as well. One such was a commercial organisation who sent a booklet which had a raft of good political questions followed by another ten minutes of commercial stuff, which was really annoying in terms of time and interest.

    I realised that all I was mostly doing was helping land agents, car salesmen and large retailers to more accurately target me and my ilk as a consumer, so I sent back the form uncompleted, saying why. I wonder how many more poll results are skewed in a similar way.

    Vox pops in the paper also annoy me for their selectiveness. That is, until the last week, when eleven out of twelve interviewees, in two separate papers, condemned Paul Henry’s comments as racist. I was especially pleased with two young male high school students who were very clear in their views and understanding.

  5. Lew 5

    Good post, Lynn, but talk about burying the lead, which is:Landline-only polling in the US favours the Republican party by about five points compared to a mixed landline/cell sample. In a two-horse middleground race, that’s a simply massive distortion.

    L

    • lprent 5.1

      I thought about it and wrote paragraphs on it. But it got in the way of the basic demographic pattern on age, and is more a consequence of conservatism vs early adopters.There is a strong correlation in nz between numbers of visible landlines in an electorate and conservative voting patterns but there are some interesting exceptions. The paragraphs just kept rising, I was writing in the conference, and it was getting too complicated… Eventually I edited it out the surplus paragraphs

Links to post

Recent Comments

Recent Posts

  • PM announces changes to portfolios
    Paul Goldsmith will take on responsibility for the Media and Communications portfolio, while Louise Upston will pick up the Disability Issues portfolio, Prime Minister Christopher Luxon announced today. “Our Government is relentlessly focused on getting New Zealand back on track. As issues change in prominence, I plan to adjust Ministerial ...
    BeehiveBy beehive.govt.nz
    19 hours ago
  • New catch limits for unique fishery areas
    Recreational catch limits will be reduced in areas of Fiordland and the Chatham Islands to help keep those fisheries healthy and sustainable, Oceans and Fisheries Minister Shane Jones says. The lower recreational daily catch limits for a range of finfish and shellfish species caught in the Fiordland Marine Area and ...
    BeehiveBy beehive.govt.nz
    23 hours ago
  • Minister welcomes hydrogen milestone
    Energy Minister Simeon Brown has welcomed an important milestone in New Zealand’s hydrogen future, with the opening of the country’s first network of hydrogen refuelling stations in Wiri. “I want to congratulate the team at Hiringa Energy and its partners K one W one (K1W1), Mitsui & Co New Zealand ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Urgent changes to system through first RMA Amendment Bill
    The coalition Government is delivering on its commitment to improve resource management laws and give greater certainty to consent applicants, with a Bill to amend the Resource Management Act (RMA) expected to be introduced to Parliament next month. RMA Reform Minister Chris Bishop has today outlined the first RMA Amendment ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Overseas decommissioning models considered
    Overseas models for regulating the oil and gas sector, including their decommissioning regimes, are being carefully scrutinised as a potential template for New Zealand’s own sector, Resources Minister Shane Jones says. The Coalition Government is focused on rebuilding investor confidence in New Zealand’s energy sector as it looks to strengthen ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Release of North Island Severe Weather Event Inquiry
    Emergency Management and Recovery Minister Mark Mitchell has today released the Report of the Government Inquiry into the response to the North Island Severe Weather Events. “The report shows that New Zealand’s emergency management system is not fit-for-purpose and there are some significant gaps we need to address,” Mr Mitchell ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Justice Minister to attend Human Rights Council
    Justice Minister Paul Goldsmith is today travelling to Europe where he’ll update the United Nations Human Rights Council on the Government’s work to restore law and order.  “Attending the Universal Periodic Review in Geneva provides us with an opportunity to present New Zealand’s human rights progress, priorities, and challenges, while ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Patterson reopens world’s largest wool scouring facility
    Associate Agriculture Minister, Mark Patterson, formally reopened the world’s largest wool processing facility today in Awatoto, Napier, following a $50 million rebuild and refurbishment project. “The reopening of this facility will significantly lift the economic opportunities available to New Zealand’s wool sector, which already accounts for 20 per cent of ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to the Southland Otago Regional Engineering Collective Summit, 18 April 2024
    Hon Andrew Bayly, Minister for Small Business and Manufacturing  At the Southland Otago Regional Engineering Collective (SOREC) Summit, 18 April, Dunedin    Ngā mihi nui, Ko Andrew Bayly aho, Ko Whanganui aho    Good Afternoon and thank you for inviting me to open your summit today.    I am delighted ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Government to introduce revised Three Strikes law
    The Government is delivering on its commitment to bring back the Three Strikes legislation, Associate Justice Minister Nicole McKee announced today. “Our Government is committed to restoring law and order and enforcing appropriate consequences on criminals. We are making it clear that repeat serious violent or sexual offending is not ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New diplomatic appointments
    Foreign Minister Winston Peters has today announced four new diplomatic appointments for New Zealand’s overseas missions.   “Our diplomats have a vital role in maintaining and protecting New Zealand’s interests around the world,” Mr Peters says.    “I am pleased to announce the appointment of these senior diplomats from the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Humanitarian support for Ethiopia and Somalia
    New Zealand is contributing NZ$7 million to support communities affected by severe food insecurity and other urgent humanitarian needs in Ethiopia and Somalia, Foreign Minister Rt Hon Winston Peters announced today.   “Over 21 million people are in need of humanitarian assistance across Ethiopia, with a further 6.9 million people ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Arts Minister congratulates Mataaho Collective
    Minister for Arts, Culture and Heritage Paul Goldsmith is congratulating Mataaho Collective for winning the Golden Lion for best participant in the main exhibition at the Venice Biennale. "Congratulations to the Mataaho Collective for winning one of the world's most prestigious art prizes at the Venice Biennale.  “It is good ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Supporting better financial outcomes for Kiwis
    The Government is reforming financial services to improve access to home loans and other lending, and strengthen customer protections, Commerce and Consumer Affairs Minister Andrew Bayly and Housing Minister Chris Bishop announced today. “Our coalition Government is committed to rebuilding the economy and making life simpler by cutting red tape. We are ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Trade relationship with China remains strong
    “China remains a strong commercial opportunity for Kiwi exporters as Chinese businesses and consumers continue to value our high-quality safe produce,” Trade and Agriculture Minister Todd McClay says.   Mr McClay has returned to New Zealand following visits to Beijing, Harbin and Shanghai where he met ministers, governors and mayors and engaged in trade and agricultural events with the New ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • PM’s South East Asia mission does the business
    Prime Minister Christopher Luxon has completed a successful trip to Singapore, Thailand and the Philippines, deepening relationships and capitalising on opportunities. Mr Luxon was accompanied by a business delegation and says the choice of countries represents the priority the New Zealand Government places on South East Asia, and our relationships in ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • $41m to support clean energy in South East Asia
    New Zealand is demonstrating its commitment to reducing global greenhouse emissions, and supporting clean energy transition in South East Asia, through a contribution of NZ$41 million (US$25 million) in climate finance to the Asian Development Bank (ADB)-led Energy Transition Mechanism (ETM). Prime Minister Christopher Luxon and Climate Change Minister Simon Watts announced ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Minister releases Fast-track stakeholder list
    The Government is today releasing a list of organisations who received letters about the Fast-track applications process, says RMA Reform Minister Chris Bishop. “Recently Ministers and agencies have received a series of OIA requests for a list of organisations to whom I wrote with information on applying to have a ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Judicial appointments announced
    Attorney-General Judith Collins today announced the appointment of Wellington Barrister David Jonathan Boldt as a Judge of the High Court, and the Honourable Justice Matthew Palmer as a Judge of the Court of Appeal. Justice Boldt graduated with an LLB from Victoria University of Wellington in 1990, and also holds ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Education Minister heads to major teaching summit in Singapore
    Education Minister Erica Stanford will lead the New Zealand delegation at the 2024 International Summit on the Teaching Profession (ISTP) held in Singapore. The delegation includes representatives from the Post Primary Teachers’ Association (PPTA) Te Wehengarua and the New Zealand Educational Institute (NZEI) Te Riu Roa.  The summit is co-hosted ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Value of stopbank project proven during cyclone
    A stopbank upgrade project in Tairawhiti partly funded by the Government has increased flood resilience for around 7000ha of residential and horticultural land so far, Regional Development Minister Shane Jones says. Mr Jones today attended a dawn service in Gisborne to mark the end of the first stage of the ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Anzac commemorations, Türkiye relationship focus of visit
    Foreign Affairs Minister Winston Peters will represent the Government at Anzac Day commemorations on the Gallipoli Peninsula next week and engage with senior representatives of the Turkish government in Istanbul.    “The Gallipoli campaign is a defining event in our history. It will be a privilege to share the occasion ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Minister to Europe for OECD meeting, Anzac Day
    Science, Innovation and Technology and Defence Minister Judith Collins will next week attend the OECD Science and Technology Ministerial conference in Paris and Anzac Day commemorations in Belgium. “Science, innovation and technology have a major role to play in rebuilding our economy and achieving better health, environmental and social outcomes ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Comprehensive Partnership the goal for NZ and the Philippines
    Prime Minister Christopher Luxon held a bilateral meeting today with the President of the Philippines, Ferdinand Marcos Jr.  The Prime Minister was accompanied by MP Paulo Garcia, the first Filipino to be elected to a legislature outside the Philippines. During today’s meeting, Prime Minister Luxon and President Marcos Jr discussed opportunities to ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government commits $20m to Westport flood protection
    The Government has announced that $20 million in funding will be made available to Westport to fund much needed flood protection around the town. This measure will significantly improve the resilience of the community, says Local Government Minister Simeon Brown. “The Westport community has already been allocated almost $3 million ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Taupō takes pole position
    The Government is proud to support the first ever Repco Supercars Championship event in Taupō as up to 70,000 motorsport fans attend the Taupō International Motorsport Park this weekend, says Economic Development Minister Melissa Lee. “Anticipation for the ITM Taupō Super400 is huge, with tickets and accommodation selling out weeks ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Cost of living support for low-income homeowners
    Local Government Minister Simeon Brown has announced an increase to the Rates Rebate Scheme, putting money back into the pockets of low-income homeowners.  “The coalition Government is committed to bringing down the cost of living for New Zealanders. That includes targeted support for those Kiwis who are doing things tough, such ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Government backing mussel spat project
    The Coalition Government is investing in a project to boost survival rates of New Zealand mussels and grow the industry, Oceans and Fisheries Minister Shane Jones has announced. “This project seeks to increase the resilience of our mussels and significantly boost the sector’s productivity,” Mr Jones says. “The project - ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Government focused on getting people into work
    Benefit figures released today underscore the importance of the Government’s plan to rebuild the economy and have 50,000 fewer people on Jobseeker Support, Social Development and Employment Minister Louise Upston says. “Benefit numbers are still significantly higher than when National was last in government, when there was about 70,000 fewer ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Clean energy key driver to reducing emissions
    The Government’s commitment to doubling New Zealand’s renewable energy capacity is backed by new data showing that clean energy has helped the country reach its lowest annual gross emissions since 1999, Climate Change Minister Simon Watts says. New Zealand’s latest Greenhouse Gas Inventory (1990-2022) published today, shows gross emissions fell ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Earthquake-prone buildings review brought forward
    The Government is bringing the earthquake-prone building review forward, with work to start immediately, and extending the deadline for remediations by four years, Building and Construction Minister Chris Penk says. “Our Government is focused on rebuilding the economy. A key part of our plan is to cut red tape that ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Thailand and NZ to agree to Strategic Partnership
    Prime Minister Christopher Luxon and his Thai counterpart, Prime Minister Srettha Thavisin, have today agreed that New Zealand and the Kingdom of Thailand will upgrade the bilateral relationship to a Strategic Partnership by 2026. “New Zealand and Thailand have a lot to offer each other. We have a strong mutual desire to build ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government consults on extending coastal permits for ports
    RMA Reform Minister Chris Bishop and Transport Minister Simeon Brown have today announced the Coalition Government’s intention to extend port coastal permits for a further 20 years, providing port operators with certainty to continue their operations. “The introduction of the Resource Management Act in 1991 required ports to obtain coastal ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Inflation coming down, but more work to do
    Today’s announcement that inflation is down to 4 per cent is encouraging news for Kiwis, but there is more work to be done - underlining the importance of the Government’s plan to get the economy back on track, acting Finance Minister Chris Bishop says. “Inflation is now at 4 per ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • School attendance restored as a priority in health advice
    Refreshed health guidance released today will help parents and schools make informed decisions about whether their child needs to be in school, addressing one of the key issues affecting school attendance, says Associate Education Minister David Seymour. In recent years, consistently across all school terms, short-term illness or medical reasons ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Unnecessary bureaucracy cut in oceans sector
    Oceans and Fisheries Minister Shane Jones is streamlining high-level oceans management while maintaining a focus on supporting the sector’s role in the export-led recovery of the economy. “I am working to realise the untapped potential of our fishing and aquaculture sector. To achieve that we need to be smarter with ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Patterson promoting NZ’s wool sector at International Congress
    Associate Agriculture Minister Mark Patterson is speaking at the International Wool Textile Organisation Congress in Adelaide, promoting New Zealand wool, and outlining the coalition Government’s support for the revitalisation the sector.    "New Zealand’s wool exports reached $400 million in the year to 30 June 2023, and the coalition Government ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Removing red tape to help early learners thrive
    The Government is making legislative changes to make it easier for new early learning services to be established, and for existing services to operate, Associate Education Minister David Seymour says. The changes involve repealing the network approval provisions that apply when someone wants to establish a new early learning service, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • RMA changes to cut coal mining consent red tape
    Changes to the Resource Management Act will align consenting for coal mining to other forms of mining to reduce barriers that are holding back economic development, Resources Minister Shane Jones says. “The inconsistent treatment of coal mining compared with other extractive activities is burdensome red tape that fails to acknowledge ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • McClay reaffirms strong NZ-China trade relationship
    Trade, Agriculture and Forestry Minister Todd McClay has concluded productive discussions with ministerial counterparts in Beijing today, in support of the New Zealand-China trade and economic relationship. “My meeting with Commerce Minister Wang Wentao reaffirmed the complementary nature of the bilateral trade relationship, with our Free Trade Agreement at its ...
    BeehiveBy beehive.govt.nz
    1 week ago

Page generated in The Standard by Wordpress at 2024-04-24T20:07:21+00:00