Thin and effeminate statistics

Written By: - Date published: 4:05 pm, November 8th, 2012 - 25 comments
Categories: science, uk politics - Tags: , ,

Here’s another entry in the Very Important Columnist vs Parasitic Bloggers file. While the professional mainstream media were all chanting in unison that the American presidential election was “too close to call”, one (famous!) blogger correctly predicted the result – for every state. The Guardian reports:

 So who is he?  A statistical analyst of elections and a former statistical analyst of baseball. His blog, FiveThirtyEight, now hosted by the New York Times, is the go-to site for cold, hard election stats.

…  Silver didn’t just predict Obama was going to win it. He correctly projected the results for every single one of America’s 50 states. Something 50 tossed coins would have less than a one in a trillion chance of getting right.

Ah, well. That’s a little more impressive. How’d he do it? With his “election simulator” statistical model, which aggregates hundreds of polling figures and economic data, weights it all for accuracy, factors in a load of fancy maths about past elections and boils the whole thing down to a percentage chance of victory for each candidate. On Tuesday morning, while many pundits were insisting it was too close to call, Silver’s model put Obama’s chances at a precise and healthy 90.9%.

How did pundits feel about that? Pretty uncomfortable. He was derided in the media as “a joke”, who was “getting into silly land”. One rightwing blogger even dismissed his predictions on the grounds that Silver – an openly gay Democrat – was “thin and effeminate”.

(Today’s xkcd is also on the case.)

In 2008 Silver correctly predicted 49 / 50 states. So, thin and effeminate statistics 2, mainstream media 0. Political punditry, at least in America, is going to have to lift its game…


Just for the record, Nate Silver’s predictions:

The result:

25 comments on “Thin and effeminate statistics”

  1. There can be only one explanation for such accurate predictions: Science! Witchcraft.

  2. kea 2

    Yep, I’ve been following Nate during this election with great interest – if anyone’s interested, follow his rss feed.

    Cheers ..

    • Nate is the anti Fox news.

      Those guys were still trying to say that at least Romney had won the popular vote when only a quarter of California’s votes has been reported in …

      Obama is currently winning the popular vote by 60.6 million to 57.8 million …

  3. Zorr 3

    I think we’re going to have to rethink the old addage “Lies, damned lies and statistics” because this guy seems to be proving the worth of the field…

    • That’s not what the adage refers to.

      http://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics

      It’s referring to the fact that lies that pretend to be statistics are the worst and hardest to debunk of all three types. 😉 Nate Silver’s statistics were honest.

    • RedLogix 3.2

      Yes. Matthew nails it correctly.

      It’s very easy to dress up a lie as data and statistics. Sadly far too many people have no real idea how these things work, and how very powerfully statistics can extract real and valuable meaning from difficult, noisy and incomplete information.

      In the real world data is very rarely clean, complete and noise-free. There are almost always other variables in play that taint or skew the raw data. Good statistics when done well (as this guy does ) can yield remarkable and powerful insights.

      Unfortunately it’s also very easy for people to hijack this power to lend credibility to their lies by dressing them up as statistics. And because most people quite understandably have little to no skill in the subject, makes them very hard to debunk effectively. Most people just shrug their shoulders and mutter the ‘damn lies’ line to themselves.

  4. tracey 4

    Perhaps because he isnt manipulating stats he is collecting them and genuinely analysing them for numerical not ploitical trends. As long as people like farrar, hooten and mccarten are relied upon for political analysis we can hardly expect a scientific outcome.

  5. Rich 5

    Only three or four states actually ever change hands, right? And they aren’t independent variables – if many Nevadans swing left, then so might Coloradans and Floridese. So it’s maybe more like a 1:5 chance of getting a prediction right.

    With 57 million blogs on WordPress alone, I’d think that a very large number of random bloggers would get the election result right in every state, if they bothered to make a call.

    • kea 5.1

      One of the things Nate does is to repeatedly re-run many models, each tweaked to cover various possibilities, and his ‘predictions’ are the aggregates of the results. The published photo I saw was of him sitting in what looked like a suburban hut with a laptop – although it may have been connected to a server via fibreoptic, who knows. I don’t know what program he was using, but it is probably a combination of baseball number crunching experience and contemporary computing power ..

  6. kea 6

    I have to give credit to someone on this blog who put me onto it. Can’t remember who ..

  7. gobsmacked 8

    “Hello, welcome to Close-Up Sunday Breakfast on TVNZ.

    Today we’re going to discuss facts and figures. Do they matter?

    Here to tell us are some Experts, all of whom you know well, because they’re appearing in all media every week. There’s 1) a washed-up former MP who lost his seat, 2) a grumpy old git who copys his column from Wikipedia, and 3) a token woman who likes to say “Look”.

    So panel, how about Nate Silver? Worth a whole lot more than anything you ever have to say, wouldn’t you agree?

    1) “Well, I’ve got a feeling about this election, a real sense that something is happening, and it’s come fresh from my arse. So don’t bother me with all these ivory tower numbers – get back in the real world!”

    2) “At the end of the day, who can you believe? Statistics, at the end of the day, are just something spouted by bloggers. I remember Muldoon once said to me …

    3) “Look …

    (audience chucks coffee cup at TV, goes back to bed)

    • Anne 8.1

      (audience chucks coffee cup at TV, goes back to bed)

      It’s true. I can vouch for it.

    • Colonial Viper 8.2

      That show worsens my hangover. Which is saying something.

    • Tracey 8.3

      for Gobsmacked NOT the show

    • QoT 8.4

      Holy shit, you totally called Firstline’s coverage this morning. Some dude excusing the blatantly biased coverage/spinning of polls in the US as being about Nate Silver being some kind of magically advanced wizard, and “oh people just aren’t used to treating statistics like this” … as opposed to, you know, corporations with obvious agendas telling their anchors how to talk down polls they don’t like.

  8. kea 9

    That’s about right ..

  9. mike e 10

    Imagine what key would have said if he had been wearing red

  10. Is there a Nate Silver type person In New Zealand???

    He is brilliant.

  11. SukieDamson 12

    Once upon a time. His name was Marty G.

  12. kea 14

    For the psephologists and election junkies

    An extended video interview with Nate Silver.

    http://www.thedailyshow.com/watch/wed-october-17-2012/exclusive—nate-silver-extended-interview-pt–1

Recent Comments

Recent Posts

  • Housing report earns Nats the red card
    National’s failure to acknowledge and fix the housing crisis will be their legacy. Labour will tackle the housing crisis head-on, says Labour Housing spokesperson Phil Twyford. ...
    3 days ago
  • Sluggish growth reflects nine years of drift from National
    Today’s GDP figures reflect an economy that the National Government has allowed to drift along on the basis of growing population rather than improving productivity and adding value, says Labour’s Finance spokesperson Grant Robertson. “It is important to recognise that ...
    3 days ago
  • National’s campaign of deception an affront to democracy
    Voters this week have a clear choice between Labour’s optimism and honesty, or rewarding National’s campaign of relentless lies, says Labour’s Finance spokesperson Grant Robertson. “Day after day National has been deliberately spreading lies about Labour, our intentions and what ...
    4 days ago
  • National’s economy scorecard: D for drift
    New Zealand’s economy is failing the very people it is supposed to uplift, characterised by stalled productivity, exports going backwards and a Government content to let it drift, says Leader of the Opposition Jacinda Ardern. “Voters have a clear choice ...
    4 days ago
  • Another day – another health crisis
    News today that the emergency department at Waikato has turned 180 patients away is another crisis for the Government and its besieged health system, says Labour’s Health spokesperson David Clark. “It’s astonishing that the Government has had to rely on ...
    4 days ago
  • Labour will get tough on loan sharks
      Labour will take a tough stance on loan sharks and make sure that the Commerce Commission is properly resourced to protect Kiwi consumers, says Labour’s Consumer Affairs spokesperson Michael Wood.   “People on low incomes must be protected from ...
    4 days ago
  • GP letter more evidence of failure in mental health
      A letter of complaint by medical practitioners to the Ministry of Health and Capital and Coast District Health Board underlines how badly patients are being let down by mental health services in Wellington, says Labour Leader Jacinda Ardern.  “The ...
    5 days ago
  • GP letter more evidence of failure in mental health
      A letter of complaint by medical practitioners to the Ministry of Health and Capital and Coast District Health Board underlines how badly patients are being let down by mental health services in Wellington, says Labour Leader Jacinda Ardern.  “The ...
    5 days ago
  • Tax cuts when kids go hungry shows National’s lack of moral compass
    National’s campaign of tax cuts that give $400 million to the top 10 per cent of earners, at a time when 120 Kiwi kids every year are being hospitalised for malnutrition, shows they have lost their moral compass, says Labour’s ...
    5 days ago
  • Freight being shifted off planes as fuel crisis worsens
    Export freight is being shifted off flights because of the Government’s failure to manage the risk of disruption to jet fuel supplies, says Labour’s Economic Development spokesperson Stuart Nash. “It has been revealed to Labour that non-perishable export freight is ...
    5 days ago
  • Apologise now Jonathan
    Health Minister Jonathan Coleman must apologise for his part in a $2.3 billion shortfall that has contributed to delays in cancer diagnosis and treatment, says Labour’s Health spokesperson David Clark. “All the Minister could say in an interview this morning ...
    5 days ago
  • National’s health report card shows need for new plan
    From increased GP fees, to kids getting sick from cold homes, to denial of important surgeries, National’s underfunding of health has hurt Kiwi families, says Leader of the Opposition Jacinda Ardern.   “It’s time to invest in the health of ...
    5 days ago
  • Eye clinic wait downright dangerous
    The fact that 9,500 Kiwis are waiting one and a half times longer than they should to get follow-up eye appointments is unacceptable and dangerous, says Labour’s Health Spokesperson David Clark. “These people are entitled to the reassurance that if ...
    5 days ago
  • National has serious questions to answer over Auckland fuel crisis
    Thousands of air travellers looking for answers to Auckland Airport’s fuel crisis should be demanding the National Government come clean over its failure to secure fuel supply for the airport, says Labour Leader Jacinda Ardern.  “There are serious questions the ...
    6 days ago
  • Come clean on trade before the election
    In the two days before the election, New Zealand MFAT negotiators will attend a negotiations meeting in Japan on the successor to the failed Trans-Pacific Partnership Agreement (TPPA), now called the TPP-11. The negotiations are shrouded in secrecy but we ...
    GreensBy Barry Coates
    1 week ago
  • National unravels on transport
    The release of extraordinary information showing that the East-West link could be the most expensive road in the world, at $327 million per kilometre, shows that National is fiscally reckless and out of ideas on transport, says Labour’s Transport spokesperson ...
    1 week ago
  • Saudi cover-up a perversion of democracy
    The Government has been exposed as dishonest after it was revealed that  they were wrong to claim they paid out $11 million dollars to a Saudi businessmen after legal advice, says Labour’s Foreign Affairs spokesperson David Parker.  “OIAs revealed on ...
    1 week ago
  • Labour supporting Te Reo Māori in schools
    Labour will support a future where New Zealanders from every background will have the ability to use Te Reo Māori in everyday conversations, says Labour’s Deputy Leader and Māori Development spokesperson Kelvin Davis. “Labour will commit to a target that ...
    1 week ago
  • Is National planning a secret fuel tax?
    Sources suggest National is considering a secret fuel tax to fund its controversial Roads of National Significance (RONS) programme, says Labour’s Transport spokesperson Michael Wood. “While the Government keeps up its stream of lies about Labour’s tax policy, sources indicate ...
    1 week ago
  • Labour’s plan for West Coast prosperity
    Labour’s regional development plan for the West Coast will build on its strengths in engineering and tourism, while delivering a much-needed upgrade to the Buller Hospital, says Labour Leader Jacinda Ardern.  “Labour’s vision is for a thriving regional New Zealand, ...
    1 week ago
  • Labour committed to fair and progressive tax system
    Labour is committed to a tax system where everyone pays their fair share and where we start to address the imbalances that have fuelled the housing crisis, says Labour’s Finance spokesperson Grant Robertson and Labour’s Revenue spokesperson Michael Wood. "Today ...
    1 week ago
  • A challenge to Bill English
    ...
    1 week ago
  • Flavell’s fake news an insult to Māori voters
    A desperate Te Ururoa Flavell has resorted to fake news about Labour’s position on his unpopular Ture Whenua reforms, says Labour’s Ikaroa-Rawhiti MP Meka Whaitiri. ...
    2 weeks ago
  • National’s tax cuts reckless and irresponsible
    It is time for Bill English and Steven Joyce to stop the scaremongering and lies, and front up to New Zealanders about the impact of their tax cuts, Labour’s Finance spokesperson Grant Robertson says. “Bill English has no credibility on ...
    2 weeks ago
  • Calculator shows Labour’s Families Package delivers
    Labour has launched a new online calculator that show how much extra families with kids will get from Labour’s Families Package, says Leader of the Opposition Jacinda Ardern. “Families can go to www.labour.org.nz/calculator and see how much better off they ...
    2 weeks ago
  • Strengthening New Zealand’s identity through Labour’s media and film policy
    Labour has today launched its media and film policy aimed at strengthening New Zealand’s identity and providing sustainability for the industry, says Leader of the Opposition Jacinda Ardern. ...
    2 weeks ago
  • Labour to invest in parents and babies
    Labour will fund an additional 100 Plunket and Tamariki Ora nurses to increase the help available for vulnerable parents and babies, says Leader of the Opposition Jacinda Ardern. “It’s so important that our children get the best start in life. ...
    2 weeks ago
  • Labour to build affordable homes and state houses in Hawke’s Bay
    Labour will build a mix of 240 affordable KiwiBuild starter homes for first home buyers and state homes for families in need in Napier and Hastings, says Leader of the Opposition Jacinda Ardern. “In 2016, the populations of Napier and ...
    2 weeks ago
  • Labour pledges more for Whānau Ora
    Labour will strengthen the oversight of Whānau Ora and provide an extra $20 million over four years to improve outcomes for whānau and families, says Labour’s Deputy Leader Kelvin Davis.    “We’ve created a new position of Whānau Ora Reviewer ...
    2 weeks ago
  • National’s housing band aid
    Throwing subsidies at an under-supplied housing market is one last desperate bid by National to be seen to do something about the housing crisis, says Labour’s Housing spokesperson Phil Twyford.  “First home buyers have been the collateral damage of National’s ...
    2 weeks ago
  • Housing, families, education and environment top priorities in Labour’s first 100 days
    Labour will take urgent action in its first 100 days in office to expand support for families and students, make rental homes warm and dry, find solutions to the mental health crisis and accelerate efforts to clean up our waterways, ...
    2 weeks ago
  • Labour pledges to unlock funding for Te Hiku sports hub project
    The Labour Government will inject nearly $3 million into the Te Hiku Sports Hub project, to help realise a much-needed health and recreational facility for the Far North, says Labour Deputy Leader and MP for Te Tai Tokerau Kelvin Davis. ...
    2 weeks ago
  • Labour’s plan to get job seekers into better work
    Labour will provide real support for people looking for work by increasing the amount of money someone can earn before their benefit begins to reduce, reinstating training incentives, and putting a renewed focus on upskilling and training, says Labour’s Social ...
    2 weeks ago
  • Labour sets strong target and plan for climate action
    Labour will set a target of net zero carbon emissions by 2050 and take the necessary steps to achieve it, says Leader of the Opposition Jacinda Ardern.  “Climate change is my generation’s nuclear-free moment. We have to take our place ...
    2 weeks ago
  • Are education cuts missing in National’s Fiscal Plan?
    National needs to explain why its plans for cuts to school transport have not been announced in its fiscal plan, says Labour’s Education spokesperson Chris Hipkins.   “Buried in the Pre-election Budget update is a $5m a year cut to ...
    2 weeks ago
  • Joyce must come clean on Health and Education funding
    Steven Joyce needs to front up to New Zealanders and tell them whether he will fund health and education to meet increasing cost pressures, or risk seeing services cut and costs increase for parents, says Labour’s Finance spokesperson Grant Robertson.  ...
    2 weeks ago
  • Housing crisis is National’s legacy
    Reports of tenants languishing in boarding houses for years because they cannot get a state house is yet more evidence National’s legacy is the housing crisis, says Labour’s Housing spokesperson Phil Twyford.  “We used to pride ourselves in this country ...
    3 weeks ago
  • Labour calls for release of report into civil defence flaws
    The National Government must stick by its word given to other political parties and release a technical report before the election addressing critical flaws in New Zealand’s civil defence capability, Labour Civil Defence spokesperson Clare Curran said today.  “Cross party ...
    3 weeks ago
  • Credibility shot as Government runs out of steam
    New Zealanders are witnessing the desperation of a government clinging to survival, evidenced by policy on-the-hoof, dodgy maths and dirty politics, says Labour MP Phil Twyford. “New Zealand had been hoping we’d seen the end of dirty politics, but what ...
    3 weeks ago
  • Steven Joyce must apologise to New Zealand
    Steven Joyce needs to front up to New Zealanders and apologise for his patently false and cynical attack on Labour’s Fiscal Plan, says Labour’s Finance spokesperson Grant Robertson. “Every respected economic commentator has come out and said that Labour’s Fiscal ...
    3 weeks ago
  • Bill English didn’t answer because the Oreti is badly polluted
    Last night Bill English was asked by Paddy Gower in the Leader’s Debate: “Which river did he swim in as a kid, and is it now polluted?” Bill English named the Oreti River, but did not answer whether it is ...
    3 weeks ago
  • Nats put out dodgy numbers – again
    National’s promise to increase the number of elective surgeries to 200,000 is bizarre, given Jonathan Coleman has claimed 200,000 electives are already being performed, says Labour’s Health spokesperson David Clark. ...
    3 weeks ago
  • Prime Minister’s Award to encourage young people into trades training
    Labour will introduce a $2,000 award for the best pupil in vocational courses in each public secondary school, says Leader of the Opposition Jacinda Ardern. “We know there’s huge demand for trades workers, particularly in the building sector, where construction ...
    3 weeks ago
  • Not another Nick Smith wild goose chase
    Only the election on September 23 can save the country and the RMA from Nick Smith, say Labour’s Housing spokesperson Phil Twyford and Environment spokesperson David Parker. ...
    3 weeks ago
  • Government supresses Climate Change report
    The Government has deliberately sat on a critical Climate Change report for 5 months which they must now release, election or no election, says Labour’s Climate Change spokesperson Megan Woods.  “I want the report released immediately, so that New Zealanders ...
    3 weeks ago
  • Joyce gets it wrong on Labour’s Fiscal Plan
    Labour’s Fiscal Plan is robust, the numbers are correct and we stand by them despite the desperate and disingenuous digging from an out-the-door Finance Minister, says Labour’s Finance spokesperson Grant Robertson. “Steven Joyce has embarrassed himself. This is a desperate, ...
    3 weeks ago