Thin and effeminate statistics

Written By: - Date published: 4:05 pm, November 8th, 2012 - 25 comments
Categories: science, uk politics - Tags: , ,

Here’s another entry in the Very Important Columnist vs Parasitic Bloggers file. While the professional mainstream media were all chanting in unison that the American presidential election was “too close to call”, one (famous!) blogger correctly predicted the result – for every state. The Guardian reports:

 So who is he?  A statistical analyst of elections and a former statistical analyst of baseball. His blog, FiveThirtyEight, now hosted by the New York Times, is the go-to site for cold, hard election stats.

…  Silver didn’t just predict Obama was going to win it. He correctly projected the results for every single one of America’s 50 states. Something 50 tossed coins would have less than a one in a trillion chance of getting right.

Ah, well. That’s a little more impressive. How’d he do it? With his “election simulator” statistical model, which aggregates hundreds of polling figures and economic data, weights it all for accuracy, factors in a load of fancy maths about past elections and boils the whole thing down to a percentage chance of victory for each candidate. On Tuesday morning, while many pundits were insisting it was too close to call, Silver’s model put Obama’s chances at a precise and healthy 90.9%.

How did pundits feel about that? Pretty uncomfortable. He was derided in the media as “a joke”, who was “getting into silly land”. One rightwing blogger even dismissed his predictions on the grounds that Silver – an openly gay Democrat – was “thin and effeminate”.

(Today’s xkcd is also on the case.)

In 2008 Silver correctly predicted 49 / 50 states. So, thin and effeminate statistics 2, mainstream media 0. Political punditry, at least in America, is going to have to lift its game…


Just for the record, Nate Silver’s predictions:

The result:

25 comments on “Thin and effeminate statistics”

  1. There can be only one explanation for such accurate predictions: Science! Witchcraft.

  2. kea 2

    Yep, I’ve been following Nate during this election with great interest – if anyone’s interested, follow his rss feed.

    Cheers ..

    • Nate is the anti Fox news.

      Those guys were still trying to say that at least Romney had won the popular vote when only a quarter of California’s votes has been reported in …

      Obama is currently winning the popular vote by 60.6 million to 57.8 million …

  3. Zorr 3

    I think we’re going to have to rethink the old addage “Lies, damned lies and statistics” because this guy seems to be proving the worth of the field…

    • That’s not what the adage refers to.

      http://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics

      It’s referring to the fact that lies that pretend to be statistics are the worst and hardest to debunk of all three types. 😉 Nate Silver’s statistics were honest.

    • RedLogix 3.2

      Yes. Matthew nails it correctly.

      It’s very easy to dress up a lie as data and statistics. Sadly far too many people have no real idea how these things work, and how very powerfully statistics can extract real and valuable meaning from difficult, noisy and incomplete information.

      In the real world data is very rarely clean, complete and noise-free. There are almost always other variables in play that taint or skew the raw data. Good statistics when done well (as this guy does ) can yield remarkable and powerful insights.

      Unfortunately it’s also very easy for people to hijack this power to lend credibility to their lies by dressing them up as statistics. And because most people quite understandably have little to no skill in the subject, makes them very hard to debunk effectively. Most people just shrug their shoulders and mutter the ‘damn lies’ line to themselves.

  4. tracey 4

    Perhaps because he isnt manipulating stats he is collecting them and genuinely analysing them for numerical not ploitical trends. As long as people like farrar, hooten and mccarten are relied upon for political analysis we can hardly expect a scientific outcome.

  5. Rich 5

    Only three or four states actually ever change hands, right? And they aren’t independent variables – if many Nevadans swing left, then so might Coloradans and Floridese. So it’s maybe more like a 1:5 chance of getting a prediction right.

    With 57 million blogs on WordPress alone, I’d think that a very large number of random bloggers would get the election result right in every state, if they bothered to make a call.

    • kea 5.1

      One of the things Nate does is to repeatedly re-run many models, each tweaked to cover various possibilities, and his ‘predictions’ are the aggregates of the results. The published photo I saw was of him sitting in what looked like a suburban hut with a laptop – although it may have been connected to a server via fibreoptic, who knows. I don’t know what program he was using, but it is probably a combination of baseball number crunching experience and contemporary computing power ..

  6. kea 6

    I have to give credit to someone on this blog who put me onto it. Can’t remember who ..

  7. gobsmacked 8

    “Hello, welcome to Close-Up Sunday Breakfast on TVNZ.

    Today we’re going to discuss facts and figures. Do they matter?

    Here to tell us are some Experts, all of whom you know well, because they’re appearing in all media every week. There’s 1) a washed-up former MP who lost his seat, 2) a grumpy old git who copys his column from Wikipedia, and 3) a token woman who likes to say “Look”.

    So panel, how about Nate Silver? Worth a whole lot more than anything you ever have to say, wouldn’t you agree?

    1) “Well, I’ve got a feeling about this election, a real sense that something is happening, and it’s come fresh from my arse. So don’t bother me with all these ivory tower numbers – get back in the real world!”

    2) “At the end of the day, who can you believe? Statistics, at the end of the day, are just something spouted by bloggers. I remember Muldoon once said to me …

    3) “Look …

    (audience chucks coffee cup at TV, goes back to bed)

    • Anne 8.1

      (audience chucks coffee cup at TV, goes back to bed)

      It’s true. I can vouch for it.

    • Colonial Viper 8.2

      That show worsens my hangover. Which is saying something.

    • Tracey 8.3

      for Gobsmacked NOT the show

    • QoT 8.4

      Holy shit, you totally called Firstline’s coverage this morning. Some dude excusing the blatantly biased coverage/spinning of polls in the US as being about Nate Silver being some kind of magically advanced wizard, and “oh people just aren’t used to treating statistics like this” … as opposed to, you know, corporations with obvious agendas telling their anchors how to talk down polls they don’t like.

  8. kea 9

    That’s about right ..

  9. mike e 10

    Imagine what key would have said if he had been wearing red

  10. Is there a Nate Silver type person In New Zealand???

    He is brilliant.

  11. SukieDamson 12

    Once upon a time. His name was Marty G.

  12. kea 14

    For the psephologists and election junkies

    An extended video interview with Nate Silver.

    http://www.thedailyshow.com/watch/wed-october-17-2012/exclusive—nate-silver-extended-interview-pt–1

Recent Comments

Recent Posts

  • Bill English must be upfront about his involvement in Barclay scandal
    Bill English’s explanations that he was on the periphery of the long running employment dispute involving Todd Barclay don’t stack up, says Labour Leader Andrew Little. “The Prime Minister claims to have been a bystander, but we know he was ...
    13 hours ago
  • Labour will not resile from royalties
    Labour believes cleaning up our rivers so that they are clean enough to swim in is the most important freshwater issue for this election, but that it is also fair that a royalty should be charged where public water is ...
    2 days ago
  • With friends like Hone, who needs enemies?
    With less than three months until the election, Hone Harawira has delivered another blow to the Māori Party’s flagship policy of Te Ture Whenua Māori reform and the already unstable MANA-Maori Party alliance, says Ikaroa-Rāwhiti MP Meka Whaitiri. “On The ...
    2 days ago
  • Shifty Bill jumps the shark
    Bill English's claim today that it has never been established that Todd Barclay's recordings of his staff took place is bizarre and shows a complete lack of honesty and leadership, says Labour’s Finance spokesperson Grant Robertson.  "Todd Barclay told Bill ...
    3 days ago
  • Te Ture Whenua – gone by lunchtime?
    Māori Development Minister Te Ururoa Flavell has to front up about yesterday’s mysterious withdrawal of Te Ture Whenua Bill from Parliament’s order paper, says Labour’s Ikaroa Rawhiti MP Meka Whaitiri.  “Has he lost his way and has decided to run ...
    3 days ago
  • Bill English ignorance of law beggars belief
    For Bill English to claim he and others in the National Party didn’t realise the law may have been broken in the Todd Barclay taping scandal is simply not credible, says Leader of the Opposition Andrew Little. “The Prime Minister ...
    4 days ago
  • Government ignored advice on Pacific people’s superannuation
    The Government ignored advice from the Ministry of Pacific Peoples that raising the Superannuation age of eligibility would have a ‘disproportionately high impact’ on Pacific people, says Labour’s Pacific Island Affairs spokesperson Aupito William Sio.   “The Ministry for Pacific ...
    4 days ago
  • Bill English misleads Parliament on Police statement
    Bill English's attempt to restore his damaged credibility over the Todd Barclay affair has backfired after his claim to have "reported" Mr Barclay's actions to Police has proven not to be true, says Labour MP for Wellington Central Grant Robertson. ...
    4 days ago
  • Keep it Public
    The Green Party strongly supports the Tertiary Education Unions call to #KeepitPublic Keep what public? Out quality tertiary education system that National is trying to open up to more private for-profit providers with a new law change. The (Tertiary Education ...
    GreensBy Gareth Hughes
    4 days ago
  • This ‘technical error’ is hurting big time
    Jonathan Coleman cannot resort to his ongoing litany that the Ministry of Health’s $38 million budget blunder is an error on paper only, says Labour’s Health spokesperson David Clark. “He might keep saying it’s a ‘technical error’ but the reality ...
    5 days ago
  • Labour to invest in public transport for Greater Christchurch
    Labour will commit $100m in capital investment for public transport in Greater Christchurch, including commuter rail from Rolleston to the CBD, says Leader of the Opposition Andrew Little. “As the rebuild progresses, there are huge opportunities for Greater Christchurch, but ...
    5 days ago
  • Green Party will repeal solar tax
    It’s ridiculous for an electricity distribution monopoly to apply a charge on solar panels but worse than that, it’s harming our effort to tackle climate change. Hawke’s Bay lines company Unison last year announced a new solar charge for their ...
    GreensBy Gareth Hughes
    5 days ago
  • English fails the character test over Barclay
    Bill English is hoping this scandal will go away, but he is still dodging important questions over his role in covering up for Todd Barclay, says Leader of the Opposition Andrew Little. ...
    5 days ago
  • Government must apologise for Christchurch schools stuff-up
    The Ombudsman’s findings that the Ministry of Education botched the reorganisation of Christchurch schools after the 2011 earthquake are damning for an under-fire National Government, says Labour’s Education spokesperson Chris Hipkins. “The Ombudsman has found the reorganisation of schools in ...
    5 days ago
  • Government’s multinational tax measures weak
    The Government’s proposals to crack down on multinational tax avoidance, by its own admission only recovering one third of the missing money, means hardworking Kiwis will bear more of the tax burden, says Labour’s Revenue spokesperson Michael Wood. “The Government ...
    6 days ago
  • World Refugee Day – we can do our bit
    I’m really proud that yesterday, on World Refugee Day, the Greens launched an ambitious plan to increase the refugee quota to 5000 over the next six years. Of those places, 4,000 will be directly resettled by the government and another ...
    GreensBy Denise Roche
    6 days ago
  • PM’s leadership in question over Barclay affair
    The Prime Minister must belatedly show some leadership and compel Todd Barclay to front up to the Police, says Labour Leader Andrew Little. “Twice today Bill English has been found wanting in this matter. ...
    6 days ago
  • Another memory lapse by Coleman?
    The Minister of Health ‘couldn’t recall’ whether the Director General of Health Chai Chuah offered his resignation over the Budget funding fiasco involving the country’s District Health Boards, says Labour’s Health spokesperson David Clark. “In the House today Jonathan Coleman ...
    6 days ago
  • Bill English needs to come clean over Barclay
    Bill English needs to explain why he failed to be upfront with the public over the actions of Clutha-Southland MP Todd Barclay, following revelations that he knew about the secretly recorded conversations in the MP’s electorate office, says Labour Leader ...
    7 days ago
  • Minister, show some backbone and front up and debate
    Rather than accusing critics of his Te Ture Whenua Māori Bill of telling ‘lies’, Māori Development Minister Te Ururoa Flavell should show some backbone and front up to a debate on the issue, says Ikaroa-Rāwhiti MP Meka Whaitiri. “Te ...
    7 days ago
  • Equal pay for mental health workers
    Today, mental health workers are filing an equal pay claim through their unions. Mental health support workers do important and difficult work in our communities. But because the workforce is largely female, they are not paid enough. It’s wrong for ...
    GreensBy Jan Logie
    1 week ago
  • Nats’ HAM-fisted housing crisis denial
    National’s decision to knowingly release a flawed Housing Affordability Measure that underestimates the cost of housing is the latest evidence of their housing crisis denial, says Labour’s Housing spokesperson Phil Twyford. ...
    1 week ago
  • New Pike footage builds compelling case for mine re-entry
    New footage of the Pike River Mine deep inside the operation, revealing no fire damage or signs of an inferno, provides a compelling reason to grant the families of Pike River’s victims their wish to re-enter the drift, says Labour ...
    1 week ago
  • Labour will get tough on slum boarding houses
    The next Labour-led Government will legislate a Warrant of Fitness based on tough minimum standards to clean out slum boarding houses, says Labour’s Housing spokesperson Phil Twyford. “It’s not acceptable for New Zealanders in the 21st Century to be living ...
    1 week ago
  • Green Party tribute to Dame Nganeko Minhinnick
    Haere ngā mate ki tua o paerau; te moenga roa o ngā mātua tupuna. Haere, haere, haere. It was with a huge sense of loss that we learned of the death of Dame Nganeko Minhinnick yesterday. The Green Party acknowledges ...
    GreensBy Catherine Delahunty
    1 week ago
  • Urgent answers needed on DHB funding
      Jonathan Coleman must come clean and answer questions about what actual funding DHBs received in Budget 2017, says Labour Health Spokesperson David Clark.   ...
    2 weeks ago
  • Treasury puts Māori Land Service on red alert
    A damning Treasury report raises serious questions about the delivery of Te Ururoa Flavell’s proposed Māori Land Service, giving it a ‘red’ rating which indicates major issues with the project, says Ikaroa-Rāwhiti MP Meka Whaitiri.  “Treasury’s Interim Major Projects Monitoring ...
    2 weeks ago
  • Economy stalling after nine years of National’s complacency
    The second successive quarterly fall in per person growth shows the need for a fresh approach to give all New Zealanders a fair share in prosperity, says Labour’s Finance spokesperson Grant Robertson. ...
    2 weeks ago
  • Kiwi kids deserve much more
    All Kiwi kids deserve so much more than the impoverished picture painted by the shameful rankings provided by the UNICEF Innocenti Report Card, says Labour’s children spokesperson Jacinda Ardern. ...
    2 weeks ago
  • NZ Zone a precursor to a total nuclear weapon ban
    New Zealand’s nuclear-free zone, legislated by Parliament in 1987, is something we all take pride in. It’s important, however, that we don’t let it thwart its own ultimate purpose – a world free of nuclear weapons. That goal must be ...
    GreensBy Kennedy Graham
    2 weeks ago
  • English must confirm we still stand by our principles on UN resolution
    Bill English must tell New Zealand whether we remain in support of the UN Security Council resolution on Israeli settlements in Palestinian territory, says Labour Leader Andrew Little. “After Foreign Affairs Minister Gerry Brownlee’s evasive answers to repeated questions on ...
    2 weeks ago
  • Māori party drop the poi on Māori health
    The Māori Party have dropped the poi when it comes to supporting Ngati Whakaue and Māori interests in Bay of Plenty by allowing an iwi owned and operated service Te Hunga Manaaki to be brushed aside in favour of a ...
    2 weeks ago
  • Labour to invest in Whanganui River infrastructure
    Labour will work in partnership with the Whanganui Council to repair and redevelop the city’s Port precinct in advance of planned economic development and expansion. To enable Whanganui’s plans, Labour will commit $3m in matching funding for repairing the Whanganui ...
    2 weeks ago
  • Parihaka: an apology
    An apology only works for healing if it is sincere and if it is accepted. We teach our children to apologise and to be genuine if they want to be forgiven. On Friday, June 9 at Parihaka, the Crown apologised ...
    GreensBy Catherine Delahunty
    2 weeks ago
  • Survey shows many international students plan to stay in NZ after study
    Most international students in New Zealand at PTEs (private training establishments) who have a plan for themselves after study intend to stay in New Zealand to work. This shows how low-level education has become a backdoor immigration route under National, ...
    2 weeks ago
  • Councils step up as Nats drop the ball on housing crisis
    Phil Goff’s Mayoral Housing Taskforce is another positive example of councils stepping up where National has failed on housing, says Labour Housing spokesperson Phil Twyford. ...
    2 weeks ago
  • Time for a breather on immigration
    Labour will introduce moderate, sensible reforms to immigration to reduce the pressure on our cities, while ensuring we get the skilled workers our country needs, says Leader of the Opposition Andrew Little. “New Zealand is a country built on immigration. ...
    2 weeks ago
  • Inaction puts Māui dolphins at risk
    Conservation Minister Maggie Barry was at the United Nations Oceans Conference in New York last week, trying to convince the world that the New Zealand Government is doing a good job at protecting our marine environment.  Yet last week after ...
    GreensBy Eugenie Sage
    2 weeks ago
  • National unprepared as immigration runs four times faster than forecast
    National has been caught asleep at the wheel by record immigration that has outstripped Budget forecasts, says Leader of the Opposition Andrew Little. ...
    2 weeks ago
  • First home buyers shouldn’t carry the can for National’s failed policies
    The introduction of tighter limits on lending to first home buyers would see them paying the price for the National Party’s failure to recognise or fix the housing crisis, Labour’s Finance spokesperson Grant Robertson says. “Nine years of denial and ...
    3 weeks ago
  • Motel bill blows out as Nats fail to deliver emergency housing
    Minister Amy Adams has admitted at select committee that National has now spent $22m on putting homeless families in motels as it fails to deliver the emergency housing places it promised, says Labour Housing spokesperson Phil Twyford. ...
    3 weeks ago
  • Minister, how out of touch are you?
    What was going through Jonathan Coleman’s head in the Health Select Committee this morning when he claimed he was unaware that an estimated 533,000 people have missed out on a GP’s visit in the last 12 months due to cost, ...
    3 weeks ago
  • Divided we fall
    I’m getting pretty sick of the politics of division in this country.  The latest example was yesterday’s comments from NZ First leader Winston Peters having a good go in the House at driving up fear and loathing towards people of ...
    GreensBy Denise Roche
    3 weeks ago
  • Labour’s Electoral Amendment Bill to enhance democracy
    Democracy will be enhanced under Labour’s Private Member’s Bill which will have its First Reading today, says Labour’s Local Government spokesperson MP Meka Whaitiri. ...
    3 weeks ago
  • Police underfunded despite rise in crime
    As crime continues to rise dairy owners are scared for their lives and communities reel under a record increase in burglary numbers, it has now been revealed that Police received less than three quarters of their bid in this year’s ...
    3 weeks ago
  • Road pricing years off, public transport investment needed now
    With road pricing still years away, Labour will step up with investment in public transport to ease Auckland’s congestion woes, says Labour’s Auckland Issues spokesperson Phil Twyford. ...
    3 weeks ago
  • Call to protect Easter Sunday in Auckland
    Auckland’s Labour MPs are backing the community to protect Easter Sunday by retaining current trading restrictions in the city, says Labour MPs Aupito William Sio and Michael Wood.  “The Government’s weak and confusing decision to delegate the decision over Easter ...
    3 weeks ago
  • $2.3 billion shortfall in health
    The funding needed for health to be restored to the level it was seven years ago to keep pace with cost pressures has widened to a massive $2.3 billion, says Labour Leader Andrew Little.  “We used to have a health ...
    3 weeks ago