web analytics

Thin and effeminate statistics

Written By: - Date published: 4:05 pm, November 8th, 2012 - 25 comments
Categories: science, uk politics - Tags: , ,

Here’s another entry in the Very Important Columnist vs Parasitic Bloggers file. While the professional mainstream media were all chanting in unison that the American presidential election was “too close to call”, one (famous!) blogger correctly predicted the result – for every state. The Guardian reports:

 So who is he?  A statistical analyst of elections and a former statistical analyst of baseball. His blog, FiveThirtyEight, now hosted by the New York Times, is the go-to site for cold, hard election stats.

…  Silver didn’t just predict Obama was going to win it. He correctly projected the results for every single one of America’s 50 states. Something 50 tossed coins would have less than a one in a trillion chance of getting right.

Ah, well. That’s a little more impressive. How’d he do it? With his “election simulator” statistical model, which aggregates hundreds of polling figures and economic data, weights it all for accuracy, factors in a load of fancy maths about past elections and boils the whole thing down to a percentage chance of victory for each candidate. On Tuesday morning, while many pundits were insisting it was too close to call, Silver’s model put Obama’s chances at a precise and healthy 90.9%.

How did pundits feel about that? Pretty uncomfortable. He was derided in the media as “a joke”, who was “getting into silly land”. One rightwing blogger even dismissed his predictions on the grounds that Silver – an openly gay Democrat – was “thin and effeminate”.

(Today’s xkcd is also on the case.)

In 2008 Silver correctly predicted 49 / 50 states. So, thin and effeminate statistics 2, mainstream media 0. Political punditry, at least in America, is going to have to lift its game…


Just for the record, Nate Silver’s predictions:

The result:

25 comments on “Thin and effeminate statistics”

  1. There can be only one explanation for such accurate predictions: Science! Witchcraft.

  2. kea 2

    Yep, I’ve been following Nate during this election with great interest – if anyone’s interested, follow his rss feed.

    Cheers ..

    • Nate is the anti Fox news.

      Those guys were still trying to say that at least Romney had won the popular vote when only a quarter of California’s votes has been reported in …

      Obama is currently winning the popular vote by 60.6 million to 57.8 million …

  3. Zorr 3

    I think we’re going to have to rethink the old addage “Lies, damned lies and statistics” because this guy seems to be proving the worth of the field…

    • That’s not what the adage refers to.

      http://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics

      It’s referring to the fact that lies that pretend to be statistics are the worst and hardest to debunk of all three types. 😉 Nate Silver’s statistics were honest.

    • RedLogix 3.2

      Yes. Matthew nails it correctly.

      It’s very easy to dress up a lie as data and statistics. Sadly far too many people have no real idea how these things work, and how very powerfully statistics can extract real and valuable meaning from difficult, noisy and incomplete information.

      In the real world data is very rarely clean, complete and noise-free. There are almost always other variables in play that taint or skew the raw data. Good statistics when done well (as this guy does ) can yield remarkable and powerful insights.

      Unfortunately it’s also very easy for people to hijack this power to lend credibility to their lies by dressing them up as statistics. And because most people quite understandably have little to no skill in the subject, makes them very hard to debunk effectively. Most people just shrug their shoulders and mutter the ‘damn lies’ line to themselves.

  4. tracey 4

    Perhaps because he isnt manipulating stats he is collecting them and genuinely analysing them for numerical not ploitical trends. As long as people like farrar, hooten and mccarten are relied upon for political analysis we can hardly expect a scientific outcome.

  5. Rich 5

    Only three or four states actually ever change hands, right? And they aren’t independent variables – if many Nevadans swing left, then so might Coloradans and Floridese. So it’s maybe more like a 1:5 chance of getting a prediction right.

    With 57 million blogs on WordPress alone, I’d think that a very large number of random bloggers would get the election result right in every state, if they bothered to make a call.

    • kea 5.1

      One of the things Nate does is to repeatedly re-run many models, each tweaked to cover various possibilities, and his ‘predictions’ are the aggregates of the results. The published photo I saw was of him sitting in what looked like a suburban hut with a laptop – although it may have been connected to a server via fibreoptic, who knows. I don’t know what program he was using, but it is probably a combination of baseball number crunching experience and contemporary computing power ..

  6. kea 6

    I have to give credit to someone on this blog who put me onto it. Can’t remember who ..

  7. gobsmacked 8

    “Hello, welcome to Close-Up Sunday Breakfast on TVNZ.

    Today we’re going to discuss facts and figures. Do they matter?

    Here to tell us are some Experts, all of whom you know well, because they’re appearing in all media every week. There’s 1) a washed-up former MP who lost his seat, 2) a grumpy old git who copys his column from Wikipedia, and 3) a token woman who likes to say “Look”.

    So panel, how about Nate Silver? Worth a whole lot more than anything you ever have to say, wouldn’t you agree?

    1) “Well, I’ve got a feeling about this election, a real sense that something is happening, and it’s come fresh from my arse. So don’t bother me with all these ivory tower numbers – get back in the real world!”

    2) “At the end of the day, who can you believe? Statistics, at the end of the day, are just something spouted by bloggers. I remember Muldoon once said to me …

    3) “Look …

    (audience chucks coffee cup at TV, goes back to bed)

    • Anne 8.1

      (audience chucks coffee cup at TV, goes back to bed)

      It’s true. I can vouch for it.

    • Colonial Viper 8.2

      That show worsens my hangover. Which is saying something.

    • Tracey 8.3

      for Gobsmacked NOT the show

    • QoT 8.4

      Holy shit, you totally called Firstline’s coverage this morning. Some dude excusing the blatantly biased coverage/spinning of polls in the US as being about Nate Silver being some kind of magically advanced wizard, and “oh people just aren’t used to treating statistics like this” … as opposed to, you know, corporations with obvious agendas telling their anchors how to talk down polls they don’t like.

  8. kea 9

    That’s about right ..

  9. mike e 10

    Imagine what key would have said if he had been wearing red

  10. Is there a Nate Silver type person In New Zealand???

    He is brilliant.

  11. SukieDamson 12

    Once upon a time. His name was Marty G.

  12. kea 14

    For the psephologists and election junkies

    An extended video interview with Nate Silver.

    http://www.thedailyshow.com/watch/wed-october-17-2012/exclusive—nate-silver-extended-interview-pt–1

Recent Comments

Recent Posts

  • Saudi sheep deal still stinks
    Documents released today confirm Treasury were not aware of any threat of legal action from a Saudi businessman to justify the Government handing over millions of dollars in taxpayers’ money, Labour MP David Parker says. “Almost $12 million has been ...
    2 days ago
  • Assaults up over the past year
    The Government needs to take a good look at the latest statistics  out today from the Statistics Department that shows there were 3,000 more assaults in 2015-16 than the previous year, says Labour’s Police spokesperson Stuart Nash.  “That  is a ...
    2 days ago
  • More last minute policy from a Government with no housing plan
    Paula Bennett’s policy to fund $9 million worth of support services is much-needed help for the homeless but smacks of yet another last minute, short-sighted and piecemeal decision, Leader of the Opposition Andrew Little says. “Funding services for two years ...
    2 days ago
  • SFO given more info on ex Ministry staffer
    More information on the background and past activities of a former senior Ministry of Transport manager, being investigated for alleged fraud, is coming to light, Labour’s Transport Spokesperson Sue Moroney says. “Today, I have ensured that information on Joanne Harrison’s ...
    2 days ago
  • Petition for free vote on Shop Trading Hours Bill
    “Labour is petitioning the Government to allow National Party MPs to have a free vote over Easter shop trading legislation, says Pacific Island Affairs spokesperson Su’a William Sio.  “The Bill which allows shop trading on Easter Sundays has just had ...
    3 days ago
  • Council must build on heritage, not destroy it
    Auckland Council must move to ensure there are heritage protections in place following recommendations that demolition restrictions be tossed out, Labour’s Arts, Culture and Heritage spokesperson Jacinda Ardern says. The panel considering the Unitary Plan has recommended removing partial protections ...
    3 days ago
  • Numbers of Māori waiting for homes grows
    With the number of Māori households waiting for homes increasing by more than 20 per cent in the past year, it’s time the Māori Party admits its support of the Government’s state house sell-off has made life worse for whānau, ...
    3 days ago
  • Children’s ministry, but only for some
    The Government is stigmatising a whole cohort of young New Zealanders while leaving others behind with its creation of a Ministry for Vulnerable Children, Labour’s Children’s spokesperson Jacinda Ardern says. “Confirmation of the move by Hekia Parata, an acting Minister, ...
    3 days ago
  • QUESTIONS FOR (ORAL) ANSWER – Thursday 28TH OF JULY
    While Parliament might be in recess, there are still plenty of things that Ministers need to answer for. So the Labour team has put together six of the best questions that the Government should be answering today (plus a special ...
    3 days ago
  • Fee fi fo fum…tax swindle comes undone
    At the same time the Government is looking to pump more cash into private schools the IRD is investigating several over a tax swindle which allows parents to falsely claim private school fees as donations and claim a rebate, Labour’s ...
    3 days ago
  • Government scuppers affordability requirements
    The Government must explain why the panel considering Auckland’s unitary plan removed affordability requirements at the behest of the Ministry of Business, Innovation and Employment and Housing NZ, Leader of the Opposition Andrew Little says. “Labour welcomes the Independent Hearing ...
    4 days ago
  • National pushes on with failed state house sell-off
    Merchant bankers, overseas companies and property developers will be lining up to buy 364 state houses in Horowhenua during two days of “market sounding” meetings starting tomorrow, Leader of the Opposition Andrew Little says. “Despite a housing crisis and families ...
    4 days ago
  • QUESTIONS FOR (ORAL) ANSWER- WEDNESDAY 27TH OF JULY
    While Parliament might be in recess, there are still plenty of things that Ministers need to answer for. So the Labour team has put together six of the best questions that the Government should be answering today (plus a special ...
    4 days ago
  • Andrew Little’s International Affairs Speech
    Tena Koutou Katoa Can I begin by acknowledging: Sir Doug Kidd, President, NZ Institute of International Affairs Maty Nikkhou-O’Brien, Executive Director, who did all the organising for today’s event. Labour’s foreign affairs spokesperson David Shearer. Victoria University of Wellington law ...
    4 days ago
  • Inquiry into surgical mesh needed now
    The Government must urgently launch a Ministerial inquiry into surgical mesh after more than 500 patients have lodged claims of complications with the ACC, say Labour’s Health spokesperson Annette King.  “This is the most widespread crisis involving surgical devices in ...
    4 days ago
  • Crime on the increase yet again
    Police Minister Judith Collins’ contention that crime is falling has proven to be wrong yet again, with latest Police statistics showing an increase in most crimes, Labour’s Police spokesperson Stuart Nash says. “Figures for June 2016 show an increase in ...
    5 days ago
  • Major reform of careers and apprenticeships to meet Future of Work
    The next Labour Government will transform careers advice in high schools to ensure every student has a personalised career plan, Leader of the Opposition Andrew Little says. “Today I am announcing the next Labour Government will commit to a major ...
    5 days ago
  • DOC struggles on the pest front undermine Nats’ predator-free promise
    The Government’s planned predator-free initiative comes at the same time as the Department of Conservation is facing major challenges to keep pest numbers down, says Labour’s Conservation spokesperson Nanaia Mahuta.  “DOC’s annual report shows it failed on 5 out of ...
    5 days ago
  • QUESTIONS FOR (ORAL) ANSWER- TUESDAY 26TH OF JULY
    While Parliament might be in recess, there are still plenty of things that Ministers need to answer for. So the Labour team has put together six of the best questions that the Government should be answering today (plus a special ...
    5 days ago
  • Unfunded CYF a ticking time bomb
    The Ministry of Social Development is sitting on a ticking time bomb with Child, Youth and Family out of pocket by $56 million despite increased demand for its services, Labour’s Children’s spokesperson Jacinda Ardern says. “The new entity that’s replacing ...
    5 days ago
  • Lack of any real funding in predator free proposal
    Predator Free New Zealand is a laudable idea but the Government has not committed any real money into killing New Zealand’s pests, says Labour’s Conservation spokesperson Nanaia Mahuta.  “The $28 million earmarked for this project is just to set up ...
    6 days ago
  • Andrew Little Speech to LGNZ Conference
    Thank you for having me here today. Local Government New Zealand’s work of advocating for New Zealand’s 78 local councils is critical as we upgrade New Zealand’s economy, and make sure it’s delivering for all our people. Whether in Auckland, ...
    6 days ago
  • John Key must sack out-of-depth Trade Minister
    The Prime Minister must sack Todd McClay for failing to do his job as Trade Minister and be on top of a significant potential threat to some of our biggest exporters, Opposition Leader Andrew Little says. “Todd McClay is clearly ...
    6 days ago
  • 45,000 Kiwis sent back to their GPs
    Last year nearly 45,000 Kiwis were sent back to their GPs without getting to see specialists they were referred to, says Labour’s Health spokesperson Annette King. “This is a shocking figure and underlines how far the cut of $1.7 billion ...
    6 days ago
  • Half a million smells like pure cronyism
    The National/ACT Government’s decision to pump hundreds of thousands of taxpayer dollars into a new lobby group to advocate for charter schools shows just how much of a failure their ideological experiment has become, Labour’s Education spokesperson Chris Hipkins says. ...
    6 days ago
  • Select committee changes Kermadec/Rangitāhua Ocean Sanctuary Bill
    Photo by Tom Hitchon Parliament’s Local Government and Environment Committee has made many changes to the Kermadec/Rangitāhua Ocean Sanctuary Bill in response to public submissions, particularly submissions from iwi authorities and Te Ohu Kaimoana.   Read the amended Bill and the ...
    GreensBy Eugenie Sage
    1 week ago
  • Housing map a hit as crisis spreads across NZ
    More than 55,000 New Zealanders have used Labour’s interactive housing map in its first week to see how the housing crisis is affecting their local community, Labour Housing spokesperson Phil Twyford says. “Our innovative map shows the housing crisis is ...
    1 week ago
  • Bridges must come clean about fraud within transport
    Hundreds of thousands of dollars of public money have gone missing and  the Minister of Transport, Simon Bridges must come clean after the Labour party revealed that a senior manager is being investigated for serious fraud, says Labour’s Transport Spokesperson ...
    1 week ago
  • Labour supports Spencer victory
    Labour congratulates Margaret Spencer for her tireless efforts in challenging the Government over family carer rights, says Labour’s Deputy Leader Annette King. ...
    1 week ago
  • US Warship visit welcomed by Labour
    Labour sees the United States warship visit as a red letter day for New Zealand’s non-nuclear status, which is core to our identity and has defined us a nation for 30 years, says Labour’s Deputy Leader Annette King. ...
    1 week ago
  • Time for honest dairy sector conversation
    ...
    1 week ago
  • What next? Dog kennels?
    Social Housing Minister Paula Bennett needs to explain why the Government thinks it is acceptable for it to refer families to live in garages and sheds, says Labour’s Housing spokesperson Phil Twyford. “This is a new low, just when you ...
    1 week ago
  • Banks bust a move, Government possum in the headlights
    Three of the big four banks have acted responsibly by bringing the shutters down on property speculators earlier than required by the Reserve Bank, says Labour’s housing spokesperson Phil Twyford. “It’s a shame the Government isn’t as motivated to act ...
    1 week ago
  • Latest OECD dairy forecast raises serious questions for economy
    The latest global dairy price forecast shows that New Zealand dairy farmers will not reach a break-even payout before 2019 at the earliest, and will not reach the dairy price factored into this year’s Budget until after 2025, Labour’s Finance spokesperson ...
    1 week ago
  • National’s reckless, out of touch approach to economy exposed
    Today’s economic assessment from the Reserve Bank highlights the danger to the New Zealand economy from a National government that is recklessly complacent in the face of a housing crisis and a struggling export sector, Labour’s Finance spokesperson Grant Robertson says. ...
    1 week ago
  • GP’s visits get more expensive
      Visiting the GP is set to become more expensive after the Government ignored warnings that people were not receiving access to affordable  healthcare, says Labour’s Health spokesperson Annette King.  “Over 400,000 New Zealanders who should be able to access ...
    2 weeks ago
  • Farm prices bear brunt of dairy downturn
    The slump in dairy prices that has seen farm prices drop to their lowest level since 2012 and down a third from their peak in 2014 will be of concern to farmers, banks and our overall financial stability, Labour’s Finance ...
    2 weeks ago
  • Reserve Bank “gets on with it”, National carries on in denial
    The proposal by the Reserve Bank to tighten loan to value ratios for investors shows they are prepared to do their bit to crack down on speculators, while National is still stuck in denial mode, Labour’s Finance spokesperson Grant Robertson says. ...
    2 weeks ago
  • Housing crisis holds up interest rate cuts
    The housing crisis that National still wants to deny is stifling the New Zealand economy, says Labour’s Finance Spokesperson Grant Robertson. “The latest Consumers Price Index shows that all prices excluding housing and household utilities decreased 0.5 per cent – ...
    2 weeks ago
  • Housing crisis holds up interest rate cuts
    The housing crisis that National still wants to deny is stifling the New Zealand economy, says Labour’s Finance Spokesperson Grant Robertson. “The latest Consumers Price Index shows that all prices excluding housing and household utilities decreased 0.5 per cent – ...
    2 weeks ago
  • Govt’s state house sell-off ramping up
    Government plans to ramp up the state house sell-off by selling another 1000 houses in 2016/17 will mean more families in need missing out, says Leader of the Opposition Andrew Little. “New figures show the Government plans to sell 1000 ...
    2 weeks ago
  • Govt’s state house sell-off ramping up
    Government plans to ramp up the state house sell-off by selling another 1000 houses in 2016/17 will mean more families in need missing out, says Leader of the Opposition Andrew Little. “New figures show the Government plans to sell 1000 ...
    2 weeks ago
  • National must reassure exporters on dumping case
        The National Government needs to show our key exporters that they are in control of any anti-dumping case against China before it damages some of our most important industries, Labour’s Finance spokesperson Grant Robertson says.     ...
    2 weeks ago
  • National must reassure exporters on dumping case
        The National Government needs to show our key exporters that they are in control of any anti-dumping case against China before it damages some of our most important industries, Labour’s Finance spokesperson Grant Robertson says.     ...
    2 weeks ago
  • Papers describe litany of incredulity
    Treasury documents which slate the Government’s plans for a national bowel screening programme confirm the proposal was nothing more than a political stunt to cover up underfunding of the health sector, Labour’s Health spokesperson Annette Kings says.  The papers were ...
    2 weeks ago
  • Effect of rampant house prices widens
    The latest house price figures from REINZ show the housing crisis expanding throughout the country, says Labour’s Housing spokesperson Phil Twyford. “We are seeing steep increases in median house prices in Central Otago Lakes – up 42.4% in the last ...
    2 weeks ago
  • Public invited to have say on homelessness
    People who are homeless, those who were once homeless, those working with the homeless and concerned New Zealanders are being asked to share their experiences and solutions to this growing issue with the Cross-Party Homelessness Inquiry. This inquiry was launched ...
    2 weeks ago
  • Sorry seems to be the hardest word
    An apology from Hekia Parata to the people of Christchurch is long overdue, Labour's Education spokesperson Chris Hipkins says. "As if the earthquakes weren't traumatic enough, Hekia Parata and the Ministry of Education then attacked the one thing that had ...
    2 weeks ago
  • Housing crisis affecting more than 98 per cent of NZ
    Labour’s new housing map shows the housing crisis is now affecting more than 98 per cent of New Zealand, Leader of the Opposition Andrew Little says. “Housing pressures have seen house prices rise faster than wages in all but four ...
    2 weeks ago
  • Uber might not be a taxi firm but it must pay tax
    Uber needs to explain how it paid only $9000 in tax when it earned $1m in revenue and is one of the fastest growing companies in the country, says Labour’s Finance spokesperson Grant Robertson. “Uber New Zealand appears to be ...
    3 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere