web analytics

Thin and effeminate statistics

Written By: - Date published: 4:05 pm, November 8th, 2012 - 25 comments
Categories: science, uk politics - Tags: , ,

Here’s another entry in the Very Important Columnist vs Parasitic Bloggers file. While the professional mainstream media were all chanting in unison that the American presidential election was “too close to call”, one (famous!) blogger correctly predicted the result – for every state. The Guardian reports:

 So who is he?  A statistical analyst of elections and a former statistical analyst of baseball. His blog, FiveThirtyEight, now hosted by the New York Times, is the go-to site for cold, hard election stats.

…  Silver didn’t just predict Obama was going to win it. He correctly projected the results for every single one of America’s 50 states. Something 50 tossed coins would have less than a one in a trillion chance of getting right.

Ah, well. That’s a little more impressive. How’d he do it? With his “election simulator” statistical model, which aggregates hundreds of polling figures and economic data, weights it all for accuracy, factors in a load of fancy maths about past elections and boils the whole thing down to a percentage chance of victory for each candidate. On Tuesday morning, while many pundits were insisting it was too close to call, Silver’s model put Obama’s chances at a precise and healthy 90.9%.

How did pundits feel about that? Pretty uncomfortable. He was derided in the media as “a joke”, who was “getting into silly land”. One rightwing blogger even dismissed his predictions on the grounds that Silver – an openly gay Democrat – was “thin and effeminate”.

(Today’s xkcd is also on the case.)

In 2008 Silver correctly predicted 49 / 50 states. So, thin and effeminate statistics 2, mainstream media 0. Political punditry, at least in America, is going to have to lift its game…


Just for the record, Nate Silver’s predictions:

The result:

25 comments on “Thin and effeminate statistics”

  1. There can be only one explanation for such accurate predictions: Science! Witchcraft.

  2. kea 2

    Yep, I’ve been following Nate during this election with great interest – if anyone’s interested, follow his rss feed.

    Cheers ..

    • Nate is the anti Fox news.

      Those guys were still trying to say that at least Romney had won the popular vote when only a quarter of California’s votes has been reported in …

      Obama is currently winning the popular vote by 60.6 million to 57.8 million …

  3. Zorr 3

    I think we’re going to have to rethink the old addage “Lies, damned lies and statistics” because this guy seems to be proving the worth of the field…

    • That’s not what the adage refers to.

      http://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics

      It’s referring to the fact that lies that pretend to be statistics are the worst and hardest to debunk of all three types. 😉 Nate Silver’s statistics were honest.

    • RedLogix 3.2

      Yes. Matthew nails it correctly.

      It’s very easy to dress up a lie as data and statistics. Sadly far too many people have no real idea how these things work, and how very powerfully statistics can extract real and valuable meaning from difficult, noisy and incomplete information.

      In the real world data is very rarely clean, complete and noise-free. There are almost always other variables in play that taint or skew the raw data. Good statistics when done well (as this guy does ) can yield remarkable and powerful insights.

      Unfortunately it’s also very easy for people to hijack this power to lend credibility to their lies by dressing them up as statistics. And because most people quite understandably have little to no skill in the subject, makes them very hard to debunk effectively. Most people just shrug their shoulders and mutter the ‘damn lies’ line to themselves.

  4. tracey 4

    Perhaps because he isnt manipulating stats he is collecting them and genuinely analysing them for numerical not ploitical trends. As long as people like farrar, hooten and mccarten are relied upon for political analysis we can hardly expect a scientific outcome.

  5. Rich 5

    Only three or four states actually ever change hands, right? And they aren’t independent variables – if many Nevadans swing left, then so might Coloradans and Floridese. So it’s maybe more like a 1:5 chance of getting a prediction right.

    With 57 million blogs on WordPress alone, I’d think that a very large number of random bloggers would get the election result right in every state, if they bothered to make a call.

    • kea 5.1

      One of the things Nate does is to repeatedly re-run many models, each tweaked to cover various possibilities, and his ‘predictions’ are the aggregates of the results. The published photo I saw was of him sitting in what looked like a suburban hut with a laptop – although it may have been connected to a server via fibreoptic, who knows. I don’t know what program he was using, but it is probably a combination of baseball number crunching experience and contemporary computing power ..

  6. kea 6

    I have to give credit to someone on this blog who put me onto it. Can’t remember who ..

  7. gobsmacked 8

    “Hello, welcome to Close-Up Sunday Breakfast on TVNZ.

    Today we’re going to discuss facts and figures. Do they matter?

    Here to tell us are some Experts, all of whom you know well, because they’re appearing in all media every week. There’s 1) a washed-up former MP who lost his seat, 2) a grumpy old git who copys his column from Wikipedia, and 3) a token woman who likes to say “Look”.

    So panel, how about Nate Silver? Worth a whole lot more than anything you ever have to say, wouldn’t you agree?

    1) “Well, I’ve got a feeling about this election, a real sense that something is happening, and it’s come fresh from my arse. So don’t bother me with all these ivory tower numbers – get back in the real world!”

    2) “At the end of the day, who can you believe? Statistics, at the end of the day, are just something spouted by bloggers. I remember Muldoon once said to me …

    3) “Look …

    (audience chucks coffee cup at TV, goes back to bed)

    • Anne 8.1

      (audience chucks coffee cup at TV, goes back to bed)

      It’s true. I can vouch for it.

    • Colonial Viper 8.2

      That show worsens my hangover. Which is saying something.

    • Tracey 8.3

      for Gobsmacked NOT the show

    • QoT 8.4

      Holy shit, you totally called Firstline’s coverage this morning. Some dude excusing the blatantly biased coverage/spinning of polls in the US as being about Nate Silver being some kind of magically advanced wizard, and “oh people just aren’t used to treating statistics like this” … as opposed to, you know, corporations with obvious agendas telling their anchors how to talk down polls they don’t like.

  8. kea 9

    That’s about right ..

  9. mike e 10

    Imagine what key would have said if he had been wearing red

  10. Is there a Nate Silver type person In New Zealand???

    He is brilliant.

  11. SukieDamson 12

    Once upon a time. His name was Marty G.

  12. kea 14

    For the psephologists and election junkies

    An extended video interview with Nate Silver.

    http://www.thedailyshow.com/watch/wed-october-17-2012/exclusive—nate-silver-extended-interview-pt–1

Recent Comments

Recent Posts

  • Government freezes elderly out of insulation subsidy
    Government cuts to the Warm Up New Zealand insulation subsidy means it will now only be available for rental properties and could leave many elderly homeowners cold this winter, Opposition Leader Andrew Little says. “In this year’s Budget the Government ...
    3 hours ago
  • Shewan report delivers rebuke to National
    John Shewan’s report into foreign trusts is a rebuke to John Key and the National Party who have protected an industry that has damaged New Zealand’s reputation, says Labour’s Finance spokesperson Grant Robertson. “Three years ago the Inland Revenue Department ...
    4 hours ago
  • Auckland Airport rail analysis must be made public
    The Government should publicly release its detailed analysis of rail to Auckland Airport before it closes off options, so the public can have an informed debate, says Labour’s Auckland Issues spokesperson Phil Twyford. The Transport Agency today said it is ...
    7 hours ago
  • Minister approved OIO consent despite death and investigations
    Louise Upston must say if she knew Intueri was being prosecuted for the death of a student and under a funding investigation when she approved its overseas investment consent to buy another education provider, says Labour’s Land Information and Associate ...
    1 day ago
  • Brexit vote costs NZ effective EU voice
    Despite being extremely close the result of the referendum in Britain reflects the majority voice, Labour’s Foreign Affairs spokesperson David Shearer says. “While we respect the decision to leave the EU, it goes without saying the move will usher in ...
    3 days ago
  • Pasifika Education Centre doomed
    The Pasifika Education Centre appears doomed to close down this December, says Labour’s Pacific Island Affairs spokesperson Su’a William Sio  “In a written question I asked the Minister whether he would put a bid in for more money. His answer ...
    3 days ago
  • Onetai Station review a shameful whitewash
    A report released today on the Overseas Investment Office’s (OIO) good character test is a whitewash that does nothing to improve New Zealand’s overseas investment regime, says Labour’s Land Information spokesperson David Cunliffe. “The review of the good character test ...
    3 days ago
  • We need a national strategy to end homelessness now
    Long before I entered Parliament, housing and homelessness were issues dear to my heart. I know from personal experience just how hard it is to find an affordable home in Auckland. In my maiden speech, I talked about how when ...
    GreensBy Marama Davidson
    3 days ago
  • Capital feels a chill economic wind
      Wellington is on the cusp of recession with a sharp fall in economic confidence in the latest Westpac McDermott Miller confidence survey, says Labour’s Regional Development spokesperson David Clark.  “Economic confidence amongst Wellingtonians has dropped 12% in the past ...
    4 days ago
  • Dive school rort took six years to dredge up
    News that yet another private training establishment (PTE) has rorted the Government’s tertiary funding system since 2009 shows that Steven Joyce has no control of the sector, says Labour’s Associate Education (Tertiary) spokesperson David Cunliffe. “Like Agribusiness Training and Taratahi, ...
    4 days ago
  • National’s housing crisis hitting renters hard
    National’s ongoing housing crisis is causing massive rental increases, with Auckland renters being hit the hardest, says Labour’s Housing spokesperson Phil Twyford. ...
    4 days ago
  • A Day with the PSA
    This week, along with Labour MP Kris Faafoi, I accepted an invitation to spend a day working alongside the good folk at the Public Service Association in Wellington. As the Workplace Relations and Safety spokesperson for the Greens, I was ...
    GreensBy Denise Roche
    4 days ago
  • A Day with the PSA
    This week, along with Labour MP Kris Faafoi, I accepted an invitation to spend a day working alongside the good folk at the Public Service Association in Wellington. As the Workplace Relations and Safety spokesperson for the Greens, I was ...
    GreensBy Denise Roche
    4 days ago
  • Government holds Northland back
    New information shows Northland remains the most economically depressed region in New Zealand, says Labour’s Regional Development spokesperson David Clark. “The latest Westpac McDermott Miller regional survey found that more Northlanders believe their local economy will deteriorate this year than ...
    4 days ago
  • Rebstock report into MFAT leaks a disgrace
    An Ombudsman’s report on the Paul Rebstock investigation into MFAT leaks shows the two diplomats at the centre of the case were treated disgracefully, says Labour’s State Services spokesperson Kris Faafoi.  “The Ombudsman says one of the diplomats Derek Leask ...
    4 days ago
  • More families forced to turn to food banks for meals
    Increasing numbers of families are having to go to food banks just to put a meal on the table, according to a new report that should shame the Government into action, says Labour’s Social Development spokesperson Carmel Sepuloni. ...
    5 days ago
  • We have a housing emergency in New Zealand
    Auckland, New Zealand, where house prices have risen 20 percent in the last year alone We have a housing emergency in New Zealand.  Like many people we are ashamed and angry that in a wealthy country like ours, we have ...
    GreensBy Eugenie Sage
    5 days ago
  • We have a housing emergency in New Zealand
    Auckland, New Zealand, where house prices have risen 20 percent in the last year alone We have a housing emergency in New Zealand.  Like many people we are ashamed and angry that in a wealthy country like ours, we have ...
    GreensBy Eugenie Sage
    5 days ago
  • Aussie reforms signal trouble ahead for school funding plan
    Plans by the Government to return to bulk funding are likely to see increased class sizes and schools most in need missing out on much-needed resources, Labour’s Acting Education spokesperson Grant Robertson says. “The signaled return to bulk funding is ...
    5 days ago
  • Toxic Sites – the down low on the go slow
    In  2011, I negotiated an agreement with the National Government to advance work on cleaning up contaminated sites across the country. This included establishing a National Register of the ten worst sites where the creators of the problem could not ...
    GreensBy Catherine Delahunty
    5 days ago
  • Aucklanders face new motorway tax of up to $2500 a year
    The Government wants to tax Aucklanders thousands of dollars a year just to use the motorway network, says Labour’s Auckland Issues spokesperson Phil Twyford. “Officials estimate the average city commute is 11.8km. This means for the average Aucklander commuting five ...
    5 days ago
  • 15 corrupt bank managers identified in student fraud
    New information show 15 bank managers in India have been identified by Immigration New Zealand as presenting fraudulent documents on behalf of foreign students studying here, Labour’s Immigration spokesperson Iain Lees-Galloway says. “Documents obtained by Labour under the Official Information ...
    6 days ago
  • National leaves Kiwi savers the most vulnerable in OECD
    News last week that Israel’s Finance Minister will insure savers’ bank deposits means New Zealand will be left as the only country in the OECD that has no deposit insurance to protect savers’ funds should a bank fail. Most Kiwis ...
    GreensBy James Shaw
    6 days ago
  • Comprehensive plan for future of work needed
    A Massey University study showing many New Zealanders are unaware of the increasing role of automation in their workplace, highlights the need for a comprehensive plan for the future of work, says Grant Robertson, Chair of Labour’s Future of Work ...
    6 days ago
  • Another National Government failure: 90 day work trials
    On Friday last week, the Treasury released a report by MOTU economic consultants into the effectiveness of the controversial 90-day work trial legislation. The report found that there was “no evidence that the policy affected the number of hires by ...
    GreensBy Denise Roche
    7 days ago
  • Iraq mission extension case not made
    The Prime Minister has not made the case for extending the Iraq deployment another 18 months nor the expansion of their mission, says Opposition Leader Andrew Little.  “Labour originally opposed the deployment because the Iraqi Army’s track record was poor, ...
    1 week ago
  • Denial is a long river
    William Rolleston from Federated Farmers made the absurd claim on RNZ on Saturday that “we actually have very clean rivers”. This statement doesn’t represent the many farmers who know water quality is in big trouble and are working to clean ...
    GreensBy Catherine Delahunty
    1 week ago
  • Denial is a long river
    William Rolleston from Federated Farmers made the absurd claim on RNZ on Saturday that “we actually have very clean rivers”. This statement doesn’t represent the many farmers who know water quality is in big trouble and are working to clean ...
    GreensBy Catherine Delahunty
    1 week ago
  • Melanoma deaths could be avoided by an early access scheme
      The tragic death of Dunedin’s Graeme Dore from advanced Melanoma underlines the cruelty of this Government in promising a treatment but delaying for months, says Labour’s Health Spokesperson Annette King.  “Graeme was diagnosed with Melanoma last year. He used ...
    1 week ago
  • Assessing the Defence White Paper
    The Government’s recently released Defence White Paper has raised questions again about New Zealand’s defence priorities, and in particular the level and nature of public funding on defensive capabilities. The Green Party has a longstanding belief that priority must be ...
    GreensBy Kennedy Graham
    1 week ago
  • Kiwis’ confidence drops again: Economy needs a boost
    Westpac’s consumer confidence survey has fallen for the seventh time in nine quarters, with middle income households ‘increasingly worried about where the economy is heading over the next few years’, says Labour’s Finance spokesperson Grant Robertson. “This survey is a ...
    1 week ago
  • Relocation grant simply kicks can down the road
    The response by state house tenants and social agencies to the Government’s rushed plan to shift families out of Auckland tells us what we already knew – this is no answer to the chronic housing shortage, Opposition Leader Andrew Little ...
    1 week ago
  • Peace hīkoi to Parihaka
    On Friday a Green crew walked with the peace hīkoi from Ōkato to Parihaka. Some of us were from Parliament and some were party members from Taranaki and further afield. It was a cloudy but gentle day and at one ...
    GreensBy Catherine Delahunty
    1 week ago
  • Children’s Commissioner right to worry about CYF transition
    The Government must listen to the Children’s Commissioner’s concerns that young people under CYF care could be ‘negatively impacted’ as the new agency’s reforms become reality, says Labour’s Children’s spokesperson Jacinda Ardern. “Dr Russell Wills has used the second annual ...
    1 week ago
  • Bill English exaggerates PPL costs to justify veto
    The Finance Minister has used trumped-up costings to justify a financial veto against parents having 26 weeks paid parental leave, says Labour MP Sue Moroney. “Bill English’s assertion on RNZ yesterday that the measure would cost an extra $280 million ...
    1 week ago
  • Government must refund overcharged motorists
    Labour is calling on the Government to refund motor registration fees to three-quarters of a million Kiwi motorists whose vehicles were wrongly classified under National’s shambolic ACC motor vehicle risk rating system, Labour’s ACC spokesperson Sue Moroney says.“Minister Kaye’s ridiculous ...
    1 week ago
  • 90-day work trials an unfair failure which must change
    A new Treasury report shows the Government’s 90-day trials haven’t helped businesses and are inherently unfair, Labour’s Workplace Relations spokesperson Iain Lees-Galloway says. “The Motu report found that 90-day trial periods had no impact on overall employment and did not ...
    1 week ago
  • Massey East houses a start but Nick Smith should think bigger
    The Massey East 196-home development is a start but the Government must think bigger if it is to end the housing crisis, Labour’s Housing spokesperson Phil Twyford says. “It is great the Government is finally realising it needs to build ...
    1 week ago
  • More changes needed to ensure fewer cases like Teina Pora’s
    Teina Pora spent 21 years behind bars for a crime he didn’t commit, shafted by a Police investigation that prioritised an investigator’s hunch over the pursuit of credible evidence. Yesterday’s announcement that the government is to pay him $2.5m in ...
    GreensBy David Clendon
    1 week ago
  • New Zealand Labour sends condolences to UK
    The New Zealand Labour Party is sickened and saddened by the murder of British Labour MP Jo Cox, Labour Leader Andrew Little says. “Ms Cox was killed in cold blood while simply doing her job as a constituent MP. She ...
    2 weeks ago
  • Shameful refugee quota increase still leaves NZ at the bottom of the list
    Minister for Immigration Michael Woodhouse announced this week that the government will put off increasing the refugee quota by 1000 places until 2018.  It’s a shameful decision that undermines the Government’s claim that it takes its international humanitarian obligations seriously, ...
    GreensBy Denise Roche
    2 weeks ago
  • Paula Bennett as a victim hard to swallow
    The National Party spin machine has gone into overdrive to try and present Paula Bennett as the victim in the Te Puea Marae smear saga, says Labour Housing spokesperson Phil Twyford. “Bill English in Parliament today tried valiantly to paint ...
    2 weeks ago
  • Voters to have the final veto on paid parental leave
    New Zealanders will have the final right of veto on a Government that has ignored democracy and is out of touch with the pressures and demands on families, says Labour MP Sue Moroney. “Today’s decision by National to veto 26 ...
    2 weeks ago
  • Collins should put Kiwis’ money where her mouth is
    Labour’s Police spokesman Stuart Nash is calling on anyone who has received a speeding ticket for going up to 5km/h over the 100km/hr open road speed limit to write to him and he will take it up on their behalf ...
    2 weeks ago
  • Where is the leadership on equal pay for work of equal value?
    The gender pay gap in the public service is worse than in the private sector. I’ve always found this particularly galling because I expect our Government to provide an example to the private sector on things like human rights, rather ...
    GreensBy Jan Logie
    2 weeks ago
  • Kiwis’ real disposable income goes nowhere for the year
    New Zealanders’ hard work for the last year resulted in no increase in real disposable income, showing Kiwis aren’t getting ahead under National, says Labour’s Finance spokesperson Grant Robertson. “Today’s GDP figures reveal that real gross national disposable income per ...
    2 weeks ago
  • Pora case a case to learn from
    Conformation that Teina Pora will receive $2.5million from the Crown for more than 20 years of wrongful imprisonment does not fix the flaws in our system that led to this miscarriage of justice, Labour’s Justice spokesperson Jacinda Ardern says. “The ...
    2 weeks ago
  • Government needs to start again with RMA changes
    The National Government’s proposed changes to the Resource Management Act have attracted more than 800 submissions, many of them critical of key aspects of the Resource Legislation Bill. There has been much criticism of the new regulation making powers given ...
    GreensBy Eugenie Sage
    2 weeks ago
  • Bennett’s briefing completely unacceptable
    It is completely unacceptable that Paula Bennett briefed her political staff on the police investigation into Hurimoana Dennis after her meeting with him, despite it having nothing to do with her social housing portfolio, says Labour’s Housing spokesperson Phil Twyford. ...
    2 weeks ago
  • Speech to Green Building Council
    Building smarter, greener cities It will be clear to anyone who has been watching the public debate on the housing crisis that housing in New Zealand is sadly far from being economically sustainable when Auckland has the fourth most unaffordable ...
    2 weeks ago

Public service advertisements by The Standard

Current CO2 level in the atmosphere