« How Things Change | Main | The Calm After The Storm »

February 26, 2009

Oscar Prediction Sausage

NP: John Cage, 4'33"

Nate Silver does a post-mortem on his Academy Award predictions. If you're into data analysis, this is by far my favorite bit:

Whenever we make an incorrect prediction, we are probably better off asking questions along these lines:

What, if anything, did the incorrect prediction reveal to us about the model's flaws? Was the model wrong for the wrong reasons? Or was it wrong for the right reasons? What, if any, improvements should we make to the model given these results?

Real modeling isn't entirely about being right or wrong, although that's certainly a big part of it. It's also about improving your understanding of what it is you're modeling. I think the political punditry (one of Silver's two bread-and-butter domains, along with baseball) gets really hung up on the first thing to the point where they're not attuned at all to the second.

Comments

Post a comment
Name:


Email Address:


URL:


Comments:


Remember info?



about notabbott.com

what is it?

notabbott.com is not spamming you -- please read

however, if you'd like e-mails about upcoming shows and whatnot, click here

recent entries in MAIN

Domino Effects
March 4, 2015

Housekeeping note
January 2, 2014

Slacker Profiteering
July 7, 2013

In My Defense
June 20, 2013

When A Foul Isn't A Foul
February 5, 2013

archives by month

credits

Creative Commons License
All content on this website (including text, photographs, audio files, and any other original works), unless otherwise noted, is licensed under a Creative Commons License.