Showing posts with label fivethirtyeight. Show all posts
Showing posts with label fivethirtyeight. Show all posts

Tuesday, May 28, 2019

Oh No, This Wasn't Just An "Average Polling Error"

As previously noted, Australian opinion polling has just experienced its first clear predictive failure, in pick-the-winner terms, in a federal election since 1980.  Every campaign poll by four different pollsters (one of them polling under two different brands) had the Labor Opposition ahead of the Liberal-National Coalition (as it had been for the entire term), and yet the Coalition has won an outright majority.  Moreover, polls in the final weeks were extremely clustered, with 17 consecutive polls (plus an exit poll) landing in the 51% to 52% two-party preferred range after rounding, a result that is vanishingly unlikely by chance.  No pollster has yet made any remotely useful contribution to explaining this clustering - those who have even commented have generally said they didn't do it and it must have been somebody else.

The general reaction has been dismay at this unusual level of pollster error in a nation where national polls have a proud record of accuracy.  The Ninefax press, as I call them (SMH/The Age), have even announced that they now have no contract with their pollster, Ipsos, or with any other pollster.  (This may just be for show, since in the past Fairfax often took long breaks in polling after elections.)  News Corp is, for now, standing by Newspoll.  The Association of Market and Social Research Associations has announced a review, although this may be of little value as its only member who is involved is Ipsos. 

Thursday, January 5, 2017

2016 Ehrlich Awards For Wrong Predictions

It's time for the fifth annual giving of the Ehrlich Awards, which round the start of each year go to the most amusingly or staggeringly wrong predictions I observe in any field of interest relating to the previous twelve months.  The Ehrlichs are named for Paul Ehrlich, the evangelist of ecological end-times who put me on a path to a lifetime of health scepticism of dark green gloomery when he not just lost a famous bet with economist Julian Simon but also gave poor excuses for the defeat. For the past editions click the Ehrlich Awards tab at the bottom, and for the ground rules see the 2012 edition.

As usual I should note my own predictive efforts are hardly perfect, but I had a pretty good year in 2016, missing by only two on the Coalition's national Reps seat tally (for example).  I did wrongly predict two Reps seats in my own home state, which was embarrassing, though I did indicate those were quite uncertain.

Two areas of widespread predictive failure that will dominate these Awards were the US election and Senate reform.  They weren't the only ones I noticed.  For instance the late Bob Ellis made a bold bid for posthumous glory with "It is likely, though not certain, that Malcolm Turnbull will lose his seat" - Turnbull won his seat 68:32 with a trivial 1.2% swing against him.  But I think the two I've mentioned are the most interesting ones and I've decided to make the US election case the dishonourable mentions, saving Senate reform for the medals.