Showing posts with label MRP. Show all posts
Showing posts with label MRP. Show all posts

Tuesday, February 25, 2025

Poll Roundup: Outliers At Thirty Paces

2PP Aggregate (Last-Election Preferences) 50.4 to Coalition (-0.2 in last four weeks)
With One Nation Adjustment (recommended) 50.9 to Coalition
If polls are accurate, either side could win election "held now", probably well into minority



It was just about time for another one of these articles anyway but we've had some extra fun in the last few days with something we've not had for a while, big outliers!  Firstly a 55-45 to Coalition by respondent preferences from Resolve (52-48 last election) and secondly a 51-49 to Labor by respondent preferences from Morgan (53-47 last election). Resolve was the worst headline 2PP of the term for Labor by far, while Morgan was Labor's first headline 2PP lead from anyone since late November, and their first lead from anyone who wasn't Morgan since early October.   Morgan of course put it down to the interest rates cut.  Who to believe?  My aggregate says neither. The net impact of these two plus Freshwater was that Labor improved its standing in my estimate by 0.001%.  

Resolve had Labor on 25 Coalition 39 Greens 13 One Nation 9 Independent 9 others 4.  Resolve has typically had the Labor vote lower than other pollsters lately and this reading is the lowest I'm aware of Labor ever recording from anyone in a federal poll.  The primary vote gap of 14% is the largest of the term from anyone.  Resolve offers a generic Independent option everywhere between campaigns which tends to inflate the independent vote compared to what they'd actually get at an election, until we know who is actually on the ballot papers.  This probably affects their estimate of the ALP primary.  Resolve's One Nation estimate of 9% on the same basis may seem very large, but don't adjust your set, this is One Nation's third 9% in recent weeks, discussed further below.  

Sunday, December 8, 2024

Media Fail Again Over MRP Reporting

Redbridge/Accent MRP model projects Coalition would be likely to have the most seats if the federal election was held now.  

It does not say Coalition would be likely to have a majority.

It does not predict the result of the election.

---------------------------------------------------------

I thought an article was in order to unpack some of what is going on with the recent Redbridge/Accent MRP model and the woeful reporting of it by pretty much every outlet that has so far mentioned it.

MRP models (stands for Multilevel Regression with Poststratification) are not the easiest to explain to lay readers at the best of times, but what we have seen from several media sources reporting on this one goes beyond understandable confusion and into the realms of reckless innumerate false reporting.

What a MRP model does is to build a picture of how certain types of seats are likely to vote based on small samples of all 150 electorates.  Although each seat's sample is uselessly tiny by itself, by assuming that seats that resemble each other in ways that affect voting intention will vote similarly, one can smooth out a lot of the rough edges in the sampling, and samples of a few dozen voters per electorate can build a model that's about as good on a seat-by-seat basis as if those samples were actually a few hundred.  That still isn't very good on a seat-by-seat basis, but on a nationwide basis, the model could capture some general trends about the kinds of seats where each party is likely to be doing well or badly, and about how a party might be going in converting vote share to expected seats.  

Sunday, July 24, 2022

Federal Election 2022: Pollster Performance Review

In 2019 the Australian polling industry had a disaster after decades of reliability - every final poll had the wrong two-party winner, the final polls were bizarrely clustered around the same wrong result, many final polls were individually wrong by more than their claimed margins and the lack of transparency in the industry was such that it was difficult to understand just why it had happened.

Fortunately 2022 has not been a repeat.  The fallout from 2019 saw a great increase in polling transparency, especially via the formation of the Australian Polling Council (though unfortunately not all pollsters have been on board with that) and also more diversity in polling approaches.  No one poll has ended up nailing the remarkable results of this year's election, but collectively, federal polling has bounced back and done well.   This is especially so on two-party-preferred results, where a simple average of the 2PP figures released in the final polls is pretty much a bullseye. The primary vote results were a little less impressive.

Here I discuss polling in several categories.  Overall YouGov (which does Newspoll) made the most useful contributions to forecasting the result, Redbridge's performance in publicly known niche polling during the campaign was very good, and Resolve Strategic's final poll was a useful counterpoint to Newspoll.  The other major polls were so-so on the whole, and many minor pollsters were wildly inaccurate.

Wednesday, May 11, 2022

Poll Roundup: Ghosts of 1996 and 2007 Edition

2PP Aggregate: 54.1 to Labor (+0.9 since last week)
(Weighted for time only, no house effects or quality weightings)
If the normal range of polling to result relationships applies, Labor is very likely to win

I've been very time-challenged this election (expending much of last night refuting an American know-all and sundry reply-guys about our preferencing system on Twitter probably didn't help) but finally, maybe, I can get something out in time for an article about the state of national polling. 

As an overall summary, Labor suffered alarmingly rapid losses in support during the first week and a half of the campaign as documented in the previous edition, but the Coalition's position did not improve over the next two weeks, and now in the latest round of polling there has been a bit of a blowout.  Labor's lead is so large now that the Coalition is extremely unlikely to win by normal means.  What hope remains for the current government is that the polls are even more wrong than last time (despite everything some of them have done to repair it) or that they are about or nearly as wrong as last time and the government makes some improvements over the final week and a half then gets lucky with the seat distribution and scrambles back, perhaps with a sub-50 2PP.  It's not all over yet, but on the other hand the prospect of a decisive Labor win is much stronger now than it looked even three weeks ago.