Showing posts with label poll accuracy. Show all posts
Showing posts with label poll accuracy. Show all posts

Friday, April 10, 2026

The Amazing 2026 South Australian Election: Final Lower House Results And Poll Performance

SA 2026 ALP 34 (+5) Lib 5 (-9) ON 4 (+4) IND 4 (-)
(Changes from pre-election/notional; Labor gained two seats from Liberal during 2022-6 term)

Estimated 2PP ALP 57.89 vs Liberal (+3.3)
Estimated "Shadow 2PP" ALP 58.19 vs One Nation

The 2026 South Australian lower house was remarkable in so many ways.  It makes Queensland 1998 seem almost boring by comparison, except that Queensland 1998 was there first.  Maybe all elections are going to be like this now and this soon will not seem so unusual but if that's so my colleagues and I are going to have a very busy time in the future!

All manner of curious things happened here.  Finally, someone (Lou Nicholson in Finniss) won a state or federal seat from fourth on primaries; hooray we have lived to see it.  Both majors missed the 2CP in Stuart and Mount Gambier in the first such cases since Nicklin 2001.  The Liberal Opposition missed more 2CPs (29) than they made (18) and were outpolled by One Nation (unprecedented) but are still the Opposition.  Worse than that they missed nine 3CPs as well and even managed to finish fifth in Port Adelaide and Black - Black being a seat they won at the previous election!  And so on.  It was obvious this was going to be a very messy election - a little while out I thought how on earth will we ever make a pendulum from THIS - but aspects of it were even more unique than I saw coming.

Saturday, August 2, 2025

Tasmania 2025: Just As Hung But More Polarised

TASMANIA 2025: LIB 14 (=) ALP 10 (=) GRN 5 (=) IND 5 (+2) SF+F 1 (+1)
(Changes from 2024 result.  JLN (3 seats 2024) did not run, their former MPs running as two Nationals and one independent, all defeated)

Counting is over for an election that finished up in much the same place as last year's ... but not quite, and this will be a rather different parliament despite the big three all coming out with what they went in with.  At present, Premier Jeremy Rockliff is intending to be recommissioned to meet the Parliament (see pathways to government article), but the storm clouds have been gathering since election night as to whether he has any prospect of surviving another no-confidence motion when Parliament resumes, let alone whether he can govern with any stability.  It didn't get any easier for him yesterday with Craig Garland ruling out supporting his party and expressing willingness to vote no-confidence again, and Peter George expressing serious reservations (while also making comments that might not make life easy for Labor either).  The writs will be returned on Tuesday, kickstarting the week in which the Governor must appoint somebody, presumably Rockliff, to meet the House, preferably sooner rather than later.

The past four minority governments elected as such in Tasmania lost the next election outright, some of them heavily.  This is the first to stop that rot since the Reece Government was re-elected with a majority in 1964, and that government had spent over two years in majority during its term after picking up a seat on a recount.  The Rockliff government has not only avoided net seat losses but had a 3.2% swing to it.  And for those saying that the days of majority government are gone forever, beware, they did not actually miss one by very much.  The Liberals finishing eighth in three divisions has enabled me to determine that on swings of 0.94%, 1.82% and 2.30% from the winners, they would have won the final seats in Franklin, Clark and Lyons respectively - the first two of which would have given them the numbers for a potential government with Carlo Di Falco and David O'Byrne (assuming those two were agreeable).  In Bass, the Liberals' elimination in tenth place makes it hard to be sure what swing would have won them the seventh seat, especially as keeping the Liberals in the final seat race requires eliminating someone who didn't actually get excluded.  But I think that about a 3% higher primary vote would have been enough, meaning the Liberals could have won a majority off about 43%.  Wherever it goes from here, this was a close election.

Saturday, July 5, 2025

2025 Federal Election Pollster Performance Review



Oh no, not again ...


On the day after the 2019 federal election I did the most media interviews I have ever done in one day, eleven.  Eight of those were entirely about the same thing: the polls being wrong.  That day and in the coming days journos from as far afield as Japan and from vague memory Switzerland wanted to know how Australia had gone into an election with Labor unanimously ahead about 51.5-48.5 and come out with the Coalition winning by the same amount. Was this part of a global pattern of polls being increasingly broken and underestimating the right?  (Answers: no and no - it was just a shocker by Australia's high standards).  

The day after the 2025 federal election it was obvious something had gone astray with polling again, and by something near the same amount, but the media reception was muted.  I think I did only one interview where the polling was even part of the report's initial focus.  The ABC did an article about the polling, but it was so quarter-arsed that it omitted four final polls, initially got the 2PPs of four others wrong, and even when "corrected" continues to this day to contain errors about what the final poll 2PPs were.  There were a few other articles that were better.

Tuesday, November 19, 2024

Queensland 2024: Final Results And Poll Performance

Queensland: LNP 52 ALP 36 KAP 3 GREEN 1 IND 1

2PP Estimate 53.76% to LNP (+6.89% from 2020)

The 2024 Queensland election is over.  At one stage it looked like it could be a bloodbath, and it was far from close despite some close-looking returns from the day booths, but it still ended up being only a routinely medium-heavy defeat for a decade old federally dragged government.  Labor was criticised for running so far to the left in this election but they did the right thing by ensuring they would hold a mass of seats in Brisbane in an election they were never going to win anyway.  The same strategies that were effective in not merely stopping the Greens taking more Labor seats but in recovering a seat from them (very narrowly) were also effective in holding off the Liberals in most of Brisbane, cutting losses to three seats on the city's eastern fringe.  For the LNP, mission accomplished, with a workable majority but without the hazards of an overly large backbench.  For the ALP, relief.  It could have been a great deal worse.

Tuesday, April 9, 2024

Tasmania 2024: Is This Hare-Clark's New Normal?



Before and after ...


TASMANIA 2024: LIB 14 ALP 10 GRN 5 JLN 3 IND 3
Changes from 2021-based notional result: LIB -3 ALP -1 GRN +1 JLN +3
(2021 election for 25 seats LIB 13 ALP 9 GRN 2 IND 1)
(Before 2024 election LIB 11 ALP 8 GRN 2 IND 4)

Counting is over for the remarkable 2024 Tasmanian election and now come the negotiations.  The Jacqui Lambie Network yesterday announced it was expecting to release a confidence and supply agreement within days and independents are also being consulted.  Premier Jeremy Rockliff has stated he intends to request to be sworn back in, agreement to which would be automatic by precedent just to give him a chance to test his numbers even if the Parliament did intend to remove him.  But with Labor seemingly not interested in governing if it relies on the Greens in any fashion, the remaining crossbenchers' choice is to find some way to back the Liberals (at least on confidence votes when they happen) or else back the sort of instability that could see them defending their seats again within months.  If what the crossbenchers actually extract from the government right away (if anything) seems modest or embarrassing, that is one of the reasons for that.

Sunday, December 3, 2023

2PP Federal Polling Aggregate Relaunched






Introduction (December 2023)

In recent weeks I've relaunched the 2PP aggregate on the sidebar that was a feature here between mid-2013 and the 2019 federal election.  The aim of the aggregate is to present a frequently updated figure for what the current polls should be taken as saying collectively about the state of the two-party preferred contest.  This is never a prediction or a statement that the polls are right, it is just putting a number on where they're at.  A couple of things encouraged me to do this and the first one was a desire to have an up-to-date figure readily available to media now that things are actually happening (my 52.9 estimate from this article was being quoted after my estimate had fallen below 52.)  

Wednesday, November 1, 2023

Voice Referendum Polling Accuracy

The 2023 Voice referendum was a triumph for Australian (and in one case UK) opinion polling.  With all votes counted apart from a few dozen that may or may not exist, here is my assessment of the accuracy of the final polls, and of the polling overall.  

Before I start a few words about the late count: firstly the Yes vote rebounded after the first night of counting from projecting to the low 39s to finishing up at very nearly 40 (39.94 pending any late corrections, which would appear unlikely at this stage).  The main causes of this were: a strong performance by Yes on absents, a relatively strong performance on out-of-division prepolls (which were intermediate between absents and in-division prepolls) and both these forms of votes being substantially more common than in 2022 (29% and 22% more common respectively).  The latter also pushed the turnout up from the initial mid-to-high 80s range to more or less 90%, with it finishing at 89.92% (up 0.1% on the 2022 Reps election, but also up over 400,000 voters because of increased enrolment).   That said because it is harder to get one's vote rejected over enrolment issues, a better comparison might be the 2022 Senate turnout of 90.47%, on which turnout was slightly down.  

34 divisions voted Yes, including all in doubt after the night except for No's closest victory in Hotham, and 117 voted No.  Tasmania pipped NSW for second highest state Yes vote by 0.02%.

The polls overall

The Voice referendum was among the most heavily polled electoral events in Australian history, and the single most diversely polled with at least 22 different pollsters releasing some kind of result on the Voice since the 2022 federal election.  The polling was characterised by a refreshing lack of herding and saw a range of approaches taken in terms of headline figures (these could be broken broadly into one-pass, two-pass and forced choice approaches).  The major national polls towards the end were in general exclusively online, the main variation being that DemosAU used device engagement whereas the others employed panel polling.  This lack of method diversity turned out not to be a problem.  

Saturday, May 13, 2023

New South Wales 2023: Final Results, Poll Accuracy And 2PP Pendulum

It's been a long time coming because of other work but here finally is my wrapup piece for the 2023 New South Wales lower house election.  The twelve-year old Coalition led by its fourth Premier Dominic Perrottet was sent packing by the Labor opposition under its fifth leader Chris Minns, but optional preferencing and some luck in the close seats cushioned the blow and the Coalition managed to retain 36 seats.  Labor after looking almost sure to get a majority on counting night (more of that later) ended up with just 45 but no trouble at all forming government given that the crossbench held three Greens and nine independents.  The result snapped a 15-election streak at state and federal level since the last case of a non-majority outcome.

Vote Share, 2PP and Preference Change

The election saw a further slight fall in the major party primary votes.  The primary votes were 36.97% Labor, 35.37% Coalition, 9.70% Greens, 8.76% independents, with the rest led by 2.23% Sustainable Australia, 1.8% One Nation, 1.56% Shooters Fishers and Farmers and 1.28% Legalise Cannabis.  The 2PP was 54.27% to Labor, a swing of 6.29%.  

There was a slight increase in preferencing at this election with 35.2% of non-major party (or minor Coalition partner in three-cornered seats) preferences reaching Labor on a 2PP basis (+2.2%), 16.1% reaching Coalition (+2.1%) and 48.7% (-4.3%) exhausting.  However these figures include many Independent and Green preferences that were not actually distributed in many seats.  The Greens' share of all non-major votes dropped slightly from 38% to 35%.  

Sunday, July 24, 2022

Federal Election 2022: Pollster Performance Review

In 2019 the Australian polling industry had a disaster after decades of reliability - every final poll had the wrong two-party winner, the final polls were bizarrely clustered around the same wrong result, many final polls were individually wrong by more than their claimed margins and the lack of transparency in the industry was such that it was difficult to understand just why it had happened.

Fortunately 2022 has not been a repeat.  The fallout from 2019 saw a great increase in polling transparency, especially via the formation of the Australian Polling Council (though unfortunately not all pollsters have been on board with that) and also more diversity in polling approaches.  No one poll has ended up nailing the remarkable results of this year's election, but collectively, federal polling has bounced back and done well.   This is especially so on two-party-preferred results, where a simple average of the 2PP figures released in the final polls is pretty much a bullseye. The primary vote results were a little less impressive.

Here I discuss polling in several categories.  Overall YouGov (which does Newspoll) made the most useful contributions to forecasting the result, Redbridge's performance in publicly known niche polling during the campaign was very good, and Resolve Strategic's final poll was a useful counterpoint to Newspoll.  The other major polls were so-so on the whole, and many minor pollsters were wildly inaccurate.

Friday, November 13, 2020

Recent State Election Polling Does Not Skew To Labor

Advance Summary

1. A major polling failure in the 2019 Australian federal election has been attributed to unrepresentative sampling, coupled with inadequate reweighting, that produced a large skew in primary vote and 2PP estimates in Labor's favour.   

2. A recent report argues that a skew in federal 2PP polling was present throughout the period 2010-2019 and was not specific to 2019.  

3. If this was the case, and was so for the same reason, then a skew to the ALP should also be expected from the much larger sample of state-level final polls taken over the same period.

4. However, state level polls in Australia from 2010-2020 do not display any overall two-party skew to the ALP.

5. Also, while federal polling for 2010 overestimated Labor, final 2PP polling at the 2013 and 2016 federal elections was mostly very accurate.

6. While federal polls overall (not all specific polls) do have a record through recent decades of on average overestimating the Labor 2PP, this record is much inflated by a single pollster (Morgan).

--------------------------------------------------------------------------------

Sunday, October 25, 2020

ACT 2020 Final Results Review: How Did The Greens Win Six Seats?

The ACT election is over and the Labor-Green government has been returned.  Predictions that the Liberals would get even remotely close - based in many cases on unsound analysis - have been squelched, with the Liberal Party dropping to nine seats out of 25, the party's second-lowest seat share since Hare-Clark was adopted for the 1995 election.  

In an election that saw relatively minor vote swings (2.9% against the Liberals and 3.2% to the Greens) the most striking result was the Greens' spectacular seat haul, taking two seats apiece from the major parties to go from two to six seats out of 25.  They thereby won 24% of the seats off 13.5% of the vote, a feat that requires some explanation.  This is, by a very small margin in percentage terms, their highest seat share in ACT history.  By comparison in 2010 the party won just five seats with 21.6% of the primary vote in Tasmania's 25-seat Hare-Clark system, which also has five divisions with five seats in each.

Wednesday, December 25, 2019

Field Guide To Opinion Pollsters: 46th Parliament Edition

It's a tradition on this site to nearly always release something on Christmas Day, but for those who are done with polls after this year's failure, I realise this gift might fall under the heading of "worst present ever".

Just before the 2013 election I posted a Field Guide to Opinion Pollsters, which has become one of the more enduringly accessed pieces on this site.  However, over time parts of its content have become dated or specific to that election, and with more and more pollsters emerging as others disappear, the thing has got too long. So now I post a new edition early in the life of each parliament, editing it through that parliament as the need arises.  Pollsters not expected to be active in the life of the current parliament will be removed, but the old edition text will remain on the previous page.  For the 2016-2019 parliament see 45th Parliament Edition.

There are a lot of polls about in Australia these days.  But how do they all work, which ones have runs on the board and do any of them deserve our trust at all? This article describes what is known about each pollster and its strengths and weaknesses and includes extensive coverage of general polling issues.

Saturday, December 14, 2019

UK 2019: Win For Polls And Tories, A Shocker For The Left And Centre

After spending yesterday commenting on the UK election on Twitter, I think it's time to put some longer-form comments down about the result in light of the sorts of themes that get covered here.

The result was of course a resounding win for Boris Johnson's Conservatives, with 365 of the 650 seats.  The major seat movements were in England, where the Tories took nearly 50 seats from Labour.  There were also movements in Scotland (where the Scottish Nationalist Party took seats from both major parties), Wales (where Labour lost more seats to the Tories) and Northern Ireland (where the Democratic Unionist Party lost two seats to nationalist parties).  The Tory vote didn't increase greatly, but the Labour vote collapsed.  

There will be plenty of detailed accounts available of the characters of areas that broke to one party or another.  As with Australian analysis, when reading these always beware of the "ecological fallacy" - an electorate with a lot of voters of type X swinging to party Y does not always mean that voters of type X themselves swung to party Y.  The obvious hook (and one not so subject to this problem as some) is Brexit, and unsurprisingly strong Leave areas swung to Conservatives and strongly against Labour, while strong Remain areas swung more modestly against Labour and weakly against the Conservatives.  However the relationship between Brexit position and swing was messier in Labour's case.  Correlation-hunting has unearthed this remarkably strong link between swing and blue collar jobs, so it will be interesting to see where that debate goes.  

Friday, November 29, 2019

The New Newspoll And The 2019 Polling Failure

This week has seen an important development in the Australian polling industry's response to the polling failure with the release of the new-format Newspoll.  Two months ago YouGov Australia announced that it would soon abandon the mixed robocall/online format that it (including under its former name Galaxy) has used to conduct Newspoll since mid-2015, and switch to exclusively online polling.  Not only that, but the new online polling methods were to use additional weighting methods and "the synthetic sampling procedures we use globally so that our samples are as representative as possible before analysis."

Following that announcement, a further three Newspolls were released using the same method mix that succeeded spectacularly in 2016 but failed badly in 2019. This appeared to be an exercise in going through the motions while the new poll was set up and there was no reason to take those polls all that seriously.  Now the new version is out, together with some new comments about the poll's direction.

Tuesday, August 20, 2019

2019 Federal Election: Pollster Performance Review

Welcome (belatedly) to another of my regular pieces that I do after all the election results are finalised and, um, we can't really give this one its usual title this year.  Normally it's called "Best and Worst Pollsters" (see the comparable articles for 2013 and 2016) but this year that title isn't really appropriate.  This year was the year of the great Poll Fail, and when it came to final voting intention polls at least, they all went down together.  The story for seat polling turns out to be a little less clearcut, but not that much.

For all the complaints about "too many polls", the frequency and diversity of Australian polls had been declining at state and federal level in the four years leading up to this election.  At this election there were only five poll series conducting national polls, and of these two were conducted by the same pollster (YouGov-Galaxy conducts both Galaxy and Newspoll polls).

I usually include three categories but this time I'm not going to take tracking too seriously.  As usual the first cab off the rank is ...

Least Worst Final Poll

I usually say the final poll should be the easiest one for the less accurate pollsters to get right, because pollsters can look over each others' shoulders and consider corrections if everybody else is getting something vastly different.  Thus there have been some prior cases where polls that differed from Newspoll for some time have jumped into line with it in their final poll.  This year unfortunately it seems that some pollsters may have taken this concept a little too far - either that or multiple pollsters got to around the same 2PP coincidentally and then decided to self-herd from that point.

Tuesday, May 28, 2019

Oh No, This Wasn't Just An "Average Polling Error"

As previously noted, Australian opinion polling has just experienced its first clear predictive failure, in pick-the-winner terms, in a federal election since 1980.  Every campaign poll by four different pollsters (one of them polling under two different brands) had the Labor Opposition ahead of the Liberal-National Coalition (as it had been for the entire term), and yet the Coalition has won an outright majority.  Moreover, polls in the final weeks were extremely clustered, with 17 consecutive polls (plus an exit poll) landing in the 51% to 52% two-party preferred range after rounding, a result that is vanishingly unlikely by chance.  No pollster has yet made any remotely useful contribution to explaining this clustering - those who have even commented have generally said they didn't do it and it must have been somebody else.

The general reaction has been dismay at this unusual level of pollster error in a nation where national polls have a proud record of accuracy.  The Ninefax press, as I call them (SMH/The Age), have even announced that they now have no contract with their pollster, Ipsos, or with any other pollster.  (This may just be for show, since in the past Fairfax often took long breaks in polling after elections.)  News Corp is, for now, standing by Newspoll.  The Association of Market and Social Research Associations has announced a review, although this may be of little value as its only member who is involved is Ipsos. 

Saturday, May 11, 2019

New South Wales 2019: Final Lower House Results And Poll Accuracy

Amid the gearing up for the federal election, the finalisation of the NSW election figures has been largely ignored.  For whatever reason it took a few weeks longer than last time to get to the final 2PP, which is necessary for assessing which polls performed the best among other things.  Though in this case, comparing polls is hardly worth the bother.

Vote Share, 2PP and Preference Change

The primary votes were 41.58% Coalition, 33.31% Labor, 9.57% Green and 15.54% Others (including 3.46% Shooters, Fishers and Farmers with the rest led by 1.53% Sustainable Australia, 1.52% Keep Sydney Open and 1.51% Animal Justice.) The 2PP was 52.02% to the Coalition, a 2.3% swing away from their 2015 result.

The overall two-party preference flow barely changed at all, with 33.0% of preferences flowing to Labor (-0.6%), 14.0% to Coalition (-0.8%) and 53.0% exhausting (+1.4%).  But overall what happened here was that the flow of Greens preferences strengthened, but this was cancelled out by the Greens' share of all non-major voting falling from just over 50% to just 38%.  In those seats in which Greens candidates were excluded, the preferences distributed at that stage flowed 51% to Labor with just 9% to Coalition and the rest exhausting.  The stronger flow in Lismore, 72%, was among the highest and was crucial to winning the seat, while East Hills would have been extremely close had Labor managed to match the state swing there.

Saturday, December 15, 2018

Victoria 2018: Final Lower House Results, Poll Performance and 2PP Pendulum

LABOR 55 SEATS COALITION 27 GREEN 3 IND 3
There is no single method of calculating 2PP for this election.  The following are examples of possible figures:

57.57% to Labor (Uniform swing applied to Richmond - probably fairest method)
57.84% to Labor (Richmond treated as 100% to Labor)
57.30% to Labor (Richmond excluded)

With two-party results for all Lower House seats now available it's time to wrap up my Victorian election coverage for 2018, on a high because at least that's the one house where I can talk about the results without constantly losing my temper at the system.  The article again includes a 2PP pendulum.  While this will be of less use for the future than the 2014 one was, given that there is a major redistribution coming, I think it is still useful for looking at the results, and especially at whether the Coalition was lucky not to lose even more seats than it did.

Saturday, September 1, 2018

How Did The Super Saturday Seat Polls Go?

With final results for the Super Saturday by-elections now available, including preference flows, it is worthwhile reviewing the accuracy of the seat polling for these by-elections.  Recently I have posted a few times here about seat polling - see Is Seat Polling Utterly Useless? and Why Is Seat Polling So Inaccurate?  The preferencing results of the Longman by-election are also of special interest to the debate about Newspoll preferences, as the first test of Newspoll's changed methods at any federal election.

We can put that one to bed right away: the preference flow from One Nation to the Coalition in Longman was a massive 67.74%.  This should not be taken as a sign of quite how strongly One Nation preferences would flow nationally, since they did preference the LNP in this seat but would not necessarily do so in every seat, and since LNP preferences flowed strongly to One Nation in the area at the Queensland election even in the seat where the party preferenced Labor.  But it does show that it is entirely reasonable for pollsters to assume that 2016-election preferences can't be trusted in the case of One Nation.

Wednesday, June 27, 2018

Is Seat Polling Utterly Useless?

Advance Summary

1. Seat polls have received bad publicity because of poor results at the 2013 and 2016 federal elections, and in some other recent elections such as the WA Darling Range state by-election.

2. Because it is clear that seat polls are not very accurate, it is common for posters on social media to dismiss them out of hand as useless or so misleading as to be worse than useless.

3. Indeed, seat polls at the 2016 federal election shows they were so inaccurate that they had greater average 2PP errors than simple models based on uniform swing and national polling.

4. However, in 2016 hybrid models combining seat polling and uniform swing would have been more accurate than either seat polling or a uniform swing model alone.

5. The correct use of publicly available seat polling seems to be not to ignore it entirely, but rather to aggregate it with other sources of information including national modelling.

6. Seat polling should be most useful for races that are difficult to predict by normal means, but seat polls may be unusually inaccurate in those races too.

7. The biggest problem with seat polling is the reporting that treats unreliable seat polls as definitive verdicts that one side or the other is "winning".  In fact they are weak indicators and need to be reported in the context of other evidence.