Sunday, February 16, 2014

Polling And The Proposed Pulp Mill

What's big, doesn't exist and eats Tasmanian Premiers?

The release of Mercury-commissioned ReachTEL polling about the proposed Tamar Valley pulp mill and its impact on state election voting seems a good time to write something I've been meaning to put up here for some time.  There's a view doing the rounds, among some of the green and gullible, that the last time this proposal was about, a huge body of credible polling showed very strong opposition to it.  As well as discussing the current poll, this article takes a little trip down memory lane and points out why we never knew as much about public views of the pulp mill as some of its more ardent opponents told us that we did.  It also includes a few of my own thoughts on the "issue" of the proposed pulp mill.

Anyway, here is the new pulp mill poll result:


I'm not totally at ease with the question design for this one.  I would have preferred "the proposed pulp mill", because the actual question design might load in favour of the assumption that the pulp mill is a real thing with very tangible prospects, which might in turn favour a "more likely" response.  A tiny percentage of respondents might not even realise this is about the former Gunns Bell Bay proposal, and might think it is about some other pulp mill; one that actually, er, is real.  So I think the question is just a teensy bit conducive to a positive response, but I've seen worse.  Much worse, in fact, as we're about to see.

But even taking that into account, it is a fascinating finding in terms of the urban myth (spread by opponents) that polling repeatedly showed strong opposition of Tasmanian voters to the pulp mill in the past.  It hardly contradicts that claim (since views of the mill may be rosier now because of the state's desperation for development, or because people have forgotten arguments made against the mill) but it does take the rug out from under the feet of those who assert that the mill has always been unpopular and always will be.

The Leaky TAP

Or it would, if the rug wasn't scrunched up in the corner and looking pretty threadbare already.  An often-mentioned resource concerning the view that the mill is strongly rejected by Tasmanian voters is the Tapvision list of pulp-mill polling, which provides results of 23 polls supposed to demonstrate lasting and overwhelming opposition to the mill.  (Note that the document itself doesn't claim to be confined to Tasmanian polls.) TAP Into A Better Tasmania and similar groups are very big on "due diligence" ... but apparently not when it comes to opinion polls. Their list of polling was loaded with results that are "critically non-compliant" with proper polling process, or at least critically irrelevant to the claims they use them to support.

Of the 23 polls aggregated and averaged by TAP to supposedly show support or opposition to the pulp mill, three were elector-polls that only represented the views of those voters who vote in council elections (and in specific areas at that).  As council election voters are a self-selecting and not necessarily a representative sample of the whole electorate, such findings are of limited use.  That leaves twenty.

Six (Win TV, Wentworth Courier, ABC, SMH twice) were opt-in "polls" (online or phone-in) prone to motivated response, orchestrated stacking, and in cases multiple voting.  Passing off such exercises, which are often explicitly disclaimed as "unscientific", and aggregating a 99-1 result from the Wentworth Courier along with the rest is the sort of stunt that would make John Gay ashamed.  Fourteen remaining.

A further four (Morgan, Essential and two by Galaxy) were national and useless in gauging support in Tasmania.  Ten green poll bottles left.

Three more were confined to support for specific aspects of the issue, such as government or bank funding, somewhat contradicting TAP's claim "all measure the level of support or opposition to Gunns’ proposed pulp mill."  These were the Mar 2008 EMRS poll (confined to the question of ANZ bank funding for the mill), the Jan 2008 EMRS (confined to "support for further state or federal government funding"), and the 1 Aug 2010 TAP self-administered poll (confined to whether a voter would be more likely to support a party intending to use government funds to support the mill.)  We're down to seven.

A further three of those seven fail due diligence because they were what I call skew-polls.  A skew-poll is a poll in which extensive leading "information" is provided, or prior questions used, that can skew the main poll result in favour of one side of the debate or the other.  The survey design is typically chosen at the instigation of the sponsor of the poll, not the pollster.  A skew-poll may also be a push-poll (in that the point of the poll is to convince the respondents of a claim made about the issue) but for the most part skew-polls are used by those commissioning them to misrepresent voter intention to the greater public, rather than to alter the views of those sampled.   Another purpose of skew-polls was frankly admitted by one senior anti-mill figure: they provide a method of convincing the media to publish the commissioning group's ambit claims about the issue.

The following were the three skew-polls:

* EMRS 8 Aug 07 commissioned by "Investors for the Future of Tasmania".  The poll first asks a question about what is called "the Government's fast-track process" before asking about views on the mill.  Asking the first question draws attention to a possible argument against the mill (that it has been approved by a "fast-track process", and is hence implied to be shonky) and may skew the response to the second. 

*  EMRS 7 Nov 2008 commissioned by The Wilderness Society.  This was the wording of the poll:

In June of this year, Premier Bartlett drew, what he called a “line in the sand” for Gunns’ pulp mill. He said that unless Gunns had gained “real finance” and achieved ‘real progress’, on construction of the mill by November 30 of this year, then government involvement in their project would end.

If Gunns has not gained real finance and made real progress by November 30th, do you agree or disagree with the view that Premier Bartlett should stick by his line in the sand and end all government involvement in the project? 

Firstly it's dubious whether this question is really about support/opposition for the mill; some respondents might understand it to be about government funding.  That aside, the question again draws attention to a possible argument against the mill (that it has failed to secure adequate finance or progress at the time) and thus encourages respondents to oppose it.  Some respondents would also have responded that David Bartlett should have adhered to his word because they think politicians more generally should do so.
* EMRS 15 June 2009 commissioned by TAP Into A Better Tasmania. The poll wording was:

The planned Tamar Valley pulp mill would be the 4th largest in the world and will consume large amounts of water and 4 million tonnes of trees from plantations and State forests. Gunns is seeking money from foreign companies to fund the project.
The question asked - Should the government allow the planned pulp mill to go ahead if it results in foreign control of Tasmanian water, land and forests? 

This wording was especially awful.  It took the information about foreign funding and twisted it into a hysterical straw bogeyman of untrammeled "foreign control", so that respondents are responding on the basis of a loaded hypothetical that doesn't even follow logically from the preamble.  It thus went beyond just loading the response by stressing various arguments for one side of the issue, and into appealling to irrational land-ownership xenophobia to try to prod a frightened response.  

The TAP press release (scroll down) that went with this poll went one step further into the mire, spinning a poll result premised on the hypothetical of "foreign control" to a completely baseless assertion that respondents agreed that there would be foreign control. 

Several of the polls excluded above were unsuitable in more than one of the indicated ways.  However, that ends the list of definite due diligence or relevance failure, with four of TAP's 23 polls standing as polls that even might pass muster. These are: Taspoll 24 April 2007, (0363 telephone district, 36.2% for, 45.7% against), Newspoll 31 Aug 07 (Bass only, 35-53), Marketmetrics 3 Oct 07 (Bass and Braddon, 38-51), EMRS 12 Nov 2007 (statewide, 37-54).  Of these the last has no known question wordings, the third is by a little-known pollster in the field, and all were commissioned by groups opposed to the mill (less negative polls commissioned by some such groups could well have been discarded.)

In all this mountain of polling supposed to prove public opposition to the pulp mill, there was not one single properly designed and neutrally-commissioned poll of the residents of Tasmania or a large portion thereof.

The impression I have overall is that in late 2007 Tasmanians were slightly opposed to the pulp mill proposal, given that the industry released no commissioned polls showing unequivocal support, but that there wasn't all that great a deal in it.  Aggregating these four possibly valid polls gives a 36.5-50.9 yes-no result (contra TAP's 27-63), but I reckon it was a bit closer than that.  And here, several years on, is a public poll with only a slight wording issue that reckons the mill is much more popular now than when Newspoll conducted similar polling about impacts on vote in the leadup to the 2007 federal election.  (For more on that see an oldie but a goodie: The shrinking pulp mill backlash.)

This debunking of TAP's polling claims is not the only time I've rumbled them for sloppy scholarship.  A few years ago, a claim by the group to have conducted a comprehensive study of the impacts of plantation forestry fell apart when someone formerly involved with TAP very kindly sent me a copy of their diagrammatic "study". 

Electoral Impact ... and my views

Opponents of the mill imagined that it would totally transform the politics of Bass.  In fact it produced very large swings in Tamar Valley booths in Bass and Lyons at its first big test, the 2007 federal election, but the overall swing to anti-mill candidates and apparently driven by the issue in each electorate was only several points (my old booth analysis is fossilised somewhere here).

Anyway, even if a slight plurality of voters say they're more likely to vote for the mill than against it, we can safely assume it will make little difference and (following my cynical pet rule of taking the difference between "more likely" and "less likely" and dividing it by five) the couple of points the issue might be worth will only vanish into the noise.  There could be some strong local effects though, in the West Tamar.  And the NIMBY factor is probably why Bass and Lyons voters give the mill a lukewarm thumbs-ups of +15.3 and +11.5 ("more likely" minus "less likely") while economically struggling and anti-Green Braddon loves it (+39.3).  Franklin is equivocal (+1.7) and The People's Republic of Denison (-10.4) really isn't impressed.

My overall impression of the whole "pulp mill" debate in this election campaign is that supporting the pulp mill has become an issue of ritual obeisance for the major parties.  It doesn't matter that the mill shows no sign of being remotely profitable and that no living company appears to want to build it.  Rather, "pulp mill" has become a totemised code for being pro-development, with a perception by both parties that if you are not ardently for the pulp mill, you are failing to soothe the feelings of blue-collar communities looking for jobs and what remains of the forest industry, and open to attack on that front.  It fills a similar abstract role to the veneration for budget surpluses in the recent federal election.

Liberal attacks on the Palmer United Party for being all over the map on the pulp mill are designed to firm up the Liberals' base, as the Liberals are probably more worried about a big PUP surge depriving them of their majority than anything that tired old Labor has left to throw.  At the same time, I think there are some voters who will actually find PUP's middle-of-the-road confused message on the pulp mill refreshing, because it acts to defuse the idea that the whole thing even needs to be taken so seriously.  The idea that the pulp mill proposal should be a prominent election issue is, in my view, almost as absurd as a lot of what PUP comes up with.

And no, we shouldn't have a referendum on the mill proposal (or, as recently proposed by the Greens, on "doubt removal" legislation relating to it); that's silly too.  If it's not worth wasting public money on, then that includes the hefty cost of a public vote about it.  Of course, I understand why the Greens want one, because they think that they might win that vote, while they never win a vote about it in parliament with both major parties voting against them.  But parliamentary democracy is a package deal - voters determine their votes across a range of issues, and of all those voters who oppose the mill, the proportion who will shift their vote to an anti-mill party because of it is eternally small. 

Indeed, most of those who very strongly oppose the mill were likely to vote Green even before the mill idea existed.  Over the last few decades the Greens have been able to use their power in various hung parliaments to get quite a lot of stuff that would have gone down in a screaming heap in any referendum through.  A move long ago towards a more directly "democratic" system, such as Citizens Initiated Referenda or Voters Veto (both ideas I'm deeply wary of) would have delivered the Greens a lot more losses on issues that they won, than wins on issues that they lost. 

My own view is that the proposed pulp mill is a pollutant.  Not of skies and seas and seals and seabirds, but of political discourse; an endless source of false frustrations, pointless diversions, empty symbolism and false hopes.  At the risk of repeating the plantation diagrams piece, the original Gunns argument for a fast-track process was that the original assessment process was taking too long.   But even with the fast-track in place they couldn't get the thing done, and there is not much reason to believe anyone else can either, especially not from a solely plantation estate.  It's well past time to kill it off, or move it, or say that if anyone can really make a go of it they are to do it properly from scratch with their own money.  The recent "doubts removal" legislation was hardly progress in the right direction on the issue (much as I like seeing a Confrontation Trust court challenge to pretty much anything get shut down), but I doubt it will amount to more than parliamentary theatre, and a pretext to throw the Greens out of Cabinet (for all the good that did.)

Meanwhile the related plantation debate has come full circle in a hilarious way. Eucalyptus nitens plantations, once so deeply hated by the Greens' support base for their wildly exaggerated environmental deficiencies and low-grade cash-crop product, now apparently need saving from the pulp mill because they are high quality timber that is too good to pulp. Next we'll be being told nitens forests have substantial ecological and threatened species values too (which is actually sometimes true, and was known to be such fifteen years ago when those who will soon say it were vehemently denying it.) Or listing them as World Heritage, assuming that has not already happened. 

Yes, the pulp mill debate is a grand Tasmanian four-party farce.  And perhaps the most farcical thing of all is that now when there is so little reason to take the issue seriously, it's finally been polled credibly ... and the result has come up positive.

Update 8 March: The Examiner has also now commissioned polling on the pulp mill, asking firstly the general question "Do you support the construction of a pulp mill in Tasmania?" This gets a positive response with 51.4% support, 33.8% opposed.  The second question is "Do you support a pulp mill at Longreach, near Bell Bay?"  Support here is more lukewarm (43.4-36.6).

Neither of these questions really test support for what was the Gunns pulp mill proposal, though it is debatable whether that proposal still really exists beyond the permit recently renewed.  But the second question at least shows there is not clearcut opposition to a pulp mill being built at the Longreach site (except from Denison voters, who are nowhere near it and who oppose a mill in general).

Differences in the net approval rating (support-oppose) for the mill and the net approval rating for the Longreach site by electorate are revealing:


As with most of this week's polls, Denison is the odd electorate out and Franklin is becoming more like the other three. In Denison and Franklin the location of the proposed mill makes little difference.  In Bass and Lyons there is slightly greater opposition to the Longreach site, probably driven by the NIMBY factor in the Tamar Valley (which is included in both electorates).  But in Braddon there is opposition to the proposed site because the job-desperate electorate wants the mill for Braddon (presumably at Hampshire).

It does not necessarily follow from all this that Hampshire is the most popular site, since no specific question about the Hampshire site was asked.  Some voters in Bass especially might approve of the local site and disapprove of Hampshire.  

=======================================================================

New ReachTEL Poll Update (14 July 2015)

A new ReachTEL poll of the federal electorates of Bass and Lyons asks the question "Do you support or oppose a pulp mill at Bell Bay?"  This is a well-constructed question as it no longer refers to a specific proposal (since there really isn't one) and only refers to "a pulp mill" rather than "the pulp mill".  I would have included "building" or "constructing" after "oppose", but it really doesn't matter.

For Bass the result is 51.2% support 38.0% oppose, a +13.2 net rating, compared with +10.4 for this site last year (in other words, no significant difference).  For Lyons, the result is 52.5-37.5, a +15 net rating, compared with +20.8 for this site last year.  I have apparently not kept a copy of the electorate breakdown from the previous poll, but it's notable that "undecided" responses were higher in the Bell Bay question in 2014, so what I suspect has happened in Lyons is a modest but statistically significant increase in those saying they are opposed, with the increase largely coming from the undecided column. With so many things being polled at once I would not read too much into that shift as it may be a false positive.

A party breakdown shows that the proposed mill has strong support from Liberal voters (68.4-18.3 in Bass, 65-24.2 in Lyons), moderate support from Labor voters (49.2-40.8 and 57.1-36.3) and spectacular levels of opposition from Green voters (1.7-95.0 and 1.5-92.4).  Most likely that represents just a single Green voter in each sample saying they supported the proposal!  "Undecided" voters (these in this case are soft voters who had to be prodded to say which party they supported, but are not "hard undecideds", who were excluded) are against the mill in Bass (31.1-59.0), where they heavily preferred Labor over other parties, and evenly split in Lyons (43.4-41.5).  Support is strongest in the youngest and oldest age groups and weaker among those aged 35-65.

15 comments:

  1. If you take the approach that for a project to get going it requires support, not opposition to kill it, then you can suppose that those unaffected in terms of voting choice on the pulp mill issue, could be construed as apathetic and not supporting the mill, though they do not oppose it either.

    So from a "social license" support point of view the poll shows not so much majority opposition to the mill, but that a majority fail to support it.

    So if you were to look at it like this:
    Division | Support | Non-support
    Total | 46.4% | 53.6%
    Bass | 49.8% | 50.2%
    Braddon | 60.5% | 39.5%
    Denison | 39.5% | 60.5%
    Franklin | 40.8% | 59.2%
    Lyons | 46.3% | 53.7%

    Aside from Braddon the pulp mill lacks majority support. Though it does clearly have some substantial support based on that poll.

    I would like to see a more detail poll worded in such a manner (support vs opposition) with multiple questions regarding the lack of financial backing the current proposal has and differentiating between supporting A pulp mill anywhere in the state, and the 'current proposed' pulp mill, and 'a pulp mill in the Tamar Valley' as different issues.

    I think that honestly that would be of more use.

    ReplyDelete
  2. Any thoughts on the oddly positive Nielsen poll for the Coalition? It's out of place with the other pollsters and the Royal Commission results are very interesting in the party breakdown.

    Further, the new Reached poll conducted in SA has the same 55-45 lead for the Liberal Party that Galaxy showed last week. Considering last SA election, the fact that there has been no redistribution since and that the Liberal Party needs 6-7 seats (depending on if they win or lose Adelaide) what are your basic thoughts on potential probable election outcomes?

    ReplyDelete
  3. I'm not that surprised by the Nielsen; Newspoll and Morgan while not showing leads for Labor were tightening. The last Morgan was a lead for Labor if corrected for house effect, Griffith was consistent with softening and the issue mix for Labor has been bad lately. We may not be seeing clear leads again for Labor for some time. We may even see the government get its act together and start polling like a first-term government should.

    It does quite irritate me that Nielsen have introduced the category "Independent". I just don't know what they're thinking there when indies polled only 1.37% at the election and are clearly overpolling as an option compared to what they would actually get (which was predictable). A very bad move in my view, that is going to undermine the usefulness of their polling through this term.

    SA: I meant to write an article on it this weekend but ran out of time because of an extremely time-consuming distraction, so I'm not sure when this will now happen given upcoming fieldwork. Shame as I was looking forward to picking apart the whole "redistribution" thing. By all normal state election standards such polling as is seen from Galaxy and ReachTEL is unsurvivable, but of course the high requirements for the Liberals to win based on uniform swing make it interesting. At the moment I think they will find a way. It would be very interesting indeed if Labor won with, say, 46% 2PP but I'm not expecting to see it.

    ReplyDelete
  4. Oh and as for the royal commission stuff I think the deal here is that a lot of Labor supporters are not ideologically attached to the union base and tend to vote for the party by default. Labor needs to realise the union movement has some image problems and that it must cooperate with cleaning out bad apples. This has been on loop for over a decade.

    ReplyDelete
  5. The fact Tasmanians are still being polled on an industrial project almost 10 years after it was first proposed shows the intellectual bankruptcy of this island. They should have been asked 'do you agree poisoning a fishery is necessary to create jobs' or 'do you support parties that don't follow the rules' or even 'do you support government by criminals'? The TAP question on 'foreign control' of water, land and forests is more relevant now than it was then in my view. Wind farms, dairy, veneer factories and newsprint mills spring to mind as well as mining. What IS controlled by Tasmanians Dr Bonham? Almost nothing because Tasmanians are crippled by a 19 century constitution and the free trade agreements that have turned us into an economic basket case. The two major parties created that situation and anybody who thinks the dumbest voters in Australia have the mental capacity to elect credible representatives in Tasmania is deluded in my opinion. This is not an 'electorate' its a 'sheltered workshop' IMHO.

    ReplyDelete
  6. Correction, I think you will find that the Greens called for a referendum on the latest pulp mill-enabling legislation, not the mill itself. I don't think this affects your broader argument with regard to the use of a referendum, but still it's good to be accurate.

    ReplyDelete
    Replies
    1. If anything it strengthens my case that a referendum would have been pointless. I agree that their recent call was restricted to specific legislation concerning the proposal and will edit the text accordingly.

      Delete
  7. Kevin, do the ReachTEL polls ring mobiles as well as landlines? 20% of Australians no longer have landlines. i don't agree with your comments about a TAP poll. You pretend 'foreign ownership' is unknown in Tasmanian but almost all mining, veneers, newsprint mills and wind farms and electro-metallurgy are foreign owned as well as dairy. Tasmanians have incat and thats about it. Of course why would you worry about how much of Tasmania is controlled from offshore as long as you can put an innocent group of Tasmanian residents down?

    ReplyDelete
    Replies
    1. My understanding is that ReachTEL do poll mobiles but in any case the landline-vs-mobile issue was a fizzer at the last election - good scaling overcomes it as Newspoll demonstrated.

      Your claim that I "pretend 'foreign ownership' is unknown" is unsubstantiated false strawmanning of a sort I recall you being far too fond of; clearly, my comments were about the mixing of the issues of foreign funding and foreign "control" over Tasmanian resources (and not even about how common either is.) I have a very limited tolerance for this kind of poor behaviour in debate and any future comments by you that accuse me of saying things I did not say will be rejected.

      And TAP are far from innocent as my article shows. Whether or not someone agrees with their core claims is irrelevant to the evidence on that score.

      Delete
    2. Kevin, you slammed TAP for asking about 'foreign control' of Tasmania 5 years ago. How much of Tasmania's economy as a percentage is controlled by foreign interests today?

      Delete
    3. Go back and re-read why I criticised TAP's question much more carefully. Consider that a formal moderation warning.

      Delete
  8. Kevin, statistically the majority of Tasmanians are not less likely to vote for a party that supports the pulp mill. Would you agree?

    ReplyDelete
  9. Got some friendly little banter here it seems... Wow.

    Anyway, I was curious as to your opinion on the latest Newspoll considering its your most weighted pollster but seems (according to other polling data showing an increase in Coalition vote) rather rogue. Do you agree this is a rogue result or perhaps a sign of things to come?

    ReplyDelete
    Replies
    1. It is extremely difficult to believe a poll that is over 4 points off the aggregate reflects just some change in the political environment; people will scramble for post hoc reasons for the result as usual but I think it is likely to be seen down the track as rogue or nearly so.

      Delete
  10. In relation to the March 8 poll:

    Most Tasmanians would be more familiar with the term "Tamar valley pulp mill" and I feel the result would had been a win for the negative based on people's immediate understanding of the proposed site and the story behind it, had the question been ""Do you support the proposed pulp mill at Longreach, near Bell Bay, in the Tamar valley?" rather than "Do you support a pulp mill at Longreach, near Bell Bay?".

    If people are pushed to answer quickly, there is no time to think "Is that the Tamar valley one?"

    It appears to me they made the question as vague as possible without quite crossing the line into question invalidation territory.

    ReplyDelete

The comment system is unreliable. If you cannot submit comments you can email me a comment (via email link in profile) - email must be entitled: Comment for publication, followed by the name of the article you wish to comment on. Comments are accepted in full or not at all. Comments will be published under the name the email is sent from unless an alias is clearly requested and stated. If you submit a comment which is not accepted within a few days you can also email me and I will check if it has been received.