Friday, January 22, 2016

Here’s what happens when you try to replicate climate contrarian papers

And we know that many/most of the denialists are being paid a lot of money by the fossil fuel companies. But I would guess that some are honestly motivated by the same psychological factors that affect non-scientists. Eg., if you acknowledge the fact that we are damaging our environment, you then have a moral obligation to change your habits, which people are resistant to.

http://www.theguardian.com/environment/climate-consensus-97-per-cent/2015/aug/25/heres-what-happens-when-you-try-to-replicate-climate-contrarian-papers

Dana Nuccitelli
Aug. 25, 2015

Those who reject the 97% expert consensus on human-caused global warming often invoke Galileo as an example of when the scientific minority overturned the majority view. In reality, climate contrarians have almost nothing in common with Galileo, whose conclusions were based on empirical scientific evidence, supported by many scientific contemporaries, and persecuted by the religious-political establishment. Nevertheless, there’s a slim chance that the 2–3% minority is correct and the 97% climate consensus is wrong.
[Another difference from Galileo is that his theory was a new one, so there was resistance from people who had existing opinions. The consensus on global warming is a fairly new idea, which has so much evidence that it has won over almost all scientists who study it.]

To evaluate that possibility, a new paper published in the journal of Theoretical and Applied Climatology examines a selection of contrarian climate science research and attempts to replicate their results. The idea is that accurate scientific research should be replicable, and through replication we can also identify any methodological flaws in that research. The study also seeks to answer the question, why do these contrarian papers come to a different conclusion than 97% of the climate science literature?

•••••

we discovered some common themes among the contrarian research papers.

Cherry picking was the most common characteristic they shared. We found that many contrarian research papers omitted important contextual information or ignored key data that did not fit the research conclusions. For example, in the discussion of a 2011 paper by Humlum et al. in our supplementary material, we note,

The core of the analysis carried out by [Humlum et al.] involved wavelet-based curve-fitting, with a vague idea that the moon and solar cycles somehow can affect the Earth’s climate. The most severe problem with the paper, however, was that it had discarded a large fraction of data for the Holocene which did not fit their claims.

When we tried to reproduce their model of the lunar and solar influence on the climate, we found that the model only simulated their temperature data reasonably accurately for the 4,000-year period they considered. However, for the 6,000 years’ worth of earlier data they threw out, their model couldn’t reproduce the temperature changes. The authors argued that their model could be used to forecast future climate changes, but there’s no reason to trust a model forecast if it can’t accurately reproduce the past.

•••••

we examined 38 papers in all. As we note, the same replication approach could be applied to papers that are consistent with the expert consensus on human-caused global warming, and undoubtedly some methodological errors would be uncovered. However, these types of flaws were the norm, not the exception, among the contrarian papers that we examined. As lead author Rasmus Benestad wrote,

we specifically chose a targeted selection to find out why they got different answers, and the easiest way to do so was to select the most visible contrarian papers ... Our hypothesis was that the chosen contrarian paper was valid, and our approach was to try to falsify this hypothesis by repeating the work with a critical eye.

If we could find flaws or weaknesses, then we would be able to explain why the results were different from the mainstream. Otherwise, the differences would be a result of genuine uncertainty.

After all this, the conclusions were surprisingly unsurprising in my mind. The replication revealed a wide range of types of errors, shortcomings, and flaws involving both statistics and physics.

You may have noticed another characteristic of contrarian climate research – there is no cohesive, consistent alternative theory to human-caused global warming. Some blame global warming on the sun, others on orbital cycles of other planets, others on ocean cycles, and so on. There is a 97% expert consensus on a cohesive theory that’s overwhelmingly supported by the scientific evidence, but the 2–3% of papers that reject that consensus are all over the map, even contradicting each other. The one thing they seem to have in common is methodological flaws like cherry picking, curve fitting, ignoring inconvenient data, and disregarding known physics.

•••••

No comments:

Post a Comment