It's a Shame About Roy
Several weeks ago climatologist Roy Spencer (prominent for his stance that humans are not important contributors to global warming) published a paper that was widely reported, especially in conservative media, as casting large doubt on global warming. One prominent LDS blog heralded it as a "major wrench" in global warming theory, and when I urged caution and suggested that they were overstating its conclusions and importance, I was thanked by being told that I am "a totalitarian." Now the editor of the journal in which it was published, Remote Sensing, has resigned. He concluded that the paper was flawed and should not have been published, and he also protested the way the paper was promoted as supporting conclusions that it did not in fact support. Spencer and his supporters are crying foul, and the drama will continue. Rather than dissect the whole thing, I will simply provide some links for people who want more information.
The Editor explains himself.
This BBC story gives the basics.
BYU geologist Barry Bickmore has a nice summary and roundup of links.
Media Matters has a great explanation of the controversy, along with critique of how the paper was reported by conservative media.

16 comments:
Extra points for those who get my post title.
You may want to take a look at what the man himself says about the debacle:
http://wattsupwiththat.com/2011/09/02/breaking-editor-in-chief-of-remote-sensing-resigns-over-spencer-braswell-paper/#more-46549
Jack
Jared,
Do you mean to say, "It's a *sham* about Roy"?
Jack
Jack,
I linked to Spencer's blog in my post. It was re-posted at WUWT.
Sorry Jack, it's more subtle than that. Since you're the only one to even hazard a guess, I may as well give you the answer. It's a reference to the 1992 song and album, "It's a Shame About Ray," by The Lemonheads.
Jared,
In connection with this discussion about failure of the peer review process, I assume a discussion of peer review failures of the IPPC 4th assessment report would be appropriate as well?
Make that "IPCC". Sorry
Matt,
You are welcome to say whatever you want about IPCC peer review.
This might be a good place to start.
http://www.noconsensus.org/ipcc-audit/IPCC-report-card.php
Go ahead and explain what you think is significant about it.
Jared,
The IPCC chairman claimed that the 2007 report relied solely on peer-reviewed sources. So, 43 citizen auditors in 12 countries audited all 18,531 references cited in the 2007 IPCC report. Of that total, 5,587 (30%) were found not to be peer reviewed.
Frankly I think the emphasis on peer review has been a little over done. For years, global warming alarmists (a pejorative, I know) have said that there is essentially no peer reviewed literature refuting the consensus of anthropogenic global warming. However, the hacked CRU emails illustrate the lengths to which alarmists have gone to keep denier’s (another pejorative) papers from being published. Climate science has been behaving badly, but where are the honest decent scientists who will stand up to bad ones? Kind of reminds me of the problem I see with Islam. A very few Muslims behave badly in the name of their religion, but where are the vast majority good and decent Muslims who will stand up to them.
Peer review is not a guarantee of accuracy. Peer review does not guarantee the science is settled. Peer review is simply a determination of whether the paper is worthy of publication. And, as we saw with the Monnett issue recently, peer review can introduce conflict of interest (his wife was one of two peers to review his paper). Peer review, because of the nature of human beings and the incentives they have, is inherently conservative. Peer review makes it tough for otherwise worthy papers that do not support the consensus to get published.
It seems to me that climate science is fundamentally different from the “hard” sciences, i.e. physics, chemistry, biology. In the hard sciences, peer review might imply that other scientists were able to reproduce your work. Climate science seems to be much more like the social sciences. Namely:
• Bad statistical methodology
• Emphasis on peer review over replication
• Reliance on computer models over observation
• Belief that there is a “right” answer for society
I strongly suspect that the editor of Remote Sensing is being forced out by the same influences that have conspired in the past to use the peer review process to suppress publication of otherwise worthy scientific papers that do not support the consensus. In other words, what we are talking about here is politics, not science.
Matt, my opinion is that website is really about shock value rather than substance.
The first thing I noticed is that WG1 comes out to 93% (A) peer reviewed, according to their accounting. In fact every individual chapter of that section is graded at an A or a B. Not bad considering it's the section of the report dedicated to the physical sciences. So even if you could legitimately dismiss the sections on impacts and mitigation on the basis of their percentage of peer review, you've still got the section on the physical sciences at 93% for use of peer reviewed sources. Maybe that will help you sleep better.
We could pick at the accounting. Looking through some of the grading, I see that reports from the National Academies of Sciences or IPCC are not considered peer reviewed. That seems wrong to me since they are extensively reviewed. And anyway they represent authoritative distillations of the primary literature. I'm betting there are more such examples.
But what does it all mean? The owners of the website would obviously like us to think that the IPCC report is largely based on poor or unreliable information, but they've not done any analysis to show that that is true. Moreover, there is no attempt to place the use of non-peer reviewed sources in any context. For example, closer to my own heart, I found a citation to the CDC's Morbidity and Mortality Weekly Report (MMWR). I don't know what kind of review processes operate for the MMWR, but it clearly is not a peer reviewed journal in the normal sense, and it is graded accordingly by this website. But the MMWR is an authoritative source for disease outbreaks in the U.S. and is commonly cited in peer reviewed articles as a primary source. Similarly, statistics and reports from the U.S. Department of Energy, Department of Agriculture, the World Health Organization, or other similar governmental agencies might be highly relevant and worthy of inclusion even though they are not considered peer reviewed. They are nevertheless authoritative and are rightly cited. There may also be academic books referenced that may or may not be reviewed, but are themselves based on peer reviewed literature and are considered authoritative in their field.
If we are interested in substance rather than games, the question is not what percentage of the references come from peer reviewed journals. The question is how well does the report represent the fields that it summarizes. I'm not qualified to render an authoritative judgment on that--if I were, I would be a climate scientist--but it seems to do a pretty good job.
Jared,
And my opinion is that lack of peer review has been used as an argument from authority to cast aspersion on the work of qualified scientists who do not support the consensus, rather than deal with the substance of their work. So are we in agreement that when it comes to the work of qualified scientists, substance trumps peer review?
So are we in agreement that when it comes to the work of qualified scientists, substance trumps peer review?
Yes. And I agree that the peer review argument has probably been overplayed by alarmists (your term). However, deniers (your term) have played their own games as well.
Publication in a peer reviewed journal does not constitute a final stamp of approval. The sifting and the weighing of the literature by the community of researchers continues on.
So, may I also assume that since the sifting and weighing continues, you advocate no political action at this time, i.e., Cap and Trade, Kyoto, and that you support an all of the above energy policy?
I don't see how lack of political action necessarily follows from the fact that scientific knowledge is always open to refinement and reconsideration.
I understand that science is always tentative. Potentially, everything is subject to revision as new information is obtained. That is healthy and I have no issue with scientists continually “sifting and weighing”. That is their job. I have no dog in that fight.
What I do take issue with is scientists who use tentative scientific results to predict horrific climate catastrophes, and then use those to justify becoming political advocates for profoundly transforming our economy. It is my opinion that the issue of anthropogenic global warming has been co-opted by people with a political agenda that is profoundly different from mine. I do have dog in that fight.
Post a Comment