Thursday, March 04, 2010

Turning peer review into modern-day holy scripture

Controversies over "peer review" in research is not anything new.  My favorite story is the one about Alan Sokal, the physicist, getting an essay "Transgressing the boundaries: Toward a transformative hermeneutics of quantum gravity" published in Social Text.  Talk about the filtering work of peer-review!

Recently, the "hard sciences" have been forced to defend peer-review thanks to various controversies.  In writing about peer-review at Spiked, Frank Furedi notes:

Increasingly, peer review is cited as kind of unquestioned and unquestionable authority for settling what are in fact political disputes. Consequently, the findings of peer review are looked upon, not simply as statements about the quality of research or of a scientific finding, but as the foundation for far-reaching policies that affect everything from the global economy to our individual lifestyles.
Increasingly, peer review has been turned into a quasi-holy institution, which apparently signifies that a certain claim is legitimate or sacred. And from this perspective, voices which lack the authority of peer review are, by definition, illegitimate. Peer review provides a warrant to be heard – those who speak without this warrant deserve only our scorn.
You can almost visualise peer-review dogmatists waving their warrant and demanding that their opponents be silenced. For someone like George Monbiot, the British climate-change alarmist, peer review is the equivalent of a holy scripture. Boasting of his encounter with an opponent, who challenged him to a debate on speed cameras, Monbiot wrote: ‘I accepted and floored him with a simple question.’ Predictably, the question was: ‘Has he published his analysis in a peer-reviewed journal?’
In a world where opponents can be ‘floored’ simply because they lack the authority provided by the ritual of peer review, it is not surprising that there is considerable incentive to manipulate the system of peer review, to bend it to one’s own will and needs. 

Yep.  It is all mashed potatoes if they are not peer-reviewed :)

No comments: