title: Cooperation between referees and authors increases peer review accuracy.
abstract: Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.
authors.affiliation: Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America. jleek@jhsph.edu
authors.forename: Jeffrey T
authors.initials: JT
authors.lastname: Leek
authors.forename: Margaret A
authors.initials: MA
authors.lastname: Taub
authors.forename: Fernando J
authors.initials: FJ
authors.lastname: Pineda
mesh_terms: D006801:Humans; D007398:Interpersonal Relations; D017712:Peer Review, Research
references.citation: Nature. 2011 Jun 15;474(7351):285
references.pmid: 21677734
references.citation: Nature. 1997 May 22;387(6631):341-3
references.pmid: 9163412
references.citation: JAMA. 2002 Jun 5;287(21):2784-6
references.pmid: 12038911
references.citation: J Gen Intern Med. 1999 Oct;14(10):622-4
references.pmid: 10571708
references.citation: BMJ. 1999 Jan 2;318(7175):4-5
references.pmid: 9872861
references.citation: JAMA. 1990 Mar 9;263(10):1330-2
references.pmid: 2304209
references.citation: BMJ. 2006 Aug 19;333(7564):366
references.pmid: 16916814
references.citation: Nature. 2011 Apr 28;472(7344):391
references.pmid: 21525890
references.citation: Nature. 2008 Mar 20;452(7185):348-51
references.pmid: 18354481
references.citation: Cardiovasc Res. 1994 Aug;28(8):1134-9; discussion 1140-5
references.pmid: 7954614
references.citation: Br J Psychiatry. 2000 Jan;176:47-51
references.pmid: 10789326
references.citation: J R Soc Med. 2006 Dec;99(12):596-8
references.pmid: 17139057
references.citation: BMJ. 2010 Nov 16;341:c5729
references.pmid: 21081600
references.citation: JAMA. 1998 Jul 15;280(3):240-2
references.pmid: 9676668
references.citation: Nature. 2010 Nov 4;468(7320):29-31
references.pmid: 21048742
references.citation: Ann Emerg Med. 2011 Feb;57(2):141-8
references.pmid: 21074894
references.citation: BMJ. 1999 Jan 2;318(7175):23-7
references.pmid: 9872878
references.citation: Nature. 2011 May 26;473(7348):452
references.pmid: 21614064