Effects of training on quality of peer review: randomised controlled trial.
OBJECTIVE
To determine the effects of training on the quality of peer review.


METHODS
Single blind randomised controlled trial with two intervention groups receiving different types of training plus a control group.


METHODS
Reviewers at a general medical journal. Interventions Attendance at a training workshop or reception of a self taught training package focusing on what editors want from reviewers and how to critically appraise randomised controlled trials.


METHODS
Quality of reviews of three manuscripts sent to reviewers at four to six monthly intervals, evaluated using the validated review quality instrument; number of deliberate major errors identified; time taken to review the manuscripts; proportion recommending rejection of the manuscripts.


RESULTS
Reviewers in the self taught group scored higher in review quality after training than did the control group (score 2.85 v 2.56; difference 0.29, 95% confidence interval 0.14 to 0.44; P = 0.001), but the difference was not of editorial significance and was not maintained in the long term. Both intervention groups identified significantly more major errors after training than did the control group (3.14 and 2.96 v 2.13; P < 0.001), and this remained significant after the reviewers' performance at baseline assessment was taken into account. The evidence for benefit of training was no longer apparent on further testing six months after the interventions. Training had no impact on the time taken to review the papers but was associated with an increased likelihood of recommending rejection (92% and 84% v 76%; P = 0.002).


CONCLUSIONS
Short training packages have only a slight impact on the quality of peer review. The value of longer interventions needs to be assessed.
BMJ Editorial Office, BMA House, Tavistock Square, London WC1H 9JR. sschroter@bmj.com
Sara
S
Schroter
Nick
N
Black
Stephen
S
Evans
James
J
Carpenter
Fiona
F
Godlee
Richard
R
Smith
D004517:Education, Professional; D006801:Humans; D015588:Observer Variation; D017712:Peer Review, Research / Q000592:standards*; D011361:Professional Competence / Q000592:standards*; D011786:Quality Control; D016037:Single-Blind Method