title: The most important tasks for peer reviewers evaluating a randomized controlled trial are not congruent with the tasks most often requested by journal editors.
abstract: BACKGROUND
  The peer review process is a cornerstone of biomedical research publications. However, it may fail to allow the publication of high-quality articles. We aimed to identify and sort, according to their importance, all tasks that are expected from peer reviewers when evaluating a manuscript reporting the results of a randomized controlled trial (RCT) and to determine which of these tasks are clearly requested by editors in their recommendations to peer reviewers.
  
  
  METHODS
  We identified the tasks expected of peer reviewers from 1) a systematic review of the published literature and 2) recommendations to peer reviewers for 171 journals (i.e., 10 journals with the highest impact factor for 14 different medical areas and all journals indexed in PubMed that published more than 15 RCTs over 3 months regardless of the medical area). Participants who had peer-reviewed at least one report of an RCT had to classify the importance of each task relative to other tasks using a Q-sort technique. Finally, we evaluated editors' recommendations to authors to determine which tasks were clearly requested by editors in their recommendations to peer reviewers.
  
  
  RESULTS
  The Q-sort survey was completed by 203 participants, 93 (46 %) with clinical expertise, 72 (36 %) with methodological/statistical expertise, 17 (8 %) with expertise in both areas, and 21 (10 %) with other expertise. The task rated most important by participants (evaluating the risk of bias) was clearly requested by only 5 % of editors. In contrast, the task most frequently requested by editors (provide recommendations for publication), was rated in the first tertile only by 21 % of all participants.
  
  
  CONCLUSIONS
  The most important tasks for peer reviewers were not congruent with the tasks most often requested by journal editors in their guidelines to reviewers.
authors.affiliation: Paris Descartes University, Paris, France. anthony.chauvin@lrb.aphp.fr.|INSERM, UMR 1153, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité - (CRESS), METHODS team, Paris, France. anthony.chauvin@lrb.aphp.fr.
authors.forename: Anthony
authors.initials: A
authors.lastname: Chauvin
authors.affiliation: Centre d'Épidémiologie Clinique, Hôpital Hôtel Dieu, Assistance Publique des Hôpitaux de Paris, Paris, France. philippe.ravaud@htd.aphp.fr.|Paris Descartes University, Paris, France. philippe.ravaud@htd.aphp.fr.|INSERM, UMR 1153, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité - (CRESS), METHODS team, Paris, France. philippe.ravaud@htd.aphp.fr.
authors.forename: Philippe
authors.initials: P
authors.lastname: Ravaud
authors.affiliation: Centre d'Épidémiologie Clinique, Hôpital Hôtel Dieu, Assistance Publique des Hôpitaux de Paris, Paris, France. gabriel.baron.ap@gmail.com.|INSERM, UMR 1153, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité - (CRESS), METHODS team, Paris, France. gabriel.baron.ap@gmail.com.
authors.forename: Gabriel
authors.initials: G
authors.lastname: Baron
authors.affiliation: Paris Descartes University, Paris, France. caroline.grace.barnes@gmail.com.|INSERM, UMR 1153, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité - (CRESS), METHODS team, Paris, France. caroline.grace.barnes@gmail.com.
authors.forename: Caroline
authors.initials: C
authors.lastname: Barnes
authors.affiliation: Centre d'Épidémiologie Clinique, Hôpital Hôtel Dieu, Assistance Publique des Hôpitaux de Paris, Paris, France. isabelle.boutron@htd.aphp.fr.|Paris Descartes University, Paris, France. isabelle.boutron@htd.aphp.fr.|INSERM, UMR 1153, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité - (CRESS), METHODS team, Paris, France. isabelle.boutron@htd.aphp.fr.
authors.forename: Isabelle
authors.initials: I
authors.lastname: Boutron
mesh_terms: D035843:Biomedical Research; D035081:Editorial Policies; D006801:Humans; D055811:Journal Impact Factor; D017712:Peer Review, Research; D010506:Periodicals as Topic; D016032:Randomized Controlled Trials as Topic