title: Validation of the CoRE Questionnaire for a Medical Journal Peer Review.
abstract: If a peer review instrument asks concrete questions (defined as items that can only generate disagreement if reviewers have different degrees of expertise), then questionnaires could become more meaningful in terms of resolving subjectivity thus leading to more reviewer agreement. A concrete item questionnaire with well-chosen questions can also help resolve disagreement when reviewers have the same level of expertise. We have recently created the core-item reviewer evaluation (CoRE) questionnaire for which decision-threshold score levels have been created, but which have not been validated. This prospective validation of these thresholds for the CoRE questionnaire demonstrated strong agreement between reviewer recommendations and their reported score levels when tested prospectively at Clinical Medicine and Research. We conclude that using the CoRE questionnaire will help reduce peer reviewer disagreement. More importantly, when reviewer expertise varies, editors can more easily detect this and decide which opinion reflects the greater expertise.
authors.affiliation: a Research School of Population Health , Australian National University , Canberra , Australia.|b Clinical Medicine and Research, Marshfield Clinic Research Foundation , Marshfield , Wisconsin , USA.
authors.forename: Suhail A R
authors.initials: SA
authors.lastname: Doi
authors.affiliation: b Clinical Medicine and Research, Marshfield Clinic Research Foundation , Marshfield , Wisconsin , USA.
authors.forename: Sherry A
authors.initials: SA
authors.lastname: Salzman-Scott
authors.affiliation: b Clinical Medicine and Research, Marshfield Clinic Research Foundation , Marshfield , Wisconsin , USA.|c Department of Hematology/Oncology , Marshfield Clinic Weston Center , Weston , Wisconsin , USA.
authors.forename: Adedayo A
authors.initials: AA
authors.lastname: Onitilo
mesh_terms: D034462:Dissent and Disputes; D035081:Editorial Policies; D032984:Ethics, Research; D006801:Humans; D017712:Peer Review, Research / Q000592:standards*; D011446:Prospective Studies; D011795:Surveys and Questionnaires / Q000592:standards*
keywords: Authorship; peer review; publication; publication ethics; research bias; research integrity