Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed.
OBJECTIVE
Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies.


METHODS
Eight experts in reliability and agreement investigation developed guidelines for reporting.


RESULTS
Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications.


CONCLUSIONS
The proposed guidelines intend to improve the quality of reporting.
Department of Nursing Science, Centre for Humanities and Health Sciences, Charité-Universitätsmedizin Berlin, Berlin, Germany. jan.kottner@charite.de
Jan
J
Kottner
Laurent
L
Audigé
Stig
S
Brorson
Allan
A
Donner
Byron J
BJ
Gajewski
Asbjørn
A
Hróbjartsson
Chris
C
Roberts
Mohamed
M
Shoukri
David L
DL
Streiner
D002986:Clinical Trials as Topic; D017408:Guidelines as Topic; D006302:Health Services Research / Q000592:standards*; D006801:Humans; D015588:Observer Variation; D011785:Quality Assurance, Health Care / Q000592:standards*; D015203:Reproducibility of Results; D012107:Research Design / Q000592:standards*