title: The development of a quality appraisal tool for studies of diagnostic reliability (QAREL).
abstract: OBJECTIVE
  In systematic reviews of the reliability of diagnostic tests, no quality assessment tool has been used consistently. The aim of this study was to develop a specific quality appraisal tool for studies of diagnostic reliability.
  
  
  METHODS
  Key principles for the quality of studies of diagnostic reliability were identified with reference to epidemiologic principles, existing quality appraisal checklists, and the Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) resources. Specific items that encompassed each of the principles were developed. Experts in diagnostic research provided feedback on the items that were to form the appraisal tool. This process was iterative and continued until consensus among experts was reached.
  
  
  RESULTS
  The Quality Appraisal of Reliability Studies (QAREL) checklist includes 11 items that explore seven principles. Items cover the spectrum of subjects, spectrum of examiners, examiner blinding, order effects of examination, suitability of the time interval among repeated measurements, appropriate test application and interpretation, and appropriate statistical analysis.
  
  
  CONCLUSIONS
  QAREL has been developed as a specific quality appraisal tool for studies of diagnostic reliability. The reliability of this tool in different contexts needs to be evaluated.
authors.affiliation: School of Biomedical and Health Sciences, University of Western Sydney, Narellan Road, Campbelltown, Sydney, Australia. n.p.lucas@uws.edu.au
authors.forename: Nicholas P
authors.initials: NP
authors.lastname: Lucas
authors.forename: Petra
authors.initials: P
authors.lastname: Macaskill
authors.forename: Les
authors.initials: L
authors.lastname: Irwig
authors.forename: Nikolai
authors.initials: N
authors.lastname: Bogduk
mesh_terms: D057189:Checklist / Q000592:standards*; D003955:Diagnostic Tests, Routine / Q000592:standards*; D019317:Evidence-Based Medicine / Q000592:standards; D006801:Humans; D015588:Observer Variation; D036301:Qualitative Research; D011786:Quality Control; D012015:Reference Standards; D015203:Reproducibility of Results; D012196:Review Literature as Topic