title: Interrater reliability of measurements of comorbid illness should be reported.
abstract: OBJECTIVE
  Comorbidity indices are commonly used to stratify patients to control for treatment selection bias. The objectives here were to review the reporting of interrater reliability when studies use comorbidity indices in clinical research publications and to report the interrater reliability of four common indices in a particular research setting.
  
  
  METHODS
  Four trained abstractors reviewed the same 40 charts of patients with squamous cell carcinoma of the head and neck from a regional cancer center. Scores for the Charlson Index, the Index of Co-existent Disease, the Cumulative Illness Rating Scale, and the Kaplan-Feinstein Classification were calculated, and the intraclass correlation coefficient was used to assess interrater reliability.
  
  
  RESULTS
  The details on the training of abstractors and the results of interrater reliability tests are not commonly reported. In our study setting, the Charlson Index had excellent reliability and the others had acceptable reliability.
  
  
  CONCLUSIONS
  If the quality of a study using an index or scale is to be assessed, the reliability and interrater reliability of the score assignment process should be reported.
authors.affiliation: Department of Otolaryngology, Queen's University, and Division of Cancer Care and Epidemiology, Queen's Cancer Research Institute, Queen's University, Kingston, Ontario, Canada. sfh@post.queensu.ca
authors.forename: Stephen F
authors.initials: SF
authors.lastname: Hall
authors.forename: Patti A
authors.initials: PA
authors.lastname: Groome
authors.forename: David L
authors.initials: DL
authors.lastname: Streiner
authors.forename: Paula A
authors.initials: PA
authors.lastname: Rochon
mesh_terms: D002294:Carcinoma, Squamous Cell / Q000150:complications; D015897:Comorbidity; D003627:Data Interpretation, Statistical; D004813:Epidemiology / Q000193:education*; D006258:Head and Neck Neoplasms / Q000150:complications; D006305:Health Status Indicators; D006801:Humans; D015588:Observer Variation; D015983:Selection Bias