title: Can physicians identify inappropriate nuclear stress tests? An examination of inter-rater reliability for the 2009 appropriate use criteria for radionuclide imaging.
abstract: BACKGROUND
  We sought to determine inter-rater reliability of the 2009 Appropriate Use Criteria for radionuclide imaging and whether physicians at various levels of training can effectively identify nuclear stress tests with inappropriate indications.
  
  
  RESULTS
  Four hundred patients were randomly selected from a consecutive cohort of patients undergoing nuclear stress testing at an academic medical center. Raters with different levels of training (including cardiology attending physicians, cardiology fellows, internal medicine hospitalists, and internal medicine interns) classified individual nuclear stress tests using the 2009 Appropriate Use Criteria. Consensus classification by 2 cardiologists was considered the operational gold standard, and sensitivity and specificity of individual raters for identifying inappropriate tests were calculated. Inter-rater reliability of the Appropriate Use Criteria was assessed using Cohen κ statistics for pairs of different raters. The mean age of patients was 61.5 years; 214 (54%) were female. The cardiologists rated 256 (64%) of 400 nuclear stress tests as appropriate, 68 (18%) as uncertain, 55 (14%) as inappropriate; 21 (5%) tests were unable to be classified. Inter-rater reliability for noncardiologist raters was modest (unweighted Cohen κ, 0.51, 95% confidence interval, 0.45-0.55). Sensitivity of individual raters for identifying inappropriate tests ranged from 47% to 82%, while specificity ranged from 85% to 97%.
  
  
  CONCLUSIONS
  Inter-rater reliability for the 2009 Appropriate Use Criteria for radionuclide imaging is modest, and there is considerable variation in the ability of raters at different levels of training to identify inappropriate tests.
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital. sy2357@cumc.columbia.edu.
authors.forename: Siqin
authors.initials: S
authors.lastname: Ye
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: LeRoy E
authors.initials: LE
authors.lastname: Rabbani
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Christopher R
authors.initials: CR
authors.lastname: Kelly
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Maureen R
authors.initials: MR
authors.lastname: Kelly
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Matthew
authors.initials: M
authors.lastname: Lewis
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Yehuda
authors.initials: Y
authors.lastname: Paz
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Clara L
authors.initials: CL
authors.lastname: Peck
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Shaline
authors.initials: S
authors.lastname: Rao
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Sabahat
authors.initials: S
authors.lastname: Bokhari
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Shepard D
authors.initials: SD
authors.lastname: Weiner
authors.affiliation: From the Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital.
authors.forename: Andrew J
authors.initials: AJ
authors.lastname: Einstein
mesh_terms: D000046:Academic Medical Centers; D000328:Adult; D000368:Aged; D057286:Electronic Health Records; D005260:Female; D019983:Guideline Adherence / Q000592:standards*; D006801:Humans; D008297:Male; D008875:Middle Aged; D009519:New York City; D015588:Observer Variation; D018579:Patient Selection; D017410:Practice Guidelines as Topic / Q000592:standards*; D010818:Practice Patterns, Physicians' / Q000592:standards*; D011237:Predictive Value of Tests; D019984:Quality Indicators, Health Care / Q000592:standards; D011877:Radionuclide Imaging / Q000592:standards* / Q000706:statistics & numerical data*; D012189:Retrospective Studies; D012307:Risk Factors; D019564:Unnecessary Procedures / Q000706:statistics & numerical data*
keywords: coronary disease; radioisotopes