title: Inter-rater Reliability and Misclassification of the ABCD(2) Score after Transient Ischemic Attack.
abstract: BACKGROUND
  The ABCD(2) score was initially developed as a simple tool to help first-line clinicians identify patients at highest short-term risk for stroke after transient ischemic attack (TIA). The score is increasingly used for risk stratification of TIA patients, but little is known about its inter-rater reliability. The aim of the present study was to prospectively assess the inter-rater reliability of the ABCD(2) score in patients with TIA, including a comparison among raters of different specialties.
  
  
  METHODS
  Patients presenting to the emergency department with TIA within 48 hours of onset were prospectively evaluated. TIA was defined as acute onset of focal cerebral or monocular symptoms lasting less than 24 hours and presumed because of a vascular cause. Only patients who were asymptomatic at the time of enrollment were eligible. ABCD(2) scores determined by raters of different specialties were compared with those of a vascular neurology attending. Estimated component and total scores and ABCD(2) risk category were compared between raters. Reliability was assessed using unweighted kappa statistics.
  
  
  RESULTS
  A total of 362 evaluations resulting in ABCD(2) scores were performed. In addition to the vascular neurology attending, scores were generated by internal medicine (n = 72), emergency medicine (n = 37), and neurology junior (n = 92) and senior (n = 57) residents. Based on attending scores, 35% of patients were categorized as low risk (ABCD(2) score, 0-3), 50% as moderate risk (ABCD(2) score, 4-5), and 16% as high risk (ABCD(2) score, 6-7). Inter-rater reliability was fair for ABCD(2) total score (κ = .26) and category (κ = .29). Raters agreed with the vascular neurology attending 67% (95% confidence interval [CI], 61%-73%) of the time for ABCD(2) category and 52% (95% CI, 46%-58%) of the time for ABCD(2) total score. Disagreement more often resulted in a lower score by the raters as compared with the vascular neurology attending for both ABCD(2) total score and category. Inter-rater reliability of component scores was near perfect for age (κ = .95) and diabetes (κ = .81) and substantial for blood pressure (κ = .67), but only moderate for clinical features (κ = .55) and duration (κ = .48).
  
  
  CONCLUSIONS
  The inter-rater reliability of the ABCD(2) score is only fair, with rater disagreement of ABCD(2) risk category in nearly one third of patients.
authors: Department of Neurology, New York University Medical Center, New York, New York. Electronic address: Koto.Ishida@nyumc.org.
authors: Koto
authors: K
authors: Ishida
authors: Department of Neurology, University of Pennsylvania Medical Center, Philadelphia, Pennsylvania.
authors: Scott E
authors: SE
authors: Kasner
authors: Department of Neurology, University of Pennsylvania Medical Center, Philadelphia, Pennsylvania.
authors: Brett
authors: B
authors: Cucchiara
mesh_terms: D000368:Aged; D005260:Female; D006801:Humans; D002546:Ischemic Attack, Transient / Q000175:diagnosis*; D008297:Male; D008875:Middle Aged; D011446:Prospective Studies; D015203:Reproducibility of Results; D012307:Risk Factors; D012720:Severity of Illness Index
keywords: ABCD(2) score; TIA; inter-rater reliability; misclassification; risk stratification