title: Reliability of Clinical Assessments in Older Adults With Syncope or Near Syncope.
abstract: Clinical prediction models for risk stratification of older adults with syncope or near syncope may improve resource utilization and management. Predictors considered for inclusion into such models must be reliable. Our primary objective was to evaluate the inter-rater agreement of historical, physical examination, and electrocardiogram (ECG) findings in older adults undergoing emergency department (ED) evaluation for syncope or near syncope. Our secondary objective was to assess the level of agreement between clinicians on the patient's overall risk for death or serious cardiac outcomes.
  
  
  
  We conducted a cross-sectional study at 11 EDs in adults 60 years of age or older who presented with unexplained syncope or near syncope. We excluded patients with a presumptive cause of syncope (e.g., seizure) or if they were unable or unwilling to follow-up. Evaluations of the patient's past medical history and current medication use were completed by treating provider and trained research associate pairs. Evaluations of the patient's physical examination and ECG interpretation were completed by attending/resident, attending/advanced practice provider, or attending/attending pairs. All evaluations were blinded to the responses from the other rater. We calculated the percent agreement and kappa statistic for binary variables. Inter-rater agreement was considered acceptable if the kappa statistic was 0.6 or higher.
  
  
  
  We obtained paired observations from 255 patients; mean (±SD) age was 73 (±9) years, 137 (54%) were male, and 204 (80%) were admitted to the hospital. Acceptable agreement was achieved in 18 of the 21 (86%) past medical history and current medication findings, none of the 10 physical examination variables, and three of the 13 (23%) ECG interpretation variables. There was moderate agreement (Spearman correlation coefficient, r = 0.40) between clinicians on the patient's probability of 30-day death or serious cardiac outcome, although as the probability increased, there was less agreement.
  
  
  
  Acceptable agreement between raters was more commonly achieved with historical rather than physical examination or ECG interpretation variables. Clinicians had moderate agreement in assessing the patient's overall risk for a serious outcome at 30 days. Future development of clinical prediction models in older adults with syncope should account for variability of assessments between raters and consider the use of objective clinical variables.
authors.affiliation: Department of Emergency Medicine, UC Davis School of Medicine, Sacramento, CA. dnishijima@ucdavis.edu.
authors.forename: Daniel K
authors.initials: DK
authors.lastname: Nishijima
authors.affiliation: Center for Policy and Research in Emergency Medicine, Department of Emergency Medicine, Oregon Heath & Science University, Portland, OR.
authors.forename: Amber L
authors.initials: AL
authors.lastname: Laurie
authors.affiliation: Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, CA.
authors.forename: Robert E
authors.initials: RE
authors.lastname: Weiss
authors.affiliation: Center for Policy and Research in Emergency Medicine, Department of Emergency Medicine, Oregon Heath & Science University, Portland, OR.
authors.forename: Annick N
authors.initials: AN
authors.lastname: Yagapen
authors.affiliation: Center for Policy and Research in Emergency Medicine, Department of Emergency Medicine, Oregon Heath & Science University, Portland, OR.
authors.forename: Susan E
authors.initials: SE
authors.lastname: Malveau
authors.affiliation: Department of Emergency Medicine, University of Rochester, Rochester, NY.
authors.forename: David H
authors.initials: DH
authors.lastname: Adler
authors.affiliation: Department of Emergency Medicine, William Beaumont Hospital-Troy, Troy, MI.
authors.forename: Aveh
authors.initials: A
authors.lastname: Bastani
authors.affiliation: Department of Emergency Medicine, Brigham & Women's Hospital, Boston, MA.
authors.forename: Christopher W
authors.initials: CW
authors.lastname: Baugh
authors.affiliation: Department of Emergency Medicine, The Ohio State University Wexner Medical Center, Columbus, OH.
authors.forename: Jeffrey M
authors.initials: JM
authors.lastname: Caterino
authors.affiliation: Department of Emergency Medicine, William Beaumont Hospital-Royal Oak, Royal Oak, MI.
authors.forename: Carol L
authors.initials: CL
authors.lastname: Clark
authors.affiliation: Department of Emergency Medicine, University of Texas-Southwestern, Dallas, TX.
authors.forename: Deborah B
authors.initials: DB
authors.lastname: Diercks
authors.affiliation: Department of Emergency Medicine, Thomas Jefferson University Hospital, Philadelphia, PA.
authors.forename: Judd E
authors.initials: JE
authors.lastname: Hollander
authors.affiliation: Department of Emergency Medicine, Wake Forest School of Medicine, Winston Salem, NC.
authors.forename: Bret A
authors.initials: BA
authors.lastname: Nicks
authors.affiliation: Department of Emergency Medicine, University of Wisconsin-Madison, Madison, WI.
authors.forename: Manish N
authors.initials: MN
authors.lastname: Shah
authors.affiliation: Department of Emergency Medicine, Summa Health System, Akron, OH.
authors.forename: Kirk A
authors.initials: KA
authors.lastname: Stiffler
authors.affiliation: Department of Emergency Medicine, Vanderbilt University, Nashville, TN.
authors.forename: Alan B
authors.initials: AB
authors.lastname: Storrow
authors.affiliation: Department of Emergency Medicine, Summa Health System, Akron, OH.
authors.forename: Scott T
authors.initials: ST
authors.lastname: Wilber
authors.affiliation: Center for Policy and Research in Emergency Medicine, Department of Emergency Medicine, Oregon Heath & Science University, Portland, OR.
authors.forename: Benjamin C
authors.initials: BC
authors.lastname: Sun
mesh_terms: D000368:Aged; D000369:Aged, 80 and over; D003430:Cross-Sectional Studies; D004636:Emergency Service, Hospital; D005260:Female; D006760:Hospitalization; D006801:Humans; D008297:Male; D008487:Medical History Taking; D008875:Middle Aged; D015588:Observer Variation; D010808:Physical Examination / Q000379:methods*; D015203:Reproducibility of Results; D012307:Risk Factors; D013575:Syncope / Q000175:diagnosis*