title: Using randomized controlled trial data, the agreement between retrospectively and prospectively collected data comprising the pneumonia severity index was substantial.
abstract: OBJECTIVE
  To assess the agreement between prospectively and retrospectively determined variables comprising the Pneumonia Severity Index (PSI), assignment to PSI risk class, and designation as low risk, based on these two methods of data collection.
  
  
  METHODS
  We analyzed data from a randomized trial of patients with community-acquired pneumonia managed in 32 hospital emergency departments (EDs). For all enrolled patients, the 20 PSI variables were collected prospectively by ED providers and retrospectively by medical record abstractors. We examined the agreement for each of the 20 PSI variables, assignment to the five PSI risk classes, and classification of patients as low (classes I-III) vs. high (classes IV and V) risk. Agreement was measured using total percent agreement and the kappa statistic.
  
  
  RESULTS
  Among the 3,220 enrolled patients, percent agreement was >90% for 18 of the 20 variables comprising the PSI, with most unweighted kappa's being >0.6. Agreement was substantial for assignment to PSI risk class (percent agreement: 92.7%; weighted kappa: 0.79) and for classification as low vs. high risk (percent agreement: 88.5%; unweighted kappa: 0.74).
  
  
  CONCLUSIONS
  There was substantial agreement between retrospective and prospective assignment to PSI risk class, classification as low vs. high risk, and the determination of most individual variables that constitute the PSI.
authors.affiliation: Division of General Internal Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA, USA. Aujesky@swissonline.ch
authors.forename: Drahomir
authors.initials: D
authors.lastname: Aujesky
authors.forename: Roslyn A
authors.initials: RA
authors.lastname: Stone
authors.forename: D Scott
authors.initials: DS
authors.lastname: Obrosky
authors.forename: Donald M
authors.initials: DM
authors.lastname: Yealy
authors.forename: Thomas E
authors.initials: TE
authors.lastname: Auble
authors.forename: Thomas P
authors.initials: TP
authors.lastname: Meehan
authors.forename: Louis G
authors.initials: LG
authors.lastname: Graff
authors.forename: Jonathan M
authors.initials: JM
authors.lastname: Fine
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Fine
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D011014:Pneumonia / Q000628:therapy*; D011446:Prospective Studies; D016032:Randomized Controlled Trials as Topic; D012189:Retrospective Studies; D018570:Risk Assessment / Q000379:methods; D012720:Severity of Illness Index