title: How reliable is emergency department triage?
abstract: OBJECTIVE
  To measure interrater and intrarater agreement for an emergency department triage system.
  
  
  METHODS
  A 2-phase experimental study was conducted using previously described in-person scripted encounters with emergency nurses who perform patient triage and attending emergency physicians at a tertiary referral center. Standardized patient scenarios were presented twice over 6 weeks. Participants rated severity for each patient using a 5-tier triage system (nurses only) and estimated the probability of hospital admission, the most appropriate time frame to physician evaluation (5 choices, from "Immediate" to "More than 24 hours"), the need for a monitored ED bed, and the need for diagnostic services. Interrater agreement was measured by a coefficient of agreement for multiple raters and multiple categories.
  
  
  RESULTS
  Of the 37 participants (fewer than 90% of those eligible), 19 (51%) completed both phases (12 nurses, 7 physicians). Four (33%) of the nurses assigned the same severity ratings for the 5 cases in phase 2 as they did in phase 1. Intrarater agreement among the 12 nurses rating triage severity was.757. Interrater agreement of nurses and physicians was substantial regarding need for ED monitoring, and moderate to substantial for other triage assessments.
  
  
  CONCLUSIONS
  There was general agreement in interrater assessment of triage classification. Continued work is necessary to more fully delineate areas of variation.
authors.affiliation: University of British Columbia, Vancouver, Canada, Harvard Medical School, Boston, MA, USA. Multicentre Operations Research Group. cfernand@unixg.ubc.ca
authors.forename: C M
authors.initials: CM
authors.lastname: Fernandes
authors.forename: R
authors.initials: R
authors.lastname: Wuerz
authors.forename: S
authors.initials: S
authors.lastname: Clark
authors.forename: O
authors.initials: O
authors.lastname: Djurdjev
mesh_terms: D000328:Adult; D001955:British Columbia; D002983:Clinical Competence; D004636:Emergency Service, Hospital / Q000592:standards*; D005260:Female; D006801:Humans; D007223:Infant; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D016544:Patient Simulation; D015203:Reproducibility of Results; D014218:Triage / Q000145:classification / Q000592:standards* / Q000706:statistics & numerical data