title: Reliability and validity of two four-level emergency triage systems.
abstract: OBJECTIVE
  To measure and compare the reliability and predictive validity of a four-level triage system (I-4L) and the new four-level model triage emergency method (TEM).
  
  
  METHODS
  This observational study was conducted in an urban hospital. Ten nurses were randomly selected to assign a triage level to 189 paper scenarios, using either the I-4L model (5 nurses) or the TEM model (5 nurses). We used weighted kappa statistics to measure the interrater and intrarater reliability of each triage tool and assessed the validity of each models based on the accuracy in predicting admission.
  
  
  RESULTS
  Interrater reliability was kappa=0.73 [95% CI (confidence interval): 0.59-0.87] and kappa=0.79 (95% CI: 0.65-0.93) with I-4L and TEM, respectively. Intrarater reliability was kappa=0.82 (95% CI: 0.67-0.96) and kappa=0.78 (95% CI: 0.62-0.93), respectively. The accuracy of triage rating for admission prediction was similarly good with I-4L and TEM, namely, 79% (95% CI: 74-85) and 77% (95% CI: 74-85). The proportion of patients admitted per triage level was similar with the two models.
  
  
  CONCLUSIONS
  The interrater and intrarater reliability for rating triage acuity and for accuracy in patient admission prediction was good with both models. Performance with the new model was similar to that of I-4L despite the nurses' short experience. The new TEM model has the advantage of predicting utilization of emergency department resources.
authors.affiliation: Department of Emergency Medicine of Community Hospital Santa Maria della Scaletta, Imola, Italy. nipar71@yahoo.it
authors.forename: Nicola
authors.initials: N
authors.lastname: Parenti
authors.forename: Laura
authors.initials: L
authors.lastname: Ferrara
authors.forename: Maria Letizia
authors.initials: ML
authors.lastname: Bacchi Reggiani
authors.forename: Diego
authors.initials: D
authors.lastname: Sangiorgi
authors.forename: Tiziano
authors.initials: T
authors.lastname: Lenzi
mesh_terms: D000465:Algorithms; D006801:Humans; D007318:Inservice Training; D007558:Italy; D009740:Nursing Staff / Q000193:education; D015588:Observer Variation; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D016037:Single-Blind Method; D014218:Triage / Q000379:methods*