title: Expert consensus vs empirical estimation of injury severity: effect on quality measurement in trauma.
abstract: OBJECTIVE
  To determine the extent to which the Injury Severity Score (ISS) and Trauma Mortality Probability Model (T-MPM), a new trauma injury score based on empirical injury severity estimates, agree on hospital quality.
  
  
  METHODS
  Retrospective cohort study based on 66,214 patients in 68 hospitals. Four risk-adjustment models based on either ISS or T-MPM were constructed, with or without physiologic information.
  
  
  METHODS
  Hospital quality was measured using the ratio of the observed-to-expected mortality rates. Pairwise comparisons of hospital quality based on ISSaugmented vs T-MPMaugmented were performed using the intraclass correlation coefficient and the kappa statistic.
  
  
  RESULTS
  There was almost perfect agreement for the ratios of the observed to expected mortality rates based on the T-MPM vs the ISS when physiologic information was included in the model (intraclass correlation coefficient, 0.93). There was substantial agreement on which hospitals were identified as high-, intermediate-, and low-quality hospitals (kappa = 0.79). Excluding physiologic information decreased the level of agreement between the T-MPM and the ISS (intraclass correlation coefficient, 0.88 and kappa = 0.58).
  
  
  CONCLUSIONS
  The choice of expert-based or empirical Abbreviated Injury Score severity scores for individual injuries does not seem to have a significant effect on hospital quality measurement when physiologic information is included in the prediction model. This finding should help to convince all stakeholders that the quality of trauma care can be accurately measured and has face validity.
authors.affiliation: Department of Anesthesiology, University of Rochester School of Medicine, 601 Elmwood Ave, Box 604, Rochester, NY 14642, USA. Laurent_Glance@urmc.rochester.edu
authors.forename: Laurent G
authors.initials: LG
authors.lastname: Glance
authors.forename: Turner M
authors.initials: TM
authors.lastname: Osler
authors.forename: Dana B
authors.initials: DB
authors.lastname: Mukamel
authors.forename: Wayne
authors.initials: W
authors.lastname: Meredith
authors.forename: Andrew W
authors.initials: AW
authors.lastname: Dick
mesh_terms: D000328:Adult; D005260:Female; D015600:Glasgow Coma Scale; D017052:Hospital Mortality; D006761:Hospitals / Q000592:standards*; D006801:Humans; D015601:Injury Severity Score; D008297:Male; D015233:Models, Statistical; D011787:Quality of Health Care; D014193:Trauma Centers / Q000592:standards*; D014947:Wounds and Injuries / Q000145:classification / Q000401:mortality*; D003245:Consensus Statements as Topic