title: Models developed by three techniques did not achieve acceptable prediction of binary trauma outcomes.
abstract: OBJECTIVE
  To develop prediction models for outcomes following trauma that met prespecified performance criteria. To compare three methods of developing prediction models: logistic regression, classification trees, and artificial neural networks.
  
  
  METHODS
  Models were developed using a 1996-2001 dataset from a major trauma center in Victoria, Australia. Developed models were subjected to external validation using the first year of data collection, 2001-2002, from a state-wide trauma registry for Victoria. Different authors developed models for each method. All authors were blinded to the validation dataset when developing models.
  
  
  RESULTS
  Prediction models were developed for an intensive care unit stay following trauma (prevalence 23%) using information collected at the scene of the injury. None of the three methods gave a model that satisfied the performance criteria of sensitivity >80%, positive predictive value >50% in the validation dataset. Prediction models were also developed for death (prevalence 2.9%) using hospital-collected information. The performance criteria of sensitivity >95%, specificity >20% in the validation dataset were not satisfied by any model.
  
  
  CONCLUSIONS
  No statistical method of model development was optimal. Prespecified performance criteria provide useful guides to interpreting the performance of developed models.
authors.affiliation: Department of Epidemiology and Preventive Medicine, Monash University, Central and Eastern Clinical School, Melbourne, Victoria 3004, Australia. Rory.Wolfe@med.monash.edu.au
authors.forename: Rory
authors.initials: R
authors.lastname: Wolfe
authors.forename: Dean P
authors.initials: DP
authors.lastname: McKenzie
authors.forename: James
authors.initials: J
authors.lastname: Black
authors.forename: Pam
authors.initials: P
authors.lastname: Simpson
authors.forename: Belinda J
authors.initials: BJ
authors.lastname: Gabbe
authors.forename: Peter A
authors.initials: PA
authors.lastname: Cameron
mesh_terms: D000328:Adult; D003663:Decision Trees; D004812:Epidemiologic Methods; D005260:Female; D006801:Humans; D007902:Length of Stay; D008297:Male; D015233:Models, Statistical; D016571:Neural Networks, Computer; D011379:Prognosis; D014947:Wounds and Injuries / Q000453:epidemiology* / Q000401:mortality