title: Bias arising from missing data in predictive models.
abstract: OBJECTIVE
  The purpose of this study is to determine the effect of three common approaches to handling missing data on the results of a predictive model.
  
  
  METHODS
  Monte Carlo simulation study using simulated data was used. A baseline logistic regression using complete data was performed to predict hospital admission, based on the white blood cell count (WBC) (dichotomized as normal or high), presence of fever, or procedures performed (PROC). A series of simulations was then performed in which WBC data were deleted for varying proportions (15-85%) of patients under various patterns of missingness. Three analytic approaches were used: analysis restricted to cases with complete data, missing data assumed to be normal (MAN), and use of imputed values.
  
  
  RESULTS
  In the baseline analysis, all three predictors were all significantly associated with admission. Using either the MAN approach or imputation, the odds ratio (OR) for WBC was substantially over- or underestimated depending on the missingness pattern, and there was considerable bias toward the null in the OR estimates for fever. In the CC analyses, OR for WBC was consistently biased toward the null, OR for PROC was biased away from the null, and the OR for fever was biased toward or away from the null. Estimates for overall model discrimination were substantially biased using all analytic approaches.
  
  
  CONCLUSIONS
  All three methods of handling large amounts of missing data can lead to biased estimates of the OR and of model performance in predictive models. Predictor variables that are measured inconsistently can affect the validity of such models.
authors.affiliation: Department of Pediatrics, Section of Emergency Medicine, Medical College of Wisconsin, Milwaukee, WI, USA. mgorelic@mcw.edu
authors.forename: Marc H
authors.initials: MH
authors.lastname: Gorelick
mesh_terms: D000293:Adolescent; D015982:Bias; D002648:Child; D002675:Child, Preschool; D004630:Emergencies; D004636:Emergency Service, Hospital / Q000706:statistics & numerical data; D004812:Epidemiologic Methods; D005334:Fever / Q000175:diagnosis; D006760:Hospitalization / Q000706:statistics & numerical data; D006801:Humans; D007223:Infant; D007231:Infant, Newborn; D007958:Leukocyte Count