title: Which Propensity Score Method Best Reduces Confounder Imbalance? An Example From a Retrospective Evaluation of a Childhood Obesity Intervention.
abstract: BACKGROUND
  Propensity score (PS) methods are increasingly being employed by researchers to reduce bias arising from confounder imbalance when using observational data to examine intervention effects.
  
  
  OBJECTIVE
  The purpose of this study was to examine PS theory and methodology and compare application of three PS methods (matching, stratification, weighting) to determine which best improves confounder balance.
  
  
  METHODS
  Baseline characteristics of a sample of 20,518 school-aged children with severe obesity (of whom 1,054 received an obesity intervention) were assessed prior to PS application. Three PS methods were then applied to the data to determine which showed the greatest improvement in confounder balance between the intervention and control group. The effect of each PS method on the outcome variable-body mass index percentile change at one year-was also examined. SAS 9.4 and Comprehensive Meta-analysis statistical software were used for analyses.
  
  
  RESULTS
  Prior to PS adjustment, the intervention and control groups differed significantly on seven of 11 potential confounders. PS matching removed all differences. PS stratification and weighting both removed one difference but created two new differences. Sensitivity analyses did not change these results. Body mass index percentile at 1 year decreased in both groups. The size of the decrease was smaller in the intervention group, and the estimate of the decrease varied by PS method.
  
  
  CONCLUSIONS
  Selection of a PS method should be guided by insight from statistical theory and simulation experiments, in addition to observed improvement in confounder balance. For this data set, PS matching worked best to correct confounder imbalance. Because each method varied in correcting confounder imbalance, we recommend that multiple PS methods be compared for ability to improve confounder balance before implementation in evaluating treatment effects in observational data.
authors: Krista Schroeder, PhD, RN, CCRN, is Postdoctoral Fellow, University of Pennsylvania School of Nursing, Philadelphia. Haomiao Jia, PhD, is Associate Professor of Biostatistics, Columbia University School of Nursing, New York, New York. Arlene Smaldone, PhD, CPNP, CDE, is Associate Professor of Nursing and Dental Behavioral Sciences and Assistant Dean of Scholarship and Research, Columbia University School of Nursing, New York, New York.
authors: Krista
authors: K
authors: Schroeder
authors: Haomiao
authors: H
authors: Jia
authors: Arlene
authors: A
authors: Smaldone
mesh_terms: D000293:Adolescent; D015982:Bias; D035843:Biomedical Research / Q000379:methods*; D002648:Child; D015986:Confounding Factors, Epidemiologic; D005260:Female; D006801:Humans; D008297:Male; D008962:Models, Theoretical; D063766:Pediatric Obesity; D057216:Propensity Score; D012189:Retrospective Studies