title: The use of bootstrapping when using propensity-score matching without replacement: a simulation study.
abstract: Propensity-score matching is frequently used to estimate the effect of treatments, exposures, and interventions when using observational data. An important issue when using propensity-score matching is how to estimate the standard error of the estimated treatment effect. Accurate variance estimation permits construction of confidence intervals that have the advertised coverage rates and tests of statistical significance that have the correct type I error rates. There is disagreement in the literature as to how standard errors should be estimated. The bootstrap is a commonly used resampling method that permits estimation of the sampling variability of estimated parameters. Bootstrap methods are rarely used in conjunction with propensity-score matching. We propose two different bootstrap methods for use when using propensity-score matching without replacementand examined their performance with a series of Monte Carlo simulations. The first method involved drawing bootstrap samples from the matched pairs in the propensity-score-matched sample. The second method involved drawing bootstrap samples from the original sample and estimating the propensity score separately in each bootstrap sample and creating a matched sample within each of these bootstrap samples. The former approach was found to result in estimates of the standard error that were closer to the empirical standard deviation of the sampling distribution of estimated effects.
authors.affiliation: Institute for Clinical Evaluative Sciences, Toronto, Canada; Institute of Health Management, Policy and Evaluation, University of Toronto, Toronto, Canada; Schulich Heart Research Program, Sunnybrook Research Institute, Toronto, Canada.
authors.forename: Peter C
authors.initials: PC
authors.lastname: Austin
authors.forename: Dylan S
authors.initials: DS
authors.lastname: Small
mesh_terms: D003198:Computer Simulation; D016001:Confidence Intervals; D003627:Data Interpretation, Statistical; D006801:Humans; D009010:Monte Carlo Method; D064887:Observational Studies as Topic / Q000379:methods*; D057216:Propensity Score
keywords: Monte Carlo simulations; bootstrap; matching; propensity score; propensity-score matching; variance estimation
references.citation: Int J Biostat. 2009 Apr 14;5(1):Article 13
references.pmid: 20949126
references.citation: Pharmacoepidemiol Drug Saf. 2008 Jun;17(6):546-55
references.pmid: 18311848
references.citation: Stat Med. 2006 Jul 15;25(13):2230-56
references.pmid: 16220488
references.citation: Stat Med. 2007 Feb 20;26(4):734-53
references.pmid: 16708349
references.citation: Stat Med. 2008 May 30;27(12):2037-49
references.pmid: 18038446
references.citation: Stat Med. 2011 May 20;30(11):1292-301
references.pmid: 21337595
references.citation: J Clin Epidemiol. 2008 Jun;61(6):537-45
references.pmid: 18471657
references.citation: Psychol Methods. 2008 Dec;13(4):279-313
references.pmid: 19071996
references.citation: Stat Med. 2010 Feb 10;29(3):337-46
references.pmid: 19960510
references.citation: Stat Med. 2013 Jul 20;32(16):2837-49
references.pmid: 23239115
references.citation: Stat Med. 2010 Sep 10;29(20):2137-48
references.pmid: 20108233
references.citation: Pharm Stat. 2011 Mar-Apr;10(2):150-61
references.pmid: 20925139
references.citation: Stat Med. 2007 Feb 20;26(4):754-68
references.pmid: 16783757
references.citation: Stat Med. 2014 Mar 15;33(6):1057-69
references.pmid: 24123228
references.citation: Pharm Stat. 2012 May-Jun;11(3):222-9
references.pmid: 22411785
references.citation: Stat Med. 2007 Jul 20;26(16):3078-94
references.pmid: 17187347
references.citation: J Thorac Cardiovasc Surg. 2007 Nov;134(5):1128-35
references.pmid: 17976439
references.citation: Circ Cardiovasc Qual Outcomes. 2008 Sep;1(1):62-7
references.pmid: 20031790
references.citation: Stat Methods Med Res. 2017 Feb;26(1):201-222
references.pmid: 25038071
references.citation: Stat Med. 2004 Jan 15;23(1):65-75
references.pmid: 14695640
references.citation: Stat Med. 2005 Jun 15;24(11):1713-23
references.pmid: 15724232