How should variable selection be performed with multiply imputed data?
Multiple imputation is a popular technique for analysing incomplete data. Given the imputed data and a particular model, Rubin's rules (RR) for estimating parameters and standard errors are well established. However, there are currently no guidelines for variable selection in multiply imputed data sets. The usual practice is to perform variable selection amongst the complete cases, a simple but inefficient and potentially biased procedure. Alternatively, variable selection can be performed by repeated use of RR, which is more computationally demanding. An approximation can be obtained by a simple 'stacked' method that combines the multiply imputed data sets into one and uses a weighting scheme to account for the fraction of missing data in each covariate. We compare these and other approaches using simulations based around a trial in community psychiatry. Most methods improve on the naïve complete-case analysis for variable selection, but importantly the type 1 error is only preserved if selection is based on RR, which is our recommended approach.
Wood
Angela M
AM
Department of Public Health and Primary Care, University of Cambridge, Strangeways Research Laboratory, Worts Causeway, Cambridge CB2 8RN, UK. amw79@medschl.cam.ac.uk
White
Ian R
IR
Royston
Patrick
P
D000293:Adolescent; D000328:Adult; D000368:Aged; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D005260:Female; D006801:Humans; D016014:Linear Models; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical; D015337:Multicenter Studies as Topic; D015999:Multivariate Analysis; D011618:Psychotic Disorders / Q000628:therapy; D016032:Randomized Controlled Trials as Topic; D013269:Stochastic Processes