title: VARIABLE SELECTION AND PREDICTION WITH INCOMPLETE HIGH-DIMENSIONAL DATA.
abstract: We propose a Multiple Imputation Random Lasso (mirl) method to select important variables and to predict the outcome for an epidemiological study of Eating and Activity in Teens. In this study 80% of individuals have at least one variable missing. Therefore, using variable selection methods developed for complete data after listwise deletion substantially reduces prediction power. Recent work on prediction models in the presence of incomplete data cannot adequately account for large numbers of variables with arbitrary missing patterns. We propose MIRL to combine penalized regression techniques with multiple imputation and stability selection. Extensive simulation studies are conducted to compare MIRL with several alternatives. MIRL outperforms other methods in high-dimensional scenarios in terms of both reduced prediction error and improved variable selection performance, and it has greater advantage when the correlation among variables is high and missing proportion is high. MIRL is shown to have improved performance when comparing with other applicable methods when applied to the study of Eating and Activity in Teens for the boys and girls separately, and to a subgroup of low social economic status (ses) Asian boys who are at high risk of developing obesity.
authors.affiliation: Department of Biostatistics, Columbia University, 722 West 168th Street, New York, New York 10032, USA, yl2802@columbia.edu.
authors.forename: Ying
authors.initials: Y
authors.lastname: Liu
authors.affiliation: Department of Biostatistics, Columbia University, 722 West 168th Street, New York, New York, 10032, USA, yw2016@columbia.edu.
authors.forename: Yuanjia
authors.initials: Y
authors.lastname: Wang
authors.affiliation: Department of Statistics, Columbia University, 1255 Amsterdam Ave., 10th Floor, MC 4690, New York, New York 10027, USA, yangfeng@stat.columbia.edu.
authors.forename: Yang
authors.initials: Y
authors.lastname: Feng
authors.affiliation: Department of Biostatistics, Columbia University, 722 West 168th Street, New York, New York 10032, USA, mmw2177@columbia.edu.
authors.forename: Melanie M
authors.initials: MM
authors.lastname: Wall
keywords: Missing data; multiple imputation; random lasso; stability selection; variable ranking; variable selection