title: AK-fold Averaging Cross-validation Procedure.
abstract: Cross-validation type of methods have been widely used to facilitate model estimation and variable selection. In this work, we suggest a newK-fold cross validation procedure to select a candidate 'optimal' model from each hold-out fold and average theKcandidate 'optimal' models to obtain the ultimate model. Due to the averaging effect, the variance of the proposed estimates can be significantly reduced. This new procedure results in more stable and efficient parameter estimation than the classicalK-fold cross validation procedure. In addition, we show the asymptotic equivalence between the proposed and classical cross validation procedures in the linear regression setting. We also demonstrate the broad applicability of the proposed procedure via two examples of parameter sparsity regularization and quantile smoothing splines modeling. We illustrate the promise of the proposed method through simulations and a real data example.
authors.affiliation: Department of Statistics, University of Waikato, Hamilton, New Zealand.
authors.forename: Yoonsuh
authors.initials: Y
authors.lastname: Jung
authors.affiliation: Department of Biostatistics, MD Anderson Cancer Center, Houston, TX, USA.
authors.forename: Jianhua
authors.initials: J
authors.lastname: Hu
keywords: Cross-validation; Model Averaging; Model Selection