title: Model-Averaged [Formula: see text] Regularization using Markov Chain Monte Carlo Model Composition.
abstract: Bayesian Model Averaging (BMA) is an effective technique for addressing model uncertainty in variable selection problems. However, current BMA approaches have computational difficulty dealing with data in which there are many more measurements (variables) than samples. This paper presents a method for combining [Formula: see text] regularization and Markov chain Monte Carlo model composition techniques for BMA. By treating the [Formula: see text] regularization path as a model space, we propose a method to resolve the model uncertainty issues arising in model averaging from solution path point selection. We show that this method is computationally and empirically effective for regression and classification in high-dimensional datasets. We apply our technique in simulations, as well as to some applications that arise in genomics.
authors: Insilicos and University of Washington, Seattle, WA / cfraley@insilicos.com.
authors: Chris
authors: C
authors: Fraley
authors: Department of Statistics, Carnegie Mellon University / dancsi@gmail.com.
authors: Daniel
authors: D
authors: Percival
keywords: MCMCMC; Markov chains; high-dimensional; lasso; model averaging; model composition; variable selection; ℓ1 regularization
references: J Stat Softw. 2010;33(1):1-22
references: 20808728
references: Proc Natl Acad Sci U S A. 2010 Apr 6;107(14):6286-91
references: 20308593
references: BMC Syst Biol. 2012 Aug 16;6:101
references: 22898396
references: Ann Appl Stat. 2011 Jan 1;5(1):232-253
references: 22081779
references: PLoS One. 2010 Feb 23;5(2):e9202
references: 20186320
references: Proc Natl Acad Sci U S A. 2011 Nov 29;108(48):19436-41
references: 22084118
references: Stat Sci. 2011 Feb 1;26(1):130-149
references: 24089585
references: Bioinformatics. 2005 May 15;21(10):2394-402
references: 15713736
references: J Comput Biol. 2009 Feb;16(2):229-39
references: 19183003