title: Ultrahigh dimensional feature selection: beyond the linear model.
abstract: Variable selection in high-dimensional space characterizes many contemporary problems in scientific discovery and decision making. Many frequently-used techniques are based on independence screening; examples include correlation ranking (Fan and Lv, 2008) or feature selection using a two-sample t-test in high-dimensional classification (Tibshirani et al., 2003). Within the context of the linear model, Fan and Lv (2008) showed that this simple correlation ranking possesses a sure independence screening property under certain conditions and that its revision, called iteratively sure independent screening (ISIS), is needed when the features are marginally unrelated but jointly related to the response variable. In this paper, we extend ISIS, without explicit definition of residuals, to a general pseudo-likelihood framework, which includes generalized linear models as a special case. Even in the least-squares setting, the new method improves ISIS by allowing feature deletion in the iterative process. Our technique allows us to select important features in high-dimensional classification where the popularly used two-sample t-method fails. A new technique is introduced to reduce the false selection rate in the feature screening stage. Several simulated and two real data examples are presented to illustrate the methodology.
authors: Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08540 USA.
authors: Jianqing
authors: J
authors: Fan
authors: Richard
authors: R
authors: Samworth
authors: Yichao
authors: Y
authors: Wu
references: Ann Stat. 2008 Aug 1;36(4):1509-1533
references: 19823597
references: J R Stat Soc Series B Stat Methodol. 2008;70(5):903
references: 19603084
references: J Clin Oncol. 2006 Nov 1;24(31):5070-8
references: 17075126
references: Ann Stat. 2008;36(6):2605-2637
references: 19169416
references: Clin Cancer Res. 2006 Aug 1;12(15):4469-73
references: 16899590
references: Nat Med. 2001 Jun;7(6):673-9
references: 11385503
references: Proc Natl Acad Sci U S A. 2003 Mar 4;100(5):2197-202
references: 16576749