title: Penalized Composite Quasi-Likelihood for Ultrahigh-Dimensional Variable Selection.
abstract: In high-dimensional model selection problems, penalized least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a data-driven weighted linear combination of convex loss functions, together with weighted L(1)-penalty. It is completely data-adaptive and does not require prior knowledge of the error distribution. The weighted L(1)-penalty is used both to ensure the convexity of the penalty term and to ameliorate the bias caused by the L(1)-penalty. In the setting with dimensionality much larger than the sample size, we establish a strong oracle property of the proposed method that possesses both the model selection consistency and estimation efficiency for the true non-zero coefficients. As specific examples, we introduce a robust method of composite L1-L2, and optimal composite quantile method and evaluate their performance in both simulated and real data examples.
authors: Department of Operations Research and Financial Engineering, Princeton University, Princeton, USA.
authors: Jelena
authors: J
authors: Bradic
authors: Jianqing
authors: J
authors: Fan
authors: Weiwei
authors: W
authors: Wang
references: Ann Stat. 2008 Aug 1;36(4):1509-1533
references: 19823597
references: Ann Stat. 2009;37(4):1733-1751
references: 20445770
references: J R Stat Soc Series B Stat Methodol. 2008;70(5):903
references: 19603084
references: J Mach Learn Res. 2009;10:2013-2038
references: 21603590
references: IEEE Trans Inf Theory. 2011 Aug;57(8):5467-5484
references: 22287795