Pairwise variable selection for high-dimensional model-based clustering.
Variable selection for clustering is an important and challenging problem in high-dimensional data analysis. Existing variable selection methods for model-based clustering select informative variables in a "one-in-all-out" manner; that is, a variable is selected if at least one pair of clusters is separable by this variable and removed if it cannot separate any of the clusters. In many applications, however, it is of interest to further establish exactly which clusters are separable by each informative variable. To address this question, we propose a pairwise variable selection method for high-dimensional model-based clustering. The method is based on a new pairwise penalty. Results on simulated and real data show that the new method performs better than alternative approaches that use ℓ(1) and ℓ(∞) penalties and offers better interpretation.
Guo
Jian
J
Department of Statistics, University of Michigan, Ann Arbor, Michigan 48109, USA.
Levina
Elizaveta
E
Michailidis
George
G
Zhu
Ji
J
D016000:Cluster Analysis; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D015233:Models, Statistical