title: The cluster graphical lasso for improved estimation of Gaussian graphical models.
abstract: The task of estimating a Gaussian graphical model in the high-dimensional setting is considered. The graphical lasso, which involves maximizing the Gaussian log likelihood subject to alassopenalty, is a well-studied approach for this task. A surprising connection between the graphical lasso and hierarchical clustering is introduced: the graphical lasso in effect performs a two-step procedure, in which (1) single linkage hierarchical clustering is performed on the variables in order to identify connected components, and then (2) a penalized log likelihood is maximized on the subset of variables within each connected component. Thus, the graphical lasso determines the connected components of the estimated network via single linkage clustering. The single linkage clustering is known to perform poorly in certain finite-sample settings. Therefore, thecluster graphical lasso, which involves clustering the features using an alternative to single linkage clustering, and then performing the graphical lasso on the subset of variables within each cluster, is proposed. Model selection consistency for this technique is established, and its improved performance relative to the graphical lasso is demonstrated in a simulation study, as well as in applications to a university webpage and a gene expression data sets.
authors: Department of Biostatistics, University of Washington, Seattle, WA 98195-7232, USA.
authors: Kean Ming
authors: KM
authors: Tan
authors: Department of Biostatistics, University of Washington, Seattle, WA 98195-7232, USA.
authors: Daniela
authors: D
authors: Witten
authors: Department of Biostatistics, University of Washington, Seattle, WA 98195-7232, USA.
authors: Ali
authors: A
authors: Shojaie
keywords: hierarchical clustering; high-dimensional setting; network; single linkage clustering; sparsity
references: Biostatistics. 2008 Jul;9(3):432-41
references: 18079126
references: Ann Stat. 2009;37(6B):4254-4278
references: 21132082
references: Genome Res. 2007 Nov;17(11):1614-25
references: 17921353
references: Ann Appl Stat. 2009 Jun 1;3(2):521-541
references: 21643444
references: Genome Biol. 2004;5(11):R92
references: 15535868
references: J Am Stat Assoc. 2009 Jun 1;104(486):735-746
references: 19881892
references: Biostatistics. 2009 Jul;10(3):515-34
references: 19377034
references: Plant Physiol. 2002 Nov;130(3):1079-89
references: 12427975
references: J Mach Learn Res. 2012 Apr;13:1059-1062
references: 26834510
references: Biometrika. 2011 Mar;98(1):1-15
references: 23049124
references: J Mach Learn Res. 2012 Mar 1;13:781-794
references: 25392704