title: Simplex Factor Models for Multivariate Unordered Categorical Data.
abstract: Gaussian latent factor models are routinely used for modeling of dependence in continuous, binary, and ordered categorical data. For unordered categorical variables, Gaussian latent factor models lead to challenging computation and complex modeling structures. As an alternative, we propose a novel class of simplex factor models. In the single-factor case, the model treats the different categorical outcomes as independent with unknown marginals. The model can characterize flexible dependence structures parsimoniously with few factors, and as factors are added, any multivariate categorical data distribution can be accurately approximated. Using a Bayesian approach for computation and inferences, a Markov chain Monte Carlo (MCMC) algorithm is proposed that scales well with increasing dimension, with the number of factors treated as unknown. We develop an efficient proposal for updating the base probability vector in hierarchical Dirichlet models. Theoretical properties are described, and we evaluate the approach through simulation examples. Applications are described for modeling dependence in nucleotide sequences and prediction from high-dimensional categorical features.
authors.affiliation: Department of Statistical Science, Duke University, NC 27708.
authors.forename: Anirban
authors.initials: A
authors.lastname: Bhattacharya
authors.forename: David B
authors.initials: DB
authors.lastname: Dunson
keywords: Classification; Contingency table; Factor analysis; Latent variable; Mutual information; Nonnegative tensor factorization; Nonparametric Bayes; Polytomous regression
references.citation: J Multivar Anal. 2013 Apr 1;116:456-472
references.pmid: 25067858
references.citation: Biometrics. 1970 Sep;26(3):535-46
references.pmid: 5480663
references.citation: Ann Appl Stat. 2007;1(2):346-384
references.pmid: 21687832
references.citation: J Am Stat Assoc. 2008 Dec 1;103(484):1438-1456
references.pmid: 21218139
references.citation: Psychometrika. 1966 Sep;31(3):279-311
references.pmid: 5221127
references.citation: J Am Stat Assoc. 2009 Dec 1;104(488):1646-1660
references.pmid: 23580793
references.citation: Biometrika. 2009;96(2):249-262
references.pmid: 23710074
references.citation: Comput Stat Data Anal. 2008 Mar 15;52(7):3697-3708
references.pmid: 19396365
references.citation: Biometrika. 2008;95(2):307-323
references.pmid: 18800173
references.citation: Bayesian Anal. 2011 Mar 1;6(1):
references.pmid: 24358072
references.citation: Cell. 2006 Jan 13;124(1):207-19
references.pmid: 16413492
references.citation: Genetics. 2000 Jun;155(2):945-59
references.pmid: 10835412
references.citation: J Am Stat Assoc. 2012 Jan 1;104(487):1042-1051
references.pmid: 23606777
references.citation: J Mach Learn Res. 2008 Dec 1;9:2847-2880
references.pmid: 19759856