Bayesian feature and model selection for Gaussian mixture models.
We present a Bayesian method for mixture model training that simultaneously treats the feature selection and the model selection problem. The method is based on the integration of a mixture model formulation that takes into account the saliency of the features and a Bayesian approach to mixture learning that can be used to estimate the number of mixture components. The proposed learning algorithm follows the variational framework and can simultaneously optimize over the number of components, the saliency of the features, and the parameters of the mixture model. Experimental results using high-dimensional artificial and real data illustrate the effectiveness of the method.
Constantinopoulos
Constantinos
C
Department of Computer Science, University of Ioannina, Ioannina GR 45110, Greece. ccostas@cs.uoi.gr
Titsias
Michalis K
MK
Likas
Aristidis
A
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods*; D015233:Models, Statistical; D016011:Normal Distribution; D010363:Pattern Recognition, Automated / Q000379:methods*