Bayesian model averaging of naive Bayes for clustering.
This paper considers a Bayesian model-averaging (MA) approach to learn an unsupervised naive Bayes classification model. By using the expectation model-averaging (EMA) algorithm, which is proposed in this paper, a unique naive Bayes model that approximates an MA over selective naive Bayes structures is obtained. This algorithm allows to obtain the parameters for the approximate MA clustering model in the same time complexity needed to learn the maximum-likelihood model with the expectation-maximization algorithm. On the other hand, the proposed method can also be regarded as an approach to an unsupervised feature subset selection due to the fact that the model obtained by the EMA algorithm incorporates information on how dependent every predictive variable is on the cluster variable.
Santafé
Guzmán
G
Intelligent Systems Group, Computer Science and Artificial Intelligent Department, University of the Basque Country, 20018 San Sebastián, Spain. guzman@si.ehu.es
Lozano
Jose A
JA
Larrañaga
Pedro
P
D000465:Algorithms; D001185:Artificial Intelligence; D001499:Bayes Theorem; D016000:Cluster Analysis; D003198:Computer Simulation; D016013:Likelihood Functions; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*