title: Learning ensembles of neural networks by means of a Bayesian artificial immune system.
abstract: In this paper, we apply an immune-inspired approach to design ensembles of heterogeneous neural networks for classification problems. Our proposal, called Bayesian artificial immune system, is an estimation of distribution algorithm that replaces the traditional mutation and cloning operators with a probabilistic model, more specifically a Bayesian network, representing the joint distribution of promising solutions. Among the additional attributes provided by the Bayesian framework inserted into an immune-inspired search algorithm are the automatic control of the population size along the search and the inherent ability to promote and preserve diversity among the candidate solutions. Both are attributes generally absent from alternative estimation of distribution algorithms, and both were shown to be useful attributes when implementing the generation and selection of components of the ensemble, thus leading to high-performance classifiers. Several aspects of the design are illustrated in practical applications, including a comparative analysis with other attempts to synthesize ensembles.
authors.affiliation: Department of Electrical and Computer Engineering, University of Campinas, Campinas, Säo Paulo 13083-970, Brazil. pablo@dca.fee.unicamp.br
authors.forename: Pablo A Dalbem
authors.initials: PA
authors.lastname: Castro
authors.forename: Fernando José
authors.initials: FJ
authors.lastname: Von Zuben
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001499:Bayes Theorem; D002965:Classification / Q000379:methods; D003198:Computer Simulation / Q000592:standards* / Q000706:statistics & numerical data; D006801:Humans; D055633:Immune System Phenomena / Q000502:physiology*; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated / Q000379:methods / Q000706:statistics & numerical data