title: Robust maximum likelihood training of heteroscedastic probabilistic neural networks.
abstract: We consider the probabilistic neural network (PNN) that is a mixture of Gaussian basis functions having different variances. Such a Gaussian heteroscedastic PNN is more economic, in terms of the number of kernel functions required, than the Gaussian mixture PNN of a common variance. The expectation-maximisation (EM) algorithm, although a powerful technique for constructing maximum likelihood (ML) homoscedastic PNNs, often encounters numerical difficulties when training heteroscedastic PNNs. We combine a robust statistical technique known as the Jack-knife with the EM algorithm to provide a robust ML training algorithm. An artificial-data case, the two-dimensional XOR problem, and a real-data case, success or failure prediction of UK private construction companies, are used to evaluate the performance of this robust learning algorithm.
authors.affiliation: Department of Electronics and Computer Science, University of Southampton, Southampton, UK
authors.forename: Zheng Rong
authors.initials: ZR
authors.lastname: Yang
authors.forename: Sheng
authors.initials: S
authors.lastname: Chen