Robust maximum likelihood training of heteroscedastic probabilistic neural networks.
We consider the probabilistic neural network (PNN) that is a mixture of Gaussian basis functions having different variances. Such a Gaussian heteroscedastic PNN is more economic, in terms of the number of kernel functions required, than the Gaussian mixture PNN of a common variance. The expectation-maximisation (EM) algorithm, although a powerful technique for constructing maximum likelihood (ML) homoscedastic PNNs, often encounters numerical difficulties when training heteroscedastic PNNs. We combine a robust statistical technique known as the Jack-knife with the EM algorithm to provide a robust ML training algorithm. An artificial-data case, the two-dimensional XOR problem, and a real-data case, success or failure prediction of UK private construction companies, are used to evaluate the performance of this robust learning algorithm.
Yang
Zheng Rong
ZR
Department of Electronics and Computer Science, University of Southampton, Southampton, UK
Chen
Sheng
S