BELM: Bayesian extreme learning machine.
The theory of extreme learning machine (ELM) has become very popular on the last few years. ELM is a new approach for learning the parameters of the hidden layers of a multilayer neural network (as the multilayer perceptron or the radial basis function neural network). Its main advantage is the lower computational cost, which is especially relevant when dealing with many patterns defined in a high-dimensional space. This brief proposes a bayesian approach to ELM, which presents some advantages over other approaches: it allows the introduction of a priori knowledge; obtains the confidence intervals (CIs) without the need of applying methods that are computationally intensive, e.g., bootstrap; and presents high generalization capabilities. Bayesian ELM is benchmarked against classical ELM in several artificial and real datasets that are widely used for the evaluation of machine learning algorithms. Achieved results show that the proposed approach produces a competitive accuracy with some additional advantages, namely, automatic production of CIs, reduction of probability of model overfitting, and use of a priori knowledge.
Digital Signal Processing Group, Department of Electronic Engineering, ETSE, University of Valencia, Burjassot 46100, Spain. emilio.soria@uv.es
Emilio
E
Soria-Olivas
Juan
J
Gómez-Sanchis
José D
JD
Martín
Joan
J
Vila-Francés
Marcelino
M
Martínez
José R
JR
Magdalena
Antonio J
AJ
Serrano
D000465:Algorithms; D001185:Artificial Intelligence; D001499:Bayes Theorem; D003198:Computer Simulation; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated / Q000379:methods