A regularization term to avoid the saturation of the sigmoids in multilayer neural networks.
In this paper we propose a new method to prevent the saturation of any set of hidden units of a multilayer neural network. This method is implemented by adding a regularization term to the standard quadratic error function, which is based on a repulsive action between pairs of patterns.
Garrido
L
L
Departament d'Estructura i Constituents de la Matèria, Facultat de Física, Universitat de Barcelona, Spain.
Gómez
S
S
Gaitán
V
V
Serra-Ricart
M
M
D000465:Algorithms; D007091:Image Processing, Computer-Assisted / Q000379:methods; D015233:Models, Statistical; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics