Simultaneous approximations of polynomials and derivatives and their applications to neural networks.
We have constructed one-hidden-layer neural networks capable of approximating polynomials and their derivatives simultaneously. Generally, optimizing neural network parameters to be trained at later steps of the BP training is more difficult than optimizing those to be trained at the first step. Taking into account this fact, we suppressed the number of parameters of the former type. We measure degree of approximation in both the uniform norm on compact sets and the Lp-norm on the whole space with respect to probability measures.
Ito
Yoshifusa
Y
School of Medicine, Aichi Medical University, Aichi-ken, 480-1195 Japan. ito@aichi-med-u.ac.jp
D000465:Algorithms; D016571:Neural Networks, Computer; D011336:Probability