title: Learning and approximation capabilities of adaptive spline activation function neural networks.
abstract: In this paper, we study the theoretical properties of a new kind of artificial neural network, which is able to adapt its activation functions by varying the control points of a Catmull-Rom cubic spline. Most of all, we are interested in generalization capability, and we can show that our architecture presents several advantages. First of all, it can be seen as a sub-optimal realization of the additive spline based model obtained by the reguralization theory. Besides, simulations confirm that the special learning mechanism allows to use in a very effective way the network's free parameters, keeping their total number at lower values than in networks with sigmoidal activation functions. Other notable properties are a shorter training time and a reduced hardware complexity, due to the surplus in the number of neurons.
authors.forename: L
authors.initials: L
authors.lastname: Vecci
authors.forename: F
authors.initials: F
authors.lastname: Piazza
authors.forename: A
authors.initials: A
authors.lastname: Uncini