title: A Single Hidden Layer Feedforward Network with Only One Neuron in the Hidden Layer Can Approximate Any Univariate Function.
abstract: The possibility of approximating a continuous function on a compact subset of the real line by a feedforward single hidden layer neural network with a sigmoidal activation function has been studied in many papers. Such networks can approximate an arbitrary continuous function provided that an unlimited number of neurons in a hidden layer is permitted. In this note, we consider constructive approximation on any finite interval of [Formula: see text] by neural networks with only one neuron in the hidden layer. We construct algorithmically a smooth, sigmoidal, almost monotone activation function [Formula: see text] providing approximation to an arbitrary continuous function within any degree of accuracy. This algorithm is implemented in a computer program, which computes the value of [Formula: see text] at any reasonable point of the real axis.
authors.affiliation: njguliyev@gmail.com.
authors.forename: Namig J
authors.initials: NJ
authors.lastname: Guliyev
authors.affiliation: Institute of Mathematics and Mechanics, Azerbaijan National Academy of Sciences, Baku AZ1141, Azerbaijan vugaris@mail.ru.
authors.forename: Vugar E
authors.initials: VE
authors.lastname: Ismailov