The correspondence between deterministic and stochastic digital neurons: analysis and methodology.
This paper analyzes the criteria for the direct correspondence between a deterministic neural network and its stochastic counterpart, and presents the guidelines that have been derived to establish such a correspondence during the design of a neural network application. In particular, the role of the slope and bias of the neuron activation function and that of the noise of its output have been addressed, thus filling a specific literature gap. This paper presents the results that have been theoretically derived in this regard, together with the simulations of few relevant application examples that have been performed to support them.
Dipartimento di Ingegneria Elettrica, Gestionale e Meccanica (DIEGM), University of Udine, Udine, Italy. luca.geretti@uniud.it
Luca
L
Geretti
Antonio
A
Abramo
D000465:Algorithms; D003198:Computer Simulation; D005246:Feedback; D015233:Models, Statistical; D016571:Neural Networks, Computer; D009716:Numerical Analysis, Computer-Assisted; D012815:Signal Processing, Computer-Assisted; D013269:Stochastic Processes