"Live" neuron and optimal learning rule.
A concept of the live unit as an automatic regulation system with a few admissible states areas in the space of states is considered. Energetic profit of oscillatory behavior consisting in the consecutive transitions of system from one admissible states area to another is shown. It is stated, that external disturbances cause the energy consumption of oscillatory system to decrease. On the basis of this concept and some neurophysiological data, the "live" energy-consuming nonlinear three-state neuron model is proposed and the existence of energy optimal generation frequency v(opt) is proved. For the realization of tendency to v(opt) the optimal learning rule is proposed, which provides unsupervised learning and interlinked short-term and long-term memories with forgetting. The model proposed explains the genesis of neural network, is promising in the sense of network self-organization and allows to solve the problem of internal activity in the researches on artificial intelligence.
Emelyanov-Yaroslavsky
L B
LB
Machines and Tools Institute, Moscow, Russia.
Potapov
V I
VI
D001683:Biological Clocks; D007858:Learning; D008433:Mathematics; D016571:Neural Networks, Computer; D009474:Neurons