A reward-modulated hebbian learning rule can explain experimentally observed network reorganization in a brain control task.
It has recently been shown in a brain-computer interface experiment that motor cortical neurons change their tuning properties selectively to compensate for errors induced by displaced decoding parameters. In particular, it was shown that the three-dimensional tuning curves of neurons whose decoding parameters were reassigned changed more than those of neurons whose decoding parameters had not been reassigned. In this article, we propose a simple learning rule that can reproduce this effect. Our learning rule uses Hebbian weight updates driven by a global reward signal and neuronal noise. In contrast to most previously proposed learning rules, this approach does not require extrinsic information to separate noise from signal. The learning rule is able to optimize the performance of a model system within biologically realistic periods of time under high noise levels. Furthermore, when the model parameters are matched to data recorded during the brain-computer interface learning experiments described above, the model produces learning effects strikingly similar to those found in the experiments.
Legenstein
Robert
R
Institute for Theoretical Computer Science, Graz University of Technology, 8010 Graz, Austria. legi@igi.tugraz.at
Chase
Steven M
SM
Schwartz
Andrew B
AB
Maass
Wolfgang
W
D000200:Action Potentials / Q000502:physiology; D002540:Cerebral Cortex / Q000502:physiology; D003198:Computer Simulation; D007858:Learning / Q000502:physiology*; D008959:Models, Neurological; D009046:Motor Neurons / Q000502:physiology; D009415:Nerve Net / Q000502:physiology*; D016571:Neural Networks, Computer; D009473:Neuronal Plasticity / Q000502:physiology*; D012201:Reward; D013569:Synapses / Q000502:physiology; D009435:Synaptic Transmission