title: Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning.
abstract: For decades, neurophysiologists have worked on elucidating the function of the cortical sensorimotor control system from the standpoint of kinematics or dynamics. Recently, computational neuroscientists have developed models that can emulate changes seen in the primary motor cortex during learning. However, these simulations rely on the existence of a reward-like signal in the primary sensorimotor cortex. Reward modulation of the primary sensorimotor cortex has yet to be characterized at the level of neural units. Here we demonstrate that single units/multiunits and local field potentials in the primary motor (M1) cortex of nonhuman primates (Macaca radiata) are modulated by reward expectation during reaching movements and that this modulation is present even while subjects passively view cursor motions that are predictive of either reward or nonreward. After establishing this reward modulation, we set out to determine whether we could correctly classify rewarding versus nonrewarding trials, on a moment-to-moment basis. This reward information could then be used in collaboration with reinforcement learning principles toward an autonomous brain-machine interface. The autonomous brain-machine interface would use M1 for both decoding movement intention and extraction of reward expectation information as evaluative feedback, which would then update the decoding algorithm as necessary. In the work presented here, we show that this, in theory, is possible.
authors.affiliation: Joint Program in Biomedical Engineering, New York University-Polytechnic School of Engineering and State University of New York, Downstate Medical Center.
authors.forename: Brandi T
authors.identifier: http://orcid.org/0000-0002-9105-6207
authors.initials: BT
authors.lastname: Marsh
authors.affiliation: Joint Program in Biomedical Engineering, New York University-Polytechnic School of Engineering and State University of New York, Downstate Medical Center.
authors.forename: Venkata S Aditya
authors.initials: VS
authors.lastname: Tarigoppula
authors.affiliation: Department of Physiology and Pharmacology.
authors.forename: Chen
authors.initials: C
authors.lastname: Chen
authors.affiliation: Joint Program in Biomedical Engineering, New York University-Polytechnic School of Engineering and State University of New York, Downstate Medical Center, Department of Physiology and Pharmacology, Program in Neural and Behavioral Science, and Robert F. Furchgott Center for Neural & Behavioral Science, State University of New York, Downstate Medical Center, Brooklyn, New York 11203 joey199us@gmail.com.
authors.forename: Joseph T
authors.initials: JT
authors.lastname: Francis
mesh_terms: D000200:Action Potentials / Q000502:physiology; D000818:Animals; D001921:Brain / Q000166:cytology / Q000502:physiology*; D062207:Brain-Computer Interfaces; D003198:Computer Simulation; D004576:Electromyography; D005071:Evoked Potentials / Q000502:physiology; D005260:Female; D016014:Linear Models; D008255:Macaca radiata; D008297:Male; D008959:Models, Neurological; D009474:Neurons / Q000502:physiology; D012054:Reinforcement, Psychology; D012201:Reward
keywords: BMI; mirror neurons; motor cortex; reward