title: Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement.
abstract: Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1-3 min separated by 3-10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust.NEW & NOTEWORTHYClosed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering activity-dependent stimuli to an intracranial reinforcement site (nucleus accumbens). We conditioned increased firing rates with the monkeys seated in a training booth and also, for the first time, during free behavior in a cage using an autonomous head-fixed BCI.
authors.affiliation: Department of Physiology and Biophysics, University of Washington, Seattle, Washington.
authors.forename: Ryan W
authors.initials: RW
authors.lastname: Eaton
authors.affiliation: Department of Bioengineering, University of Washington, Seattle, Washington; and.|Center for Sensorimotor Neural Engineering, National Science Foundation, Engineering Research Centers, University of Washington, Seattle, Washington.
authors.forename: Tyler
authors.initials: T
authors.lastname: Libey
authors.affiliation: Department of Physiology and Biophysics, University of Washington, Seattle, Washington; fetz@uw.edu.|Department of Bioengineering, University of Washington, Seattle, Washington; and.|Center for Sensorimotor Neural Engineering, National Science Foundation, Engineering Research Centers, University of Washington, Seattle, Washington.
authors.forename: Eberhard E
authors.initials: EE
authors.lastname: Fetz
mesh_terms: D000200:Action Potentials; D000818:Animals; D003216:Conditioning, Operant / Q000502:physiology*; D004558:Electric Stimulation; D004576:Electromyography; D008254:Macaca nemestrina; D008297:Male; D009044:Motor Cortex / Q000502:physiology*; D009474:Neurons / Q000502:physiology*; D009714:Nucleus Accumbens / Q000502:physiology*; D012054:Reinforcement, Psychology; D012201:Reward; D034941:Upper Extremity / Q000502:physiology
keywords: free behavior; intracranial reinforcement; neural activity; operant conditioning; primate