Action and outcome encoding in the primate caudate nucleus.
The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.
Lau
Brian
B
Center for Neural Science, New York University, New York, New York 10003, USA.
Glimcher
Paul W
PW
D000200:Action Potentials / Q000502:physiology*; D000818:Animals; D001522:Behavior, Animal / Q000502:physiology; D001931:Brain Mapping; D002421:Caudate Nucleus / Q000166:cytology*; D003463:Cues; D008253:Macaca mulatta; D008279:Magnetic Resonance Imaging / Q000379:methods; D008297:Male; D008568:Memory / Q000502:physiology; D009474:Neurons / Q000145:classification / Q000502:physiology*; D017711:Nonlinear Dynamics; D009949:Orientation / Q000502:physiology; D010775:Photic Stimulation / Q000379:methods; D011597:Psychomotor Performance / Q000502:physiology; D011930:Reaction Time / Q000502:physiology; D012201:Reward; D012438:Saccades / Q000502:physiology