Dissociable roles of ventral and dorsal striatum in instrumental conditioning.
Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.
O'Doherty
John
J
Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK. j.odoherty@fil.ion.ucl.ac.uk
Dayan
Peter
P
Schultz
Johannes
J
Deichmann
Ralf
R
Friston
Karl
K
Dolan
Raymond J
RJ
D000328:Adult; D001479:Basal Ganglia / Q000502:physiology*; D002421:Caudate Nucleus / Q000502:physiology*; D003214:Conditioning, Classical; D003216:Conditioning, Operant; D005260:Female; D006801:Humans; D007858:Learning; D008279:Magnetic Resonance Imaging; D008297:Male; D008875:Middle Aged; D009714:Nucleus Accumbens / Q000502:physiology*; D011336:Probability; D011699:Putamen / Q000502:physiology*; D012054:Reinforcement, Psychology; D012201:Reward