title: Dissociable roles of ventral and dorsal striatum in instrumental conditioning.
abstract: Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.
authors.affiliation: Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK. j.odoherty@fil.ion.ucl.ac.uk
authors.forename: John
authors.initials: J
authors.lastname: O'Doherty
authors.forename: Peter
authors.initials: P
authors.lastname: Dayan
authors.forename: Johannes
authors.initials: J
authors.lastname: Schultz
authors.forename: Ralf
authors.initials: R
authors.lastname: Deichmann
authors.forename: Karl
authors.initials: K
authors.lastname: Friston
authors.forename: Raymond J
authors.initials: RJ
authors.lastname: Dolan
mesh_terms: D000328:Adult; D001479:Basal Ganglia / Q000502:physiology*; D002421:Caudate Nucleus / Q000502:physiology*; D003214:Conditioning, Classical; D003216:Conditioning, Operant; D005260:Female; D006801:Humans; D007858:Learning; D008279:Magnetic Resonance Imaging; D008297:Male; D008875:Middle Aged; D009714:Nucleus Accumbens / Q000502:physiology*; D011336:Probability; D011699:Putamen / Q000502:physiology*; D012054:Reinforcement, Psychology; D012201:Reward