Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix.
The striatum is the major input nucleus of the basal ganglia. It is thought to play a key role in learning on the basis of positive reinforcement and in action selection. One view of the striatum conceives it as comprising a reiterated matrix of processing units that perform common operations in different striatal regions, namely synaptic plasticity according to a three-factor rule, and lateral inhibition. These operations are required for reinforcement learning and selection of previously reinforced actions. Analysis of the behavioral effects of circumscribed lesions of the striatum, however, suggests regional specialization of learning and decision-making operations. We consider how a basic processing unit may be modified by regional variations in neurochemical parameters, for example, by the gradient in density of dopamine terminals from dorsal to ventral striatum. These variations suggest subtle differences between dorsolateral and ventromedial striatal regions in the temporal properties of dopamine signaling, which are superimposed on regional differences in connectivity. We propose that these variations make sense in relation to the temporal structure of activity in striatal inputs from different regions, and the requirements of different learning operations. Dorsolateral striatal (DLS) regions may be subject to brief, precisely timed pulses of dopamine, whereas ventromedial striatal regions integrate dopamine signals over a longer time course. These differences may be important for understanding regional variations in the contribution to reinforcement of habits, versus incentive processes that are sensitive to the value of expected rewards.
Wickens
Jeffery R
JR
Neurobiology Research Unit, Okinawa Institute of Science and Technology, 12-22 Suzaki, Uruma City, Okinawa, Japan. wickens@oist.jp
Budd
Christopher S
CS
Hyland
Brian I
BI
Arbuthnott
Gordon W
GW
D000818:Animals; D001479:Basal Ganglia / Q000033:anatomy & histology* / Q000502:physiology; D001519:Behavior; D003342:Corpus Striatum / Q000033:anatomy & histology* / Q000502:physiology; D003657:Decision Making; D004298:Dopamine / Q000378:metabolism; D006801:Humans; D007858:Learning; D008953:Models, Anatomic; D008959:Models, Neurological; D009434:Neural Pathways; D009714:Nucleus Accumbens / Q000033:anatomy & histology* / Q000502:physiology; D012054:Reinforcement, Psychology; D012201:Reward; D013997:Time Factors
D004298:Dopamine