Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks.
Here we challenge the view that reward-guided learning is solely controlled by the mesoaccumbens pathway arising from dopaminergic neurons in the ventral tegmental area and projecting to the nucleus accumbens. This widely accepted view assumes that reward is a monolithic concept, but recent work has suggested otherwise. It now appears that, in reward-guided learning, the functions of ventral and dorsal striata, and the cortico-basal ganglia circuitry associated with them, can be dissociated. Whereas the nucleus accumbens is necessary for the acquisition and expression of certain appetitive Pavlovian responses and contributes to the motivational control of instrumental performance, the dorsal striatum is necessary for the acquisition and expression of instrumental actions. Such findings suggest the existence of multiple independent yet interacting functional systems that are implemented in iterating and hierarchically organized cortico-basal ganglia networks engaged in appetitive behaviors ranging from Pavlovian approach responses to goal-directed instrumental actions controlled by action-outcome contingencies.
Yin
Henry H
HH
Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University, Durham, NC 27708, USA. hy43@duke.edu
Ostlund
Sean B
SB
Balleine
Bernard W
BW
D000818:Animals; D002540:Cerebral Cortex / Q000033:anatomy & histology / Q000502:physiology*; D003213:Conditioning, Psychological / Q000502:physiology; D004298:Dopamine / Q000502:physiology*; D006801:Humans; D007858:Learning / Q000502:physiology*; D017072:Neostriatum / Q000033:anatomy & histology / Q000502:physiology*; D009434:Neural Pathways / Q000033:anatomy & histology / Q000502:physiology; D009714:Nucleus Accumbens / Q000033:anatomy & histology / Q000502:physiology*; D012201:Reward; D017557:Ventral Tegmental Area / Q000502:physiology; D014836:Volition / Q000502:physiology
D004298:Dopamine
J Neurosci. 2000 Oct 15;20(20):7737-42
11027236
Neuron. 2008 Feb 7;57(3):432-41
18255035
Behav Neurosci. 2000 Jun;114(3):468-83
10883798
Trends Neurosci. 2006 May;29(5):272-9
16545468
Neurobiol Learn Mem. 2006 May;85(3):283-8
16423542
Eur J Neurosci. 2007 Apr;25(8):2491-7
17445244
J Neurosci. 2003 Nov 12;23(32):10402-10
14614099
Neuron. 2000 Mar;25(3):515-32
10774721
Eur J Neurosci. 2005 Jul;22(2):513-23
16045504
Exp Brain Res. 2002 Sep;146(1):122-6
12192586
J Neurophysiol. 2006 Feb;95(2):948-59
16192338
Nat Neurosci. 1998 Sep;1(5):411-6
10196532
Eur J Neurosci. 2004 Jan;19(1):181-9
14750976
Annu Rev Neurosci. 1988;11:329-52
3284445
J Neurophysiol. 1989 Apr;61(4):814-32
2723722
Ann N Y Acad Sci. 2007 May;1104:192-212
17416920
Eur J Neurosci. 2005 Jul;22(2):505-12
16045503
Science. 1964 Nov 20;146(3647):1071-2
14202465
Neuron. 2005 Feb 17;45(4):587-97
15721244
J Neurosci. 2006 Jan 4;26(1):217-22
16399690
J Neurosci. 1999 Dec 1;19(23):10502-11
10575046
Nat Neurosci. 2005 Jun;8(6):805-12
15908948
J Neurophysiol. 1998 Jul;80(1):1-27
9658025
Science. 2004 Apr 16;304(5669):452-4
15087550
J Neurosci. 2000 Nov 1;20(21):8122-30
11050134
Physiol Behav. 2005 Dec 15;86(5):717-30
16257019
BMC Neurosci. 2005 Feb 03;6:9
15691387
J Exp Psychol Anim Behav Process. 1983 Jul;9(3):225-47
6153052
Psychol Rev. 1957 Jul;64(4):217-28
13453606
Annu Rev Neurosci. 2006;29:565-98
16776597
Learn Mem. 2004 Jul-Aug;11(4):459-63
15286184
Exp Brain Res. 1997 Jun;115(1):1-5
9224828
Science. 2005 Nov 25;310(5752):1337-40
16311337
Brain Res Brain Res Rev. 1998 Dec;28(3):309-69
9858756
J Neurophysiol. 1997 Mar;77(3):1313-24
9084599
Proc Natl Acad Sci U S A. 2005 Apr 26;102(17):6189-94
15833811
Nat Neurosci. 2004 Jun;7(6):583-4
15146188
Learn Mem. 2006 Mar-Apr;13(2):123-6
16547159
Neural Netw. 2002 Jun-Jul;15(4-6):507-21
12371508
Neuroscience. 2000;96(3):451-74
10717427
J Neurophysiol. 1998 Aug;80(2):947-63
9705481
Eur J Neurosci. 2003 Sep;18(5):1286-94
12956727
Adv Pharmacol. 1998;42:686-90
9327992
Behav Brain Res. 2002 Dec 2;137(1-2):149-63
12445721
Neuron. 2007 Apr 19;54(2):237-44
17442245
J Chem Neuroanat. 2003 Dec;26(4):317-30
14729134
Neurosci Biobehav Rev. 2006;30(2):148-72
16125239
Neuroimage. 2005 Feb 1;24(3):862-73
15652321
J Neurosci. 2001 May 1;21(9):3251-60
11312310
Q J Exp Psychol B. 1990 Feb;42(1):59-71
2326494
Nature. 2004 Oct 14;431(7010):760-7
15483596
J Exp Anal Behav. 1968 Jan;11(1):1-8
5636851
J Exp Anal Behav. 1980 Nov;34(3):297-304
16812191
Adv Neurol. 1993;60:62-70
8380529
Behav Brain Res. 2006 Jan 30;166(2):189-96
16153716
Trends Neurosci. 2007 May;30(5):220-7
17400299
Q J Exp Psychol B. 1996 Nov;49(4):289-306
8962537
J Comp Physiol Psychol. 1968 Aug;66(1):1-5
5672628
Proc Natl Acad Sci U S A. 2007 May 29;104(22):9493-8
17519340
Nat Neurosci. 2002 Dec;5(12):1327-31
12426572
J Exp Anal Behav. 1969 Jul;12(4):511-20
16811370
Nat Neurosci. 2007 Jan;10(1):15-7
17189947
Neural Netw. 2006 Oct;19(8):1242-54
16987637
Psychol Rev. 1967 May;74(3):151-82
5342881
Brain Res. 2000 Dec 15;886(1-2):113-164
11119693
J Neurosci. 2000 Mar 15;20(6):2369-82
10704511
Neuron. 2006 Sep 7;51(5):541-7
16950153
Learn Mem. 2005 May-Jun;12(3):285-95
15930507
Neuropharmacology. 1998 Apr-May;37(4-5):407-19
9704982
Neuroscientist. 2006 Dec;12(6):500-11
17079516
Nat Neurosci. 2007 Jan;10(1):126-31
17187065
Eur J Neurosci. 2005 Nov;22(10):2605-16
16307603
J Neurosci. 2005 Mar 16;25(11):2771-80
15772337
Annu Rev Neurosci. 2001;24:167-202
11283309
Psychopharmacology (Berl). 2007 Apr;191(3):507-20
17031711
J Neurosci. 2001 Dec 1;21(23):9471-7
11717381
J Neurosci. 2011 Aug 17;31(33):11786-94
21849539
Neuroscientist. 2007 Apr;13(2):148-59
17404375
Neurosci Biobehav Rev. 2002 May;26(3):321-52
12034134
J Neurophysiol. 2007 Feb;97(2):1621-32
17122317
J Neurophysiol. 1997 Mar;77(3):1325-37
9084600
J Neurosci. 2008 Apr 23;28(17):4398-405
18434518
Science. 2003 Mar 21;299(5614):1898-902
12649484
Neuron. 2004 Jan 22;41(2):281-92
14741108
J Neurosci. 2004 Feb 18;24(7):1660-5
14973239
Psychopharmacology (Berl). 2007 Apr;191(3):567-78
17093978
Nat Neurosci. 2005 Nov;8(11):1481-9
16251991
Eur J Neurosci. 2007 Dec;26(11):3141-9
18005062
Neuroscience. 1994 Nov;63(2):363-79
7891852
Behav Neurosci. 2000 Feb;114(1):42-63
10718261
Life Sci. 1989;45(21):1943-57
2689823
J Neurosci. 2005 Feb 2;25(5):1193-202
15689556
Curr Biol. 2004 Jul 13;14(13):1124-34
15242609
J Exp Anal Behav. 1971 Mar;15(2):237-41
16811508
Nature. 2001 Jul 5;412(6842):43-8
11452299
Behav Brain Res. 2003 Nov 30;146(1-2):145-57
14643467
Cereb Cortex. 2004 Sep;14(9):1022-30
15115748
Adv Neurol. 1993;60:107-12
8093572
Brain Res Rev. 2008 Aug;58(2):303-13
18433875
J Neurophysiol. 1992 Jan;67(1):145-63
1552316
Neuroscience. 1978;3(4-5):385-401
683502
J Neurosci. 2007 Dec 19;27(51):13977-81
18094235
Neuron. 2002 Oct 10;36(2):285-98
12383782
J Neurophysiol. 2006 Jan;95(1):301-10
16192329
Science. 1997 Mar 14;275(5306):1593-9
9054347
Nat Neurosci. 2006 Aug;9(8):1057-63
16862149
Nat Neurosci. 2007 Aug;10(8):1020-8
17603481
J Neurosci. 2002 Jul 1;22(13):5705-12
12097522
J Exp Psychol Anim Behav Process. 1975 Oct;1(4):355-63
1202141
Annu Rev Neurosci. 1986;9:357-81
3085570
Neurosci Biobehav Rev. 2000 Jan;24(1):85-105
10654664
Brain Res. 2005 Nov 9;1061(2):88-96
16226228
J Exp Psychol Anim Behav Process. 2004 Apr;30(2):104-17
15078120
Eur J Neurosci. 2006 Mar;23(5):1341-51
16553795
Eur J Neurosci. 2007 Feb;25(3):847-53
17328779
Prog Brain Res. 1990;85:95-116; discussion 116-8
2094917
Proc Natl Acad Sci U S A. 2004 Sep 7;101(36):13124-31
15331782
Behav Neurosci. 2002 Feb;116(1):174-7
11895179