title: Reward functions of the basal ganglia.
abstract: Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior.
authors.affiliation: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, CB2 3DY, UK. ws234@cam.ac.uk.
authors.forename: Wolfram
authors.initials: W
authors.lastname: Schultz
mesh_terms: D000818:Animals; D001479:Basal Ganglia / Q000166:cytology / Q000502:physiology*; D004298:Dopamine / Q000494:pharmacology; D015259:Dopamine Agents / Q000494:pharmacology; D059290:Dopaminergic Neurons / Q000502:physiology; D006801:Humans; D009042:Motivation / Q000502:physiology*; D012201:Reward
chemical_list: D015259:Dopamine Agents; D004298:Dopamine
keywords: Dopamine; Pedunculopontine nucleus; Striatum
references.citation: Science. 1997 Mar 14;275(5306):1593-9
references.pmid: 9054347
references.citation: Nature. 1998 Jan 29;391(6666):481-4
references.pmid: 9461214
references.citation: Proc Natl Acad Sci U S A. 2010 Apr 27;107(17):7981-6
references.pmid: 20385799
references.citation: J Neurosci. 2002 Mar 1;22(5):1976-84
references.pmid: 11880528
references.citation: Nat Neurosci. 1999 Feb;2(2):176-85
references.pmid: 10195203
references.citation: J Neurosci. 1994 Jun;14(6):3969-84
references.pmid: 8207500
references.citation: Eur J Neurosci. 2011 Jan;33(2):308-21
references.pmid: 21198983
references.citation: Biol Psychiatry. 2010 Aug 1;68(3):306-9
references.pmid: 20452572
references.citation: J Neurophysiol. 1990 Mar;63(3):592-606
references.pmid: 2329363
references.citation: Brain Res. 1997 Jun 13;759(2):251-8
references.pmid: 9221945
references.citation: J Neurosci. 2006 Jun 21;26(25):6761-70
references.pmid: 16793883
references.citation: Neuroscience. 1984 Dec;13(4):1189-215
references.pmid: 6152036
references.citation: Behav Brain Res. 1999 Mar;99(2):169-79
references.pmid: 10512583
references.citation: Brain Res Rev. 2008 Aug;58(2):265-71
references.pmid: 18343506
references.citation: Annu Rev Neurosci. 2007;30:259-88
references.pmid: 17600522
references.citation: J Neurophysiol. 2001 Oct;86(4):1916-36
references.pmid: 11600651
references.citation: Exp Brain Res. 2005 May;162(4):520-5
references.pmid: 15754177
references.citation: J Neurosci. 1992 Dec;12(12):4595-610
references.pmid: 1464759
references.citation: J Neurosci. 2010 Nov 24;30(47):15747-59
references.pmid: 21106814
references.citation: Neuron. 2002 Jan 31;33(3):463-73
references.pmid: 11832232
references.citation: J Neurosci. 2005 May 11;25(19):4725-32
references.pmid: 15888648
references.citation: Proc Natl Acad Sci U S A. 1984 Aug;81(15):4998-5001
references.pmid: 6589643
references.citation: Brain Res. 1983 Jan 10;258(2):217-28
references.pmid: 6824912
references.citation: Nat Neurosci. 2008 Aug;11(8):966-73
references.pmid: 18660807
references.citation: J Neurosci. 2013 Mar 13;33(11):4693-709
references.pmid: 23486943
references.citation: Neuron. 2009 Jul 30;63(2):244-53
references.pmid: 19640482
references.citation: J Neurophysiol. 1998 Jul;80(1):1-27
references.pmid: 9658025
references.citation: Neuroscience. 1999;92(1):245-54
references.pmid: 10392847
references.citation: Neuron. 2008 Aug 28;59(4):648-61
references.pmid: 18760700
references.citation: Nat Neurosci. 2012 Sep;15(9):1281-9
references.pmid: 22902719
references.citation: J Neurophysiol. 1998 Aug;80(2):947-63
references.pmid: 9705481
references.citation: Psychol Rev. 1981 Mar;88(2):135-70
references.pmid: 7291377
references.citation: Nat Neurosci. 2006 Apr;9(4):562-8
references.pmid: 16501567
references.citation: Neuron. 2010 Nov 18;68(4):789-800
references.pmid: 21092866
references.citation: Curr Biol. 2014 Nov 3;24(21):2491-500
references.pmid: 25283778
references.citation: Trends Neurosci. 1999 Apr;22(4):146-51
references.pmid: 10203849
references.citation: Neuroscience. 1991;41(1):1-24
references.pmid: 1676137
references.citation: Ann N Y Acad Sci. 2007 May;1104:310-23
references.pmid: 17344541
references.citation: Nature. 1997 May 15;387(6630):281-4
references.pmid: 9153392
references.citation: Proc Natl Acad Sci U S A. 2009 Mar 24;106(12):4894-9
references.pmid: 19261850
references.citation: Annu Rev Neurosci. 2009;32:267-87
references.pmid: 19555290
references.citation: Nat Neurosci. 1998 Sep;1(5):411-6
references.pmid: 10196532
references.citation: J Neurosci. 2012 Nov 21;32(47):16917-32
references.pmid: 23175843
references.citation: J Neurosci. 2009 Apr 15;29(15):4858-70
references.pmid: 19369554
references.citation: PLoS One. 2012;7(4):e33612
references.pmid: 22506004
references.citation: Curr Biol. 2014 Jan 6;24(1):56-62
references.pmid: 24332545
references.citation: Nat Neurosci. 2006 Aug;9(8):1057-63
references.pmid: 16862149
references.citation: J Neurophysiol. 1998 Aug;80(2):964-77
references.pmid: 9705482
references.citation: Brain Res. 1991 Dec 20;567(2):337-41
references.pmid: 1817739
references.citation: J Neurosci. 2011 Dec 7;31(49):17772-87
references.pmid: 22159094
references.citation: Exp Brain Res. 1998 Aug;121(4):401-10
references.pmid: 9746146
references.citation: J Neurosci. 2014 Jan 22;34(4):1380-96
references.pmid: 24453328
references.citation: Nat Neurosci. 2016 Jan;19(1):117-26
references.pmid: 26595651
references.citation: J Neurophysiol. 1986 Nov;56(5):1439-61
references.pmid: 3794777
references.citation: Neuroscience. 1992 Jun;48(4):871-6
references.pmid: 1378576
references.citation: Proc Natl Acad Sci U S A. 2011 Sep 13;108(37):15462-7
references.pmid: 21896766
references.citation: Nature. 2012 Jan 18;482(7383):85-8
references.pmid: 22258508
references.citation: Nature. 2001 Jul 5;412(6842):43-8
references.pmid: 11452299
references.citation: Brain Res. 1980 Mar 3;185(1):1-15
references.pmid: 7353169
references.citation: J Neurophysiol. 1996 Mar;75(3):1061-73
references.pmid: 8867118
references.citation: Exp Brain Res. 1992;89(1):79-86
references.pmid: 1351000
references.citation: Neuron. 2004 Jul 8;43(1):133-43
references.pmid: 15233923
references.citation: Neurosci Res. 1995 Feb;21(4):331-42
references.pmid: 7777224
references.citation: Nat Neurosci. 2013 Jul;16(7):966-73
references.pmid: 23708143
references.citation: J Neurophysiol. 1996 Dec;76(6):4040-55
references.pmid: 8985899
references.citation: J Neurophysiol. 1992 Sep;68(3):945-60
references.pmid: 1432059
references.citation: Eur J Neurosci. 2004 Jan;19(1):181-9
references.pmid: 14750976
references.citation: J Neurosci. 2008 Jul 30;28(31):7837-46
references.pmid: 18667616
references.citation: J Neurophysiol. 1989 Apr;61(4):814-32
references.pmid: 2723722
references.citation: J Neurophysiol. 2005 Jan;93(1):337-51
references.pmid: 15317836
references.citation: Brain Res. 1975 Sep 5;94(3):507-22
references.pmid: 1171714
references.citation: Proc Natl Acad Sci U S A. 2013 Oct 8;110(41):16634-9
references.pmid: 24062436
references.citation: Nature. 2006 Feb 16;439(7078):865-70
references.pmid: 16482160
references.citation: J Neurosci. 2007 Jan 31;27(5):1176-83
references.pmid: 17267573
references.citation: J Neurophysiol. 1990 Mar;63(3):607-24
references.pmid: 2329364
references.citation: J Neurosci. 1996 Mar 1;16(5):1936-47
references.pmid: 8774460
references.citation: Science. 2003 Mar 21;299(5614):1898-902
references.pmid: 12649484
references.citation: Nature. 1996 Feb 1;379(6564):449-51
references.pmid: 8559249
references.citation: J Neurosci. 2005 Jun 29;25(26):6235-42
references.pmid: 15987953
references.citation: J Neurosci. 1987 Dec;7(12):3888-96
references.pmid: 3121802
references.citation: J Neurophysiol. 2010 Aug;104(2):1068-76
references.pmid: 20538770
references.citation: Physiol Rev. 2015 Jul;95(3):853-951
references.pmid: 26109341
references.citation: J Neurosci. 2012 Jul 25;32(30):10296-305
references.pmid: 22836263
references.citation: J Neurosci. 2010 Aug 11;30(32):10692-702
references.pmid: 20702700
references.citation: J Neurosci. 2013 Mar 13;33(11):4710-25
references.pmid: 23486944
references.citation: Nat Neurosci. 2013 Feb;16(2):243-50
references.pmid: 23263442
references.citation: J Neurosci. 1998 Apr 1;18(7):2613-25
references.pmid: 9502820
references.citation: Proc Natl Acad Sci U S A. 2014 Apr 29;111(17):6467-72
references.pmid: 24711379
references.citation: Nat Neurosci. 2013 Mar;16(3):340-8
references.pmid: 23377126
references.citation: Neuron. 2008 May 8;58(3):451-63
references.pmid: 18466754
references.citation: Proc Natl Acad Sci U S A. 2011 Dec 6;108(49):19767-71
references.pmid: 22106310
references.citation: Proc Natl Acad Sci U S A. 1989 Nov;86(22):9015-9
references.pmid: 2573073
references.citation: Brain Res. 1984 Jun 25;304(2):351-61
references.pmid: 6744046
references.citation: Science. 2005 Nov 25;310(5752):1337-40
references.pmid: 16311337
references.citation: Neuron. 2004 Jan 22;41(2):269-80
references.pmid: 14741107
references.citation: Science. 2013 Aug 2;341(6145):546-9
references.pmid: 23908236
references.citation: Psychol Rev. 1980 Nov;87(6):532-52
references.pmid: 7443916
references.citation: J Neurosci. 2009 Oct 21;29(42):13365-76
references.pmid: 19846724
references.citation: Nature. 2005 Feb 24;433(7028):873-6
references.pmid: 15729344
references.citation: Eur J Neurosci. 2003 Sep;18(5):1306-14
references.pmid: 12956729
references.citation: J Neurosci. 2002 Nov 1;22(21):9475-89
references.pmid: 12417672
references.citation: J Neurosci. 2009 Nov 25;29(47):14701-12
references.pmid: 19940165
references.citation: J Neurosci. 2003 Oct 29;23(30):9913-23
references.pmid: 14586021
references.citation: J Neurophysiol. 2001 Jun;85(6):2477-89
references.pmid: 11387394
references.citation: J Neurophysiol. 2009 Oct;102(4):2526-37
references.pmid: 19710371
references.citation: Exp Brain Res. 1991;85(3):491-500
references.pmid: 1915708
references.citation: Eur J Neurosci. 2005 Jul;22(2):513-23
references.pmid: 16045504
references.citation: Neuron. 2012 Nov 21;76(4):826-37
references.pmid: 23177966
references.citation: Exp Brain Res. 1999 Oct;128(4):531-4
references.pmid: 10541747
references.citation: Front Syst Neurosci. 2013 Sep 03;7:47
references.pmid: 24027501
references.citation: J Neurophysiol. 1994 Aug;72(2):1024-7
references.pmid: 7983508
references.citation: Neuroscience. 2014 Dec 12;282:139-55
references.pmid: 25058502
references.citation: Exp Brain Res. 1986;62(3):470-8
references.pmid: 2873047
references.citation: Neuron. 2013 Sep 4;79(5):1011-24
references.pmid: 23932490
references.citation: Science. 2009 May 22;324(5930):1080-4
references.pmid: 19389999
references.citation: J Neurophysiol. 2001 Feb;85(2):998-1004
references.pmid: 11160530
references.citation: J Neurosci. 2011 Jul 27;31(30):10829-35
references.pmid: 21795535
references.citation: J Neurophysiol. 1992 Jan;67(1):145-63
references.pmid: 1552316
references.citation: J Neurosci. 2010 Aug 25;30(34):11447-57
references.pmid: 20739566
references.citation: Science. 2005 Mar 11;307(5715):1642-5
references.pmid: 15761155
references.citation: Nature. 2013 Aug 29;500(7464):575-9
references.pmid: 23913271
references.citation: Eur J Neurosci. 2009 Aug;30(3):515-26
references.pmid: 19656171
references.citation: J Neurosci. 1993 Mar;13(3):900-13
references.pmid: 8441015
references.citation: Science. 1999 Nov 26;286(5445):1745-9
references.pmid: 10576743
references.citation: Neuron. 2012 Jun 7;74(5):858-73
references.pmid: 22681690
references.citation: J Neurosci Methods. 2004 Sep 30;138(1-2):57-63
references.pmid: 15325112
references.citation: J Neurosci. 2011 Jan 26;31(4):1507-15
references.pmid: 21273435
references.citation: Proc Natl Acad Sci U S A. 2013 May 28;110(22):9136-41
references.pmid: 23676276
references.citation: J Neurophysiol. 2003 May;89(5):2823-38
references.pmid: 12611937
references.citation: J Neurosci. 2009 Aug 5;29(31):9861-74
references.pmid: 19657038
references.citation: J Neurosci. 2003 Nov 12;23(32):10402-10
references.pmid: 14614099
references.citation: J Neurophysiol. 2004 Oct;92(4):2520-9
references.pmid: 15163669
references.citation: Neuron. 2005 Jul 7;47(1):129-41
references.pmid: 15996553
references.citation: Proc Natl Acad Sci U S A. 2014 Feb 11;111(6):2343-8
references.pmid: 24453218
references.citation: Nat Neurosci. 2007 Aug;10(8):1020-8
references.pmid: 17603481
references.citation: Biol Psychiatry. 2012 Feb 1;71(3):199-205
references.pmid: 22055017
references.citation: Neuron. 2012 Jun 7;74(5):947-60
references.pmid: 22681697
references.citation: J Neurosci. 1983 Aug;3(8):1599-606
references.pmid: 6875659
references.citation: Trends Neurosci. 2007 May;30(5):220-7
references.pmid: 17400299
references.citation: J Neurosci. 2008 Nov 5;28(45):11673-84
references.pmid: 18987203
references.citation: J Neurophysiol. 2002 Aug;88(2):715-31
references.pmid: 12163524
references.citation: Eur J Neurosci. 2011 May;33(10):1885-96
references.pmid: 21395868
references.citation: J Neurosci. 2014 Jun 18;34(25):8594-604
references.pmid: 24948813
references.citation: Nat Neurosci. 1998 Aug;1(4):304-9
references.pmid: 10195164
references.citation: Neuron. 2007 Dec 6;56(5):785-92
references.pmid: 18054856
references.citation: Nature. 2009 Jun 11;459(7248):837-41
references.pmid: 19448610