title: Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task.
abstract: Animals are thought to evaluate the desirability of action options using a unified scale that combines predicted benefits ("rewards"), costs, and the animal's internal motivational state. Midbrain dopamine neurons have long been associated with the reward part of this equation, but it is unclear whether these neurons also estimate the costs of taking an action. We studied the spiking activity of dopamine neurons in the substantia nigra pars compacta of monkeys (Macaca mulatta) during a reaching task in which the energetic costs incurred (friction loads) and the benefits gained (drops of food) were manipulated independently. Although the majority of dopamine neurons encoded the upcoming reward alone, a subset predicted net utility of a course of action by signaling the expected reward magnitude discounted by the invested cost in terms of physical effort. In addition, the tonic activity of some dopamine neurons was slowly reduced in conjunction with the accumulated trials, which is consistent with the hypothesized role for tonic dopamine in the invigoration or motivation of instrumental responding. The present results shed light on an often-hypothesized role for dopamine in the regulation of the balance in natural behaviors between the energy expended and the benefits gained, which could explain why dopamine disorders, such as Parkinson's disease, lead to a breakdown of that balance.
authors: Department of Neurobiology, Center for Neuroscience and the Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, Pennsylvania 15261, USA.
authors: Benjamin
authors: B
authors: Pasquereau
authors: Robert S
authors: RS
authors: Turner
mesh_terms: D000200:Action Potentials / Q000502:physiology; D000704:Analysis of Variance; D000818:Animals; D003216:Conditioning, Operant / Q000502:physiology; D003657:Decision Making / Q000502:physiology*; D059290:Dopaminergic Neurons / Q000502:physiology*; D005260:Female; D008253:Macaca mulatta; D008297:Male; D008636:Mesencephalon / Q000166:cytology*; D009042:Motivation / Q000502:physiology*; D011237:Predictive Value of Tests; D011597:Psychomotor Performance; D011930:Reaction Time / Q000502:physiology; D012201:Reward; D013997:Time Factors
references: Front Syst Neurosci. 2011 May 09;5:22
references: 21603228
references: J Neurosci. 2010 Sep 8;30(36):12020-7
references: 20826665
references: Neuroimage. 1996 Oct;4(2):119-50
references: 9345504
references: Psychopharmacology (Berl). 2007 Apr;191(3):483-95
references: 17119929
references: Behav Neurosci. 2000 Jun;114(3):468-83
references: 10883798
references: Biol Psychiatry. 2010 Aug 1;68(3):306-9
references: 20452572
references: Behav Brain Res. 2002 Dec 2;137(1-2):3-25
references: 12445713
references: Annu Rev Psychol. 2006;57:87-115
references: 16318590
references: Psychopharmacology (Berl). 2007 Apr;191(3):507-20
references: 17031711
references: J Neurosci. 2007 Jul 4;27(27):7105-16
references: 17611263
references: Science. 2003 Mar 21;299(5614):1898-902
references: 12649484
references: Nat Neurosci. 1998 Aug;1(4):304-9
references: 10195164
references: Acta Neurochir Suppl. 2007;97(Pt 2):561-7
references: 17691348
references: Nat Neurosci. 2008 Aug;11(8):966-73
references: 18660807
references: Neuroscience. 1999;92(2):545-52
references: 10408603
references: Nat Neurosci. 2002 Nov;5(11):1226-35
references: 12404008
references: Curr Biol. 2005 Oct 25;15(20):1855-60
references: 16243033
references: Behav Brain Res. 2004 May 5;151(1-2):83-91
references: 15084424
references: Games Econ Behav. 2005 Aug;52(2):213-256
references: 16845435
references: Pharmacol Biochem Behav. 1994 Sep;49(1):85-91
references: 7816895
references: Nat Neurosci. 2010 Jan;13(1):25-7
references: 19904261
references: J Neurosci. 2008 Jul 30;28(31):7837-46
references: 18667616
references: Neuron. 2010 Dec 9;68(5):815-34
references: 21144997
references: Nat Rev Neurosci. 2004 Jun;5(6):483-94
references: 15152198
references: Psychopharmacology (Berl). 1988;95(3):423-6
references: 3137631
references: Proc Natl Acad Sci U S A. 2001 Jan 30;98(3):1089-94
references: 11158599
references: Psychopharmacology (Berl). 2007 Apr;191(3):461-82
references: 17225164
references: Neuroscience. 2001;105(4):863-70
references: 11530224
references: Science. 2005 Mar 11;307(5715):1642-5
references: 15761155
references: J Neurosci. 2010 Aug 4;30(31):10507-16
references: 20685993
references: J Neurosci. 2010 Oct 20;30(42):14080-90
references: 20962229
references: J Neurosci. 2009 Jul 29;29(30):9575-81
references: 19641120
references: Psychopharmacology (Berl). 2005 May;179(3):587-96
references: 15864561
references: PLoS Biol. 2004 Oct;2(10):e330
references: 15383835
references: J Neurosci. 2010 Dec 8;30(49):16585-600
references: 21147998
references: Neuron. 2006 Sep 7;51(5):541-7
references: 16950153
references: J Neurosci. 2008 Nov 5;28(45):11673-84
references: 18987203
references: Ann N Y Acad Sci. 2007 Dec;1121:431-46
references: 17846160
references: Brain. 1980 Jun;103(2):301-14
references: 7397480
references: Nature. 2009 Jun 11;459(7248):837-41
references: 19448610
references: Psychopharmacology (Berl). 1984;84(3):405-12
references: 6440188
references: Nat Neurosci. 2007 Dec;10(12):1615-24
references: 18026098
references: Ann N Y Acad Sci. 2007 May;1104:357-76
references: 17416928
references: J Neurosci. 2013 Jan 9;33(2):665-77
references: 23303945
references: Science. 1997 Mar 14;275(5306):1593-9
references: 9054347
references: Neuron. 2005 Jul 7;47(1):129-41
references: 15996553
references: Nat Neurosci. 2006 Aug;9(8):1057-63
references: 16862149
references: Brain. 2001 Nov;124(Pt 11):2131-46
references: 11673316