title: Effort and valuation in the brain: the effects of anticipation and execution.
abstract: Neural representations of the effort deployed in performing actions, and the valence of the outcomes they yield, form the foundation of action choice. To discover whether brain areas represent effort and outcome valence together or if they represent one but not the other, we examined these variables in an explicitly orthogonal way. We did this by asking human subjects to exert one of two levels of effort to improve their chances of either winning or avoiding the loss of money. Subjects responded faster both when exerting greater effort and when exerting effort in anticipation of winning money. Using fMRI, we inspected BOLD responses during anticipation (before any action was executed) and when the outcome was delivered. In this way, we indexed BOLD signals associated with an anticipated need to exert effort and its affective consequences, as well as the effect of executed effort on the representation of outcomes. Anterior cingulate cortex and dorsal striatum (dorsal putamen) signaled the anticipation of effort independently of the prospect of winning or losing. Activity in ventral striatum (ventral putamen) was greater for better-than-expected outcomes compared with worse-than-expected outcomes, an effect attenuated in the context of having exerted greater effort. Our findings provide evidence that neural representations of anticipated actions are sensitive to the expected demands, but not to the expected value of their consequence, whereas representations of outcome value are discounted by exertion, commensurate with an integration of cost and benefit so as to approximate net value.
authors.affiliation: Wellcome Trust Centre for Neuroimaging, University College London, London WC1N 3BG, United Kingdom. irma.kurniawan@gmail.com
authors.forename: Irma T
authors.initials: IT
authors.lastname: Kurniawan
authors.forename: Marc
authors.initials: M
authors.lastname: Guitart-Masip
authors.forename: Peter
authors.initials: P
authors.lastname: Dayan
authors.forename: Raymond J
authors.initials: RJ
authors.lastname: Dolan
mesh_terms: D000328:Adult; D000704:Analysis of Variance; D001921:Brain / Q000098:blood supply / Q000502:physiology*; D001931:Brain Mapping; D003463:Cues; D056344:Executive Function / Q000502:physiology*; D005260:Female; D018737:Hand Strength / Q000502:physiology; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008297:Male; D009483:Neuropsychological Tests; D010100:Oxygen / Q000097:blood; D010775:Photic Stimulation; D005082:Physical Exertion / Q000502:physiology*; D011237:Predictive Value of Tests; D011930:Reaction Time; D012201:Reward; D055815:Young Adult
chemical_list: D010100:Oxygen
references.citation: Behav Brain Res. 2011 Jul 7;220(2):288-93
references.pmid: 21316399
references.citation: Eur J Neurosci. 2012 Apr;35(7):1152-68
references.pmid: 22487044
references.citation: Nat Neurosci. 2010 Jan;13(1):25-7
references.pmid: 19904261
references.citation: Neuron. 2011 Nov 17;72(4):654-64
references.pmid: 22099466
references.citation: Science. 2004 Feb 20;303(5661):1157-62
references.pmid: 14976305
references.citation: J Neurosci. 2008 Mar 12;28(11):2745-52
references.pmid: 18337404
references.citation: Neuropsychopharmacology. 2011 Jan;36(1):98-113
references.pmid: 20736991
references.citation: J Neurosci. 2011 May 25;31(21):7867-75
references.pmid: 21613500
references.citation: Neural Netw. 2006 Oct;19(8):1302-14
references.pmid: 16949252
references.citation: Proc Natl Acad Sci U S A. 2013 Feb 12;110(7):2641-6
references.pmid: 23341598
references.citation: Neuroimage. 2006 Nov 1;33(2):493-504
references.pmid: 16959495
references.citation: J Neurosci. 2009 Nov 18;29(46):14617-26
references.pmid: 19923294
references.citation: PLoS Comput Biol. 2011 Apr;7(4):e1002028
references.pmid: 21556131
references.citation: Psychon Bull Rev. 2000 Mar;7(1):100-6
references.pmid: 10780022
references.citation: Neuropsychopharmacology. 2011 Jan;36(1):74-97
references.pmid: 20881948
references.citation: Neuropsychopharmacology. 2010 Jan;35(1):4-26
references.pmid: 19812543
references.citation: Trends Neurosci. 2004 Aug;27(8):468-74
references.pmid: 15271494
references.citation: Prog Neurobiol. 1994 Apr;42(6):719-61
references.pmid: 7938546
references.citation: Neuroimage. 2012 Aug 1;62(1):154-66
references.pmid: 22548809
references.citation: J Neurosci. 2009 Apr 8;29(14):4531-41
references.pmid: 19357278
references.citation: J Neurosci. 2009 Sep 23;29(38):11993-9
references.pmid: 19776285
references.citation: Science. 2004 Apr 16;304(5669):452-4
references.pmid: 15087550
references.citation: Psychopharmacology (Berl). 2007 Apr;191(3):483-95
references.pmid: 17119929
references.citation: Nature. 2006 Aug 31;442(7106):1042-5
references.pmid: 16929307
references.citation: J Neurophysiol. 2010 Jul;104(1):313-21
references.pmid: 20463204
references.citation: Front Neurosci. 2011 Jun 21;5:81
references.pmid: 21734862
references.citation: Proc Natl Acad Sci U S A. 2012 May 8;109(19):7511-6
references.pmid: 22529363
references.citation: J Neurosci. 2005 May 11;25(19):4806-12
references.pmid: 15888656
references.citation: Cereb Cortex. 2007 Feb;17(2):251-60
references.pmid: 16495432
references.citation: J Exp Anal Behav. 1977 Jul;28(1):83-95
references.pmid: 16812016
references.citation: J Neurosci. 2008 Jan 9;28(2):360-8
references.pmid: 18184778
references.citation: Neural Netw. 2006 Oct;19(8):1153-60
references.pmid: 16938432
references.citation: J Neurosci. 2010 Oct 20;30(42):14080-90
references.pmid: 20962229
references.citation: Prog Neurobiol. 1980;14(2-3):69-97
references.pmid: 6999537
references.citation: J Cogn Neurosci. 2009 Jun;21(6):1162-78
references.pmid: 18752411
references.citation: Behav Processes. 2009 Oct;82(2):126-32
references.pmid: 19607889
references.citation: Neuron. 2003 Apr 24;38(2):329-37
references.pmid: 12718865
references.citation: Proc Biol Sci. 2011 May 22;278(1711):1450-6
references.pmid: 21047860
references.citation: PLoS Biol. 2012 Feb;10(2):e1001266
references.pmid: 22363208
references.citation: J Neurosci. 2002 Dec 15;22(24):10996-1003
references.pmid: 12486195
references.citation: J Exp Psychol. 1948 Apr;38(2):173-7
references.pmid: 18913666
references.citation: J Psychopharmacol. 1991 Jan;5(4):305-15
references.pmid: 22282829
references.citation: J Neurosci. 2012 Jan 11;32(2):551-62
references.pmid: 22238090
references.citation: J Comp Physiol Psychol. 1965 Jun;59:406-12
references.pmid: 14313781
references.citation: J Neurosci. 2001 Apr 15;21(8):2793-8
references.pmid: 11306631
references.citation: Neuroimage. 2004 Feb;21(2):757-67
references.pmid: 14980579
references.citation: Nature. 2004 Jun 10;429(6992):664-7
references.pmid: 15190354