Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off.
Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization.



The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization.
Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, University College London, London WC1N3BG, United Kingdom, Department of Experimental Psychology, Oxford University, Oxford OX1 3UD, United Kingdom, and miriam.klein-flugge@psy.ox.ac.uk.
Miriam C
0000-0002-5156-9833
MC
Klein-Flügge
Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, University College London, London WC1N3BG, United Kingdom.
Steven W
0000-0002-5696-7507
SW
Kennerley
Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, University College London, London WC1N3BG, United Kingdom.
Karl
0000-0001-7984-8909
K
Friston
Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, University College London, London WC1N3BG, United Kingdom.
Sven
0000-0002-6867-9545
S
Bestmann
D000328:Adult; D002755:Choice Behavior / Q000502:physiology*; D003071:Cognition / Q000502:physiology*; D004193:Discrimination Learning / Q000502:physiology; D005260:Female; D006179:Gyrus Cinguli / Q000502:physiology*; D006801:Humans; D008297:Male; D009415:Nerve Net / Q000502:physiology*; D005082:Physical Exertion / Q000502:physiology*; D012201:Reward
cingulate cortex; cost-benefit decision making; fMRI; motor cost; physical effort; value comparison
J Neurosci. 2014 Nov 19;34(47):15621-30
25411490
Cereb Cortex. 2016 Feb;26(2):807-19
26564255
J Neurosci. 2010 Mar 3;30(9):3339-46
20203193
J Neurosci. 2011 May 18;31(20):7527-32
21593337
J Neurosci. 2011 Oct 12;31(41):14693-707
21994386
Cereb Cortex. 2016 Feb;26(2):467-76
25217467
Soc Cogn Affect Neurosci. 2014 Sep;9(9):1289-302
23887811
Science. 2012 Apr 6;336(6077):95-8
22491854
Proc Natl Acad Sci U S A. 2011 Nov 1;108(44):18120-5
22006321
Cereb Cortex. 2007 Feb;17(2):251-60
16495432
Schizophr Bull. 2015 Mar;41(2):503-12
25053653
Biol Psychiatry. 2013 Jul 15;74(2):130-6
23394903
Neuroimage. 2007 Jan 1;34(1):220-34
17055746
Proc Natl Acad Sci U S A. 2009 Oct 6;106(40):17199-204
19805082
J Neurosci. 2011 May 11;31(19):7083-8
21562270
Neuroimage. 2001 May;13(5):903-19
11304086
Nat Neurosci. 2012 Jun 17;15(7):960-1
22706268
J Neurosci. 2013 Jan 23;33(4):1706-13a
23345243
Elife. 2015 Dec 11;4:null
26653139
Curr Opin Neurobiol. 2010 Apr;20(2):262-70
20338744
J Neurosci. 2003 Jul 23;23(16):6475-9
12878688
Brain Res Bull. 1998;45(2):209-32
9443842
J Neurosci. 2015 Aug 12;35(32):11233-51
26269633
J Comp Neurol. 1994 Dec 15;350(3):337-56
7533796
Neuroimage. 2003 Jul;19(3):727-41
12880802
Science. 2004 Oct 15;306(5695):443-7
15486290
J Cogn Neurosci. 2009 Jun;21(6):1162-78
18752411
Nat Neurosci. 2011 Oct 30;14(12):1581-9
22037498
Cereb Cortex. 2015 Sep;25(9):3197-218
24904073
Neuron. 2009 Jun 11;62(5):733-43
19524531
Nat Neurosci. 2015 May;18(5):620-7
25919962
Biol Psychiatry. 2002 Feb 15;51(4):342-4
11958786
Cereb Cortex. 2006 Jul;16(7):916-28
16207933
Nat Neurosci. 2014 Nov;17(11):1613-22
25306549
Science. 2002 May 31;296(5573):1709-11
12040201
Curr Opin Neurobiol. 2012 Dec;22(6):946-55
22572389
Neural Netw. 2006 Oct;19(8):1302-14
16949252
J Neurosci. 2013 Apr 3;33(14):6160-9
23554497
J Neurosci. 2010 Jun 2;30(22):7705-13
20519545
PLoS Comput Biol. 2015 Mar 27;11(3):e1004116
25816114
J Neurosci. 2008 Dec 17;28(51):13775-85
19091968
Neuroimage. 2011 Jul 1;57(1):101-12
21515386
Cereb Cortex. 2014 Mar;24(3):563-78
23131805
Nature. 2006 May 11;441(7090):223-6
16633341
J Neurosci. 2009 Jan 28;29(4):1175-90
19176826
Neuroimage. 2006 Nov 1;33(2):493-504
16959495
Schizophr Res. 2015 Feb;161(2-3):382-5
25487699
Neuron. 2015 Sep 2;87(5):1106-18
26335649
Proc Natl Acad Sci U S A. 2010 May 18;107(20):9430-5
20439711
Neuron. 2002 Dec 5;36(5):955-68
12467598
Neuroimage. 2006 Jul 15;31(4):1536-48
16632379
Learn Mem. 2005 May-Jun;12(3):334-42
15930509
Nat Neurosci. 2015 May;18(5):752-9
25894290
Nat Neurosci. 2006 Sep;9(9):1161-8
16921368
J Physiol Paris. 2015 Feb-Jun;109(1-3):16-26
24747776
Proc Natl Acad Sci U S A. 2010 Nov 23;107(47):20547-52
21059901
J Neurosci. 2010 Oct 20;30(42):14080-90
20962229
J Neurosci. 2011 Oct 19;31(42):15048-52
22016538
J Neurosci. 1985 Mar;5(3):776-94
2983048
J Abnorm Psychol. 2012 Aug;121(3):553-8
22775583
Proc Natl Acad Sci U S A. 2015 May 19;112(20):E2695-704
25947150
Magn Reson Med. 2000 Jul;44(1):162-7
10893535
Neurosci Biobehav Rev. 2013 Dec;37(10 Pt 2):2649-65
24035741
J Neurosci. 2013 Feb 13;33(7):3202-11
23407973
J Comp Neurol. 1992 Aug 22;322(4):471-89
1383283
Eur J Neurosci. 2009 Apr;29(8):1678-91
19385990
Brain. 2003 Apr;126(Pt 4):873-88
12615645
J Neurosci. 2013 Oct 30;33(44):17385-97
24174671
Eur J Neurosci. 2009 May;29(10):2061-73
19453638
Psychiatry Res. 2014 Dec 30;220(3):874-82
25262638
Science. 2003 Jul 11;301(5630):229-32
12855813
J Neurosci. 2009 Jun 10;29(23):7526-39
19515921
Ann N Y Acad Sci. 2011 Dec;1239:1-13
22145870
J Neurosci. 1991 Mar;11(3):667-89
1705965
J Neurosci. 2009 Jul 1;29(26):8388-95
19571129
Nat Neurosci. 2006 Jul;9(7):940-7
16783368
Neuron. 2014 Jun 18;82(6):1357-66
24881835
Nature. 1997 Apr 24;386(6627):824-7
9126739
J Neurosci. 2015 May 20;35(20):7866-77
25995472
Nat Neurosci. 2007 Dec;10(12):1625-33
17982449
Curr Opin Neurobiol. 2016 Apr;37:36-43
26774693
Nat Neurosci. 2012 Jan 08;15(3):470-6, S1-3
22231429
J Neurosci. 2009 Apr 8;29(14):4531-41
19357278
J Neurophysiol. 2010 Jul;104(1):313-21
20463204
Annu Rev Clin Psychol. 2014;10:393-423
24471371
PLoS One. 2011;6(8):e23178
21853083