title: Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task.
abstract: Prominent computational models describe a neural mechanism for learning from reward prediction errors, and it has been suggested that variations in this mechanism are reflected in personality factors such as trait extraversion. However, although trait extraversion has been linked to improved reward learning, it is not yet known whether this relationship is selective for the particular computational strategy associated with error-driven learning, known as model-free reinforcement learning, vs. another strategy, model-based learning, which the brain is also known to employ. In the present study we test this relationship by examining whether humans' scores on an extraversion scale predict individual differences in the balance between model-based and model-free learning strategies in a sequentially structured decision task designed to distinguish between them. In previous studies with this task, participants have shown a combination of both types of learning, but with substantial individual variation in the balance between them. In the current study, extraversion predicted worse behavior across both sorts of learning. However, the hypothesis that extraverts would be selectively better at model-free reinforcement learning held up among a subset of the more engaged participants, and overall, higher task engagement was associated with a more selective pattern by which extraversion predicted better model-free learning. The findings indicate a relationship between a broad personality orientation and detailed computational learning mechanisms. Results like those in the present study suggest an intriguing and rich relationship between core neuro-computational mechanisms and broader life orientations and outcomes.
authors.affiliation: The School of Psychology, University of Nottingham Nottingham, UK ; Horizon Digital Economy Research, University of Nottingham Nottingham, UK ; Department of Psychology, Center for Neural Science, New York University New York, NY, USA.
authors.forename: Anya
authors.initials: A
authors.lastname: Skatova
authors.forename: Patricia A
authors.initials: PA
authors.lastname: Chan
authors.forename: Nathaniel D
authors.initials: ND
authors.lastname: Daw
keywords: decision-making; dopamine; extraversion; personality; reinforcement learning
references.citation: Soc Cogn Affect Neurosci. 2007 Mar;2(1):20-30
references.pmid: 17710118
references.citation: Pers Soc Psychol Bull. 2007 Apr;33(4):476-89
references.pmid: 17363762
references.citation: Nature. 2006 Aug 31;442(7106):1042-5
references.pmid: 16929307
references.citation: J Exp Psychol Gen. 2014 Feb;143(1):182-94
references.pmid: 23230992
references.citation: Addict Behav. 2004 Sep;29(7):1389-405
references.pmid: 15345272
references.citation: Psychol Sci. 2013 May;24(5):751-61
references.pmid: 23558545
references.citation: Nat Rev Neurosci. 2008 Jul;9(7):545-56
references.pmid: 18545266
references.citation: Neuroimage. 2010 Jan 1;49(1):772-81
references.pmid: 19682583
references.citation: Science. 2004 Dec 10;306(5703):1940-3
references.pmid: 15528409
references.citation: Science. 1997 Mar 14;275(5306):1593-9
references.pmid: 9054347
references.citation: Brain. 2009 Sep;132(Pt 9):2385-95
references.pmid: 19416950
references.citation: Soc Cogn Affect Neurosci. 2011 Oct;6(5):646-52
references.pmid: 20855297
references.citation: J Pers Soc Psychol. 1997 Aug;73(2):337-44
references.pmid: 9303949
references.citation: Annu Rev Psychol. 2001;52:141-66
references.pmid: 11148302
references.citation: Neurosci Biobehav Rev. 2004 May;28(3):343-51
references.pmid: 15225976
references.citation: Science. 2007 May 11;316(5826):904-6
references.pmid: 17431137
references.citation: Neurosci Lett. 2010 Jan 14;468(3):234-7
references.pmid: 19897017
references.citation: J Subst Abuse Treat. 2010 Mar;38(2):178-90
references.pmid: 19717274
references.citation: J Pers Soc Psychol. 2006 Jul;91(1):171-87
references.pmid: 16834487
references.citation: J Neurosci. 2009 Feb 4;29(5):1538-43
references.pmid: 19193900
references.citation: Annu Rev Psychol. 2005;56:149-78
references.pmid: 15709932
references.citation: Brain Res Cogn Brain Res. 2005 Dec;25(3):851-61
references.pmid: 16289773
references.citation: Neuron. 2012 Aug 9;75(3):418-24
references.pmid: 22884326
references.citation: Neuron. 2010 May 27;66(4):585-95
references.pmid: 20510862
references.citation: Neuron. 2010 Jan 14;65(1):135-42
references.pmid: 20152119
references.citation: Behav Brain Sci. 2008 Aug;31(4):415-37; discussion 437-87
references.pmid: 18662461
references.citation: Drug Alcohol Depend. 1997 Mar 14;44(2-3):95-103
references.pmid: 9088781
references.citation: Neuron. 2011 Mar 24;69(6):1204-15
references.pmid: 21435563
references.citation: J Exp Psychol. 1946 Feb;36:13-24
references.pmid: 21015338
references.citation: J Neurosci. 2007 Nov 21;27(47):12860-7
references.pmid: 18032658
references.citation: Behav Brain Sci. 1999 Jun;22(3):491-517; discussion 518-69
references.pmid: 11301519
references.citation: Neuron. 2003 Apr 24;38(2):329-37
references.pmid: 12718865
references.citation: Nat Neurosci. 2005 Dec;8(12):1704-11
references.pmid: 16286932
references.citation: Accid Anal Prev. 2000 Sep;32(5):673-8
references.pmid: 10908140
references.citation: Nat Neurosci. 2005 Nov;8(11):1481-9
references.pmid: 16251991
references.citation: Neuron. 2003 Apr 24;38(2):339-46
references.pmid: 12718866
references.citation: J Affect Disord. 2009 Apr;114(1-3):110-21
references.pmid: 18687471