title: Don't Think, Just Feel the Music: Individuals with Strong Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning.
abstract: Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus-action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian-instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposing individuals to both have strong Pavlovian interference and be less model-based and provides a framework within which to interpret the observation of both effects in addiction.
authors.affiliation: Charité-Universitätsmedizin Berlin.|Humboldt-Universität zu Berlin.
authors.forename: Miriam
authors.initials: M
authors.lastname: Sebold
authors.affiliation: Charité-Universitätsmedizin Berlin.|University of Potsdam.
authors.forename: Daniel J
authors.initials: DJ
authors.lastname: Schad
authors.affiliation: Technische Universität Dresden.
authors.forename: Stephan
authors.initials: S
authors.lastname: Nebe
authors.affiliation: Charité-Universitätsmedizin Berlin.|Humboldt-Universität zu Berlin.
authors.forename: Maria
authors.initials: M
authors.lastname: Garbusow
authors.affiliation: Technische Universität Dresden.
authors.forename: Elisabeth
authors.initials: E
authors.lastname: Jünger
authors.affiliation: Technische Universität Dresden.|Yale University School of Medicine.|The John B. Pierce Laboratory, New Haven, CT.
authors.forename: Nils B
authors.initials: NB
authors.lastname: Kroemer
authors.affiliation: Humboldt-Universität zu Berlin.
authors.forename: Norbert
authors.initials: N
authors.lastname: Kathmann
authors.affiliation: Technische Universität Dresden.
authors.forename: Ulrich S
authors.initials: US
authors.lastname: Zimmermann
authors.affiliation: Technische Universität Dresden.
authors.forename: Michael N
authors.initials: MN
authors.lastname: Smolka
authors.affiliation: University of Potsdam.
authors.forename: Michael A
authors.initials: MA
authors.lastname: Rapp
authors.affiliation: Charité-Universitätsmedizin Berlin.
authors.forename: Andreas
authors.initials: A
authors.lastname: Heinz
authors.affiliation: University of Zurich.|ETH Zürich.
authors.forename: Quentin J M
authors.initials: QJ
authors.lastname: Huys
mesh_terms: D000328:Adult; D002755:Choice Behavior; D003198:Computer Simulation; D003214:Conditioning, Classical; D003216:Conditioning, Operant; D030141:Feedback, Psychological; D005260:Female; D006801:Humans; D007206:Individuality; D016014:Linear Models; D008137:Longitudinal Studies; D008297:Male; D008960:Models, Psychological; D011337:Probability Learning; D011930:Reaction Time; D012054:Reinforcement, Psychology; D014163:Transfer, Psychology