title: Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.
abstract: Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes.
authors.affiliation: Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom; Human Neuroimaging Laboratory, Virginia Tech Carilion Research Institute, Roanoke, Virginia.
authors.forename: Xiaosi
authors.initials: X
authors.lastname: Gu
authors.forename: Ulrich
authors.initials: U
authors.lastname: Kirk
authors.forename: Terry M
authors.initials: TM
authors.lastname: Lohrenz
authors.forename: P Read
authors.initials: PR
authors.lastname: Montague
mesh_terms: D000328:Adult; D059031:Anticipation, Psychological / Q000502:physiology; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D003071:Cognition / Q000502:physiology*; D003657:Decision Making; D005260:Female; D006801:Humans; D007449:Investments; D007858:Learning / Q000502:physiology; D016014:Linear Models; D008279:Magnetic Resonance Imaging; D008297:Male; D009434:Neural Pathways / Q000502:physiology; D009483:Neuropsychological Tests; D011601:Psychophysics; D012044:Regression Analysis; D012201:Reward
keywords: decision-making; emotion regulation; fMRI; fictive learning; insula; reappraisal; reward prediction errors