title: Contextual modulation of value signals in reward and punishment learning.
abstract: Compared with reward seeking, punishment avoidance learning is less clearly understood at both the computational and neurobiological levels. Here we demonstrate, using computational modelling and fMRI in humans, that learning option values in a relative--context-dependent--scale offers a simple computational solution for avoidance learning. The context (or state) value sets the reference point to which an outcome should be compared before updating the option value. Consequently, in contexts with an overall negative expected value, successful punishment avoidance acquires a positive value, thus reinforcing the response. As revealed by post-learning assessment of options values, contextual influences are enhanced when subjects are informed about the result of the forgone alternative (counterfactual information). This is mirrored at the neural level by a shift in negative outcome encoding from the anterior insula to the ventral striatum, suggesting that value contextualization also limits the need to mobilize an opponent punishment learning system.
authors: Institute of Cognitive Neuroscience (ICN), University College London (UCL), London WC1N 3AR, UK.|Laboratoire de Neurosciences Cognitives (LNC), Département d'Etudes Cognitives (DEC), Institut National de la Santé et Recherche Médical (INSERM) U960, École Normale Supérieure (ENS), 75005 Paris, France.
authors: Stefano
authors: S
authors: Palminteri
authors: Instintut des Systèmes Intelligents et Robotique (ISIR), Centre National de la Recherche Scientifique (CNRS) UMR 7222, Université Pierre et Marie Curie (UPMC), 70013 Paris, France.|Interdepartmental Centre for Mind/Brain Sciences (CIMeC), Università degli study di Trento, 38060 Trento, Italy.
authors: Mehdi
authors: http://orcid.org/0000-0002-2515-1046
authors: M
authors: Khamassi
authors: Interdepartmental Centre for Mind/Brain Sciences (CIMeC), Università degli study di Trento, 38060 Trento, Italy.|Groupe d'Analyse et de Théorie Economique, Centre National de la Recherche Scientifique (CNRS) UMR 5229, Université de Lyon, 69003 Lyon, France.
authors: Mateus
authors: M
authors: Joffily
authors: Laboratoire de Neurosciences Cognitives (LNC), Département d'Etudes Cognitives (DEC), Institut National de la Santé et Recherche Médical (INSERM) U960, École Normale Supérieure (ENS), 75005 Paris, France.|Interdepartmental Centre for Mind/Brain Sciences (CIMeC), Università degli study di Trento, 38060 Trento, Italy.|Department of Economics, University of Southern California (USC), 90089-0253 Los Angeles, California, USA.
authors: Giorgio
authors: G
authors: Coricelli
mesh_terms: D000328:Adult; D001362:Avoidance Learning / Q000502:physiology*; D001499:Bayes Theorem; D001921:Brain / Q000502:physiology; D001931:Brain Mapping; D002540:Cerebral Cortex / Q000502:physiology; D003198:Computer Simulation; D003657:Decision Making / Q000502:physiology*; D005260:Female; D059907:Functional Neuroimaging; D006801:Humans; D007091:Image Processing, Computer-Assisted; D007858:Learning / Q000502:physiology; D008279:Magnetic Resonance Imaging; D008297:Male; D008959:Models, Neurological; D017397:Prefrontal Cortex / Q000502:physiology*; D011678:Punishment; D012201:Reward; D066328:Ventral Striatum / Q000502:physiology*; D055815:Young Adult