Orbitofrontal cortex as a cognitive map of task space.
Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere in the brain. This function is especially critical when task states include unobservable information, for instance, from working memory. We use this framework to explain classic findings in reversal learning, delayed alternation, extinction, and devaluation as well as more recent findings showing the effect of OFC lesions on the firing of dopaminergic neurons in ventral tegmental area (VTA) in rodents performing an RL task. In addition, we generate a number of testable experimental predictions that can distinguish our theory from other accounts of OFC function.
Department of Psychology and Neuroscience Institute, Princeton University.
Robert C
RC
Wilson
Department of Anatomy & Neurobiology, University of Maryland School of Medicine.
Yuji K
YK
Takahashi
Department of Anatomy & Neurobiology, University of Maryland School of Medicine.|Department of Psychiatry, University of Maryland School of Medicine.
G
G
Schoenbaum
Department of Psychology and Neuroscience Institute, Princeton University.
Yael
Y
Niv
D000200:Action Potentials / Q000502:physiology; D000818:Animals; D003071:Cognition; D003657:Decision Making; D059290:Dopaminergic Neurons / Q000502:physiology; D006801:Humans; D007858:Learning / Q000502:physiology*; D008960:Models, Psychological; D017397:Prefrontal Cortex / Q000293:injuries / Q000502:physiology*; D012054:Reinforcement, Psychology; D017557:Ventral Tegmental Area / Q000166:cytology