Dialogues on prediction errors.
The recognition that computational ideas from reinforcement learning are relevant to the study of neural circuits has taken the cognitive neuroscience community by storm. A central tenet of these models is that discrepancies between actual and expected outcomes can be used for learning. Neural correlates of such prediction-error signals have been observed now in midbrain dopaminergic neurons, striatum, amygdala and even prefrontal cortex, and models incorporating prediction errors have been invoked to explain complex phenomena such as the transition from goal-directed to habitual behavior. Yet, like any revolution, the fast-paced progress has left an uneven understanding in its wake. Here, we provide answers to ten simple questions about prediction errors, with the aim of exposing both the strengths and the limitations of this active area of neuroscience research.
Niv
Yael
Y
Center for the Study of Brain, Mind and Behavior and Department of Psychology, Green Hall, Princeton University, Princeton, NJ 08544, USA. yael@princeton.edu
Schoenbaum
Geoffrey
G
D001185:Artificial Intelligence; D001245:Association Learning; D001921:Brain / Q000502:physiology*; D004193:Discrimination Learning; D004298:Dopamine / Q000502:physiology; D006801:Humans; D008959:Models, Neurological; D008960:Models, Psychological; D011337:Probability Learning; D011582:Psychological Theory; D012054:Reinforcement, Psychology
D004298:Dopamine