Human insula activation reflects risk prediction errors as well as risk.
Understanding how organisms deal with probabilistic stimulus-reward associations has been advanced by a convergence between reinforcement learning models and primate physiology, which demonstrated that the brain encodes a reward prediction error signal. However, organisms must also predict the level of risk associated with reward forecasts, monitor the errors in those risk predictions, and update these in light of new information. Risk prediction serves a dual purpose: (1) to guide choice in risk-sensitive organisms and (2) to modulate learning of uncertain rewards. To date, it is not known whether or how the brain accomplishes risk prediction. Using functional imaging during a simple gambling task in which we constantly changed risk, we show that an early-onset activation in the human insula correlates significantly with risk prediction error and that its time course is consistent with a role in rapid updating. Additionally, we show that activation previously associated with general uncertainty emerges with a delay consistent with a role in risk prediction. The activations correlating with risk prediction and risk prediction errors are the analogy for risk of activations correlating with reward prediction and reward prediction errors for reward expectation. As such, our findings indicate that our understanding of the neural basis of reward anticipation under uncertainty needs to be expanded to include risk prediction.
Preuschoff
Kerstin
K
Computation and Neural Systems Program and Division of Humanities and Social Sciences, Caltech, Pasadena, California 91125, USA.
Quartz
Steven R
SR
Bossaerts
Peter
P
D000293:Adolescent; D000328:Adult; D002540:Cerebral Cortex / Q000378:metabolism*; D002755:Choice Behavior / Q000502:physiology; D005260:Female; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000379:methods; D008297:Male; D011237:Predictive Value of Tests; D011597:Psychomotor Performance / Q000502:physiology; D012201:Reward; D012309:Risk-Taking