Discrete coding of reward probability and uncertainty by dopamine neurons.
Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response covaried with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.
Fiorillo
Christopher D
CD
Institute of Physiology, University of Fribourg, CH-1700 Fribourg, Switzerland. cdf28@cam.ac.uk
Tobler
Philippe N
PN
Schultz
Wolfram
W
D000818:Animals; D001288:Attention; D003214:Conditioning, Classical; D004192:Discrimination, Psychological; D004298:Dopamine / Q000502:physiology*; D004594:Electrophysiology; D005260:Female; D007858:Learning; D016014:Linear Models; D008252:Macaca fascicularis; D008636:Mesencephalon / Q000166:cytology / Q000502:physiology*; D009042:Motivation; D009474:Neurons / Q000502:physiology*; D010775:Photic Stimulation; D011336:Probability; D012054:Reinforcement, Psychology; D012201:Reward; D012309:Risk-Taking; D035501:Uncertainty
D004298:Dopamine