Axiomatic methods, dopamine and reward prediction error.
The phasic firing rate of midbrain dopamine neurons has been shown to respond both to the receipt of rewarding stimuli, and the degree to which such stimuli are anticipated by the recipient. This has led to the hypothesis that these neurons encode reward prediction error (RPE)-the difference between how rewarding an event is, and how rewarding it was expected to be. However, the RPE model is one of a number of competing explanations for dopamine activity that have proved hard to disentangle, mainly because they are couched in terms of latent, or unobservable, variables. This article describes techniques for dealing with latent variables common in economics and decision theory, and reviews work that uses these techniques to provide simple, non-parametric tests of the RPE hypothesis, allowing clear differentiation between competing explanations.
Caplin
Andrew
A
Department of Economics, New York University, NY 10012, USA. andrew.caplin@nyu.edu
Dean
Mark
M
D000465:Algorithms; D003657:Decision Making / Q000502:physiology*; D004298:Dopamine / Q000378:metabolism / Q000502:physiology*; D006801:Humans; D008636:Mesencephalon / Q000033:anatomy & histology / Q000502:physiology; D008959:Models, Neurological; D009474:Neurons / Q000166:cytology / Q000378:metabolism / Q000502:physiology*; D012055:Reinforcement Schedule; D012201:Reward
D004298:Dopamine