A model of reward choice based on the theory of reinforcement learning.
A model explaining behavioral "impulsivity" and "self-control" is proposed on the basis of the theory of reinforcement learning. The discount coefficient gamma, which in this theory accounts for the subjective reduction in the value of a delayed reinforcement, is identified with the overall level of dopaminergic neuron activity which, according to published data, also determines the behavioral variant. Computer modeling showed that high values of gamma are characteristic of predominantly "self-controlled" subjects, while smaller values of gamma are characteristic of "impulsive" subjects.
Smirnitskaya
I A
IA
Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Moscow. i.a.i.a@mail.ru
Frolov
A A
AA
Merzhanova
G Kh
GKh
D000222:Adaptation, Physiological; D000223:Adaptation, Psychological; D000465:Algorithms; D000818:Animals; D001245:Association Learning / Q000502:physiology*; D002415:Cats; D002755:Choice Behavior / Q000502:physiology*; D003213:Conditioning, Psychological / Q000502:physiology*; D004298:Dopamine / Q000378:metabolism; D007175:Impulsive Behavior / Q000378:metabolism; D008959:Models, Neurological; D012054:Reinforcement, Psychology
D004298:Dopamine