title: A model of reward choice based on the theory of reinforcement learning.
abstract: A model explaining behavioral "impulsivity" and "self-control" is proposed on the basis of the theory of reinforcement learning. The discount coefficient gamma, which in this theory accounts for the subjective reduction in the value of a delayed reinforcement, is identified with the overall level of dopaminergic neuron activity which, according to published data, also determines the behavioral variant. Computer modeling showed that high values of gamma are characteristic of predominantly "self-controlled" subjects, while smaller values of gamma are characteristic of "impulsive" subjects.
authors.affiliation: Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Moscow. i.a.i.a@mail.ru
authors.forename: I A
authors.initials: IA
authors.lastname: Smirnitskaya
authors.forename: A A
authors.initials: AA
authors.lastname: Frolov
authors.forename: G Kh
authors.initials: GKh
authors.lastname: Merzhanova
mesh_terms: D000222:Adaptation, Physiological; D000223:Adaptation, Psychological; D000465:Algorithms; D000818:Animals; D001245:Association Learning / Q000502:physiology*; D002415:Cats; D002755:Choice Behavior / Q000502:physiology*; D003213:Conditioning, Psychological / Q000502:physiology*; D004298:Dopamine / Q000378:metabolism; D007175:Impulsive Behavior / Q000378:metabolism; D008959:Models, Neurological; D012054:Reinforcement, Psychology
chemical_list: D004298:Dopamine