title: [The model of the reward choice basing on the theory of reinforcement learning].
abstract: We developed the model of alimentary instrumental conditioned bar-pressing reflex for cats making a choice between either immediate small reinforcement ("impulsive behavior") or delayed more valuable reinforcement ("self-control behavior"). Our model is based on the reinforcement learning theory. We emulated dopamine contribution by discount coefficient of this theory (a subjective decrease in the value of a delayed reinforcement). The results of computer simulation showed that "cats" with large discount coefficient demonstrated "self-control behavior"; small discount coefficient was associated with "impulsive behavior". This data are in agreement with the experimental data indicating that the impulsive behavior is due to a decreased amount of dopamine in striatum.
authors.forename: I A
authors.initials: IA
authors.lastname: Smirnitskaia
authors.forename: A A
authors.initials: AA
authors.lastname: Frolov
authors.forename: G Kh
authors.initials: GKh
authors.lastname: Merzhanova
mesh_terms: D000818:Animals; D002415:Cats; D003198:Computer Simulation; D004298:Dopamine / Q000502:physiology; D007858:Learning / Q000502:physiology*; D008954:Models, Biological; D012054:Reinforcement, Psychology; D012201:Reward
chemical_list: D004298:Dopamine