title: Reinforcement learning for discounted values often loses the goal in the application to animal learning.
abstract: The impulsive preference of an animal for an immediate reward implies that it might subjectively discount the value of potential future outcomes. A theoretical framework to maximize the discounted subjective value has been established in the reinforcement learning theory. The framework has been successfully applied in engineering. However, this study identified a limitation when applied to animal behavior, where in some cases, there is no learning goal. Here a possible learning framework was proposed that is well-posed in any cases and that is consistent with the impulsive preference.
authors.affiliation: Graduate School of Brain Sciences, Tamagawa University, Tokyo, Japan.
authors.forename: Yoshiya
authors.initials: Y
authors.lastname: Yamaguchi
authors.forename: Yutaka
authors.initials: Y
authors.lastname: Sakai
mesh_terms: D000818:Animals; D001522:Behavior, Animal; D006040:Goals; D007858:Learning / Q000502:physiology*; D012054:Reinforcement, Psychology; D012201:Reward