When does reward maximization lead to matching law?
What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal's decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject's past choices. We may term this strategy of partial reward maximization "matching strategy". Then, this strategy is applied to the case where the subject's decision system updates the information for making a decision. Such information includes subject's past actions or sensory stimuli, and the internal storage of this information is often called "state variables". We demonstrate that the matching strategy provides an easy way to maximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching.
Sakai
Yutaka
Y
Brain Science Institute, Tamagawa University, Machida, Tokyo, Japan.
Fukai
Tomoki
T
D000465:Algorithms; D000818:Animals; D001522:Behavior, Animal; D002755:Choice Behavior; D003657:Decision Making; D008959:Models, Neurological; D008962:Models, Theoretical; D012201:Reward