Self-choice enhances value in reward-seeking in primates.
When an individual chooses one item from two or more alternatives, they compare the values of the expected outcomes. The outcome value can be determined by the associated reward amount, the probability of reward, and the workload required to earn the reward. Rational choice theory states that choices are made to maximize rewards over time, and that the same outcome values lead to an equal likelihood of choices. However, the theory does not distinguish between conditions with the same reward value, even when acquired under different circumstances, and does not always accurately describe real behavior. We have found that allowing a monkey to choose a reward schedule endows the schedule with extra value when compared to performance in an identical schedule that is chosen by another agent (a computer here). This behavior is not consistent with pure rational choice theory. Theoretical analysis using a modified temporal-difference learning model showed an enhanced schedule state value by self-choice. These results suggest that an increased reward value underlies the improved performances by self-choice during reward-seeking behavior.
Doctoral Program in Kansei, Behavioral and Brain Science, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan; Japan Society for the Promotion of Science, Japan.
Tsuyoshi
T
Setogawa
Doctoral Program in Kansei, Behavioral and Brain Science, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan; Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan.
Takashi
T
Mizuhiki
Human Technology Research Institute, AIST, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8568, Japan.
Narihisa
N
Matsumoto
Doctoral Program in Kansei, Behavioral and Brain Science, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan.
Fumika
F
Akizawa
Doctoral Program in Kansei, Behavioral and Brain Science, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan; Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan. Electronic address: mshidara@md.tsukuba.ac.jp.
Munetaka
M
Shidara
D000818:Animals; D002755:Choice Behavior / Q000502:physiology*; D003216:Conditioning, Operant; D003657:Decision Making / Q000502:physiology*; D004192:Discrimination, Psychological; D008253:Macaca mulatta; D008297:Male; D008954:Models, Biological; D010775:Photic Stimulation; D011336:Probability; D012055:Reinforcement Schedule; D012201:Reward
Heuristics of bounded rationality; Rational choice theory; Reward-based decision-making; Rhesus monkey; Self-choice; Temporal-difference learning model