Acquisition of decision making criteria: reward rate ultimately beats accuracy.
Speed-accuracy trade-offs strongly influence the rate of reward that can be earned in many decision-making tasks. Previous reports suggest that human participants often adopt suboptimal speed-accuracy trade-offs in single session, two-alternative forced-choice tasks. We investigated whether humans acquired optimal speed-accuracy trade-offs when extensively trained with multiple signal qualities. When performance was characterized in terms of decision time and accuracy, our participants eventually performed nearly optimally in the case of higher signal qualities. Rather than adopting decision criteria that were individually optimal for each signal quality, participants adopted a single threshold that was nearly optimal for most signal qualities. However, setting a single threshold for different coherence conditions resulted in only negligible decrements in the maximum possible reward rate. Finally, we tested two hypotheses regarding the possible sources of suboptimal performance: (1) favoring accuracy over reward rate and (2) misestimating the reward rate due to timing uncertainty. Our findings provide support for both hypotheses, but also for the hypothesis that participants can learn to approach optimality. We find specifically that an accuracy bias dominates early performance, but diminishes greatly with practice. The residual discrepancy between optimal and observed performance can be explained by an adaptive response to uncertainty in time estimation.
Princeton Neuroscience Institute, Princeton University, Green Hall, Princeton, NJ 08544, USA. fbalci@princeton.edu
Fuat
F
Balci
Patrick
P
Simen
Ritwik
R
Niyogi
Andrew
A
Saxe
Jessica A
JA
Hughes
Philip
P
Holmes
Jonathan D
JD
Cohen
D000293:Adolescent; D000328:Adult; D001288:Attention; D003657:Decision Making; D004192:Discrimination, Psychological; D005260:Female; D006801:Humans; D008297:Male; D009039:Motion Perception; D009042:Motivation; D010364:Pattern Recognition, Visual; D011214:Practice, Psychological; D011337:Probability Learning; D011601:Psychophysics; D011930:Reaction Time; D012201:Reward; D035501:Uncertainty; D055815:Young Adult
J Exp Psychol Hum Percept Perform. 2009 Dec;35(6):1865-97
19968441
J Math Psychol. 2010 Apr 1;54(2):230-246
23180885
Psychol Aging. 2010 Jun;25(2):377-90
20545422
Q J Exp Psychol (Hove). 2010 May;63(5):863-91
19746300
J Exp Psychol Anim Behav Process. 1998 Jan;24(1):15-33
9438963
Behav Res Methods. 2008 Feb;40(1):61-72
18411528
Psychol Rev. 2006 Oct;113(4):700-65
17014301
Neuron. 2002 Oct 10;36(2):299-308
12383783
Psychol Rev. 2004 Apr;111(2):333-67
15065913
Curr Dir Psychol Sci. 2009;18(6):321-326
20485453
Proc Natl Acad Sci U S A. 2009 Feb 17;106(7):2459-63
19188592
Psychon Bull Rev. 2009 Dec;16(6):1026-36
19966251
Psychon Bull Rev. 2006 Aug;13(4):636-42
17201363
Spat Vis. 1997;10(4):437-42
9176953
J Exp Psychol Learn Mem Cogn. 1998 Nov;24(6):1459-82
9835061
Spat Vis. 1997;10(4):433-6
9176952
Q J Exp Psychol B. 1991 Feb;43(1):59-81
2017575