Recognition ROCs are curvilinear-or are they? On premature arguments against the two-high-threshold model of recognition.
Recent reviews of recognition receiver operating characteristics (ROCs) claim that their curvilinear shape rules out threshold models of recognition. However, the shape of ROCs based on confidence ratings is not diagnostic to refute threshold models, whereas ROCs based on experimental bias manipulations are. Also, fitting predicted frequencies to actual data is a more sensitive method for model comparisons than ROC regressions. In a reanalysis of 59 published data sets, the 2-high-threshold model (2HTM) fit the data better than an unequal variance signal detection model in about half of the cases. Three recognition experiments with experimental bias manipulation were conducted that yielded linear ROCs and a better fit of the 2HTM in all cases. On the basis of actual data and a simulation, the authors argue that both models are at least equally valid as measurement tools and can perhaps be integrated theoretically.
Bröder
Arndt
A
Department of Psychology, University of Bonn, and Max Planck Institute for Research on Collective Goods, Bonn, Germany. broeder@uni-bonn.de
Schütz
Julia
J
D000293:Adolescent; D000328:Adult; D001288:Attention; D015982:Bias; D005260:Female; D006801:Humans; D016014:Linear Models; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical; D009042:Motivation; D011594:Psychometrics / Q000706:statistics & numerical data*; D012372:ROC Curve; D021641:Recognition, Psychology; D012054:Reinforcement, Psychology; D012153:Retention, Psychology; D012684:Sensory Thresholds; D017603:Signal Detection, Psychological; D014706:Verbal Learning; D055815:Young Adult