title: Where is the criterion noise in recognition? (Almost) everyplace you look: comment on Kellen, Klauer, and Singmann (2012).
abstract: Recent articles, including Benjamin, Diaz, and Wee (2009), have argued that recognition memory may be better understood if consideration is given to sources of noise in the decisions, as well as to those in the representations, underlying recognition judgments. They based that conclusion on a wide consideration of persisting mysteries in recognition research as well as a new experimental paradigm involving ensemble recognition. Kellen, Klauer, and Singmann (2012) reanalyzed Benjamin et al.'s data and introduced their own new experimental paradigm to this debate. They concluded that criteria do not vary much from trial to trial in recognition testing and, thus, that decision noise in recognition is small or nonexistent. However, their alternative interpretation of Benjamin et al.'s data relies on a questionable conclusion to reject all models in which the locations of criteria are restricted to be the same across ensembles and a meta-assumption that a model should be rejected as false if it yields unconventional parameters. In addition, their experimental logic relies on the assumption that ranking tasks are always bias-free. Here, I question these assumptions and suggest avenues for reconciliation between these contrasting claims.
authors.affiliation: Department of Psychology, University of Illinois at Urbana-Champaign, 603 East Daniel Street, Champaign, IL 61820, USA. asbenjam@illinois.edu
authors.forename: Aaron S
authors.initials: AS
authors.lastname: Benjamin
mesh_terms: D003657:Decision Making; D006801:Humans; D015233:Models, Statistical; D011582:Psychological Theory; D021641:Recognition, Psychology; D017603:Signal Detection, Psychological
references.citation: Percept Psychophys. 1994 Feb;55(2):162-79
references.pmid: 8036098
references.citation: Psychol Rev. 2010 Oct;117(4):1025-54
references.pmid: 20836613
references.citation: J Exp Psychol Hum Percept Perform. 1983 Apr;9(2):299-309
references.pmid: 6221074
references.citation: J Appl Psychol. 2004 Apr;89(2):362-8
references.pmid: 15065981
references.citation: Mem Cognit. 2005 Mar;33(2):261-9
references.pmid: 16028581
references.citation: Psychon Bull Rev. 2008 Jun;15(3):465-94
references.pmid: 18567246
references.citation: J Exp Psychol Learn Mem Cogn. 1995 Mar;21(2):302-13
references.pmid: 7738502
references.citation: J Exp Psychol Learn Mem Cogn. 2008 May;34(3):703-11
references.pmid: 18444767
references.citation: Mem Cognit. 1978 Sep;6(5):544-53
references.pmid: 24203388
references.citation: J Exp Psychol Learn Mem Cogn. 2000 May;26(3):582-600
references.pmid: 10855419
references.citation: J Exp Anal Behav. 2011 Sep;96(2):155-76
references.pmid: 21909162
references.citation: J Exp Psychol Learn Mem Cogn. 2001 Jul;27(4):941-7
references.pmid: 11486927
references.citation: J Exp Psychol Hum Percept Perform. 1995 Oct;21(5):1088-97
references.pmid: 7595244
references.citation: Mem Cognit. 2007 Mar;35(2):254-62
references.pmid: 17645166
references.citation: Psychol Bull. 1966 Sep;66(3):228-34
references.pmid: 5954898
references.citation: J Exp Psychol Learn Mem Cogn. 1998 Nov;24(6):1397-410
references.pmid: 9835060
references.citation: J Exp Psychol Gen. 2012 May;141(2):233-59
references.pmid: 21928922
references.citation: J Exp Psychol Learn Mem Cogn. 2004 May;30(3):615-25
references.pmid: 15099130
references.citation: Psychol Rev. 2009 Jan;116(1):84-115
references.pmid: 19159149
references.citation: Psychol Rev. 2012 Jul;119(3):457-79
references.pmid: 22468607
references.citation: Percept Psychophys. 2001 Nov;63(8):1421-55
references.pmid: 11800466
references.citation: Psychon Bull Rev. 2004 Aug;11(4):616-41
references.pmid: 15581116
references.citation: J Acoust Soc Am. 1969 Aug;46(2):372-83
references.pmid: 5804107
references.citation: Psychol Rev. 1966 Jan;73(1):44-58
references.pmid: 5324567
references.citation: Psychon Bull Rev. 2008 Aug;15(4):692-712
references.pmid: 18792497
references.citation: Psychol Rev. 2007 Jan;114(1):152-76
references.pmid: 17227185
references.citation: J Exp Psychol Learn Mem Cogn. 2009 Sep;35(5):1123-36
references.pmid: 19686009
references.citation: J Exp Psychol Learn Mem Cogn. 2002 Nov;28(6):1095-110
references.pmid: 12450335
references.citation: Percept Psychophys. 1993 Jan;53(1):49-70
references.pmid: 8433906
references.citation: Psychon Bull Rev. 2005 Jun;12(3):403-8
references.pmid: 16235625
references.citation: Psychol Rev. 2010 Oct;117(4):1055-79
references.pmid: 20822289