title: Should metacognition be measured by logistic regression?
abstract: Are logistic regression slopes suitable to quantify metacognitive sensitivity, i.e. the efficiency with which subjective reports differentiate between correct and incorrect task responses? We analytically show that logistic regression slopes are independent from rating criteria in one specific model of metacognition, which assumes (i) that rating decisions are based on sensory evidence generated independently of the sensory evidence used for primary task responses and (ii) that the distributions of evidence are logistic. Given a hierarchical model of metacognition, logistic regression slopes depend on rating criteria. According to all considered models, regression slopes depend on the primary task criterion. A reanalysis of previous data revealed that massive numbers of trials are required to distinguish between hierarchical and independent models with tolerable accuracy. It is argued that researchers who wish to use logistic regression as measure of metacognitive sensitivity need to control the primary task criterion and rating criteria.
authors.affiliation: Katholische Universität Eichstätt-Ingolstadt, Eichstätt, Germany; Ludwig-Maximilians-Universität München, Munich, Germany. Electronic address: manuel.rausch@ku.de.
authors.forename: Manuel
authors.initials: M
authors.lastname: Rausch
authors.affiliation: Katholische Universität Eichstätt-Ingolstadt, Eichstätt, Germany; Ludwig-Maximilians-Universität München, Munich, Germany.
authors.forename: Michael
authors.initials: M
authors.lastname: Zehetleitner
mesh_terms: D006801:Humans; D016015:Logistic Models; D000067489:Metacognition / Q000502:physiology*; D008962:Models, Theoretical; D009483:Neuropsychological Tests; D012044:Regression Analysis; D017603:Signal Detection, Psychological / Q000502:physiology*
keywords: Cognitive modeling; Generalized linear regression; Logistic regression; Metacognition; Metacognitive sensitivity; Signal detection theory; Type 2 signal detection theory