Accuracy and stability of metacognitive monitoring: a new measure.
An examination of gamma (gamma; Goodman & Kruskal, 1954) and the Hamann coefficient (HC; see Schraw, 1995) as a measure of feeling-of-knowing (FOK) accuracy in the prediction of subsequent memory performance shows that neither coefficient provides a pure measure of accuracy in 2 (feeling-of-not-knowing and FOK) x 2 (correct and incorrect recognition) cases. gamma underestimated accuracy in the m x 2 case with m being an integer larger than 2, producing low and unstable values of gamma. In the present study, FOK predictive accuracy is treated as the extent to which the percentage of correct recognition can be increased by an increase from one FOK rank to another. A statistic computing the relative magnitude of the percentage increase to its maximal increase, designated as C, is able to provide a correct estimate of accuracy. Furthermore, the value of C is stable across different portions of FOK data and is free from restricted-/truncated-range and fineness/coarseness effects.
Cheng
Chao-Ming
CM
Department of Psychology, Fo Guang University, 160, Linwei Road, Jiaosi, Yi-Lan County 25247, Taiwan. cmcheng@ntu.edu.tw
D000465:Algorithms; D003071:Cognition / Q000502:physiology*; D003627:Data Interpretation, Statistical; D005544:Forecasting; D006801:Humans; D019359:Knowledge; D008568:Memory / Q000502:physiology; D011237:Predictive Value of Tests; D011597:Psychomotor Performance / Q000502:physiology*; D021641:Recognition, Psychology / Q000502:physiology; D015203:Reproducibility of Results