Equivalence of the statistics for replicability and area under the ROC curve.
Two statistics, one recent and one well known, are shown to be equivalent. The recent statistic, p(rep), gives the probability that the sign of an experimental effect is replicable by an experiment of equal power. That statistic is equivalent to the well-known measure for the area under a receiver operating characteristic (ROC) curve for statistical power against significance level. Both statistics can be seen as exemplifying the area theorem of psychophysics.
Irwin
R John
RJ
Department of Psychology, The University of Auckland, Auckland, New Zealand. rj.irwin@auckland.ac.nz
D006801:Humans; D011336:Probability; D011589:Psychology, Experimental / Q000706:statistics & numerical data*; D011594:Psychometrics / Q000706:statistics & numerical data; D012372:ROC Curve; D015203:Reproducibility of Results; D016008:Statistical Distributions