title: Mental chronometry and individual differences: modeling reliabilities and correlations of reaction time means and effect sizes.
abstract: We used a general stage-based model of reaction time (RT) to investigate the psychometric properties of mean RTs and experimental effect sizes (i.e., differences in mean RTs). Using the model, formulas were derived for the reliabilities of mean RTs and RT difference scores, and these formulas provide guidance about the number of trials per participant needed to obtain reliable estimates of these measures. In addition, formulas were derived for various different types of correlations computed in RT research (e.g., correlations between a mean RT and an external non-RT measure, between two mean RTs, between a mean RT and an RT effect size). The analysis revealed that observed RT-based correlations depend on many parameters of the underlying processes contributing to RT. We conclude that these correlations often fail to support the inferences drawn from them and that their proper interpretation is far more complex than is generally acknowledged.
authors: Department of Psychology, University of Otago, PO Box 56, Dunedin, 9054, New Zealand, miller@psy.otago.ac.nz.
authors: Jeff
authors: J
authors: Miller
authors: Rolf
authors: R
authors: Ulrich
mesh_terms: D006801:Humans; D007206:Individuality; D008960:Models, Psychological; D011594:Psychometrics / Q000706:statistics & numerical data*; D011930:Reaction Time / Q000502:physiology*; D015203:Reproducibility of Results
references: Neuropsychology. 2006 Mar;20(2):178-84
references: 16594778
references: Br J Clin Psychol. 2004 Jun;43(Pt 2):211-215
references: 15169619
references: Acta Psychol (Amst). 2010 Jun;134(2):154-61
references: 20185118
references: J Exp Psychol Hum Percept Perform. 1976 Nov;2(4):503-14
references: 1010999
references: Neuropsychology. 2010 Sep;24(5):637-51
references: 20804252
references: Psychol Res. 2009 Nov;73(6):762-76
references: 19034502
references: Percept Mot Skills. 2001 Feb;92(1):11-8
references: 11322574
references: J Soc Psychol. 1948 Aug;28:103-20
references: 18893217
references: Neuropsychologia. 2002;40(4):423-34
references: 11684175
references: Curr Biol. 1993 Feb;3(2):79-81
references: 15335798
references: Psychol Bull. 1994 Sep;116(2):220-44
references: 7972591
references: J Exp Anal Behav. 2007 Nov;88(3):319-37
references: 18047224
references: Psychol Bull. 1985 Jul;98(1):67-83
references: 4034819
references: Acta Psychol (Amst). 1997 Jun;96(1-2):83-101
references: 9210852
references: Psychol Bull. 1968 Feb;69(2):77-110
references: 4867597
references: J Gerontol. 1994 Mar;49(2):P65-71
references: 8126361
references: Psychol Aging. 2001 Mar;16(1):47-54
references: 11302367
references: Acta Psychol (Amst). 1995 Nov;90(1-3):11-28
references: 8525866
references: Psychol Aging. 2009 Dec;24(4):841-57
references: 20025400
references: Psychol Bull. 1991 Mar;109(2):163-203
references: 2034749
references: Br J Clin Psychol. 1997 Sep;36(3):365-76
references: 9309352
references: J Acoust Soc Am. 2001 Apr;109(4):1464-73
references: 11325118
references: Psychol Aging. 2006 Mar;21(1):62-73
references: 16594792
references: Dev Psychol. 2011 May;47(3):877-85
references: 21142364
references: Vision Res. 2004 Jun;44(12):1297-320
references: 15066392
references: Ann N Y Acad Sci. 1993 Nov 17;702:103-29
references: 8109872
references: PLoS Biol. 2006 Jul;4(7):e220
references: 16787105
references: J Neurol Sci. 1994 Nov;126(2):168-71
references: 7853023
references: Psychol Bull. 1999 Nov;125(6):777-99
references: 10589302
references: Neuropsychologia. 2010 Aug;48(10):3128-36
references: 20600181
references: Stat Methodol. 2010 May 1;7(3):277-291
references: 20526445
references: Neuropsychologia. 2000;38(4):380-7
references: 10683389
references: J Exp Psychol Hum Percept Perform. 2012 Apr;38(2):414-28
references: 22250865
references: Psychol Res. 2012 Nov;76(6):777-91
references: 21909980
references: Psychophysiology. 1986 Jan;23(1):57-61
references: 3945708
references: Acta Psychol (Amst). 1994 Aug;86(2-3):295-325
references: 7976470
references: J Exp Psychol Gen. 2007 Aug;136(3):414-29
references: 17696691
references: Cogn Affect Behav Neurosci. 2011 Jun;11(2):159-71
references: 21264645
references: Cognition. 2012 Mar;122(3):426-41
references: 22197060
references: Q J Exp Psychol A. 1985 Nov;37(4):571-90
references: 4081101
references: Psychol Rev. 2007 Jul;114(3):830-41
references: 17638508
references: J Exp Psychol Hum Percept Perform. 2011 Feb;37(1):85-99
references: 20718567
references: J Exp Psychol Hum Percept Perform. 1997 Jun;23(3):632-50
references: 9180038
references: Percept Mot Skills. 1995 Jun;80(3 Pt 2):1243-9
references: 7478883
references: J Gerontol. 1994 Mar;49(2):P81-9
references: 8126363
references: Acta Psychol (Amst). 2001 Jan;106(1-2):147-246
references: 11256336
references: J Exp Psychol. 1968 Sep;78(1):38-45
references: 5682964
references: Neuropsychologia. 2004;42(2):257-71
references: 14644111
references: Proc Natl Acad Sci U S A. 1998 Feb 3;95(3):781-7
references: 9448241
references: J Pers Soc Psychol. 1998 Jun;74(6):1464-80
references: 9654756
references: J Math Psychol. 2000 Sep;44(3):408-463
references: 10973778
references: Neuropsychologia. 2000;38(5):535-41
references: 10689031
references: J Neurosci. 2008 Sep 24;28(39):9790-6
references: 18815263
references: Neuropsychologia. 2004;42(4):419-25
references: 14728916
references: J Abnorm Psychol. 2002 Nov;111(4):648-658
references: 12428778
references: Front Hum Neurosci. 2010 Mar 08;4:10
references: 20300463
references: Psychol Rev. 2005 Jan;112(1):117-28
references: 15631590
references: Psychol Rev. 2004 Apr;111(2):333-67
references: 15065913
references: J Cogn Neurosci. 2002 Apr 1;14(3):340-7
references: 11970796
references: Mem Cognit. 1976 Nov;4(6):661-72
references: 21286995
references: Pers Soc Psychol Bull. 2005 Oct;31(10):1369-85
references: 16143669
references: Assessment. 2008 Jun;15(2):145-52
references: 18463405
references: Psychol Rev. 1991 Apr;98(2):268-94
references: 2047514
references: J Pers Soc Psychol. 1988 Feb;54(2):274-90
references: 3346814
references: Psychophysiology. 1983 Mar;20(2):168-79
references: 6844516
references: Exp Psychol. 2007;54(1):14-29
references: 17341011
references: Clin Neurophysiol. 2004 Sep;115(9):2164-74
references: 15294220
references: J Pers Soc Psychol. 2003 Aug;85(2):197-216
references: 12916565
references: Cogn Psychol. 2002 May;44(3):193-251
references: 11971632
references: J Pers Soc Psychol. 2002 Jul;83(1):44-59
references: 12088131
references: Psychol Rev. 1985 Apr;92(2):137-72
references: 3887449
references: Cognition. 2011 Jun;119(3):381-93
references: 21420077
references: Psychon Bull Rev. 2003 Mar;10(1):224-37
references: 12747512
references: Ergonomics. 1970 Jan;13(1):37-58
references: 5416868
references: J Exp Psychol Hum Percept Perform. 1994 Apr;20(2):219-34
references: 8189189
references: Psychon Bull Rev. 2000 Mar;7(1):1-25
references: 10780018
references: Acta Psychol (Amst). 1986 Aug;62(3):237-61
references: 3766199
references: J Exp Psychol Hum Percept Perform. 2003 Feb;29(1):3-18
references: 12669744
references: J Pers. 2007 Oct;75(5):985-1006
references: 17760854
references: Psychon Bull Rev. 1996 Dec;3(4):458-80
references: 24213979
references: Cogn Psychol. 2003 Mar;46(2):101-51
references: 12643892
references: Psychol Rev. 2001 Jul;108(3):550-92
references: 11488378
references: Atten Percept Psychophys. 2011 May;73(4):1096-107
references: 21264741
references: Psychol Sci. 2003 May;14(3):287-90
references: 12741756