title: Are reaction times obtained during fMRI scanning reliable and valid measures of behavior?
abstract: Assuming that behavior observed during functional magnetic resonance imaging (fMRI) is comparable with behavior outside the scanner appears to be a basic tenet in cognitive neuroscience. Nevertheless, this assumption has rarely been tested directly. Here, we examined the reliability and validity of speeded performance during fMRI scanning by having the same 30 participants perform a battery of five reaction time (RT) tasks in two separate fMRI sessions and a standard laboratory (i.e., outside-scanner) session. Medium-to-high intra-class correlations between the three sessions showed that individual RT differences were conserved across sessions. Thus, for the range of tasks used, test-retest reliability and criterion validity of performance during scanning were satisfactory. Further, the pattern of between-task relations did not change within the scanner, attesting to the construct validity of performance measurements during scanning. In some tasks, however, RTs obtained from fMRI conditions were significantly shorter than those observed under normal laboratory conditions. In summary, RTs obtained during fMRI scanning appear to be largely reliable and valid measures of behavior. The observed RT speed-up during scanning might reflect task-specific interactions with a slightly different neuro-cognitive state, indicating some limits to generalizing brain-behavior relations observed with fMRI. These findings encourage further efforts in fMRI research to establish the external validity of within-scanner task performance.
authors.affiliation: Neuropsychology Section, Department of Neurology, Medical School, RWTH Aachen University, Universitätsklinikum Aachen, Pauwelsstr. 30, 52074, Aachen, Germany. Jan.Koten@gmx.de
authors.forename: Jan Willem
authors.initials: JW
authors.lastname: Koten
authors.forename: Robert
authors.initials: R
authors.lastname: Langner
authors.forename: Guilherme
authors.initials: G
authors.lastname: Wood
authors.forename: Klaus
authors.initials: K
authors.lastname: Willmes
mesh_terms: D000328:Adult; D001519:Behavior / Q000502:physiology*; D001921:Brain / Q000502:physiology*; D006801:Humans; D008279:Magnetic Resonance Imaging; D008297:Male; D008875:Middle Aged; D011930:Reaction Time / Q000502:physiology; D015203:Reproducibility of Results; D013647:Task Performance and Analysis; D055815:Young Adult
references.citation: Neuroimage. 2005 Oct 15;28(1):122-31
references.pmid: 16051501
references.citation: Neuroimage. 2006 Feb 1;29(3):1000-6
references.pmid: 16139527
references.citation: Neuroimage. 2003 Sep;20(1):572-7
references.pmid: 14527617
references.citation: Dev Neuropsychol. 2011;36(6):721-40
references.pmid: 21761995
references.citation: Neuroimage. 2010 Apr 15;50(3):1168-76
references.pmid: 20083206
references.citation: Neurology. 2003 Mar 25;60(6):969-75
references.pmid: 12654961
references.citation: Clin Neurophysiol. 2010 May;121(5):672-85
references.pmid: 20097609
references.citation: Psychol Bull. 2013 Jul;139(4):870-900
references.pmid: 23163491
references.citation: Neuroimage. 2008 May 15;41(1):130-44
references.pmid: 18375148
references.citation: Hum Brain Mapp. 2003 Jan;18(1):42-52
references.pmid: 12454911
references.citation: J Exp Psychol Hum Percept Perform. 2012 Apr;38(2):290-301
references.pmid: 22201469
references.citation: J Neurol Neurosurg Psychiatry. 2006 May;77(5):674-6
references.pmid: 16614033
references.citation: Sci Rep. 2011;1:130
references.pmid: 22355647
references.citation: J Cogn Neurosci. 2008 Aug;20(8):1443-53
references.pmid: 18303981
references.citation: Am J Psychiatry. 2001 Jun;158(6):955-8
references.pmid: 11384907
references.citation: Neuropsychobiology. 2004;50(1):108-18
references.pmid: 15179028
references.citation: Psychol Res. 2010 Sep;74(5):499-512
references.pmid: 20146071
references.citation: Neuropsychologia. 2010 Jul;48(9):2709-18
references.pmid: 20478320
references.citation: Science. 2009 Mar 27;323(5922):1737-40
references.pmid: 19325117
references.citation: Hum Brain Mapp. 2009 Dec;30(12):4033-47
references.pmid: 19492301