title: Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates.
abstract: The most widely used task functional magnetic resonance imaging (fMRI) analyses use parametric statistical methods that depend on a variety of assumptions. In this work, we use real resting-state data and a total of 3 million random task group analyses to compute empirical familywise error rates for the fMRI software packages SPM, FSL, and AFNI, as well as a nonparametric permutation method. For a nominal familywise error rate of 5%, the parametric statistical methods are shown to be conservative for voxelwise inference and invalid for clusterwise inference. Our results suggest that the principal cause of the invalid cluster inferences is spatial autocorrelation functions that do not follow the assumed Gaussian shape. By comparison, the nonparametric permutation test is found to produce nominal results for voxelwise as well as clusterwise inference. These findings speak to the need of validating the statistical methods being used in the field of neuroimaging.
authors.affiliation: Division of Medical Informatics, Department of Biomedical Engineering, Linköping University, S-581 85 Linköping, Sweden; Division of Statistics and Machine Learning, Department of Computer and Information Science, Linköping University, S-581 83 Linköping, Sweden; Center for Medical Image Science and Visualization, Linköping University, S-581 83 Linköping, Sweden; anders.eklund@liu.se.
authors.forename: Anders
authors.initials: A
authors.lastname: Eklund
authors.affiliation: Department of Statistics, University of Warwick, Coventry CV4 7AL, United Kingdom; WMG, University of Warwick, Coventry CV4 7AL, United Kingdom.
authors.forename: Thomas E
authors.initials: TE
authors.lastname: Nichols
authors.affiliation: Division of Medical Informatics, Department of Biomedical Engineering, Linköping University, S-581 85 Linköping, Sweden; Center for Medical Image Science and Visualization, Linköping University, S-581 83 Linköping, Sweden;
authors.forename: Hans
authors.initials: H
authors.lastname: Knutsson
mesh_terms: D005189:False Positive Reactions; D059907:Functional Neuroimaging; D006801:Humans; D008279:Magnetic Resonance Imaging; D013223:Statistics as Topic
keywords: cluster inference; fMRI; false positives; permutation test; statistics