title: Zen and the art of multiple comparisons.
abstract: OBJECTIVE
  The need for appropriate multiple comparisons correction when performing statistical inference is not a new problem. However, it has come to the forefront in many new modern data-intensive disciplines. For example, researchers in areas such as imaging and genetics are routinely required to simultaneously perform thousands of statistical tests. Ignoring this multiplicity can cause severe problems with false positives, thereby introducing nonreproducible results into the literature.
  
  
  METHODS
  This article serves as an introduction to hypothesis testing and multiple comparisons for practical research applications, with a particular focus on its use in the analysis of functional magnetic resonance imaging data.
  
  
  RESULTS
  We discuss hypothesis testing and a variety of principled techniques for correcting for multiple tests. We also illustrate potential pitfalls problems that can occur if the multiple comparisons issue is not dealt with properly. We conclude, by discussing effect size estimation, an issue often linked with the multiple comparisons problem.
  
  
  CONCLUSIONS
  Failure to properly account for multiple comparisons will ultimately lead to heightened risks for false positives and erroneous conclusions.
authors: From the Department of Biostatistics, Johns Hopkins University, Baltimore, Maryland.
authors: Martin A
authors: MA
authors: Lindquist
authors: Amanda
authors: A
authors: Mejia
mesh_terms: D003627:Data Interpretation, Statistical; D005189:False Positive Reactions; D059907:Functional Neuroimaging; D006801:Humans; D008279:Magnetic Resonance Imaging; D012107:Research Design; D018401:Sample Size; D013223:Statistics as Topic / Q000379:methods*
references: Perspect Psychol Sci. 2009 May;4(3):310-3
references: 26158969
references: J Cereb Blood Flow Metab. 2010 Sep;30(9):1551-7
references: 20571517
references: J Cereb Blood Flow Metab. 1993 May;13(3):425-37
references: 8478401
references: Nat Rev Neurosci. 2013 May;14(5):365-76
references: 23571845
references: Perspect Psychol Sci. 2009 May;4(3):274-90
references: 26158964
references: Neuroimage. 2014 May 1;91:412-9
references: 24412399
references: Neuroimage. 2012 Jan 2;59(1):490-501
references: 21835242
references: Neuroimage. 2004;23 Suppl 1:S189-95
references: 15501088
references: PLoS Med. 2005 Aug;2(8):e124
references: 16060722
references: Proc Natl Acad Sci U S A. 2003 Aug 5;100(16):9440-5
references: 12883005
references: Soc Cogn Affect Neurosci. 2007 Jun;2(2):150-8
references: 18985131
references: Stat Methods Med Res. 2003 Oct;12(5):419-46
references: 14599004
references: Neuroimage. 2002 Apr;15(4):870-8
references: 11906227
references: Nat Neurosci. 2009 May;12(5):535-40
references: 19396166