title: Comparison of statistical tests for group differences in brain functional networks.
abstract: Brain functional connectivity has been studied by analyzing time series correlations in regional brain activities based on resting-state fMRI data. Brain functional connectivity can be depicted as a network or graph defined as a set of nodes linked by edges. Nodes represent brain regions and an edge measures the strength of functional correlation between two regions. Most of existing work focuses on estimation of such a network. A key but inadequately addressed question is how to test for possible differences of the networks between two subject groups, say between healthy controls and patients. Here we illustrate and compare the performance of several state-of-the-art statistical tests drawn from the neuroimaging, genetics, ecology and high-dimensional data literatures. Both real and simulated data were used to evaluate the methods. We found that Network Based Statistic (NBS) performed well in many but not all situations, and its performance critically depends on the choice of its threshold parameter, which is unknown and difficult to choose in practice. Importantly, two adaptive statistical tests called adaptive sum of powered score (aSPU) and its weighted version (aSPUw) are easy to use and complementary to NBS, being higher powered than NBS in some situations. The aSPU and aSPUw tests can also be applied to adjust for covariates. Between the aSPU and aSPUw tests, they often, but not always, performed similarly with neither one as a uniform winner. On the other hand, Multivariate Matrix Distance Regression (MDMR) has been applied to detect group differences for brain connectivity; with the usual choice of the Euclidean distance, MDMR is a special case of the aSPU test. Consequently NBS, aSPU and aSPUw tests are recommended to test for group differences in functional connectivity.
authors.affiliation: Division of Biostatistics, University of Minnesota, USA.
authors.forename: Junghi
authors.initials: J
authors.lastname: Kim
authors.affiliation: Department of Psychiatry, University of Minnesota, USA.
authors.forename: Jeffrey R
authors.initials: JR
authors.lastname: Wozniak
authors.affiliation: Department of Psychiatry, University of Minnesota, USA.
authors.forename: Bryon A
authors.initials: BA
authors.lastname: Mueller
authors.affiliation: School of Statistics, University of Minnesota, USA.
authors.forename: Xiaotong
authors.initials: X
authors.lastname: Shen
authors.affiliation: Division of Biostatistics, University of Minnesota, USA. Electronic address: weip@biostat.umn.edu.
authors.forename: Wei
authors.initials: W
authors.lastname: Pan
mesh_terms: D000293:Adolescent; D001921:Brain / Q000502:physiology*; D002648:Child; D003198:Computer Simulation; D063132:Connectome / Q000379:methods*; D003627:Data Interpretation, Statistical; D063647:Fetal Alcohol Spectrum Disorders / Q000503:physiopathology; D006801:Humans; D008279:Magnetic Resonance Imaging; D009415:Nerve Net / Q000502:physiology*
keywords: Brain network connectivity; High dimensional data; Neuroimaging; Statistical power; aSPU test; rs-fMRI
references.citation: Brain Connect. 2013;3(4):339-52
references.pmid: 23705677
references.citation: Nature. 1998 Jun 4;393(6684):440-2
references.pmid: 9623998
references.citation: Neuroimage. 2014 Aug 1;96:309-25
references.pmid: 24704269
references.citation: Am J Hum Genet. 2006 Nov;79(5):792-806
references.pmid: 17033957
references.citation: Neuroimage. 2014 Jun;93 Pt 1:74-94
references.pmid: 24583255
references.citation: Genetics. 2014 Aug;197(4):1081-95
references.pmid: 24831820
references.citation: Front Syst Neurosci. 2010 Jun 17;4:22
references.pmid: 20592949
references.citation: Nat Rev Neurosci. 2009 Mar;10(3):186-98
references.pmid: 19190637
references.citation: Neuroimage. 2011 Jan 15;54(2):875-91
references.pmid: 20817103
references.citation: Front Genet. 2012 Sep 27;3:190
references.pmid: 23060897
references.citation: Neurobiol Aging. 2014 Apr;35(4):757-68
references.pmid: 24216223
references.citation: Brain Connect. 2011;1(2):99-103
references.pmid: 22433005
references.citation: Biometrics. 2015 Sep;71(3):812-20
references.pmid: 25939365
references.citation: Phys Rev Lett. 2001 Nov 5;87(19):198701
references.pmid: 11690461
references.citation: Proc Natl Acad Sci U S A. 2009 Feb 10;106(6):2035-40
references.pmid: 19188601
references.citation: PLoS One. 2011;6(8):e23009
references.pmid: 21829681
references.citation: Front Syst Neurosci. 2012 Aug 30;6:61
references.pmid: 22969709
references.citation: J Am Stat Assoc. 2010 Mar 1;105(489):401-414
references.pmid: 21152360
references.citation: Neuroimage. 2012 Nov 1;63(2):858-73
references.pmid: 22800732
references.citation: Biometrics. 2010 Jun;66(2):636-43
references.pmid: 19673867
references.citation: Neuroimage. 2010 Dec;53(4):1197-207
references.pmid: 20600983
references.citation: Genet Epidemiol. 2011 May;35(4):211-6
references.pmid: 21308765
references.citation: Neuroimage. 1999 Feb;9(2):179-94
references.pmid: 9931268
references.citation: Genet Epidemiol. 2009 Sep;33(6):497-507
references.pmid: 19170135
references.citation: Comput Biomed Res. 1996 Jun;29(3):162-73
references.pmid: 8812068
references.citation: Proc Natl Acad Sci U S A. 2006 Dec 19;103(51):19430-5
references.pmid: 17146048
references.citation: Alcohol Clin Exp Res. 2013 May;37(5):748-56
references.pmid: 23240997
references.citation: Curr Opin Neurol. 2010 Aug;23(4):341-50
references.pmid: 20581686
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Jun;71(6 Pt 2):065103
references.pmid: 16089800
references.citation: Neuroimage. 2010 Sep;52(3):1059-69
references.pmid: 19819337
references.citation: Proc Natl Acad Sci U S A. 2007 Jun 12;104(24):10240-5
references.pmid: 17548818
references.citation: Neuroimage. 2004;23 Suppl 1:S208-19
references.pmid: 15501092
references.citation: Brain. 2009 Sep;132(Pt 9):2413-25
references.pmid: 19389870
references.citation: Neural Netw. 2000 Oct-Nov;13(8-9):861-70
references.pmid: 11156197
references.citation: Neuroimage. 2013 Oct 15;80:144-68
references.pmid: 23702415
references.citation: Phys Rev Lett. 2006 Dec 8;97(23):238103
references.pmid: 17280251
references.citation: Neuroimage. 2010 Apr 15;50(3):935-49
references.pmid: 20079441
references.citation: Neuroimage. 2009 Oct 15;48(1):63-72
references.pmid: 19573611
references.citation: Hum Brain Mapp. 1994;1(3):210-20
references.pmid: 24578041
references.citation: Neuroimage. 2012 Apr 2;60(2):1055-62
references.pmid: 22273567
references.citation: Stat Appl Genet Mol Biol. 2005;4:Article32
references.pmid: 16646851
references.citation: Hum Brain Mapp. 2002 Jan;15(1):1-25
references.pmid: 11747097
references.citation: Neuroimage. 2013 Oct 15;80:405-15
references.pmid: 23583357
references.citation: Neuroimage. 2009 Mar;45(1 Suppl):S173-86
references.pmid: 19059349
references.citation: Biometrics. 2007 Dec;63(4):1079-88
references.pmid: 18078480
references.citation: Genet Epidemiol. 2011 Nov;35(7):606-19
references.pmid: 21769936
references.citation: Neuroimage. 2012 Jul 16;61(4):907-20
references.pmid: 22484408