title: A statistically motivated framework for simulation of stochastic data fusion models applied to multimodal neuroimaging.
abstract: Multimodal fusion is becoming more common as it proves to be a powerful approach to identify complementary information from multimodal datasets. However, simulation of joint information is not straightforward. Published approaches mostly employ limited, provisional designs that often break the link between the model assumptions and the data for the sake of demonstrating properties of fusion techniques. This work introduces a new approach to synthetic data generation which allows full-compliance between data and model while still representing realistic spatiotemporal features in accordance with the current neuroimaging literature. The focus is on the simulation of joint information for the verification of stochastic linear models, particularly those used in multimodal data fusion of brain imaging data. Our first goal is to obtain a benchmark ground-truth in which estimation errors due to model mismatch are minimal or none. Then we move on to assess how estimation is affected by gradually increasing model discrepancies toward a more realistic dataset. The key aspect of our approach is that it permits complete control over the type and level of model mismatch, allowing for more educated inferences about the limitations and caveats of select stochastic linear models. As a result, impartial comparison of models is possible based on their performance in multiple different scenarios. Our proposed method uses the commonly overlooked theory of copulas to enable full control of the type and level of dependence/association between modalities, with no occurrence of spurious multimodal associations. Moreover, our approach allows for arbitrary single-modality marginal distributions for any fixed choice of dependence/association between multimodal features. Using our simulation framework, we can rigorously challenge the assumptions of several existing multimodal fusion approaches. Our study brings a new perspective to the problem of simulating multimodal data that can be used for ground-truth verification of various stochastic multimodal models available in the literature, and reveals some important aspects that are not captured or are overlooked by ad hoc simulations that lack a firm statistical motivation.
authors.affiliation: The Mind Research Network, 1101 Yale Blvd., Albuquerque, NM 87106, USA; Department of ECE, MSC01 1100, 1 University of New Mexico, Albuquerque, NM 87131, USA. Electronic address: rsilva@mrn.org.
authors.forename: Rogers F
authors.initials: RF
authors.lastname: Silva
authors.affiliation: The Mind Research Network, 1101 Yale Blvd., Albuquerque, NM 87106, USA. Electronic address: splis@mrn.org.
authors.forename: Sergey M
authors.initials: SM
authors.lastname: Plis
authors.affiliation: Department of CSEE, University of Maryland Baltimore County, 1000 Hilltop Circle, Baltimore, MD 21250, USA. Electronic address: adali@umbc.edu.
authors.forename: Tülay
authors.initials: T
authors.lastname: Adalı
authors.affiliation: The Mind Research Network, 1101 Yale Blvd., Albuquerque, NM 87106, USA; Department of ECE, MSC01 1100, 1 University of New Mexico, Albuquerque, NM 87131, USA; Department of CS, MSC01 1130, 1 University of New Mexico, Albuquerque, NM 87131, USA. Electronic address: vcalhoun@unm.edu.
authors.forename: Vince D
authors.initials: VD
authors.lastname: Calhoun
mesh_terms: D003198:Computer Simulation; D006801:Humans; D008959:Models, Neurological; D064847:Multimodal Imaging; D059906:Neuroimaging; D013269:Stochastic Processes
keywords: Copula; Fusion; ICA; Multidimensional; Multimodal; Simulation; Stochastic
references.citation: Hum Brain Mapp. 2006 Jul;27(7):598-610
references.pmid: 16342150
references.citation: Neuroimage. 2004 Jul;22(3):1214-22
references.pmid: 15219593
references.citation: J Neurosci Methods. 2012 Feb 15;204(1):68-81
references.pmid: 22108139
references.citation: Hum Brain Mapp. 2007 Nov;28(11):1251-66
references.pmid: 17274023
references.citation: Neuroimage. 2010 May 1;50(4):1438-45
references.pmid: 20100584
references.citation: Hum Brain Mapp. 1998;6(3):160-88
references.pmid: 9673671
references.citation: Symmetry (Basel). 2011 Aug 23;3(3):574-599
references.pmid: 22685629
references.citation: Hum Brain Mapp. 2010 Jul;31(7):1076-88
references.pmid: 20017117
references.citation: Magn Reson Imaging. 1999 Jul;17(6):795-815
references.pmid: 10402587
references.citation: IEEE J Sel Top Signal Process. 2008 Dec 1;2(6):998-1007
references.pmid: 19834573
references.citation: PLoS One. 2013 Aug 29;8(8):e73309
references.pmid: 24009746
references.citation: Magn Reson Med. 2001 Feb;45(2):323-30
references.pmid: 11180440
references.citation: Neuroimage. 2012 Feb 15;59(4):4141-59
references.pmid: 22019879
references.citation: Hum Brain Mapp. 2001 Nov;14(3):140-51
references.pmid: 11559959
references.citation: Proc Natl Acad Sci U S A. 2009 Jun 30;106(26):10415-22
references.pmid: 19556548
references.citation: Neuroimage. 2011 Aug 1;57(3):839-55
references.pmid: 21640835
references.citation: IEEE Eng Med Biol Mag. 2006 Mar-Apr;25(2):79-90
references.pmid: 16568940
references.citation: Neuroimage. 2012 Feb 15;59(4):4160-7
references.pmid: 22178299
references.citation: Hum Brain Mapp. 2009 Sep;30(9):2953-70
references.pmid: 19172631
references.citation: Neuroimage. 2013 Apr 1;69:157-97
references.pmid: 23194820
references.citation: J Cereb Blood Flow Metab. 1991 Mar;11(2):A121-35
references.pmid: 1997480
references.citation: Conf Proc IEEE Eng Med Biol Soc. 2006;2006:3672-5
references.pmid: 17946195
references.citation: Neuroimage. 2011 Feb 1;54(3):2198-217
references.pmid: 20932919
references.citation: Neuroimage. 2010 May 15;51(1):123-34
references.pmid: 20114081
references.citation: IEEE Trans Signal Process. 2009 Oct 1;57(10):3918-3929
references.pmid: 20221319
references.citation: IEEE Trans Pattern Anal Mach Intell. 2005 Aug;27(8):1226-38
references.pmid: 16119262