title: A review of multivariate methods for multimodal fusion of brain imaging data.
abstract: The development of various neuroimaging techniques is rapidly improving the measurements of brain function/structure. However, despite improvements in individual modalities, it is becoming increasingly clear that the most effective research approaches will utilize multi-modal fusion, which takes advantage of the fact that each modality provides a limited view of the brain. The goal of multi-modal fusion is to capitalize on the strength of each modality in a joint analysis, rather than a separate analysis of each. This is a more complicated endeavor that must be approached more carefully and efficient methods should be developed to draw generalized and valid conclusions from high dimensional data with a limited number of subjects. Numerous research efforts have been reported in the field based on various statistical approaches, e.g. independent component analysis (ICA), canonical correlation analysis (CCA) and partial least squares (PLS). In this review paper, we survey a number of multivariate methods appearing in previous multimodal fusion reports, mostly fMRI with other modality, which were performed with or without prior information. A table for comparing optimization assumptions, purpose of the analysis, the need of priors, dimension reduction strategies and input data types is provided, which may serve as a valuable reference that helps readers understand the trade-offs of the 7 methods comprehensively. Finally, we evaluate 3 representative methods via simulation and give some suggestions on how to select an appropriate method based on a given research.
authors: The Mind Research Network, Albuquerque, NM 87106, USA. Electronic address: jsui@mrn.org.
authors: Jing
authors: J
authors: Sui
authors: Dept. of CSEE, University of Maryland, Baltimore County, Baltimore, MD 21250, USA.
authors: Tülay
authors: T
authors: Adali
authors: The Mind Research Network, Albuquerque, NM 87106, USA.
authors: Qingbao
authors: Q
authors: Yu
authors: The Mind Research Network, Albuquerque, NM 87106, USA; Dept. of ECE, University of New Mexico, Albuquerque, NM 87131, USA.
authors: Jiayu
authors: J
authors: Chen
authors: The Mind Research Network, Albuquerque, NM 87106, USA; Dept. of ECE, University of New Mexico, Albuquerque, NM 87131, USA; Dept. of Psychiatry, Yale University, New Haven, CT 06519, USA.
authors: Vince D
authors: VD
authors: Calhoun
mesh_terms: D000818:Animals; D001921:Brain / Q000033:anatomy & histology* / Q000502:physiology*; D003627:Data Interpretation, Statistical; D059907:Functional Neuroimaging / Q000379:methods*; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D015999:Multivariate Analysis; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique