title: Why more is better: Simultaneous modeling of EEG, fMRI, and behavioral data.
abstract: The need to test a growing number of theories in cognitive science has led to increased interest in inferential methods that integrate multiple data modalities. In this manuscript, we show how a method for integrating three data modalities within a single framework provides (1) more detailed descriptions of cognitive processes and (2) more accurate predictions of unobserved data than less integrative methods. Specifically, we show how combining either EEG and fMRI with a behavioral model can perform substantially better than a behavioral-data-only model in both generative and predictive modeling analyses. We then show how a trivariate model - a model including EEG, fMRI, and behavioral data - outperforms bivariate models in both generative and predictive modeling analyses. Together, these results suggest that within an appropriate modeling framework, more data can be used to better constrain cognitive theory, and to generate more accurate predictions for behavioral and neural data.
authors.affiliation: Department of Psychology, The Ohio State University, USA. Electronic address: turner.826@gmail.com.
authors.forename: Brandon M
authors.initials: BM
authors.lastname: Turner
authors.affiliation: Department of Psychology, Stanford University, USA.
authors.forename: Christian A
authors.initials: CA
authors.lastname: Rodriguez
authors.affiliation: Department of Psychology, Stanford University, USA.
authors.forename: Tony M
authors.initials: TM
authors.lastname: Norcia
authors.affiliation: Department of Psychology, Arizona State University, USA.
authors.forename: Samuel M
authors.initials: SM
authors.lastname: McClure
authors.affiliation: Department of Cognitive Science, University of California, Irvine, USA.
authors.forename: Mark
authors.initials: M
authors.lastname: Steyvers
mesh_terms: D001499:Bayes Theorem; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping / Q000379:methods*; D004569:Electroencephalography / Q000379:methods; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000379:methods; D008959:Models, Neurological
keywords: Bayesian modeling; EEG; Joint modeling framework; Linear Ballistic Accumulator model; fMRI