title: A Simulation Framework for Benchmarking EEG-Based Brain Connectivity Estimation Methodologies.
abstract: Due to its high temporal resolution, electroencephalography (EEG) is widely used to study functional and effective brain connectivity. Yet, there is currently a mismatch between the vastness of studies conducted and the degree to which the employed analyses are theoretically understood and empirically validated. We here provide a simulation framework that enables researchers to test their analysis pipelines on realistic pseudo-EEG data. We construct a minimal example of brain interaction, which we propose as a benchmark for assessing a methodology's general eligibility for EEG-based connectivity estimation. We envision that this benchmark be extended in a collaborative effort to validate methods in more complex scenarios. Quantitative metrics are defined to assess a method's performance in terms of source localization, connectivity detection and directionality estimation. All data and code needed for generating pseudo-EEG data, conducting source reconstruction and connectivity estimation using baseline methods from the literature, evaluating performance metrics, as well as plotting results, are made publicly available. While this article covers only EEG modeling, we will also provide a magnetoencephalography version of our framework online.
authors.affiliation: Laboratory for Intelligent Imaging and Neural Computing, Columbia University, New York, NY, 10027, USA. stefan.haufe@tu-berlin.de.|Machine Learning Department, Technische Universität Berlin, 10587, Berlin, Germany. stefan.haufe@tu-berlin.de.
authors.forename: Stefan
authors.initials: S
authors.lastname: Haufe
authors.affiliation: Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
authors.forename: Arne
authors.initials: A
authors.lastname: Ewald
mesh_terms: D019985:Benchmarking; D001921:Brain; D001931:Brain Mapping / Q000379:methods*; D003198:Computer Simulation; D004569:Electroencephalography / Q000379:methods*; D006801:Humans; D008959:Models, Neurological
keywords: Benchmark; Brain connectivity; EEG; MEG; Open source; Simulation; Validation