title: How to Build a Hybrid Neurofeedback Platform Combining EEG and fMRI.
abstract: Multimodal neurofeedback estimates brain activity using information acquired with more than one neurosignal measurement technology. In this paper we describe how to set up and use a hybrid platform based on simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), then we illustrate how to use it for conducting bimodal neurofeedback experiments. The paper is intended for those willing to build a multimodal neurofeedback system, to guide them through the different steps of the design, setup, and experimental applications, and help them choose a suitable hardware and software configuration. Furthermore, it reports practical information from bimodal neurofeedback experiments conducted in our lab. The platform presented here has a modular parallel processing architecture that promotes real-time signal processing performance and simple future addition and/or replacement of processing modules. Various unimodal and bimodal neurofeedback experiments conducted in our lab showed high performance and accuracy. Currently, the platform is able to provide neurofeedback based on electroencephalography and functional magnetic resonance imaging, but the architecture and the working principles described here are valid for any other combination of two or more real-time brain activity measurement technologies.
authors.affiliation: Institut National de Recherche en Informatique et en Automatique (INRIA) Rennes, France.
authors.forename: Marsel
authors.initials: M
authors.lastname: Mano
authors.affiliation: Institut National de Recherche en Informatique et en Automatique (INRIA)Rennes, France; Institut de Recherche en Informatique et Systèmes Aléatoires (IIRISA)Rennes, France.
authors.forename: Anatole
authors.initials: A
authors.lastname: Lécuyer
authors.affiliation: Institut de Recherche en Informatique et Systèmes Aléatoires (IIRISA)Rennes, France; CHU PontchaillouRennes, France.
authors.forename: Elise
authors.initials: E
authors.lastname: Bannier
authors.affiliation: Institut National de Recherche en Informatique et en Automatique (INRIA) Rennes, France.
authors.forename: Lorraine
authors.initials: L
authors.lastname: Perronnet
authors.affiliation: Institut National de Recherche en Informatique et en Automatique (INRIA) Rennes, France.
authors.forename: Saman
authors.initials: S
authors.lastname: Noorzadeh
authors.affiliation: Institut National de Recherche en Informatique et en Automatique (INRIA)Rennes, France; Institut de Recherche en Informatique et Systèmes Aléatoires (IIRISA)Rennes, France; Institut National de la Santé et de la Recherche MédicaleRennes, France.
authors.forename: Christian
authors.initials: C
authors.lastname: Barillot
keywords: brain signals; electroencephalography; functional magnetic resonance imaging; multimodal; neurofeedback; real-time