title: Toward FRP-Based Brain-Machine Interfaces-Single-Trial Classification of Fixation-Related Potentials.
abstract: The co-registration of eye tracking and electroencephalography provides a holistic measure of ongoing cognitive processes. Recently, fixation-related potentials have been introduced to quantify the neural activity in such bi-modal recordings. Fixation-related potentials are time-locked to fixation onsets, just like event-related potentials are locked to stimulus onsets. Compared to existing electroencephalography-based brain-machine interfaces that depend on visual stimuli, fixation-related potentials have the advantages that they can be used in free, unconstrained viewing conditions and can also be classified on a single-trial level. Thus, fixation-related potentials have the potential to allow for conceptually different brain-machine interfaces that directly interpret cortical activity related to the visual processing of specific objects. However, existing research has investigated fixation-related potentials only with very restricted and highly unnatural stimuli in simple search tasks while participant's body movements were restricted. We present a study where we relieved many of these restrictions while retaining some control by using a gaze-contingent visual search task. In our study, participants had to find a target object out of 12 complex and everyday objects presented on a screen while the electrical activity of the brain and eye movements were recorded simultaneously. Our results show that our proposed method for the classification of fixation-related potentials can clearly discriminate between fixations on relevant, non-relevant and background areas. Furthermore, we show that our classification approach generalizes not only to different test sets from the same participant, but also across participants. These results promise to open novel avenues for exploiting fixation-related potentials in electroencephalography-based brain-machine interfaces and thus providing a novel means for intuitive human-machine interaction.
authors.affiliation: Center of Excellence Cognitive Interaction Technology CITEC, Bielefeld University, Bielefeld, Germany.|Neuroinformatics Group, Technical Faculty, Bielefeld University, Bielefeld, Germany.
authors.forename: Andrea
authors.initials: A
authors.lastname: Finke
authors.affiliation: Center of Excellence Cognitive Interaction Technology CITEC, Bielefeld University, Bielefeld, Germany.|Neurocognition and Action Group, Faculty of Psychology, Bielefeld University, Bielefeld, Germany.
authors.forename: Kai
authors.initials: K
authors.lastname: Essig
authors.affiliation: Neuroinformatics Group, Technical Faculty, Bielefeld University, Bielefeld, Germany.|Department of Computer Science, Verona University, Verona, Italy.
authors.forename: Giuseppe
authors.initials: G
authors.lastname: Marchioro
authors.affiliation: Center of Excellence Cognitive Interaction Technology CITEC, Bielefeld University, Bielefeld, Germany.|Neuroinformatics Group, Technical Faculty, Bielefeld University, Bielefeld, Germany.
authors.forename: Helge
authors.initials: H
authors.lastname: Ritter
mesh_terms: D000328:Adult; D062207:Brain-Computer Interfaces; D004569:Electroencephalography; D005071:Evoked Potentials; D005260:Female; D006801:Humans; D008297:Male; D055815:Young Adult
references.citation: Stat Appl Genet Mol Biol. 2005;4:Article32
references.pmid: 16646851
references.citation: Science. 1979 Oct 26;206(4417):468-9
references.pmid: 504987
references.citation: J Neural Eng. 2005 Dec;2(4):123-30
references.pmid: 16317236
references.citation: Psychophysiology. 1993 Jan;30(1):98-119
references.pmid: 8416067
references.citation: J Neural Eng. 2011 Jun;8(3):036020
references.pmid: 21555847
references.citation: J Neurosci Methods. 2012 Jun 30;208(1):59-65
references.pmid: 22580222
references.citation: Electroencephalogr Clin Neurophysiol. 1988 Dec;70(6):510-23
references.pmid: 2461285
references.citation: Clin Neurophysiol. 2007 Oct;118(10):2128-48
references.pmid: 17573239
references.citation: Front Syst Neurosci. 2013 Jul 10;7:28
references.pmid: 23847477
references.citation: J Exp Psychol Hum Percept Perform. 2004 Aug;30(4):720-32
references.pmid: 15301620
references.citation: J Exp Psychol Gen. 2011 Nov;140(4):552-72
references.pmid: 21744985
references.citation: Percept Psychophys. 1979 Feb;25(2):119-25
references.pmid: 432096
references.citation: Cognition. 2001 Sep;81(2):B57-67
references.pmid: 11376644
references.citation: Neural Netw. 2009 Nov;22(9):1329-33
references.pmid: 19635654
references.citation: PLoS One. 2014;9(2):e87347
references.pmid: 24551055
references.citation: J Exp Psychol Gen. 2006 Feb;135(1):12-35
references.pmid: 16478314
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2016 Jun;24(6):692-9
references.pmid: 26469340
references.citation: J Neural Eng. 2014 Jun;11(3):035013
references.pmid: 24836294
references.citation: J Neural Eng. 2014 Jun;11(3):035002
references.pmid: 24838215
references.citation: J Neurosci Methods. 2004 Mar 15;134(1):9-21
references.pmid: 15102499
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2008 Apr;16(2):121-30
references.pmid: 18403280
references.citation: Trends Cogn Sci. 2005 Apr;9(4):188-94
references.pmid: 15808501
references.citation: Psychol Sci. 2009 Jun;20(6):721-8
references.pmid: 19470124
references.citation: Motor Control. 2005 Jul;9(3):332-51
references.pmid: 16239719
references.citation: J Vis. 2013;13(3):17
references.pmid: 23863335