title: Toward high performance, weakly invasive brain computer interfaces using selective visual attention.
abstract: Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.
authors.affiliation: Institute for Theoretical Physics and Institute for Brain Research, University of Bremen, Bremen, Germany. davrot@neuro.uni-bremen.de
authors.forename: David
authors.initials: D
authors.lastname: Rotermund
authors.forename: Udo A
authors.initials: UA
authors.lastname: Ernst
authors.forename: Sunita
authors.initials: S
authors.lastname: Mandon
authors.forename: Katja
authors.initials: K
authors.lastname: Taylor
authors.forename: Yulia
authors.initials: Y
authors.lastname: Smiyukha
authors.forename: Andreas K
authors.initials: AK
authors.lastname: Kreiter
authors.forename: Klaus R
authors.initials: KR
authors.lastname: Pawelzik
mesh_terms: D000818:Animals; D001288:Attention / Q000502:physiology*; D001921:Brain / Q000502:physiology*; D062207:Brain-Computer Interfaces; D004192:Discrimination, Psychological / Q000502:physiology*; D004567:Electrodes, Implanted; D004569:Electroencephalography; D005071:Evoked Potentials; D008253:Macaca mulatta; D008297:Male; D010775:Photic Stimulation; D011930:Reaction Time
references.citation: Front Neurosci. 2011 Feb 07;5:5
references.pmid: 21369351
references.citation: Front Neuroeng. 2012 Jul 18;5:16
references.pmid: 22826698
references.citation: Trends Neurosci. 2006 Sep;29(9):536-46
references.pmid: 16859758
references.citation: Front Integr Neurosci. 2009 Sep 01;3:20
references.pmid: 19750199
references.citation: J Neurosci. 2009 Aug 12;29(32):10120-30
references.pmid: 19675246
references.citation: Science. 2009 May 29;324(5931):1207-10
references.pmid: 19478185
references.citation: J Neurosci. 1999 Mar 1;19(5):1736-53
references.pmid: 10024360
references.citation: Curr Opin Neurobiol. 2010 Dec;20(6):741-5
references.pmid: 20952183
references.citation: Cereb Cortex. 2005 Sep;15(9):1424-37
references.pmid: 15659657
references.citation: J Neurosci. 2010 Feb 24;30(8):3058-66
references.pmid: 20181602
references.citation: Neural Comput. 2011 Dec;23(12):3162-204
references.pmid: 21919788
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2008 Jun;16(3):213-22
references.pmid: 18586600
references.citation: Brain Res Cogn Brain Res. 2003 Dec;18(1):102-5
references.pmid: 14659502
references.citation: PLoS Biol. 2004 Nov;2(11):e365
references.pmid: 15510225
references.citation: Nature. 2000 Aug 17;406(6797):691
references.pmid: 10963584
references.citation: J Neurosci. 2009 Aug 19;29(33):10203-14
references.pmid: 19692595
references.citation: Annu Rev Neurosci. 2004;27:487-507
references.pmid: 15217341
references.citation: Commun ACM. 2011;54(5):60-66
references.pmid: 21984822
references.citation: Neuroimage. 2011 May 15;56(2):814-25
references.pmid: 20600976
references.citation: Nature. 2002 Oct 10;419(6907):616-20
references.pmid: 12374979
references.citation: Proc Natl Acad Sci U S A. 2011 May 24;108(21):8850-5
references.pmid: 21555594
references.citation: Neural Comput. 2000 May;12(5):1207-45
references.pmid: 10905814
references.citation: J Neural Eng. 2009 Aug;6(4):041001
references.pmid: 19622847
references.citation: IEEE Trans Biomed Eng. 1984 May;31(5):419-27
references.pmid: 6430785
references.citation: Neuron. 2012 Feb 9;73(3):581-94
references.pmid: 22325208
references.citation: Nature. 2008 Jun 19;453(7198):1098-101
references.pmid: 18509337
references.citation: Annu Rev Psychol. 2010;61:169-90, C1-3
references.pmid: 19575625
references.citation: J Neurosci. 2010 Nov 10;30(45):15241-53
references.pmid: 21068329
references.citation: IEEE Trans Biomed Eng. 1984 Dec;31(12):833-50
references.pmid: 6396209
references.citation: Front Neurosci. 2010 Dec 08;4:198
references.pmid: 21165175
references.citation: Eur J Neurosci. 2001 Mar;13(5):1002-8
references.pmid: 11264673
references.citation: J Neural Eng. 2011 Dec;8(6):066003
references.pmid: 21975312
references.citation: Science. 1985 Aug 23;229(4715):782-4
references.pmid: 4023713
references.citation: Biol Cybern. 2006 Sep;95(3):243-57
references.pmid: 16802156
references.citation: Science. 2007 Jun 15;316(5831):1609-12
references.pmid: 17569862
references.citation: Proc Natl Acad Sci U S A. 2004 Oct 26;101(43):15541-4
references.pmid: 15489272
references.citation: Nature. 2006 Jul 13;442(7099):195-8
references.pmid: 16838020
references.citation: Nature. 2001 Jul 12;412(6843):150-7
references.pmid: 11449264
references.citation: Nature. 2000 Nov 16;408(6810):361-5
references.pmid: 11099043
references.citation: Proc Natl Acad Sci U S A. 2004 Dec 21;101(51):17849-54
references.pmid: 15585584
references.citation: IEEE Trans Biomed Eng. 1987 Apr;34(4):283-8
references.pmid: 3504202
references.citation: Electroencephalogr Clin Neurophysiol. 1997 Nov;103(5):499-515
references.pmid: 9402881
references.citation: J Neural Eng. 2011 Jun;8(3):036005
references.pmid: 21474878
references.citation: J Neurosci. 2003 May 15;23(10):3990-8
references.pmid: 12764083
references.citation: Cereb Cortex. 2007 Oct;17(10):2293-302
references.pmid: 17172632
references.citation: Nature. 2003 Jan 23;421(6921):370-3
references.pmid: 12540901
references.citation: Neuropsychologia. 1987;25(1A):31-40
references.pmid: 3574648