title: An iterative framework for EEG-based image search: robust retrieval with weak classifiers.
abstract: We revisit the framework for brain-coupled image search, where the Electroencephalography (EEG) channel under rapid serial visual presentation protocol is used to detect user preferences. Extending previous works on the synergy between content-based image labeling and EEG-based brain-computer interface (BCI), we propose a different perspective on iterative coupling. Previously, the iterations were used to improve the set of EEG-based image labels before propagating them to the unseen images for the final retrieval. In our approach we accumulate the evidence of the true labels for each image in the database through iterations. This is done by propagating the EEG-based labels of the presented images at each iteration to the rest of images in the database. Our results demonstrate a continuous improvement of the labeling performance across iterations despite the moderate EEG-based labeling (AUC <75%). The overall analysis is done in terms of the single-trial EEG decoding performance and the image database reorganization quality. Furthermore, we discuss the EEG-based labeling performance with respect to a search task given the same image database.
authors: École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
authors: Marija
authors: M
authors: Ušćumlić
authors: Ricardo
authors: R
authors: Chavarriaga
authors: José Del R
authors: Jdel R
authors: Millán
mesh_terms: D000465:Algorithms; D001921:Brain / Q000502:physiology*; D016208:Databases, Factual; D004569:Electroencephalography; D001330:Electronic Data Processing; D018913:Event-Related Potentials, P300; D006801:Humans; D010364:Pattern Recognition, Visual; D010775:Photic Stimulation; D012372:ROC Curve; D057386:Search Engine
references: Brain Topogr. 2001 Summer;13(4):251-67
references: 11545154
references: IEEE Trans Biomed Eng. 2004 Jun;51(6):1026-33
references: 15188874
references: IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14(2):174-9
references: 16792287
references: J Neurosci Methods. 2008 Jan 15;167(1):15-21
references: 17822777
references: Clin Neurophysiol. 2007 Oct;118(10):2128-48
references: 17573239
references: Psychophysiology. 2002 May;39(3):388-96
references: 12212658
references: Int J Med Sci. 2005;2(4):147-54
references: 16239953
references: J Neural Eng. 2011 Jun;8(3):036025
references: 21562364
references: Annu Int Conf IEEE Eng Med Biol Soc. 2010;2010:138-41
references: 21096742
references: Int J Psychophysiol. 2006 Jan;59(1):8-14
references: 16253363
references: Clin Neurophysiol. 2007 Jan;118(1):98-104
references: 17088100
references: Neuroscientist. 2005 Dec;11(6):563-76
references: 16282597
references: PLoS One. 2009 Jun 17;4(6):e5927
references: 19536292
references: IEEE Trans Neural Syst Rehabil Eng. 2008 Oct;16(5):432-41
references: 18990647