title: A low-cost EEG system-based hybrid brain-computer interface for humanoid robot navigation and recognition.
abstract: This paper describes a hybrid brain-computer interface (BCI) technique that combines the P300 potential, the steady state visually evoked potential (SSVEP), and event related de-synchronization (ERD) to solve a complicated multi-task problem consisting of humanoid robot navigation and control along with object recognition using a low-cost BCI system. Our approach enables subjects to control the navigation and exploration of a humanoid robot and recognize a desired object among candidates. This study aims to demonstrate the possibility of a hybrid BCI based on a low-cost system for a realistic and complex task. It also shows that the use of a simple image processing technique, combined with BCI, can further aid in making these complex tasks simpler. An experimental scenario is proposed in which a subject remotely controls a humanoid robot in a properly sized maze. The subject sees what the surrogate robot sees through visual feedback and can navigate the surrogate robot. While navigating, the robot encounters objects located in the maze. It then recognizes if the encountered object is of interest to the subject. The subject communicates with the robot through SSVEP and ERD-based BCIs to navigate and explore with the robot, and P300-based BCI to allow the surrogate robot recognize their favorites. Using several evaluation metrics, the performances of five subjects navigating the robot were quite comparable to manual keyboard control. During object recognition mode, favorite objects were successfully selected from two to four choices. Subjects conducted humanoid navigation and recognition tasks as if they embodied the robot. Analysis of the data supports the potential usefulness of the proposed hybrid BCI system for extended applications. This work presents an important implication for the future work that a hybridization of simple BCI protocols provide extended controllability to carry out complicated tasks even with a low-cost system.
authors.affiliation: Department of Computer Science, Korea Advanced Institute of Science and Technology (KAIST), Yuseong-gu, Daejeon, Republic of Korea.
authors.forename: Bongjae
authors.initials: B
authors.lastname: Choi
authors.forename: Sungho
authors.initials: S
authors.lastname: Jo
mesh_terms: D062207:Brain-Computer Interfaces / Q000191:economics*; D004569:Electroencephalography / Q000191:economics*; D007088:Illusions; D015203:Reproducibility of Results; D012371:Robotics / Q000191:economics*; D013997:Time Factors
references.citation: J Neurosci Methods. 2012 Aug 15;209(2):299-307
references.pmid: 22771715
references.citation: Neuroimage. 2006 May 15;31(1):153-9
references.pmid: 16443377
references.citation: Neuroimage. 2012 Jan 2;59(1):519-29
references.pmid: 21840399
references.citation: PLoS One. 2011;6(6):e20674
references.pmid: 21695206
references.citation: Med Biol Eng Comput. 2011 May;49(5):567-77
references.pmid: 21394652
references.citation: J Neural Eng. 2008 Jun;5(2):214-20
references.pmid: 18483450
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2010 Aug;18(4):409-14
references.pmid: 20144923
references.citation: Biomed Eng Online. 2011 Sep 23;10:83
references.pmid: 21939560
references.citation: IEEE Trans Biomed Eng. 2009 Aug;56(8):2035-43
references.pmid: 19174332
references.citation: Front Neurosci. 2010 Sep 07;4:
references.pmid: 20877434
references.citation: J Neural Eng. 2009 Aug;6(4):046002
references.pmid: 19494422
references.citation: IEEE Trans Rehabil Eng. 2000 Jun;8(2):216-9
references.pmid: 10896192
references.citation: IEEE Trans Biomed Eng. 2010 Oct;57(10):2495-505
references.pmid: 20615806
references.citation: J Neural Eng. 2007 Jun;4(2):R1-R13
references.pmid: 17409472
references.citation: Commun ACM. 2011;54(5):60-66
references.pmid: 21984822
references.citation: J Neural Eng. 2012 Feb;9(1):013001
references.pmid: 22156029
references.citation: J Neural Eng. 2011 Apr;8(2):025011
references.pmid: 21436524
references.citation: Front Neurosci. 2010 Apr 21;4:30
references.pmid: 20582271
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2012 Sep;20(5):720-9
references.pmid: 22692936
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2003 Jun;11(2):137-40
references.pmid: 12899256
references.citation: Proc Natl Acad Sci U S A. 2004 Dec 21;101(51):17849-54
references.pmid: 15585584
references.citation: IEEE Trans Rehabil Eng. 2000 Dec;8(4):441-6
references.pmid: 11204034
references.citation: J Neural Eng. 2005 Dec;2(4):123-30
references.pmid: 16317236
references.citation: IEEE Trans Neural Syst Rehabil Eng. 2010 Apr;18(2):107-16
references.pmid: 20083463
references.citation: J Neurosci Methods. 2008 Jan 15;167(1):115-25
references.pmid: 17445904
references.citation: Neural Comput. 2007 May;19(5):1155-78
references.pmid: 17381263