title: Decoding semantic information from human electrocorticographic (ECoG) signals.
abstract: This study examined the feasibility of decoding semantic information from human cortical activity. Four human subjects undergoing presurgical brain mapping and seizure foci localization participated in this study. Electrocorticographic (ECoG) signals were recorded while the subjects performed simple language tasks involving semantic information processing, such as a picture naming task where subjects named pictures of objects belonging to different semantic categories. Robust high-gamma band (60-120 Hz) activation was observed at the left inferior frontal gyrus (LIFG) and the posterior portion of the superior temporal gyrus (pSTG) with a temporal sequence corresponding to speech production and perception. Furthermore, Gaussian Naïve Bayes and Support Vector Machine classifiers, two commonly used machine learning algorithms for pattern recognition, were able to predict the semantic category of an object using cortical activity captured by ECoG electrodes covering the frontal, temporal and parietal cortices. These findings have implications for both basic neuroscience research and development of semantic-based brain-computer interface systems (BCI) that can help individuals with severe motor or communication disorders to express their intention and thoughts.
authors.affiliation: Department of Physical Medicine and Rehabilitation, University of Pittsburgh, PA15213, USA. wangwei3@pitt.edu
authors.forename: Wei
authors.initials: W
authors.lastname: Wang
authors.forename: Alan D
authors.initials: AD
authors.lastname: Degenhart
authors.forename: Gustavo P
authors.initials: GP
authors.lastname: Sudre
authors.forename: Dean A
authors.initials: DA
authors.lastname: Pomerleau
authors.forename: Elizabeth C
authors.initials: EC
authors.lastname: Tyler-Kabara
mesh_terms: D000293:Adolescent; D000328:Adult; D001185:Artificial Intelligence; D001499:Bayes Theorem; D001921:Brain / Q000473:pathology / Q000502:physiology*; D001931:Brain Mapping / Q000379:methods; D002648:Child; D003142:Communication; D003143:Communication Devices for People with Disabilities; D004566:Electrodes; D004594:Electrophysiology / Q000379:methods*; D004827:Epilepsy / Q000503:physiopathology; D005260:Female; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000379:methods; D016011:Normal Distribution; D012815:Signal Processing, Computer-Assisted; D014584:User-Computer Interface