title: Decision-level fusion of EEG and pupil features for single-trial visual detection analysis.
abstract: Several recent studies have reported success in applying EEG-based signal analysis to achieve accurate single-trial classification of responses to visual target detection. Pupil responses are proposed as a complementary modality that can support improved accuracy of single-trial signal analysis. We develop a pupillary response feature-extraction and -selection procedure that helps to improve the classification performance of a system based only on EEG signal analysis. We apply a two-level linear classifier to obtain cognitive-task-related analysis of EEG and pupil responses. The classification results based on the two modalities are then fused at the decision level. Here, the goal is to support increased classification confidence through the inherent modality complementarities. The fusion results show significant improvement over classification performance based on a single modality.
authors.affiliation: Teledyne Scientific and Imaging LLC, Research Triangle Laboratory, Durham, NC 27713, USA. mqian@teledyne.com
authors.forename: Ming
authors.initials: M
authors.lastname: Qian
authors.forename: Mario
authors.initials: M
authors.lastname: Aguilar
authors.forename: Karen N
authors.initials: KN
authors.lastname: Zachery
authors.forename: Claudio
authors.initials: C
authors.lastname: Privitera
authors.forename: Stanley
authors.initials: S
authors.lastname: Klein
authors.forename: Thom
authors.initials: T
authors.lastname: Carney
authors.forename: Loren W
authors.initials: LW
authors.lastname: Nolte