title: Automated protocol for evaluation of electromagnetic component separation (APECS): Application of a framework for evaluating statistical methods of blink extraction from multichannel EEG.
abstract: OBJECTIVE
  We present APECS (Automated Protocol for Evaluation of Electromagnetic Component Separation), a framework for evaluating the accuracy of blind source separation algorithms in removing artifacts from EEG data. APECS applies multiple, automated procedures to quantify the extent to which blinks are removed, and the degree to which nonocular activity is left intact.
  
  
  METHODS
  APECS was used to evaluate blink removal using three BSS algorithms: Second-Order Blind Inference (SOBI) and two Independent Component Analysis (ICA) implementations, FastICA and Infomax. The algorithms were applied to a series of blink-free EEG datasets, which were contaminated with real or simulated blinks. Extracted components were assumed to contain blink activity if correlation of their spatial projectors to a predefined blink template exceeded some threshold, and if polarity inverted above and below the eyes. Blink-related components were then subtracted to produce filtered data. The success of each data decomposition is evaluated through the use of multiple, automated metrics, to determine which decomposition best approximates the ideal solution (complete separation of blink from nonblink activity).
  
  
  RESULTS
  The outcomes for the evaluation measures were generally congruent, but also provided different and complementary information about the quality of each data decomposition. Under our testing framework, Infomax outperformed both FastICA and SOBI. Best results were achieved when blink activity loaded onto a single component.
  
  
  CONCLUSIONS
  Multiple metrics, both quantitative and qualitative, are important in evaluating algorithms for artifact extraction.
  
  
  CONCLUSIONS
  Failure to achieve complete separation of blink from nonblink activity can affect experimental outcomes, as illustrated here, using an ERP study of word-nonword discrimination. This illustrates the importance of methods for evaluation of artifact extraction results.
authors.affiliation: NeuroInformatics Center, 5219 University of Oregon, Eugene, OR 97403, USA. rmfrank@mac.com
authors.forename: Robert M
authors.initials: RM
authors.lastname: Frank
authors.forename: Gwen A
authors.initials: GA
authors.lastname: Frishkoff
mesh_terms: D000465:Algorithms; D016477:Artifacts; D001767:Blinking / Q000502:physiology*; D001931:Brain Mapping; D003198:Computer Simulation; D004569:Electroencephalography; D055590:Electromagnetic Phenomena; D006801:Humans; D010363:Pattern Recognition, Automated; D012815:Signal Processing, Computer-Assisted