title: Classifier-based latency estimation: a novel way to estimate and predict BCI accuracy.
abstract: OBJECTIVE
  Brain-computer interfaces (BCIs) that detect event-related potentials (ERPs) rely on classification schemes that are vulnerable to latency jitter, a phenomenon known to occur with ERPs such as the P300 response. The objective of this work was to investigate the role that latency jitter plays in BCI classification.
  
  
  METHODS
  We developed a novel method, classifier-based latency estimation (CBLE), based on a generalization of Woody filtering. The technique works by presenting the time-shifted data to the classifier, and using the time shift that corresponds to the maximal classifier score.
  
  
  RESULTS
  The variance of CBLE estimates correlates significantly (p < 10(-42)) with BCI accuracy in the Farwell-Donchin BCI paradigm. Additionally, CBLE predicts same-day accuracy, even from small datasets or datasets that have already been used for classifier training, better than the accuracy on the small dataset (p < 0.05). The technique should be relatively classifier-independent, and the results were confirmed on two linear classifiers.
  
  
  CONCLUSIONS
  The results suggest that latency jitter may be an important cause of poor BCI performance, and methods that correct for latency jitter may improve that performance. CBLE can also be used to decrease the amount of data needed for accuracy estimation, allowing research on effects with shorter timescales.
authors.affiliation: Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA. dthomp@umich.edu
authors.forename: David E
authors.initials: DE
authors.lastname: Thompson
authors.forename: Seth
authors.initials: S
authors.lastname: Warschausky
authors.forename: Jane E
authors.initials: JE
authors.lastname: Huggins
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D001921:Brain / Q000502:physiology*; D062207:Brain-Computer Interfaces / Q000145:classification* / Q000592:standards*; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D011237:Predictive Value of Tests; D011930:Reaction Time / Q000502:physiology*; D055815:Young Adult