title: Probabilistic co-adaptive brain-computer interfacing.
abstract: OBJECTIVE
  Brain-computer interfaces (BCIs) are confronted with two fundamental challenges: (a) the uncertainty associated with decoding noisy brain signals, and (b) the need for co-adaptation between the brain and the interface so as to cooperatively achieve a common goal in a task. We seek to mitigate these challenges.
  
  
  METHODS
  We introduce a new approach to brain-computer interfacing based on partially observable Markov decision processes (POMDPs). POMDPs provide a principled approach to handling uncertainty and achieving co-adaptation in the following manner: (1) Bayesian inference is used to compute posterior probability distributions ('beliefs') over brain and environment state, and (2) actions are selected based on entire belief distributions in order to maximize total expected reward; by employing methods from reinforcement learning, the POMDP's reward function can be updated over time to allow for co-adaptive behaviour.
  
  
  RESULTS
  We illustrate our approach using a simple non-invasive BCI which optimizes the speed-accuracy trade-off for individual subjects based on the signal-to-noise characteristics of their brain signals. We additionally demonstrate that the POMDP BCI can automatically detect changes in the user's control strategy and can co-adaptively switch control strategies on-the-fly to maximize expected reward.
  
  
  CONCLUSIONS
  Our results suggest that the framework of POMDPs offers a promising approach for designing BCIs that can handle uncertainty in neural signals and co-adapt with the user on an ongoing basis. The fact that the POMDP BCI maintains a probability distribution over the user's brain state allows a much more powerful form of decision making than traditional BCI approaches, which have typically been based on the output of classifiers or regression techniques. Furthermore, the co-adaptation of the system allows the BCI to make online improvements to its behaviour, adjusting itself automatically to the user's changing circumstances.
authors.affiliation: Neural Systems Laboratory, Department of Computer Science and Engineering, University of Washington, Box 352350, Seattle, WA 98105, USA.
authors.forename: Matthew J
authors.initials: MJ
authors.lastname: Bryan
authors.forename: Stefan A
authors.initials: SA
authors.lastname: Martin
authors.forename: Willy
authors.initials: W
authors.lastname: Cheung
authors.forename: Rajesh P N
authors.initials: RP
authors.lastname: Rao
mesh_terms: D000222:Adaptation, Physiological / Q000502:physiology*; D000328:Adult; D062207:Brain-Computer Interfaces; D004569:Electroencephalography / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D008390:Markov Chains; D010775:Photic Stimulation / Q000379:methods; D011336:Probability; D011930:Reaction Time / Q000502:physiology*; D055815:Young Adult