title: Utilising reinforcement learning to develop strategies for driving auditory neural implants.
abstract: In this paper we propose a novel application of reinforcement learning to the area of auditory neural stimulation. We aim to develop a simulation environment which is based off real neurological responses to auditory and electrical stimulation in the cochlear nucleus (CN) and inferior colliculus (IC) of an animal model. Using this simulator we implement closed loop reinforcement learning algorithms to determine which methods are most effective at learning effective acoustic neural stimulation strategies.
  
  
  
  By recording a comprehensive set of acoustic frequency presentations and neural responses from a set of animals we created a large database of neural responses to acoustic stimulation. Extensive electrical stimulation in the CN and the recording of neural responses in the IC provides a mapping of how the auditory system responds to electrical stimuli. The combined dataset is used as the foundation for the simulator, which is used to implement and test learning algorithms.
  
  
  
  Reinforcement learning, utilising a modified n-Armed Bandit solution, is implemented to demonstrate the model's function. We show the ability to effectively learn stimulation patterns which mimic the cochlea's ability to covert acoustic frequencies to neural activity. Time taken to learn effective replication using neural stimulation takes less than 20 min under continuous testing.
  
  
  
  These results show the utility of reinforcement learning in the field of neural stimulation. These results can be coupled with existing sound processing technologies to develop new auditory prosthetics that are adaptable to the recipients current auditory pathway. The same process can theoretically be abstracted to other sensory and motor systems to develop similar electrical replication of neural signals.
authors.affiliation: School of Computer Science and Information Technology, RMIT University, Melbourne  3000, Australia.
authors.forename: Geoffrey W
authors.initials: GW
authors.lastname: Lee
authors.forename: Fabio
authors.initials: F
authors.lastname: Zambetta
authors.forename: Xiaodong
authors.initials: X
authors.lastname: Li
authors.forename: Antonio G
authors.initials: AG
authors.lastname: Paolini
mesh_terms: D000465:Algorithms; D000818:Animals; D062207:Brain-Computer Interfaces; D003054:Cochlear Implants; D017626:Cochlear Nucleus / Q000502:physiology; D004558:Electric Stimulation; D004567:Electrodes, Implanted; D006801:Humans; D007245:Inferior Colliculi / Q000502:physiology; D007858:Learning / Q000502:physiology*; D000069550:Machine Learning; D011474:Prosthesis Design; D051381:Rats; D017208:Rats, Wistar; D012054:Reinforcement, Psychology; D012984:Software