title: Machine Learning Capabilities of a Simulated Cerebellum.
abstract: This paper describes the learning and control capabilities of a biologically constrained bottom-up model of the mammalian cerebellum. Results are presented from six tasks: 1) eyelid conditioning; 2) pendulum balancing; 3) proportional-integral-derivative control; 4) robot balancing; 5) pattern recognition; and 6) MNIST handwritten digit recognition. These tasks span several paradigms of machine learning, including supervised learning, reinforcement learning, control, and pattern recognition. Results over these six domains indicate that the cerebellar simulation is capable of robustly identifying static input patterns even when randomized across the sensory apparatus. This capability allows the simulated cerebellum to perform several different supervised learning and control tasks. On the other hand, both reinforcement learning and temporal pattern recognition prove problematic due to the delayed nature of error signals and the simulator's inability to solve the credit assignment problem. These results are consistent with previous findings which hypothesize that in the human brain, the basal ganglia is responsible for reinforcement learning, while the cerebellum handles supervised learning.
authors.forename: Matthew
authors.initials: M
authors.lastname: Hausknecht
authors.forename: Wen-Ke
authors.initials: WK
authors.lastname: Li
authors.forename: Michael
authors.initials: M
authors.lastname: Mauk
authors.forename: Peter
authors.initials: P
authors.lastname: Stone
mesh_terms: D000818:Animals; D002531:Cerebellum / Q000502:physiology* / Q000648:ultrastructure; D003198:Computer Simulation; D003215:Conditioning, Eyelid / Q000502:physiology; D006801:Humans; D000069550:Machine Learning; D008959:Models, Neurological; D016571:Neural Networks, Computer; D009474:Neurons / Q000502:physiology*; D046709:Pattern Recognition, Physiological; D004856:Postural Balance / Q000502:physiology; D012054:Reinforcement, Psychology