title: Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: Design methodology and selected applications.
abstract: The paper describes a new type of evolving connectionist systems (ECOS) called evolving spatio-temporal data machines based on neuromorphic, brain-like information processing principles (eSTDM). These are multi-modular computer systems designed to deal with large and fast spatio/spectro temporal data using spiking neural networks (SNN) as major processing modules. ECOS and eSTDM in particular can learn incrementally from data streams, can include 'on the fly' new input variables, new output class labels or regression outputs, can continuously adapt their structure and functionality, can be visualised and interpreted for new knowledge discovery and for a better understanding of the data and the processes that generated it. eSTDM can be used for early event prediction due to the ability of the SNN to spike early, before whole input vectors (they were trained on) are presented. A framework for building eSTDM called NeuCube along with a design methodology for building eSTDM using this is presented. The implementation of this framework in MATLAB, Java, and PyNN (Python) is presented. The latter facilitates the use of neuromorphic hardware platforms to run the eSTDM. Selected examples are given of eSTDM for pattern recognition and early event prediction on EEG data, fMRI data, multisensory seismic data, ecological data, climate data, audio-visual data. Future directions are discussed, including extension of the NeuCube framework for building neurogenetic eSTDM and also new applications of eSTDM.
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand. Electronic address: nkasabov@aut.ac.nz.
authors.forename: Nikola
authors.initials: N
authors.lastname: Kasabov
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand. Electronic address: nascott@aut.ac.nz.
authors.forename: Nathan Matthew
authors.initials: NM
authors.lastname: Scott
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Enmei
authors.initials: E
authors.lastname: Tu
authors.affiliation: CoLab, Auckland University of Techology, Auckland, New Zealand.
authors.forename: Stefan
authors.initials: S
authors.lastname: Marks
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Neelava
authors.initials: N
authors.lastname: Sengupta
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Elisa
authors.initials: E
authors.lastname: Capecci
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand; Universiti Tun Hussein Onn Malaysia, Johor, Malaysia.
authors.forename: Muhaini
authors.initials: M
authors.lastname: Othman
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Maryam Gholami
authors.initials: MG
authors.lastname: Doborjeh
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Norhanifah
authors.initials: N
authors.lastname: Murli
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Reggio
authors.initials: R
authors.lastname: Hartono
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand; Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico.
authors.forename: Josafath Israel
authors.initials: JI
authors.lastname: Espinosa-Ramos
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand; Shanghai Jiao Tong University, Shanghai, China.
authors.forename: Lei
authors.initials: L
authors.lastname: Zhou
authors.affiliation: Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Fahad Bashir
authors.initials: FB
authors.lastname: Alvi
authors.affiliation: Gambling & Addictions Research Centre, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Grace
authors.initials: G
authors.lastname: Wang
authors.affiliation: Health & Rehabilitation Research Centre, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Denise
authors.initials: D
authors.lastname: Taylor
authors.affiliation: National Institute for Stroke and Applied Neurosciences, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Valery
authors.initials: V
authors.lastname: Feigin
authors.affiliation: Institute for Radio Astronomy & Space Research, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Sergei
authors.initials: S
authors.lastname: Gulyaev
authors.affiliation: Institute for Radio Astronomy & Space Research, Auckland University of Technology, Auckland, New Zealand.
authors.forename: Mahmoud
authors.initials: M
authors.lastname: Mahmoud
authors.affiliation: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
authors.forename: Zeng-Guang
authors.initials: ZG
authors.lastname: Hou
authors.affiliation: Shanghai Jiao Tong University, Shanghai, China.
authors.forename: Jie
authors.initials: J
authors.lastname: Yang
mesh_terms: D000200:Action Potentials / Q000502:physiology; D001921:Brain / Q000502:physiology; D004569:Electroencephalography / Q000379:methods; D004867:Equipment Design / Q000379:methods* / Q000639:trends; D006801:Humans; D000069550:Machine Learning / Q000639:trends; D008959:Models, Neurological; D016571:Neural Networks, Computer; D009488:Neurosciences; D013997:Time Factors
keywords: Computational neurogenetic systems; Evolving connectionist systems; Evolving spatio-temporal data machines; Evolving spiking neural networks; NeuCube; Spatio/spectro temporal data