SWAT: a spiking neural network training algorithm for classification problems.
This paper presents a synaptic weight association training (SWAT) algorithm for spiking neural networks (SNNs). SWAT merges the Bienenstock-Cooper-Munro (BCM) learning rule with spike timing dependent plasticity (STDP). The STDP/BCM rule yields a unimodal weight distribution where the height of the plasticity window associated with STDP is modulated causing stability after a period of training. The SNN uses a single training neuron in the training phase where data associated with all classes is passed to this neuron. The rule then maps weights to the classifying output neurons to reflect similarities in the data across the classes. The SNN also includes both excitatory and inhibitory facilitating synapses which create a frequency routing capability allowing the information presented to the network to be routed to different hidden layer neurons. A variable neuron threshold level simulates the refractory period. SWAT is initially benchmarked against the nonlinearly separable Iris and Wisconsin Breast Cancer datasets. Results presented show that the proposed training algorithm exhibits a convergence accuracy of 95.5% and 96.2% for the Iris and Wisconsin training sets, respectively, and 95.3% and 96.7% for the testing sets, noise experiments show that SWAT has a good generalization capability. SWAT is also benchmarked using an isolated digit automatic speech recognition (ASR) system where a subset of the TI46 speech corpus is used. Results show that with SWAT as the classifier, the ASR system provides an accuracy of 98.875% for training and 95.25% for testing.
Wade
John J
JJ
Intelligent Systems Research Center, University of Ulster, School of Computing and Intelligent Systems, Derry, Northern Ireland, U.K. jj.wade@ulster.ac.uk
McDaid
Liam J
LJ
Santos
Jose A
JA
Sayers
Heather M
HM
D000200:Action Potentials / Q000502:physiology; D000465:Algorithms; D001185:Artificial Intelligence; D001921:Brain / Q000502:physiology; D003198:Computer Simulation; D009415:Nerve Net / Q000502:physiology; D016571:Neural Networks, Computer; D009473:Neuronal Plasticity / Q000502:physiology; D009474:Neurons / Q000502:physiology; D010363:Pattern Recognition, Automated / Q000379:methods*; D010936:Plant Extracts; D012985:Software Design; D049250:Speech Recognition Software / Q000592:standards; D009435:Synaptic Transmission / Q000502:physiology; D013663:Teaching / Q000379:methods*
D010936:Plant Extracts; C533808:U & D Sweet Bitter