Binary neural network training algorithms based on linear sequential learning.
A key problem in Binary Neural Network learning is to decide bigger linear separable subsets. In this paper we prove some lemmas about linear separability. Based on these lemmas, we propose Multi-Core Learning (MCL) and Multi-Core Expand-and-Truncate Learning (MCETL) algorithms to construct Binary Neural Networks. We conclude that MCL and MCETL simplify the equations to compute weights and thresholds, and they result in the construction of simpler hidden layer. Examples are given to demonstrate these conclusions.
Wang
Di
D
School of Computing Engineering, Block N4-2a-32, 50 Nanyang Avenue, Nanyang Technological University, Singapore 639798, Singapore. wangdi@pmail.ntu.edu.sg
Chaudhari
Narendra S
NS
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D005246:Feedback; D006801:Humans; D007858:Learning; D016014:Linear Models; D016571:Neural Networks, Computer; D009474:Neurons; D013663:Teaching