title: Sensitivity-based adaptive learning rules for binary feedforward neural networks.
abstract: This paper proposes a set of adaptive learning rules for binary feedforward neural networks (BFNNs) by means of the sensitivity measure that is established to investigate the effect of a BFNN's weight variation on its output. The rules are based on three basic adaptive learning principles: the benefit principle, the minimal disturbance principle, and the burden-sharing principle. In order to follow the benefit principle and the minimal disturbance principle, a neuron selection rule and a weight adaptation rule are developed. Besides, a learning control rule is developed to follow the burden-sharing principle. The advantage of the rules is that they can effectively guide the BFNN's learning to conduct constructive adaptations and avoid destructive ones. With these rules, a sensitivity-based adaptive learning (SBALR) algorithm for BFNNs is presented. Experimental results on a number of benchmark data demonstrate that the SBALR algorithm has better learning performance than the Madaline rule II and backpropagation algorithms.
authors.forename: Shuiming
authors.initials: S
authors.lastname: Zhong
authors.forename: Xiaoqin
authors.initials: X
authors.lastname: Zeng
authors.forename: Shengli
authors.initials: S
authors.lastname: Wu
authors.forename: Lixin
authors.initials: L
authors.lastname: Han
mesh_terms: D001185:Artificial Intelligence; D016208:Databases, Factual / Q000706:statistics & numerical data; D016571:Neural Networks, Computer