title: A Distributed Learning Method for ℓ 1 -Regularized Kernel Machine over Wireless Sensor Networks.
abstract: In wireless sensor networks, centralized learning methods have very high communication costs and energy consumption. These are caused by the need to transmit scattered training examples from various sensor nodes to the central fusion center where a classifier or a regression machine is trained. To reduce the communication cost, a distributed learning method for a kernel machine that incorporates ℓ 1 norm regularization ( ℓ 1 -regularized) is investigated, and a novel distributed learning algorithm for the ℓ 1 -regularized kernel minimum mean squared error (KMSE) machine is proposed. The proposed algorithm relies on in-network processing and a collaboration that transmits the sparse model only between single-hop neighboring nodes. This paper evaluates the proposed algorithm with respect to the prediction accuracy, the sparse rate of model, the communication cost and the number of iterations on synthetic and real datasets. The simulation results show that the proposed algorithm can obtain approximately the same prediction accuracy as that obtained by the batch learning method. Moreover, it is significantly superior in terms of the sparse rate of model and communication cost, and it can converge with fewer iterations. Finally, an experiment conducted on a wireless sensor network (WSN) test platform further shows the advantages of the proposed algorithm with respect to communication cost.
authors.affiliation: Beijing Engineering Research Center for IOT Software and Systems, Beijing 100124, China. jixinrong@emails.bjut.edu.cn.|School of Information &amp; Electrical Engineering, Hebei University of Engineering, Handan 056038, China. jixinrong@emails.bjut.edu.cn.
authors.forename: Xinrong
authors.initials: X
authors.lastname: Ji
authors.affiliation: Beijing Engineering Research Center for IOT Software and Systems, Beijing 100124, China. houcuiqin@bjut.edu.cn.
authors.forename: Cuiqin
authors.initials: C
authors.lastname: Hou
authors.affiliation: Beijing Engineering Research Center for IOT Software and Systems, Beijing 100124, China. yhou@bjut.edu.cn.
authors.forename: Yibin
authors.initials: Y
authors.lastname: Hou
authors.affiliation: Beijing Engineering Research Center for IOT Software and Systems, Beijing 100124, China. gaofang@emails.bjut.edu.cn.
authors.forename: Fang
authors.initials: F
authors.lastname: Gao
authors.affiliation: Beijing Engineering Research Center for IOT Software and Systems, Beijing 100124, China. wangshulong@emails.bjut.edu.cn.
authors.forename: Shulong
authors.initials: S
authors.lastname: Wang
keywords: distributed learning; kernel machines; kernel minimum mean squared error (KMSE); wireless sensor network (WSN); ℓ1 norm regularization (ℓ1-regularized)