title: MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning.
abstract: Artificial neural networks (ANNs) have been widely used in pattern recognition and classification applications. However, ANNs are notably slow in computation especially when the size of data is large. Nowadays, big data has received a momentum from both industry and academia. To fulfill the potentials of ANNs for big data applications, the computation process must be speeded up. For this purpose, this paper parallelizes neural networks based on MapReduce, which has become a major computing model to facilitate data intensive applications. Three data intensive scenarios are considered in the parallelization process in terms of the volume of classification data, the size of the training data, and the number of neurons in the neural network. The performance of the parallelized neural networks is evaluated in an experimental MapReduce computer cluster from the aspects of accuracy in classification and efficiency in computation.
authors.affiliation: School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China.
authors.forename: Yang
authors.identifier: 0000-0002-7935-7146
authors.initials: Y
authors.lastname: Liu
authors.affiliation: School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China.
authors.forename: Jie
authors.initials: J
authors.lastname: Yang
authors.affiliation: School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China.
authors.forename: Yuan
authors.initials: Y
authors.lastname: Huang
authors.affiliation: School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China.
authors.forename: Lixiong
authors.initials: L
authors.lastname: Xu
authors.affiliation: The Key Laboratory of Embedded Systems and Service Computing, Tongji University, Shanghai 200092, China.
authors.forename: Siguang
authors.initials: S
authors.lastname: Li
authors.affiliation: Department of Computing, Canterbury Christ Church University, Canterbury, Kent CT1 1QU, UK.
authors.forename: Man
authors.initials: M
authors.lastname: Qi
mesh_terms: D000465:Algorithms; D003627:Data Interpretation, Statistical; D000069550:Machine Learning; D016571:Neural Networks, Computer; D009474:Neurons / Q000502:physiology