title: Market Model for Resource Allocation in Emerging Sensor Networks with Reinforcement Learning.
abstract: Emerging sensor networks (ESNs) are an inevitable trend with the development of the Internet of Things (IoT), and intend to connect almost every intelligent device. Therefore, it is critical to study resource allocation in such an environment, due to the concern of efficiency, especially when resources are limited. By viewing ESNs as multi-agent environments, we model them with an agent-based modelling (ABM) method and deal with resource allocation problems with market models, after describing users' patterns. Reinforcement learning methods are introduced to estimate users' patterns and verify the outcomes in our market models. Experimental results show the efficiency of our methods, which are also capable of guiding topology management.
authors.affiliation: The State Key Laboratory of Integrated Services Networks, Xidian University, Xi'an 710071, China. y.zhang@stu.xidian.edu.cn.
authors.forename: Yue
authors.initials: Y
authors.lastname: Zhang
authors.affiliation: The State Key Laboratory of Integrated Services Networks, Xidian University, Xi'an 710071, China. bsong@mail.xidian.edu.cn.
authors.forename: Bin
authors.initials: B
authors.lastname: Song
authors.affiliation: The State Key Laboratory of Integrated Services Networks, Xidian University, Xi'an 710071, China. yzxdedm@163.com.
authors.forename: Ying
authors.initials: Y
authors.lastname: Zhang
authors.affiliation: Department of Computer and Information Sciences, Temple University, Philadelphia, PA 19122, USA. dxj@ieee.org.
authors.forename: Xiaojiang
authors.initials: X
authors.lastname: Du
authors.affiliation: Department of Electrical and Computer Engineering, University of Idaho, Moscow, ID 83844, USA. mguizani@ieee.org.
authors.forename: Mohsen
authors.initials: M
authors.lastname: Guizani
keywords: Internet of Things; agent-based modelling; emerging sensor networks; market model; reinforcement learning; resource allocation; topology management