title: Application of reinforcement learning in cognitive radio networks: models and algorithms.
abstract: Cognitive radio (CR) enables unlicensed users to exploit the underutilized spectrum in licensed spectrum whilst minimizing interference to licensed users. Reinforcement learning (RL), which is an artificial intelligence approach, has been applied to enable each unlicensed user to observe and carry out optimal actions for performance enhancement in a wide range of schemes in CR, such as dynamic channel selection and channel sensing. This paper presents new discussions of RL in the context of CR networks. It provides an extensive review on how most schemes have been approached using the traditional and enhanced RL algorithms through state, action, and reward representations. Examples of the enhancements on RL, which do not appear in the traditional RL approach, are rules and cooperative learning. This paper also reviews performance enhancements brought about by the RL algorithms and open issues. This paper aims to establish a foundation in order to spark new research interests in this area. Our discussion has been presented in a tutorial manner so that it is comprehensive to readers outside the specialty of RL and CR.
authors.affiliation: Faculty of Science and Technology, Sunway University, No. 5 Jalan Universiti, Bandar Sunway, 46150 Petaling Jaya, Selangor, Malaysia.
authors.forename: Kok-Lim Alvin
authors.initials: KL
authors.lastname: Yau
authors.affiliation: University Malaysia of Computer Science & Engineering, Jalan Alamanda 2, Presint 16, 62150 Putrajaya, Wilayah Persekutuan Putrajaya, Malaysia.
authors.forename: Geong-Sen
authors.initials: GS
authors.lastname: Poh
authors.affiliation: Department of Mathematical Modeling Laboratory, Mimos Berhad, Technology Park Malaysia, 57000 Kuala Lumpur, Malaysia.
authors.forename: Su Fong
authors.initials: SF
authors.lastname: Chien
authors.affiliation: Faculty of Science and Technology, Sunway University, No. 5 Jalan Universiti, Bandar Sunway, 46150 Petaling Jaya, Selangor, Malaysia.
authors.forename: Hasan A A
authors.initials: HA
authors.lastname: Al-Rawi
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003195:Computer Communication Networks; D006801:Humans; D008962:Models, Theoretical; D012054:Reinforcement, Psychology