title: Learning to rapidly re-contact the lost plume in chemical plume tracing.
abstract: Maintaining contact between the robot and plume is significant in chemical plume tracing (CPT). In the time immediately following the loss of chemical detection during the process of CPT, Track-Out activities bias the robot heading relative to the upwind direction, expecting to rapidly re-contact the plume. To determine the bias angle used in the Track-Out activity, we propose an online instance-based reinforcement learning method, namely virtual trail following (VTF). In VTF, action-value is generalized from recently stored instances of successful Track-Out activities. We also propose a collaborative VTF (cVTF) method, in which multiple robots store their own instances, and learn from the stored instances, in the same database. The proposed VTF and cVTF methods are compared with biased upwind surge (BUS) method, in which all Track-Out activities utilize an offline optimized universal bias angle, in an indoor environment with three different airflow fields. With respect to our experimental conditions, VTF and cVTF show stronger adaptability to different airflow environments than BUS, and furthermore, cVTF yields higher success rates and time-efficiencies than VTF.
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. menglicao@tju.edu.cn.
authors.forename: Meng-Li
authors.initials: ML
authors.lastname: Cao
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. qh_meng@tju.edu.cn.
authors.forename: Qing-Hao
authors.initials: QH
authors.lastname: Meng
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. wjy0709@tju.edu.cn.
authors.forename: Jia-Ying
authors.initials: JY
authors.lastname: Wang
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. roice@tju.edu.cn.
authors.forename: Bing
authors.initials: B
authors.lastname: Luo
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. jingyaqi@tju.edu.cn.
authors.forename: Ya-Qi
authors.initials: YQ
authors.lastname: Jing
authors.affiliation: Institute of Robotics and Autonomous Systems, Tianjin Key Laboratory of Process Measurement and Control, School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China. shugen@se.ritsumei.ac.jp.|Department of Robotics, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu-Shi 525-8577, Japan. shugen@se.ritsumei.ac.jp.
authors.forename: Shu-Gen
authors.initials: SG
authors.lastname: Ma
mesh_terms: D000465:Algorithms; D013696:Temperature
references.citation: Nature. 2007 Jan 25;445(7126):406-9
references.pmid: 17251974
references.citation: J Exp Biol. 2002 Nov;205(Pt 21):3387-98
references.pmid: 12324548
references.citation: Sensors (Basel). 2011;11(11):10415-43
references.pmid: 22346650
references.citation: Sensors (Basel). 2014;14(7):11444-66
references.pmid: 24977387
references.citation: J Chem Ecol. 2008 Jul;34(7):854-66
references.pmid: 18581182
references.citation: Sensors (Basel). 2013;13(12):16591-610
references.pmid: 24300599
references.citation: Sensors (Basel). 2012;12(4):4737-63
references.pmid: 22666056