title: Sensor-Aware Recognition and Tracking for Wide-Area Augmented Reality on Mobile Phones.
abstract: Wide-area registration in outdoor environments on mobile phones is a challenging task in mobile augmented reality fields. We present a sensor-aware large-scale outdoor augmented reality system for recognition and tracking on mobile phones. GPS and gravity information is used to improve the VLAD performance for recognition. A kind of sensor-aware VLAD algorithm, which is self-adaptive to different scale scenes, is utilized to recognize complex scenes. Considering vision-based registration algorithms are too fragile and tend to drift, data coming from inertial sensors and vision are fused together by an extended Kalman filter (EKF) to achieve considerable improvements in tracking stability and robustness. Experimental results show that our method greatly enhances the recognition rate and eliminates the tracking jitters.
authors.affiliation: School of Optoelectronics, Beijing Institute of Technology, Beijing 100081, China. chen74jing29@bit.edu.cn.
authors.forename: Jing
authors.initials: J
authors.lastname: Chen
authors.affiliation: School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China. crccrc005@163.com.
authors.forename: Ruochen
authors.initials: R
authors.lastname: Cao
authors.affiliation: School of Optoelectronics, Beijing Institute of Technology, Beijing 100081, China. wyt@bit.edu.cn.|School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China. wyt@bit.edu.cn.
authors.forename: Yongtian
authors.initials: Y
authors.lastname: Wang
keywords: VLAD; mobile augmented reality; sensor fusion; sensor-aware scene recognition