title: A Hierarchical Framework Combining Motion and Feature Information for Infrared-Visible Video Registration.
abstract: In this paper, we propose a novel hierarchical framework that combines motion and feature information to implement infrared-visible video registration on nearly planar scenes. In contrast to previous approaches, which involve the direct use of feature matching to find the global homography, the framework adds coarse registration based on the motion vectors of targets to estimate scale and rotation prior to matching. In precise registration based on keypoint matching, the scale and rotation are used in re-location to eliminate their impact on targets and keypoints. To strictly match the keypoints, first, we improve the quality of keypoint matching by using normalized location descriptors and descriptors generated by the histogram of edge orientation. Second, we remove most mismatches by counting the matching directions of correspondences. We tested our framework on a public dataset, where our proposed framework outperformed two recently-proposed state-of-the-art global registration methods in almost all tested videos.
authors.affiliation: School of Optoelectronics, Image Engineering & Video Technology Lab, Beijing Institute of Technology, Beijing 100081, China. 2120545@bit.edu.cn.
authors.forename: Xinglong
authors.initials: X
authors.lastname: Sun
authors.affiliation: School of Optoelectronics, Image Engineering & Video Technology Lab, Beijing Institute of Technology, Beijing 100081, China. ciom_xtf1@bit.edu.cn.|Key Laboratory of Photoelectronic Imaging Technology and System, Ministry of Education of China, Beijing 100081, China. ciom_xtf1@bit.edu.cn.
authors.forename: Tingfa
authors.initials: T
authors.lastname: Xu
authors.affiliation: School of Optoelectronics, Image Engineering & Video Technology Lab, Beijing Institute of Technology, Beijing 100081, China. xiaomianzhou@126.com.
authors.forename: Jizhou
authors.initials: J
authors.lastname: Zhang
authors.affiliation: School of Optoelectronics, Image Engineering & Video Technology Lab, Beijing Institute of Technology, Beijing 100081, China. li_xiangmin@bit.edu.cn.
authors.forename: Xiangmin
authors.initials: X
authors.lastname: Li
keywords: edge orientation; infrared-visible registration; mismatch elimination; normalized location; objective motion vector