title: Dynamic scene stitching driven by visual cognition model.
abstract: Dynamic scene stitching still has a great challenge in maintaining the global key information without missing or deforming if multiple motion interferences exist in the image acquisition system. Object clips, motion blurs, or other synthetic defects easily occur in the final stitching image. In our research work, we proceed from human visual cognitive mechanism and construct a hybrid-saliency-based cognitive model to automatically guide the video volume stitching. The model consists of three elements of different visual stimuli, that is, intensity, edge contour, and scene depth saliencies. Combined with the manifold-based mosaicing framework, dynamic scene stitching is formulated as a cut path optimization problem in a constructed space-time graph. The cutting energy function for column width selections is defined according to the proposed visual cognition model. The optimum cut path can minimize the cognitive saliency difference throughout the whole video volume. The experimental results show that it can effectively avoid synthetic defects caused by different motion interferences and summarize the key contents of the scene without loss. The proposed method gives full play to the role of human visual cognitive mechanism for the stitching. It is of high practical value to environmental surveillance and other applications.
authors.affiliation: School of Computer and Communication Engineering, University of Science and Technology, Beijing 100083, China ; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China.
authors.forename: Li-hui
authors.identifier: 0000-0002-0102-9900
authors.initials: LH
authors.lastname: Zou
authors.affiliation: School of Computer and Communication Engineering, University of Science and Technology, Beijing 100083, China ; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China.
authors.forename: Dezheng
authors.identifier: 0000-0002-0647-3154
authors.initials: D
authors.lastname: Zhang
authors.affiliation: School of Computer and Communication Engineering, University of Science and Technology, Beijing 100083, China ; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China.
authors.forename: Aziguli
authors.identifier: 0000-0002-3320-8110
authors.initials: A
authors.lastname: Wulamu
mesh_terms: D000465:Algorithms; D003071:Cognition; D003198:Computer Simulation; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008962:Models, Theoretical; D014741:Video Recording / Q000379:methods