title: Spatio-temporal saliency perception via hypercomplex frequency spectral contrast.
abstract: Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms.
authors.affiliation: Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an 710049, China. xjtulice@gmail.com
authors.forename: Ce
authors.initials: C
authors.lastname: Li
authors.forename: Jianru
authors.initials: J
authors.lastname: Xue
authors.forename: Nanning
authors.initials: N
authors.lastname: Zheng
authors.forename: Xuguang
authors.initials: X
authors.lastname: Lan
authors.forename: Zhiqiang
authors.initials: Z
authors.lastname: Tian
mesh_terms: D000465:Algorithms; D001288:Attention / Q000502:physiology; D003116:Color; D006801:Humans; D008962:Models, Theoretical; D013998:Time Perception / Q000502:physiology*; D014741:Video Recording; D014796:Visual Perception / Q000502:physiology*