title: Video sensor-based complex scene analysis with Granger causality.
abstract: In this report, we propose a novel framework to explore the activity interactions and temporal dependencies between activities in complex video surveillance scenes. Under our framework, a low-level codebook is generated by an adaptive quantization with respect to the activeness criterion. The Hierarchical Dirichlet Processes (HDP) model is then applied to automatically cluster low-level features into atomic activities. Afterwards, the dynamic behaviors of the activities are represented as a multivariate point-process. The pair-wise relationships between activities are explicitly captured by the non-parametric Granger causality analysis, from which the activity interactions and temporal dependencies are discovered. Then, each video clip is labeled by one of the activity interactions. The results of the real-world traffic datasets show that the proposed method can achieve a high quality classification performance. Compared with traditional K-means clustering, a maximum improvement of 19.19% is achieved by using the proposed causal grouping method.
authors.affiliation: Institution of Image Communication and Information Processing, Department of ElectronicEngineering, Shanghai Jiaotong University, Shanghai 200240, China. ywen.fan@gmail.com.
authors.forename: Yawen
authors.initials: Y
authors.lastname: Fan
authors.forename: Hua
authors.initials: H
authors.lastname: Yang
authors.forename: Shibao
authors.initials: S
authors.lastname: Zheng
authors.forename: Hang
authors.initials: H
authors.lastname: Su
authors.forename: Shuang
authors.initials: S
authors.lastname: Wu
mesh_terms: D000465:Algorithms; D001336:Automobiles / Q000145:classification; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D010781:Photography / Q000379:methods*; D014159:Transducers; D014741:Video Recording / Q000379:methods*