Video content classification based on 3-D eigen analysis.
To achieve video understanding, it is of utmost practical importance to classify videos according to its spatial and temporal features in an efficient and effective manner. It still remains, however, largely an elusive task. In still-image analysis, thanks to the great efforts made by many researchers, a broad spectrum of methods have been developed with great success, especially the ones based on eigen analysis due to its efficacy. In this paper, inspired by the impressive performance achieved by this framework, we will develop a content-based video classification method based on three-dimensional (3-D) eigen analysis. Unlike most other video understanding schemes where the spatial and temporal contents play different roles in the processing, this new method treats a video as a solid within a 3-D Euclidean space and can, thus, naturally take advantage of the spatial and temporal contents existing in videos. After computing the eigen values and corresponding eigen vectors of the autocorrelation matrix for each small 3-D macroblock, different labels are assigned regarding its spatial/temporal natures based on the behavioral properties of the eigen values and eigen vectors. Extensive empirical studies have suggested encouraging performance for the use of this eigen analysis-based video classification method.
Wei
Jie
J
Department of Computer Science, City College of New York, New York, NY 10031, USA. wei@cs.ccny.cuny.edu
D000465:Algorithms; D001185:Artificial Intelligence; D016000:Cluster Analysis; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted; D014741:Video Recording / Q000379:methods*