title: Motion analysis using 3D high-resolution frequency analysis.
abstract: The spatiotemporal spectra of a video that contains a moving object form a plane in the 3D frequency domain. This plane, which is described as the theoretical motion plane, reflects the velocity of the moving objects, which is calculated from the slope. However, if the resolution of the frequency analysis method is not high enough to obtain actual spectra from the object signal, the spatiotemporal spectra disperse away from the theoretical motion plane. In this paper, we propose a high-resolution frequency analysis method, described as 3D nonharmonic analysis (NHA), which is only weakly influenced by the analysis window. In addition, we estimate the motion vectors of objects in a video using the plane-clustering method, in conjunction with the least-squares method, for 3D NHA spatiotemporal spectra. We experimentally verify the accuracy of the 3D NHA and its usefulness for a sequence containing complex motions, such as cross-over motion, through comparison with 3D fast Fourier transform. The experimental results show that increasing the frequency resolution contributes to high-accuracy estimation of a motion plane.
authors.affiliation: Department of Intellectual Information Systems Engineering, University of Toyama, Toyama 930-8555, Japan.
authors.forename: Takaaki
authors.initials: T
authors.lastname: Ueda
authors.forename: Kenta
authors.initials: K
authors.lastname: Fujii
authors.forename: Shigeki
authors.initials: S
authors.lastname: Hirobayashi
authors.forename: Toshio
authors.initials: T
authors.lastname: Yoshizawa
authors.forename: Tadanobu
authors.initials: T
authors.lastname: Misawa
mesh_terms: D000465:Algorithms; D016477:Artifacts; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D009038:Motion; D009716:Numerical Analysis, Computer-Assisted; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014741:Video Recording / Q000379:methods*