Large displacement optical flow: descriptor matching in variational motion estimation.
Optical flow estimation is classically marked by the requirement of dense sampling in time. While coarse-to-fine warping schemes have somehow relaxed this constraint, there is an inherent dependency between the scale of structures and the velocity that can be estimated. This particularly renders the estimation of detailed human motion problematic, as small body parts can move very fast. In this paper, we present a way to approach this problem by integrating rich descriptors into the variational optical flow setting. This way we can estimate a dense optical flow field with almost the same high accuracy as known from variational optical flow, while reaching out to new domains of motion analysis where the requirement of dense sampling in time is no longer satisfied.
Brox
Thomas
T
Computer Science Division, Department of Electrical Engineering and Computer Science, University of California at Berkeley, 94720, USA. brox@eecs.berkeley.edu
Malik
Jitendra
J
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D006801:Humans; D007089:Image Enhancement / Q000295:instrumentation; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000295:instrumentation*; D016247:Information Storage and Retrieval / Q000379:methods; D008962:Models, Theoretical; D009038:Motion; D010363:Pattern Recognition, Automated / Q000379:methods*; D019047:Phantoms, Imaging; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted / Q000295:instrumentation; D013382:Subtraction Technique; D014741:Video Recording