title: Large displacement optical flow: descriptor matching in variational motion estimation.
abstract: Optical flow estimation is classically marked by the requirement of dense sampling in time. While coarse-to-fine warping schemes have somehow relaxed this constraint, there is an inherent dependency between the scale of structures and the velocity that can be estimated. This particularly renders the estimation of detailed human motion problematic, as small body parts can move very fast. In this paper, we present a way to approach this problem by integrating rich descriptors into the variational optical flow setting. This way we can estimate a dense optical flow field with almost the same high accuracy as known from variational optical flow, while reaching out to new domains of motion analysis where the requirement of dense sampling in time is no longer satisfied.
authors: Computer Science Division, Department of Electrical Engineering and Computer Science, University of California at Berkeley, 94720, USA. brox@eecs.berkeley.edu
authors: Thomas
authors: T
authors: Brox
authors: Jitendra
authors: J
authors: Malik
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D006801:Humans; D007089:Image Enhancement / Q000295:instrumentation; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000295:instrumentation*; D016247:Information Storage and Retrieval / Q000379:methods; D008962:Models, Theoretical; D009038:Motion; D010363:Pattern Recognition, Automated / Q000379:methods*; D019047:Phantoms, Imaging; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted / Q000295:instrumentation; D013382:Subtraction Technique; D014741:Video Recording