title: Detecting objects of variable shape structure with hidden state shape models.
abstract: This paper proposes a method for detecting object classes that exhibit variable shape structure in heavily cluttered images. The term "variable shape structure" is used to characterize object classes in which some shape parts can be repeated an arbitrary number of times, some parts can be optional, and some parts can have several alternative appearances. Hidden State Shape Models (HSSMs), a generalization of Hidden Markov Models (HMMs), are introduced to model object classes of variable shape structure using a probabilistic framework. A polynomial inference algorithm automatically determines object location, orientation, scale and structure by finding the globally optimal registration of model states with the image features, even in the presence of clutter. Experiments with real images demonstrate that the proposed method can localize objects of variable shape structure with high accuracy. For the task of hand shape localization and structure identification, the proposed method is significantly more accurate than previously proposed methods based on chamfer-distance matching. Furthermore, by integrating simple temporal constraints, the proposed method gains speed-ups of more than an order of magnitude, and produces highly accurate results in experiments on non-rigid hand motion tracking.
authors.affiliation: Google Inc, Mountain View, CA 94043, USA. jingbinw@cs.bu.edu
authors.forename: Jingbin
authors.initials: J
authors.lastname: Wang
authors.forename: Vassilis
authors.initials: V
authors.lastname: Athitsos
authors.forename: Stan
authors.initials: S
authors.lastname: Sclaroff
authors.forename: Margrit
authors.initials: M
authors.lastname: Betke
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001699:Biometry / Q000379:methods*; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D006225:Hand / Q000033:anatomy & histology*; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D008390:Markov Chains; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity