title: Multiple hypotheses image segmentation and classification with application to dietary assessment.
abstract: We propose a method for dietary assessment to automatically identify and locate food in a variety of images captured during controlled and natural eating events. Two concepts are combined to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on global and local features; and perceptually similar object classes can be used to assess the accuracy of image segmentation. These ideas are implemented by generating multiple segmentations of an image to select stable segmentations based on the classifier's confidence score assigned to each segmented image region. Automatic segmented regions are classified using a multichannel feature classification system. For each segmented region, multiple feature spaces are formed. Feature vectors in each of the feature spaces are individually classified. The final decision is obtained by combining class decisions from individual feature spaces using decision rules. We show improved accuracy of segmenting food images with classifier feedback.
authors.forename: Fengqing
authors.initials: F
authors.lastname: Zhu
authors.forename: Marc
authors.initials: M
authors.lastname: Bosch
authors.forename: Nitin
authors.initials: N
authors.lastname: Khanna
authors.forename: Carol J
authors.initials: CJ
authors.lastname: Boushey
authors.forename: Edward J
authors.initials: EJ
authors.lastname: Delp
mesh_terms: D001185:Artificial Intelligence; D015930:Diet Records; D005502:Food / Q000145:classification*; D005504:Food Analysis / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D063731:Mobile Applications; D010363:Pattern Recognition, Automated / Q000379:methods; D010781:Photography / Q000379:methods; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity