title: Lip segmentation under MAP-MRF framework with automatic selection of local observation scale and number of segments.
abstract: This paper addresses the problem of segmenting lip region from frontal human face image. Supposing each pixel of the target image has an optimal local scale from the segmentation viewpoint, we treat the lip segmentation problem as a combination of observation scale selection and observed data classification. Accordingly, we propose a hierarchical multiscale Markov random field (MRF) model to represent the membership map of each input pixel to a specific segment and local-scale map simultaneously. Subsequently, lip segmentation can be formulated as an optimal problem in the maximum a posteriori (MAP)-MRF framework. Then, we present a rival-penalized iterative algorithm to implement the segmentation, which is independent of the number of predefined segments. The proposed method mainly features two aspects: 1) its performance is independent of the predefined number of segments, and 2) it takes into account the local optimal observation scale for each pixel. Finally, we conduct the experiments on four benchmark databases, i.e. AR, CVL, GTAV, and VidTIMIT. Experimental results show that the proposed method is robust to the segment number that changes with a speaker's appearance, and can enhance the segmentation accuracy by taking advantage of the local optimal observation scale information.
authors: Yiu-Ming
authors: YM
authors: Cheung
authors: Meng
authors: M
authors: Li
authors: Xiaochun
authors: X
authors: Cao
authors: Xinge
authors: X
authors: You
mesh_terms: D000465:Algorithms; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008046:Lip / Q000033:anatomy & histology* / Q000502:physiology; D008085:Lipreading; D010363:Pattern Recognition, Automated / Q000379:methods*; D010781:Photography / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013060:Speech / Q000502:physiology; D049250:Speech Recognition Software; D013382:Subtraction Technique