A novel Shape Constrained Feature-based Active Contour model for lips/mouth segmentation in the wild

Autor: Marios Savvides, T. Hoang Ngan Le
Rok vydání: 2016
Předmět:
Zdroj: Pattern Recognition. 54:23-33
ISSN: 0031-3203
DOI: 10.1016/j.patcog.2015.11.009
Popis: In this paper, we propose a novel joint formulation of feature-based active contour (FAC) and prior shape constraints (CS) for lips/mouth segmentation in the wild. Our proposed SC-FAC model is able to robustly segment the lips/mouth that belongs to a given mouth shape space while minimizing the energy functional. The shape space is defined by a 2D Modified Active Shape Model (MASM) whereas the active contour model is based on the Chan-Vese functional. Our SC-FAC energy functional is able to overcome the drawback of noise while minimizing the fitting forces under the shape constraints. We conducted our experiments on images captured under challenging conditions such as varying illumination, low contrast, facial expression, low resolution, blurring, wearing beard/moustache and cosmetic affection from the MBGC, VidTIMIT, JAFFE, and LFW databases. The results from our studies indicate that the proposed SC-FAC model is reliable and accurately perform prior shape weak object segmentation. The average performance of the mouth segmentation using proposed SC-FAC on 1918 images from the MBGC database under different illuminations, expressions, and complex background reaches to a Precision of 91.30%, a Recall of 91.32% and an F-measure of 90.62%. HighlightsPropose a novel joint formulation of contour and shape for lips segmentation.Robustly segment lips under challenging environment and complex background.The energy functional is composed of 5 terms based on the Chan-Vese functional.The shape space is defined by a 2D.Experiments are conducted from the MBGC, VidTIMIT, JAFFE, and LFW databases.
Databáze: OpenAIRE
Externí odkaz: