Guided Spatial Transformers for Facial Expression Recognition

Autor: Cristina Luna-Jiménez, Jorge Cristóbal-Martín, Ricardo Kleinlein, Manuel Gil-Martín, José M. Moya, Fernando Fernández-Martínez
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Applied Sciences, Vol 11, Iss 16, p 7217 (2021)
Druh dokumentu: article
ISSN: 2076-3417
DOI: 10.3390/app11167217
Popis: Spatial Transformer Networks are considered a powerful algorithm to learn the main areas of an image, but still, they could be more efficient by receiving images with embedded expert knowledge. This paper aims to improve the performance of conventional Spatial Transformers when applied to Facial Expression Recognition. Based on the Spatial Transformers’ capacity of spatial manipulation within networks, we propose different extensions to these models where effective attentional regions are captured employing facial landmarks or facial visual saliency maps. This specific attentional information is then hardcoded to guide the Spatial Transformers to learn the spatial transformations that best fit the proposed regions for better recognition results. For this study, we use two datasets: AffectNet and FER-2013. For AffectNet, we achieve a 0.35% point absolute improvement relative to the traditional Spatial Transformer, whereas for FER-2013, our solution gets an increase of 1.49% when models are fine-tuned with the Affectnet pre-trained weights.
Databáze: Directory of Open Access Journals