Fusion deep capsule-network based facial expression recognition

Autor: YaErmaimaiti, Yilihamu, Zhuang, Guohang, Kari, Tusongjiang
Zdroj: International Journal of Information and Communication Technology; 2024, Vol. 24 Issue: 2 p165-180, 16p
Abstrakt: Facial expression recognition plays a crucial role in many automated system applications such as human-computer interaction, multi-modal emotion analysis, and medical assistance. Recognising facial expressions accurately is challenging. The existing facial expression recognition methods are limited in exploring the correlation between features, and most of them ignore the significance of feature relationship to FER. In this article, we propose a neural network FDC for facial expression identification. The main purpose is to design a deep capsule neural network that is a fusion of multi-layer convolutional neural network and capsule neural network. In the light-layer network, we have added an attention mechanism based on LPB, and the loss function of the FDC network is constructed. The main purpose is: 1) consider the influence of feature relationship on facial expression recognition; 2) use a designed attention mechanism to capture the important local information in facial features; 3) balance overall loss. Our method can achieve 97.93%, 92.86% and 98.57% recognition accuracy for RaFD, KDEF and CK+, respectively, which is more accurate than most state-of-the-art techniques while maintaining real-time performance, which is a great improvement compared to current public facial expression recognition methods.
Databáze: Supplemental Index