Hybrid Model-Based Emotion Contextual Recognition for Cognitive Assistance Services
| Autor: | Abdelghani Chibani, Naouel Ayari, Yacine Amirat, Hazem Abdelkawy |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
Knowledge representation and reasoning
Computer science Emotions Cognition Context (language use) Ontology (information science) Computer Science Applications Human-Computer Interaction Control and Systems Engineering Human–computer interaction Multilayer perceptron Pattern recognition (psychology) Humans Learning Upper ontology Robot Neural Networks Computer Electrical and Electronic Engineering Software Information Systems |
| Zdroj: | IEEE Transactions on Cybernetics. 52:3567-3576 |
| ISSN: | 2168-2275 2168-2267 |
| DOI: | 10.1109/tcyb.2020.3013112 |
| Popis: | Endowing ubiquitous robots with cognitive capabilities for recognizing emotions, sentiments, affects, and moods of humans in their context is an important challenge, which requires sophisticated and novel approaches of emotion recognition. Most studies explore data-driven pattern recognition techniques that are generally highly dependent on learning data and insufficiently effective for emotion contextual recognition. In this article, a hybrid model-based emotion contextual recognition approach for cognitive assistance services in ubiquitous environments is proposed. This model is based on: 1) a hybrid-level fusion exploiting a multilayer perceptron (MLP) neural-network model and the possibilistic logic and 2) an expressive emotional knowledge representation and reasoning model to recognize nondirectly observable emotions; this model exploits jointly the emotion upper ontology (EmUO) and the n-ary ontology of events HTemp supported by the NKRL language. For validation purposes of the proposed approach, experiments were carried out using a YouTube dataset, and in a real-world scenario dedicated to the cognitive assistance of visitors in a smart devices showroom. Results demonstrated that the proposed multimodal emotion recognition model outperforms all baseline models. The real-world scenario corroborates the effectiveness of the proposed approach in terms of emotion contextual recognition and management and in the creation of emotion-based assistance services. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|