Towards Bi-Hemispheric Emotion Mapping through EEG: A Dual-Stream Neural Network Approach

Autor: Freire-Obregón, David, Hernández-Sosa, Daniel, Santana, Oliverio J., Lorenzo-Navarro, Javier, Castrillón-Santana, Modesto
Rok vydání: 2024
Předmět:
Druh dokumentu: Working Paper
DOI: 10.1109/FG59268.2024.10581965
Popis: Emotion classification through EEG signals plays a significant role in psychology, neuroscience, and human-computer interaction. This paper addresses the challenge of mapping human emotions using EEG data in the Mapping Human Emotions through EEG Signals FG24 competition. Subjects mimic the facial expressions of an avatar, displaying fear, joy, anger, sadness, disgust, and surprise in a VR setting. EEG data is captured using a multi-channel sensor system to discern brain activity patterns. We propose a novel two-stream neural network employing a Bi-Hemispheric approach for emotion inference, surpassing baseline methods and enhancing emotion recognition accuracy. Additionally, we conduct a temporal analysis revealing that specific signal intervals at the beginning and end of the emotion stimulus sequence contribute significantly to improve accuracy. Leveraging insights gained from this temporal analysis, our approach offers enhanced performance in capturing subtle variations in the states of emotions.
Comment: Second place award at the Brain Responses to Emotional Avatars Challenge held by the 18th IEEE International Conference on Automatic Face and Gesture Recognition(FG2024)
Databáze: arXiv