Fusion of EEG and Musical Features in Continuous Music-emotion Recognition

Autor: Thammasan, Nattapong, Fukui, Ken-ichi, Numao, Masayuki
Rok vydání: 2016
Předmět:
Druh dokumentu: Working Paper
Popis: Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals captured from listeners to improve the performance of emotion recognition. In this paper, we present a study of fusion of signals of electroencephalogram (EEG), a tool to capture brainwaves at a high-temporal resolution, and musical features at decision level in recognizing the time-varying binary classes of arousal and valence. Our empirical results showed that the fusion could outperform the performance of emotion recognition using only EEG modality that was suffered from inter-subject variability, and this suggested the promise of multimodal fusion in improving the accuracy of music-emotion recognition.
Comment: The short version of this paper is accepted to appear as an abstract in the proceedings of AAAI-17 (student abstract and poster program)
Databáze: arXiv