Speech emotion recognition based on Graph-LSTM neural network

Autor: Yan Li, Yapeng Wang, Xu Yang, Sio-Kei Im
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: EURASIP Journal on Audio, Speech, and Music Processing, Vol 2023, Iss 1, Pp 1-10 (2023)
Druh dokumentu: article
ISSN: 1687-4722
DOI: 10.1186/s13636-023-00303-9
Popis: Abstract Currently, Graph Neural Networks have been extended to the field of speech signal processing. It is the more compact and flexible way to represent speech sequences by graphs. However, the structures of the relationships in recent studies are tend to be relatively uncomplicated. Moreover, the graph convolution module exhibits limitations that impede its adaptability to intricate application scenarios. In this study, we establish the speech-graph using feature similarity and introduce a novel architecture for graph neural network that leverages an LSTM aggregator and weighted pooling. The unweighted accuracy of 65.39% and the weighted accuracy of 71.83% are obtained on the IEMOCAP dataset, achieving the performance comparable to or better than existing graph baselines. This method can improve the interpretability of the model to some extent, and identify speech emotion features effectively.
Databáze: Directory of Open Access Journals