Improving the Learning Power of Artificial Intelligence Using Multimodal Deep Learning

Autor: Shchetinin Eugene Yu., Sevastianov Leonid
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: EPJ Web of Conferences, Vol 248, p 01017 (2021)
Druh dokumentu: article
ISSN: 2100-014X
DOI: 10.1051/epjconf/202124801017
Popis: Computer paralinguistic analysis is widely used in security systems, biometric research, call centers and banks. Paralinguistic models estimate different physical properties of voice, such as pitch, intensity, formants and harmonics to classify emotions. The main goal is to find such features that would be robust to outliers and will retain variety of human voice properties at the same time. Moreover, the model used must be able to estimate features on a time scale for an effective analysis of voice variability. In this paper a paralinguistic model based on Bidirectional Long Short-Term Memory (BLSTM) neural network is described, which was trained for vocal-based emotion recognition. The main advantage of this network architecture is that each module of the network consists of several interconnected layers, providing the ability to recognize flexible long-term dependencies in data, which is important in context of vocal analysis. We explain the architecture of a bidirectional neural network model, its main advantages over regular neural networks and compare experimental results of BLSTM network with other models.
Databáze: Directory of Open Access Journals