Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition

Autor:	Karmakar, Priyabrata, Teng, Shyh Wei, Lu, Guojun
Rok vydání:	2021
Předmět:	Computer Science - Sound Computer Science - Computation and Language Electrical Engineering and Systems Science - Audio and Speech Processing
Druh dokumentu:	Working Paper
Popis:	Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, a comprehensive review of the different attention models used in developing automatic speech recognition systems is provided. The paper focuses on the development and evolution of attention models for offline and streaming speech recognition within recurrent neural network- and Transformer- based architectures. Comment: Submitted to IEEE/ACM Trans. on Audio, Speech, and Language Processing
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2102.07259 Zobrazit plný text záznamu View this record from Arxiv