Incremental Learning for End-to-End Automatic Speech Recognition

Autor:	Fu, Li, Li, Xiaoxiao, Zi, Libo, Zhang, Zhengchen, Wu, Youzheng, He, Xiaodong, Zhou, Bowen
Rok vydání:	2020
Předmět:	Electrical Engineering and Systems Science - Audio and Speech Processing Computer Science - Computation and Language Computer Science - Machine Learning Computer Science - Sound Statistics - Machine Learning
Druh dokumentu:	Working Paper
Popis:	In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To mitigate catastrophic forgetting during incremental learning, we design a novel explainability-based knowledge distillation for ASR models, which is combined with a response-based knowledge distillation to maintain the original model's predictions and the "reason" for the predictions. Our method works without access to the training data of original tasks, which addresses the cases where the previous data is no longer available or joint training is costly. Results on a multi-stage sequential training task show that our method outperforms existing ones in mitigating forgetting. Furthermore, in two practical scenarios, compared to the target-reference joint training method, the performance drop of our method is 0.02% Character Error Rate (CER), which is 97% smaller than the drops of the baseline methods. Comment: ASRU 2021
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2005.04288 Zobrazit plný text záznamu View this record from Arxiv