A study of speaker adaptation for DNN-based speech synthesis
| Autor: | Wu, Z., Pawel Swietojanski, Veaux, C., Renals, S., King, S. |
|---|---|
| Rok vydání: | 2015 |
| Předmět: | |
| Zdroj: | Scopus-Elsevier Wu, Z, Swietojanski, P, Veaux, C, Renals, S & King, S 2015, A study of speaker adaptation for DNN-based speech synthesis . in Proceedings of Interspeech 2015 . Interspeech 2015, Dresden, Germany, 6/09/15 . https://doi.org/10.7488/ds/259 |
| DOI: | 10.21437/interspeech.2015-270 |
| Popis: | A major advantage of statistical parametric speech synthe- sis (SPSS) over unit-selection speech synthesis is its adapt- ability and controllability in changing speaker characteristics and speaking style. Recently, several studies using deep neural networks (DNNs) as acoustic models for SPSS have shown promising results. However, the adaptability of DNNs in SPSS has not been systematically studied. In this paper, we conduct an experimental analysis of speaker adaptation for DNN-based speech synthesis at different levels. In particular, we augment a low-dimensional speaker-specific vector with linguistic features as input to represent speaker identity, perform model adaptation to scale the hidden activation weights, and perform a fea- ture space transformation at the output layer to modify generated acoustic features. We systematically analyse the performance of each individual adaptation technique and that of their combinations. Experimental results confirm the adaptability of the DNN, and listening tests demonstrate that the DNN can achieve significantly better adaptation performance than the hidden Markov model (HMM) baseline in terms of naturalness and speaker similarity. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|