Improving Factored Hybrid HMM Acoustic Modeling without State Tying
Autor: | Tina Raissi, Eugen Beck, Ralf Schluter, Hermann Ney |
---|---|
Rok vydání: | 2022 |
Předmět: |
FOS: Computer and information sciences
Sound (cs.SD) Computer Science::Sound Audio and Speech Processing (eess.AS) I.2.7 FOS: Electrical engineering electronic engineering information engineering Computer Science::Computation and Language (Computational Linguistics and Natural Language and Speech Processing) 68T10 Computer Science - Sound Electrical Engineering and Systems Science - Audio and Speech Processing |
DOI: | 10.48550/arxiv.2201.09692 |
Popis: | In this work, we show that a factored hybrid hidden Markov model (FH-HMM) which is defined without any phonetic state-tying outperforms a state-of-the-art hybrid HMM. The factored hybrid HMM provides a link to transducer models in the way it models phonetic (label) context while preserving the strict separation of acoustic and language model of the hybrid HMM approach. Furthermore, we show that the factored hybrid model can be trained from scratch without using phonetic state-tying in any of the training steps. Our modeling approach enables triphone context while avoiding phonetic state-tying by a decomposition into locally normalized factored posteriors for monophones/HMM states in phoneme context. Experimental results are provided for Switchboard 300h and LibriSpeech. On the former task we also show that by avoiding the phonetic state-tying step, the factored hybrid can take better advantage of regularization techniques during training, compared to the standard hybrid HMM with phonetic state-tying based on classification and regression trees (CART). Comment: Accepted for presentation at IEEE ICASSP 2022 |
Databáze: | OpenAIRE |
Externí odkaz: |