Using a Neural Network Codec Approximation Loss to Improve Source Separation Performance in Limited Capacity Networks
| Autor: | Sebastian Ewert, Joseph A. Paradiso, Ishwarya Ananthabhotla |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: |
Artificial neural network
Computer science SIGNAL (programming language) 020206 networking & telecommunications Context (language use) 02 engineering and technology Loss network 030507 speech-language pathology & audiology 03 medical and health sciences Computer engineering Audio codec 0202 electrical engineering electronic engineering information engineering Source separation Codec 0305 other medical science |
| Zdroj: | MIT web domain IJCNN |
| Popis: | © 2020 IEEE. A growing need for on-device machine learning has led to an increased interest in light-weight neural networks that lower model complexity while retaining performance. While a variety of general-purpose techniques exist in this context, very few approaches exploit domain-specific properties to further improve upon the capacity-performance trade-off. In this paper, extending our prior work [1], we train a network to emulate the behaviour of an audio codec and use this network to construct a loss. By approximating the psychoacoustic model underlying the codec, our approach enables light-weight neural networks to focus on perceptually relevant properties without wasting their limited capacity on imperceptible signal components. We adapt our method to two audio source separation tasks, demonstrate an improvement in performance for small-scale networks via listening tests, characterize the behaviour of the loss network in detail, and quantify the relationship between performance gain and model capacity. Our work illustrates the potential for incorporating perceptual principles into objective functions for neural networks. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|