Phonetic subspace features for improved query by example spoken term detection
| Autor: | Afsaneh Asaei, Hervé Bourlard, Dhananjay Ram |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Linguistics and Language
Dynamic time warping Computer science Feature vector Speech recognition 02 engineering and technology ComputingMethodologies_ARTIFICIALINTELLIGENCE Language and Linguistics 030507 speech-language pathology & audiology 03 medical and health sciences 0202 electrical engineering electronic engineering information engineering Query by Example Pattern matching computer.programming_language Communication 020206 networking & telecommunications Sparse approximation Computer Science Applications Projection (relational algebra) ComputingMethodologies_PATTERNRECOGNITION Modeling and Simulation Computer Vision and Pattern Recognition 0305 other medical science Neural coding computer Software Subspace topology |
| Zdroj: | Speech Communication. 103:27-36 |
| ISSN: | 0167-6393 |
| DOI: | 10.1016/j.specom.2018.07.001 |
| Popis: | This paper addresses the problem of detecting speech utterances from a large audio archive using a simple spoken query, hence referring to this problem as “Query by Example Spoken Term Detection” (QbE-STD). This still open pattern matching problem has been addressed in different contexts, often based on variants of the Dynamic Time Warping (DTW) algorithm. In the work reported here, we exploit Deep Neural Networks (DNN) and the so inferred phone posteriors to better model the phonetic subspaces and, consequently, improve the QbE-STD performance. Those phone posteriors have indeed been shown to properly model the union of the underlying low-dimensional phonetic subspaces. Exploiting this property, we investigate here two methods relying on sparse modeling and linguistic knowledge of sub-phonetic components. Sparse modeling characterizes the phonetic subspaces through a dictionary for sparse coding. Projection of the phone posteriors through reconstruction on the corresponding subspaces using their sparse representation enhance those phone posteriors. On the other hand, linguistic knowledge driven sub-phonetic structures are identified using phonological posteriors which consists of the probabilities of phone attributes estimated by DNNs, resulting in a new set of feature vectors. These phonological posteriors provide complementary information and a distance fusion method is proposed to integrate information from phone and phonological posterior features. Both posterior features are used for query detection using DTW and evaluated on AMI database. We demonstrate that the subspace enhanced phone posteriors obtained using sparse reconstruction outperforms the conventional DNN posteriors. The distance fusion technique gives further improvement in QbE-STD performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect