Frame-Based Phone Classification Using EMG Signals

Autor: Zuazo, Inge Salomons, Eder del Blanco, Eva Navas, Inma Hernáez, Xabier de
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Applied Sciences; Volume 13; Issue 13; Pages: 7746
ISSN: 2076-3417
DOI: 10.3390/app13137746
Popis: This paper evaluates the impact of inter-speaker and inter-session variability on the development of a silent speech interface (SSI) based on electromyographic (EMG) signals from the facial muscles. The final goal of the SSI is to provide a communication tool for Spanish-speaking laryngectomees by generating audible speech from voiceless articulation. However, before moving on to such a complex task, a simpler phone classification task in different modalities regarding speaker and session dependency is performed for this study.These experiments consist of processing the recorded utterances into phone-labeled segments and predicting the phonetic labels using only features obtained from the EMG signals. We evaluate and compare the performance of each model considering the classification accuracy.Results show that the models are able to predict the phonetic label best when they are trained and tested using data from the same session. The accuracy drops drastically when the model is tested with data from a different session, although it improves when more data are added to the training data. Similarly, when the same model is tested on a session from a different speaker, the accuracy decreases. This suggests that using larger amounts of data could help to reduce the impact of inter-session variability, but more research is required to understand if this approach would suffice to account for inter-speaker variability as well.
Databáze: OpenAIRE