Eardrum-inspired soft viscoelastic diaphragms for CNN-based speech recognition with audio visualization images

Autor: Seok-Jin Park, Hee-Beom Lee, Gi-Woo Kim
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Scientific Reports, Vol 13, Iss 1, Pp 1-10 (2023)
Druh dokumentu: article
ISSN: 2045-2322
DOI: 10.1038/s41598-023-33755-2
Popis: Abstract In this study, we present initial efforts for a new speech recognition approach aimed at producing different input images for convolutional neural network (CNN)-based speech recognition. We explored the potential of the tympanic membrane (eardrum)-inspired viscoelastic membrane-type diaphragms to deliver audio visualization images using a cross-recurrence plot (CRP). These images were formed by the two phase-shifted vibration responses of viscoelastic diaphragms. We expect this technique to replace the fast Fourier transform (FFT) spectrum currently used for speech recognition. Herein, we report that the new creation method of color images enabled by combining two phase-shifted vibration responses of viscoelastic diaphragms with CRP shows a lower computation burden and a promising potential alternative way to STFT (conventional spectrogram) when the image resolution (pixel size) is below critical resolution.
Databáze: Directory of Open Access Journals
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje