Real-Time Machine Learning for Accurate Mexican Sign Language Identification: A Distal Phalanges Approach

Autor: Gerardo García-Gil, Gabriela del Carmen López-Armas, Juan Jaime Sánchez-Escobar, Bryan Armando Salazar-Torres, Alma Nayeli Rodríguez-Vázquez
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Technologies, Vol 12, Iss 9, p 152 (2024)
Druh dokumentu: article
ISSN: 2227-7080
DOI: 10.3390/technologies12090152
Popis: Effective communication is crucial in daily life, and for people with hearing disabilities, sign language is no exception, serving as their primary means of interaction. Various technologies, such as cochlear implants and mobile sign language translation applications, have been explored to enhance communication and improve the quality of life of the deaf community. This article presents a new, innovative method that uses real-time machine learning (ML) to accurately identify Mexican sign language (MSL) and is adaptable to any sign language. Our method is based on analyzing six features that represent the angles between the distal phalanges and the palm, thus eliminating the need for complex image processing. Our ML approach achieves accurate sign language identification in real-time, with an accuracy and F1 score of 99%. These results demonstrate that a simple approach can effectively identify sign language. This advance is significant, as it offers an effective and accessible solution to improve communication for people with hearing impairments. Furthermore, the proposed method has the potential to be implemented in mobile applications and other devices to provide practical support to the deaf community.
Databáze: Directory of Open Access Journals