Challenges with Sign Language Datasets for Sign Language Recognition and Translation
| Autor: | Sisto, M., Vincent Vandeghinste, Gómez, S. E., Coster, M., Shterionov, D., Saggion, H. |
|---|---|
| Přispěvatelé: | Calzolari, N, Bechet, F, Blache, P, Choukri, K, Cieri, C, Declerck, T, Goggi, S, Isahara, H, Maegaard, B, Mazo, H, Odijk, H, Piperidis, S, Cognitive Science & AI, Calzolari, Nicoletta, Béchet, Frédéric, Blache, Philippe, Choukri, Khalid, Cieri, Christopher, Declerck, Thierry, Goggi, Sara, Isahara, Hitoshi, Maegaard, Bente, Mariani, Joseph, Mazo, Hélane, Odijk, Jan, Piperidis, Stelios |
| Rok vydání: | 2022 |
| Předmět: | |
| Zdroj: | Proceedings of the 13th International Conference on Language Resources and Evaluation (LREC) Tilburg University-PURE PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2022) Scopus-Elsevier |
| ISSN: | 2522-2686 |
| Popis: | Comunicació presentada a: LREC 2022, 13th International Conference on Language Resources and Evaluation, celebrat del 20 al 25 de juny de 2022, a Marsella, França. Sign Languages (SLs) are the primary means of communication for at least half a million people in Europe alone. However, the development of SL recognition and translation tools is slowed down by a series of obstacles concerning resource scarcity and standardization issues in the available data. The former challenge relates to the volume of data available for machine learning as well as the time required to collect and process new data. The latter obstacle is linked to the variety of the data, i.e., annotation formats are not unified and vary amongst different resources. The available data formats are often not suitable for machine learning, obstructing the provision of automatic tools based on neural models. In the present paper, we give an overview of these challenges by comparing various SL corpora and SL machine learning datasets. Furthermore, we propose a framework to address the lack of standardization at format level, unify the available resources and facilitate SL research for different languages. Our framework takes ELAN files as inputs and returns textual and visual data ready to train SL recognition and translation models. We present a proof of concept, training neural translation models on the data produced by the proposed framework. Work in this paper is part of the SignON project.27 This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No. 101017255. Mathieu De Coster’s research is funded by the Research Foundation Flanders (FWO Vlaanderen): file number 77410. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|