Towards Multilingual Sign Language Recognition
| Autor: | Mathew Magimai.-Doss, Sandrine Tornay, Marzieh Razavi |
|---|---|
| Předmět: |
Computer science
Swiss-German sign language Movement (music) sign language processing hidden markov models German Sign Language 020206 networking & telecommunications 02 engineering and technology Sign language Linguistics Turkish sign language language.human_language 0202 electrical engineering electronic engineering information engineering language 020201 artificial intelligence & image processing Hidden Markov model multilingual sign language recognition Sign (mathematics) hand movement modeling hand shape modeling |
| Zdroj: | ICASSP |
| Popis: | Sign language recognition involves modeling of multichannel information such as, hand shapes, hand movements. This requires also sufficient sign language specific data. This is a challenge as sign languages are inherently under-resourced. In the literature, it has been shown that hand shape information can be estimated by pooling resources from multiple sign languages. Such a capability does not exist yet for modeling hand movement information. In this paper, we develop a multilingual sign language approach, where hand movement modeling is also done with target sign language independent data by derivation of hand movement subunits. We validate the proposed approach through an investigation on Swiss German Sign Language, German Sign Language and Turkish Sign Language, and demonstrate that sign language recognition systems can be effectively developed by using multilingual sign language resources. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|