Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs
| Autor: | Juhyun Oh, Sangwook Kang, Seonggyu Jeon, Hyuk-Chul Kwon, Byungsun Kim, Iktae Kim, Youngho Song, Minho Kim |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
Closed captioning
Computer science Speech recognition 05 social sciences WordNet 020207 software engineering 02 engineering and technology Sign language computer.software_genre Broadcasting (networking) Scripting language 0502 economics and business Synonym (database) 0202 electrical engineering electronic engineering information engineering Media Technology Electrical and Electronic Engineering computer 050203 business & management Word (computer architecture) Avatar |
| Zdroj: | SMPTE Motion Imaging Journal. 126:57-62 |
| ISSN: | 2160-2492 1545-0279 |
| DOI: | 10.5594/jmi.2016.2632278 |
| Popis: | Whereas the closed-caption broadcasting is provided for almost the whole broadcast time in Korea, the sign language interpretation is not. By translating the realtime closed captions, it is possible to provide three-dimensional (3D) sign language translations for more broadcast time. We propose a sign language broadcasting system for weather forecasts and extend it for all kinds of TV programs. To find the frequency of each word, we analyzed the last three years' weather forecast scripts, and an open-domain corpus of about 1.2 million words from the Korean Broadcasting System. We use KorLex, the Korean wordnet, to build the sign language synonym dictionary and for the word sense disambiguation to improve the translation performance. Optically captured sign language motions are used for the 3D avatar to present sign language with motion blending. We developed a mobile on-demand sign language weather forecast application and a realtime sign language interpretation system for all kinds of TV programs. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|