Machine Translation Verbosity Control for Automatic Dubbing
| Autor: | Robert Enyedi, Marcello Federico, Surafel Melaku Lakew, Yogesh Virkar, Cuong Hoang, Roberto Barra-Chicote, Yue Wang |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Sound (cs.SD) Machine translation Computer science media_common.quotation_subject Speech synthesis computer.software_genre Computer Science - Sound Task (project management) German Audio and Speech Processing (eess.AS) medicine FOS: Electrical engineering electronic engineering information engineering Quality (business) Control (linguistics) Verbosity media_common Computer Science - Computation and Language business.industry Pipeline (software) language.human_language language Artificial intelligence medicine.symptom business computer Computation and Language (cs.CL) Natural language processing Electrical Engineering and Systems Science - Audio and Speech Processing |
| Zdroj: | ICASSP |
| DOI: | 10.48550/arxiv.2110.03847 |
| Popis: | Automatic dubbing aims at seamlessly replacing the speech in a video document with synthetic speech in a different language. The task implies many challenges, one of which is generating translations that not only convey the original content, but also match the duration of the corresponding utterances. In this paper, we focus on the problem of controlling the verbosity of machine translation output, so that subsequent steps of our automatic dubbing pipeline can generate dubs of better quality. We propose new methods to control the verbosity of MT output and compare them against the state of the art with both intrinsic and extrinsic evaluations. For our experiments we use a public data set to dub English speeches into French, Italian, German and Spanish. Finally, we report extensive subjective tests that measure the impact of MT verbosity control on the final quality of dubbed video clips. Comment: Accepted at IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|