The WMT’18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Autor: Yves Scherrer, Maarit Koponen, Ondřej Bojar, François Yvon, Franck Burlot, Tommi Nieminen, Vinit Ravishankar, Stig-Arne Grönroos
Přispěvatelé: Bojar, Ondřej, Chatterjee, Rajen, Federmann, Christian, Fishel, Mark, Graham, Yvette, Haddow, Barry, Huck, Matthias, Yepes, Antonio Jimeno, Koehn, Philipp, Monz, Christof, Negri, Matteo, Névéol, Aurélie, Neves, Mariana, Post, Matt, Specia, Lucia, Turchi, Marco, Verspoor, Karin, Department of Digital Humanities, Language Technology, Lingua Custodia, University of Helsinki, Charles University, Centre of Excellence in Computational Inference, COIN, University of Turku, Université Paris-Saclay, Aalto-yliopisto, Aalto University, Traitement du Langage Parlé (TLP), Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur (LIMSI), Université Paris Saclay (COmUE)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université - UFR d'Ingénierie (UFR 919), Sorbonne Université (SU)-Sorbonne Université (SU)-Université Paris-Saclay-Université Paris-Sud - Paris 11 (UP11)-Université Paris Saclay (COmUE)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université - UFR d'Ingénierie (UFR 919), Sorbonne Université (SU)-Sorbonne Université (SU)-Université Paris-Saclay-Université Paris-Sud - Paris 11 (UP11), Charles University [Prague] (CU)
Jazyk: angličtina
Předmět:
Zdroj: Proceedings of the Third Conference on Machine Translation: Shared Task Papers
Proceedings of the Third Conference on Machine Translation
3rd Conference on Machine Translation (WMT 18)
3rd Conference on Machine Translation (WMT 18), Oct 2018, Bruxelles, Belgium. pp.550-564, ⟨10.18653/v1/W18-64060⟩
WMT (shared task)
DOI: 10.18653/v1/w18-6433
Popis: openaire: EC/H2020/780069/EU//MeMAD Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure
Databáze: OpenAIRE