Manual and Automatic Paraphrases for MT Evaluation

Autor: Tamchyna, Aleš, Barančíková, Petra
Jazyk: angličtina
Rok vydání: 2016
Zdroj: [Paris] : European Language Resources Association 3543-3548 (2016).
LREC 2016, Tenth International Conference on Language Resources and Evaluation : May 23-28, 2016, Grand Hotel Bernardin Conference Center, Portorož, Slovenia / editors: Nicoletta Calzolari (conference chair), Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asunción Moreno, Jan Odijk, Stelios Piperidis ; organization: European Language Resources Association, Evaluation and Language resources Distribution Agency, Istituto di Linguistica Computazionale
LREC 2016, Tenth International Conference on Language Resources and Evaluation : May 23-28, 2016, Grand Hotel Bernardin Conference Center, Portorož, Slovenia / editors: Nicoletta Calzolari (conference chair), Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asunción Moreno, Jan Odijk, Stelios Piperidis ; organization: European Language Resources Association, Evaluation and Language resources Distribution Agency, Istituto di Linguistica Computazionale10. International Conference on Language Resources and Evaluation, LREC 2016, Portorož, Slovenia, 2016-05-23-2016-05-28
Popis: Paraphrasing of reference translations has been shown to improve the correlation with human judgements in automatic evaluation of machine translation (MT) outputs. In this work, we present a new dataset for evaluating English-Czech translation based on automatic paraphrases. We compare this dataset with an existing set of manually created paraphrases and find that even automatic paraphrases can improve MT evaluation. We have also propose and evaluate several criteria for selecting suitable reference translations from a larger set.
Databáze: OpenAIRE