TER-Plus: paraphrase, semantic, and alignment enhancements to Translation Edit Rate

Autor: Matthew Snover, Bonnie J. Dorr, Nitin Madnani, Richard Schwartz
Rok vydání: 2009
Předmět:
Zdroj: Machine Translation. 23:117-127
ISSN: 1573-0573
0922-6567
DOI: 10.1007/s10590-009-9062-9
Popis: This paper describes a new evaluation metric, TER-Plus (TERp) for automatic evaluation of machine translation (MT). TERp is an extension of Translation Edit Rate (TER). It builds on the success of TER as an evaluation metric and alignment tool and addresses several of its weaknesses through the use of paraphrases, stemming, synonyms, as well as edit costs that can be automatically optimized to correlate better with various types of human judgments. We present a correlation study comparing TERp to BLEU, METEOR and TER, and illustrate that TERp can better evaluate translation adequacy.
Databáze: OpenAIRE