Work-in-Progress project report : CESTA - Machine Translation Evaluation Campaign
| Autor: | Martin Rajman, Ismaïl Timimi, Andrei Popescu Belis, Philippe Langlais, Marianne Dabbadie, Widad Mustafa El Hadi, Antony Hartley |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2004 |
| Předmět: |
Machine translation
business.industry Computer science Work in process computer.software_genre Task (project management) Set (abstract data type) World Wide Web ddc:410.2 IBM Adaptation (computer science) Software engineering business Protocol (object-oriented programming) computer Reliability (statistics) |
| Zdroj: | Second International Workshop on Language Resources for Translation Work, Research and Training pp. 8-17 Second International Workshop on Language Resources for Translation Work, Research and Training |
| Popis: | CESTA, the first European Campaign dedicated to MT Evaluation, is a project labelled by the French Technolangue action. CESTA provides an evaluation of six commercial and academic MT systems using a protocol set by an international panel of experts. CESTA aims at producing reusable resources and information about reliability of the metrics. Two runs will be carried out: one using the system's basic dictionary, another after terminological adaptation. Evaluation task, test material, resources, evaluation measures, metrics, will be detailed in the full paper. The protocol is the combination of a contrastive reference to: IBM "BLEU" protocol (Papineni, K., S. Roukos, T. Ward and Z. Wei-Jing, 2001); "BLANC" protocol derived from (Hartley, Rajman, 2002).; "ROUGE" protocol (Babych, Hartley, Atwell, 2003). The results of the campaign will be published in a final report and be the object of two intermediary and final workshops. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|