Misalignment Detection for Web-Scraped Corpora: A Supervised Regression Approach
| Autor: | Roko Mijic, Frederic Everaert, Kim Scholte, Anna Bardadym, Sara Szoc, Arne Defauw, Koen Van Winckel, Joachim Van den Bogaert, Joris Brabers, Tom Vanallemeersch |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Machine translation
Computer Networks and Communications Computer science 02 engineering and technology computer.software_genre Translation (geometry) Task (project management) data-curation 0202 electrical engineering electronic engineering information engineering web crawling lcsh:T58.5-58.64 Data curation lcsh:Information technology business.industry Communication 020206 networking & telecommunications Pattern recognition Levenshtein distance neural machine translation Regression Human-Computer Interaction ComputingMethodologies_PATTERNRECOGNITION 020201 artificial intelligence & image processing Artificial intelligence business Web crawler computer Sentence |
| Zdroj: | Informatics Volume 6 Issue 3 Informatics, Vol 6, Iss 3, p 35 (2019) |
| ISSN: | 2227-9709 |
| DOI: | 10.3390/informatics6030035 |
| Popis: | To build state-of-the-art Neural Machine Translation (NMT) systems, high-quality parallel sentences are needed. Typically, large amounts of data are scraped from multilingual web sites and aligned into datasets for training. Many tools exist for automatic alignment of such datasets. However, the quality of the resulting aligned corpus can be disappointing. In this paper, we present a tool for automatic misalignment detection (MAD). We treated the task of determining whether a pair of aligned sentences constitutes a genuine translation as a supervised regression problem. We trained our algorithm on a manually labeled dataset in the FR&ndash NL language pair. Our algorithm used shallow features and features obtained after an initial translation step. We showed that both the Levenshtein distance between the target and the translated source, as well as the cosine distance between sentence embeddings of the source and the target were the two most important features for the task of misalignment detection. Using gold standards for alignment, we demonstrated that our model can increase the quality of alignments in a corpus substantially, reaching a precision close to 100%. Finally, we used our tool to investigate the effect of misalignments on NMT performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|