Mi{\dh}eind's WMT 2021 submission

Autor: Símonarson, Haukur Barri, Snæbjarnarson, Vésteinn, Ragnarsson, Pétur Orri, Jónsson, Haukur Páll, Þorsteinsson, Vilhjálmur
Rok vydání: 2021
Předmět:
Zdroj: 2021.wmt-1.9
Druh dokumentu: Working Paper
Popis: We present Mi{\dh}eind's submission for the English$\to$Icelandic and Icelandic$\to$English subsets of the 2021 WMT news translation task. Transformer-base models are trained for translation on parallel data to generate backtranslations iteratively. A pretrained mBART-25 model is then adapted for translation using parallel data as well as the last backtranslation iteration. This adapted pretrained model is then used to re-generate backtranslations, and the training of the adapted model is continued.
Databáze: arXiv