EENLP: Cross-lingual Eastern European NLP Index

Autor: Tikhonov, Alexey, Malkhasov, Alex, Manoshin, Andrey, Dima, George, Cserháti, Réka, Asif, Md. Sadek Hossain, Sárdi, Matt
Rok vydání: 2021
Předmět:
Druh dokumentu: Working Paper
Popis: Motivated by the sparsity of NLP resources for Eastern European languages, we present a broad index of existing Eastern European language resources (90+ datasets and 45+ models) published as a github repository open for updates from the community. Furthermore, to support the evaluation of commonsense reasoning tasks, we provide hand-crafted cross-lingual datasets for five different semantic tasks (namely news categorization, paraphrase detection, Natural Language Inference (NLI) task, tweet sentiment detection, and news sentiment detection) for some of the Eastern European languages. We perform several experiments with the existing multilingual models on these datasets to define the performance baselines and compare them to the existing results for other languages.
Comment: Accepted for LREC 2022. 5 pages, 1 figure. Originally EEML 2021 project
Databáze: arXiv
načítá se...