NorBench -- A Benchmark for Norwegian Language Models

Autor: Samuel, David, Kutuzov, Andrey, Touileb, Samia, Velldal, Erik, Øvrelid, Lilja, Rønningstad, Egil, Sigdel, Elina, Palatkina, Anna
Rok vydání: 2023
Předmět:
Druh dokumentu: Working Paper
Popis: We present NorBench: a streamlined suite of NLP tasks and probes for evaluating Norwegian language models (LMs) on standardized data splits and evaluation metrics. We also introduce a range of new Norwegian language models (both encoder and encoder-decoder based). Finally, we compare and analyze their performance, along with other existing LMs, across the different benchmark tests of NorBench.
Comment: Accepted to NoDaLiDa 2023
Databáze: arXiv