NorBench -- A Benchmark for Norwegian Language Models (2305.03880v1)

Abstract: We present NorBench: a streamlined suite of NLP tasks and probes for evaluating Norwegian LLMs (LMs) on standardized data splits and evaluation metrics. We also introduce a range of new Norwegian LLMs (both encoder and encoder-decoder based). Finally, we compare and analyze their performance, along with other existing LMs, across the different benchmark tests of NorBench.