Výsledky vyhledávání - "Mathematical understanding"

Report

Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs

Autor: Guo, Siyuan, Didolkar, Aniket, Ke, Nan Rosemary, Goyal, Anirudh, Huszár, Ferenc, Schölkopf, Bernhard

We are beginning to see progress in language model assisted scientific discovery. Motivated by the use of LLMs as a general scientific assistant, this paper assesses the domain knowledge of LLMs through its understanding of different mathematical ski

Externí odkaz: http://arxiv.org/abs/2405.15485

Zobrazit plný text záznamu

Report

The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian

Autor: Puccetti, Giovanni, Cassese, Maria, Esuli, Andrea

While Italian is a high-resource language, there are few Italian-native benchmarks to evaluate generative Large Language Models (LLMs) in this language. This work presents three new benchmarks: Invalsi MATE to evaluate models performance on mathemati

Externí odkaz: http://arxiv.org/abs/2403.18697

Zobrazit plný text záznamu