Zobrazeno 1 - 1
of 1
pro vyhledávání: '"Hellsten, Simi"'
Autor:
Bean, Andrew M., Hellsten, Simi, Mayne, Harry, Magomere, Jabez, Chi, Ethan A., Chi, Ryan, Hale, Scott A., Kirk, Hannah Rose
In this paper, we present the LingOly benchmark, a novel benchmark for advanced reasoning abilities in large language models. Using challenging Linguistic Olympiad puzzles, we evaluate (i) capabilities for in-context identification and generalisation
Externí odkaz:
http://arxiv.org/abs/2406.06196