Zobrazeno 1 - 4
of 4
pro vyhledávání: '"Watts, Ishaan"'
Autor:
Watts, Ishaan, Gumma, Varun, Yadavalli, Aditya, Seshadri, Vivek, Swaminathan, Manohar, Sitaram, Sunayana
Evaluation of multilingual Large Language Models (LLMs) is challenging due to a variety of factors -- the lack of benchmarks with sufficient linguistic diversity, contamination of popular benchmarks into LLM pre-training data and the lack of local, c
Externí odkaz:
http://arxiv.org/abs/2406.15053
Autor:
de Wynter, Adrian, Watts, Ishaan, Altıntoprak, Nektar Ege, Wongsangaroonsri, Tua, Zhang, Minghui, Farra, Noura, Baur, Lena, Claudet, Samantha, Gajdusek, Pavel, Gören, Can, Gu, Qilong, Kaminska, Anna, Kaminski, Tomasz, Kuo, Ruby, Kyuba, Akiko, Lee, Jongho, Mathur, Kartik, Merok, Petter, Milovanović, Ivana, Paananen, Nani, Paananen, Vesa-Matti, Pavlenko, Anna, Vidal, Bruno Pereira, Strika, Luciano, Tsao, Yueh, Turcato, Davide, Vakhno, Oleksandr, Velcsov, Judit, Vickers, Anna, Visser, Stéphanie, Widarmanto, Herdyan, Zaikin, Andrey, Chen, Si-Qing
Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale: can we exp
Externí odkaz:
http://arxiv.org/abs/2404.14397
Parameter Efficient Finetuning (PEFT) has emerged as a viable solution for improving the performance of Large Language Models (LLMs) without requiring massive resources and compute. Prior work on multilingual evaluation has shown that there is a larg
Externí odkaz:
http://arxiv.org/abs/2401.07598
Autor:
Ahuja, Sanchit, Aggarwal, Divyanshu, Gumma, Varun, Watts, Ishaan, Sathe, Ashutosh, Ochieng, Millicent, Hada, Rishav, Jain, Prachi, Axmed, Maxamed, Bali, Kalika, Sitaram, Sunayana
There has been a surge in LLM evaluation research to understand LLM capabilities and limitations. However, much of this research has been confined to English, leaving LLM building and evaluation for non-English languages relatively unexplored. Severa
Externí odkaz:
http://arxiv.org/abs/2311.07463