Zobrazeno 1 - 3
of 3
pro vyhledávání: '"Peng, Runyu"'
Autor:
Zhu, Qin, Cheng, Qingyuan, Peng, Runyu, Li, Xiaonan, Liu, Tengxiao, Peng, Ru, Qiu, Xipeng, Huang, Xuanjing
The training process of large language models (LLMs) often involves varying degrees of test data contamination. Although current LLMs are achieving increasingly better performance on various benchmarks, their performance in practical applications doe
Externí odkaz:
http://arxiv.org/abs/2406.13990
Autor:
Qiu, Jiantao, Lv, Haijun, Jin, Zhenjiang, Wang, Rui, Ning, Wenchang, Yu, Jia, Zhang, ChaoBin, Li, Zhenxiang, Chu, Pei, Qu, Yuan, Shi, Jin, Lu, Lindong, Peng, Runyu, Zeng, Zhiyuan, Tang, Huanze, Lei, Zhikai, Hong, Jiawei, Chen, Keyu, Fei, Zhaoye, Xu, Ruiliang, Li, Wei, Tu, Zhongying, Dahua, Lin, Qiao, Yu, Yan, Hang, He, Conghui
This paper presents WanJuan-CC, a safe and high-quality open-sourced English webtext dataset derived from Common Crawl data. The study addresses the challenges of constructing large-scale pre-training datasets for language models, which require vast
Externí odkaz:
http://arxiv.org/abs/2402.19282
Large Language Models (LLMs) are reshaping the research landscape in artificial intelligence, particularly as model parameters scale up significantly, unlocking remarkable capabilities across various domains. Nevertheless, the scalability of model pa
Externí odkaz:
http://arxiv.org/abs/2402.16319