Zobrazeno 1 - 2
of 2
pro vyhledávání: '"Gu, Sipei"'
Autor:
Xu, Si, Huang, Zixiao, Zeng, Yan, Yan, Shengen, Ning, Xuefei, Zhang, Quanlu, Ye, Haolin, Gu, Sipei, Shui, Chunsheng, Lin, Zhezheng, Zhang, Hao, Wang, Sheng, Dai, Guohao, Wang, Yu
Training large-scale models relies on a vast number of computing resources. For example, training the GPT-4 model (1.8 trillion parameters) requires 25000 A100 GPUs . It is a challenge to build a large-scale cluster with one type of GPU-accelerator.
Externí odkaz:
http://arxiv.org/abs/2405.16256
Publikováno v:
In Pattern Recognition March 2025 159
