Zobrazeno 1 - 10
of 2 876
pro vyhledávání: '"Ma, Chi A."'
Dynamic activation (DA) techniques, such as DejaVu and MoEfication, have demonstrated their potential to significantly enhance the inference efficiency of large language models (LLMs). However, these techniques often rely on ReLU activation functions
Externí odkaz:
http://arxiv.org/abs/2408.11393
Autor:
Shi, Xinzheng, Fu, Hui, Huang, Zhenghua, Yan, Limei, Ma, Chi, Huangfu, Chenxi, Song, Hongqiang, Xia, Lidong
The dependence of the sources and properties of the near-Earth solar wind on solar cycle activity is an important issue in solar and space physics. We use the improved two-step mapping procedure that takes into account the initial acceleration proces
Externí odkaz:
http://arxiv.org/abs/2407.00915
Massive Over-activation Yielded Uplifts(MOYU) is an inherent property of large language models, and dynamic activation(DA) based on the MOYU property is a clever yet under-explored strategy designed to accelerate inference in these models. Existing m
Externí odkaz:
http://arxiv.org/abs/2406.12569
In this work, we systematically investigate the efficacy of dynamic activation mechanisms within the LLaMA family of language models. Despite the potential of dynamic activation methods to reduce computation and increase speed in models using the ReL
Externí odkaz:
http://arxiv.org/abs/2405.09274
Pipeline parallelism is an essential technique in the training of large-scale Transformer models. However, it suffers from imbalanced memory consumption, leading to insufficient memory utilization. The BPipe technique was proposed to address this iss
Externí odkaz:
http://arxiv.org/abs/2401.02088
Autor:
Ma, Chi1 (AUTHOR) machi@zemt.cn, Xu, Wenzhong1 (AUTHOR) iwisdomxu@163.com, Liu, Mingtian1 (AUTHOR), Hong, Jianfeng2 (AUTHOR) jfhong@bjtu.edu.cn
Publikováno v:
Energies (19961073). Sep2024, Vol. 17 Issue 18, p4666. 14p.
Autor:
Deng, Zhe1,2 (AUTHOR), Ma, Chi3 (AUTHOR), Xia, Zhiguo1 (AUTHOR) xzgyy88@163.com, Ma, Qiangying1 (AUTHOR), Lu, Zengxiang1 (AUTHOR) zengxiang_lu@sohu.com
Publikováno v:
Scientific Reports. 9/11/2024, Vol. 14 Issue 1, p1-14. 14p.
Publikováno v:
In Chemical Engineering Journal 15 October 2024 498
Publikováno v:
In Geochimica et Cosmochimica Acta 15 October 2024 383:108-119
Autor:
Ding, Zhenni, Cao, Yanhui, Ye, Zhimin, Zhuang, Haiyan, Wang, Jingjing, Huang, Congshu, Ma, Chi
Publikováno v:
In Ceramics International 15 October 2024 50(20) Part A:38140-38148