Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

Autor: Sun, Xingwu, Chen, Yanfeng, Huang, Yiqing, Xie, Ruobing, Zhu, Jiaqi, Zhang, Kai, Li, Shuaipeng, Yang, Zhen, Han, Jonny, Shu, Xiaobo, Bu, Jiahao, Chen, Zhongzhi, Huang, Xuemeng, Lian, Fengzong, Yang, Saiyong, Yan, Jianfeng, Zeng, Yuyuan, Ren, Xiaoqin, Yu, Chao, Wu, Lulu, Mao, Yue, Xia, Jun, Yang, Tao, Zheng, Suncong, Wu, Kan, Jiao, Dian, Xue, Jinbao, Zhang, Xipeng, Wu, Decheng, Liu, Kai, Wu, Dengpeng, Xu, Guanghui, Chen, Shaohua, Chen, Shuang, Feng, Xiao, Hong, Yigeng, Zheng, Junqiang, Xu, Chengcheng, Li, Zongwei, Kuang, Xiong, Hu, Jianglu, Chen, Yiqi, Deng, Yuchi, Li, Guiyang, Liu, Ao, Zhang, Chenchen, Hu, Shihui, Zhao, Zilong, Wu, Zifan, Ding, Yao, Wang, Weichao, Liu, Han, Wang, Roberts, Fei, Hao, Yu, Peijie, Zhao, Ze, Cao, Xun, Wang, Hai, Xiang, Fusheng, Huang, Mengyuan, Xiong, Zhiyuan, Hu, Bin, Hou, Xuebin, Jiang, Lei, Ma, Jianqiang, Wu, Jiajia, Deng, Yaping, Shen, Yi, Wang, Qian, Liu, Weijie, Liu, Jie, Chen, Meng, Dong, Liang, Jia, Weiwen, Chen, Hu, Liu, Feifei, Yuan, Rui, Xu, Huilin, Yan, Zhenxiang, Cao, Tengfei, Hu, Zhichao, Feng, Xinhua, Du, Dong, Yu, Tinghao, Tao, Yangyu, Zhang, Feng, Zhu, Jianchen, Xu, Chengzhong, Li, Xirui, Zha, Chong, Ouyang, Wen, Xia, Yinben, Li, Xiang, He, Zekun, Chen, Rongpeng, Song, Jiawei, Chen, Ruibin, Jiang, Fan, Zhao, Chongqing, Wang, Bo, Gong, Hao, Gan, Rong, Hu, Winston, Kang, Zhanhui, Yang, Yong, Liu, Yuhong, Wang, Di, Jiang, Jie

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We c

Externí odkaz: http://arxiv.org/abs/2411.02265

pH-Responsive Aqueous Foams of Oleic Acid/Oleate Solution.

Autor: Shu, Xiaobo¹ (AUTHOR), Meng, Yingfeng¹ (AUTHOR), Wan, Liping¹ (AUTHOR) wanliping72@163.com, Li, Gao¹ (AUTHOR) lgmichael@263.net, Yang, Mou¹ (AUTHOR), Jin, Wenbo¹ (AUTHOR)

Publikováno v: Journal of Dispersion Science & Technology. Feb2014, Vol. 35 Issue 2, p293-300. 8p. 3 Black and White Photographs, 2 Charts, 4 Graphs.

Flooding hazard mapping for Poyang Lake Region with remote sensing and water level records

Autor: QI Shuhua, Daniel Brown, Shu Xiaobo, Jiang Luguang

Publikováno v: Journal of Lake Sciences. 21:720-724

Flooding is a natural calamity that can caused great loss. Flooding hazard mapping is an effective tool for managing flooding to reduce the destructivity. In this paper, we suggested a new method to map the flooding hazard for alluvial plain with mul

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_________::5e9b8ec32fe58a8b06c51812953a797b
https://doi.org/10.18307/2009.0517

Effect of pH value on foaming properties of oleate and recirculating utilization mechanism of foam. (English)

Autor: Zhu Li, Wan Liping, Gu Siman, Shu Xiaobo, Zhai Lituan, Tao Jie

Publikováno v: Chemical Engineering of Oil & Gas / Shi You Yu Tian Ran Qi Hua Gong; 2014, Vol. 43 Issue 3, p292-296, 5p