Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

Autor: Sun, Xingwu, Chen, Yanfeng, Huang, Yiqing, Xie, Ruobing, Zhu, Jiaqi, Zhang, Kai, Li, Shuaipeng, Yang, Zhen, Han, Jonny, Shu, Xiaobo, Bu, Jiahao, Chen, Zhongzhi, Huang, Xuemeng, Lian, Fengzong, Yang, Saiyong, Yan, Jianfeng, Zeng, Yuyuan, Ren, Xiaoqin, Yu, Chao, Wu, Lulu, Mao, Yue, Xia, Jun, Yang, Tao, Zheng, Suncong, Wu, Kan, Jiao, Dian, Xue, Jinbao, Zhang, Xipeng, Wu, Decheng, Liu, Kai, Wu, Dengpeng, Xu, Guanghui, Chen, Shaohua, Chen, Shuang, Feng, Xiao, Hong, Yigeng, Zheng, Junqiang, Xu, Chengcheng, Li, Zongwei, Kuang, Xiong, Hu, Jianglu, Chen, Yiqi, Deng, Yuchi, Li, Guiyang, Liu, Ao, Zhang, Chenchen, Hu, Shihui, Zhao, Zilong, Wu, Zifan, Ding, Yao, Wang, Weichao, Liu, Han, Wang, Roberts, Fei, Hao, Yu, Peijie, Zhao, Ze, Cao, Xun, Wang, Hai, Xiang, Fusheng, Huang, Mengyuan, Xiong, Zhiyuan, Hu, Bin, Hou, Xuebin, Jiang, Lei, Ma, Jianqiang, Wu, Jiajia, Deng, Yaping, Shen, Yi, Wang, Qian, Liu, Weijie, Liu, Jie, Chen, Meng, Dong, Liang, Jia, Weiwen, Chen, Hu, Liu, Feifei, Yuan, Rui, Xu, Huilin, Yan, Zhenxiang, Cao, Tengfei, Hu, Zhichao, Feng, Xinhua, Du, Dong, Yu, Tinghao, Tao, Yangyu, Zhang, Feng, Zhu, Jianchen, Xu, Chengzhong, Li, Xirui, Zha, Chong, Ouyang, Wen, Xia, Yinben, Li, Xiang, He, Zekun, Chen, Rongpeng, Song, Jiawei, Chen, Ruibin, Jiang, Fan, Zhao, Chongqing, Wang, Bo, Gong, Hao, Gan, Rong, Hu, Winston, Kang, Zhanhui, Yang, Yong, Liu, Yuhong, Wang, Di, Jiang, Jie

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We c

Externí odkaz: http://arxiv.org/abs/2411.02265

Numerical optimization of obstacles channel geometry for solid oxide fuel cells

Autor: Zhang, Wenying, Zhang, Wenchao, Kuang, Xiong, Jia, Lichao, Yan, Dong

Publikováno v: In International Journal of Hydrogen Energy 15 December 2023 48(97):38438-38453

Elevated expression of myosin VI contributes to breast cancer progression via MAPK/ERK signaling pathway

Autor: Zhan, Xiao-Juan, Wang, Rui, Kuang, Xiong-Ri, Zhou, Jue-Yu, Hu, Xiao-Lei

Publikováno v: In Cellular Signalling June 2023 106

The neighborhood effects of provincial-level stock market participation in China

Autor: Liu, Zhifeng, Zhang, Tingting, Li, Wenquan, Kuang, Xiong

Publikováno v: In Physica A: Statistical Mechanics and its Applications 1 November 2018 509:459-468

Thrombectomy Using “Clamping Embolus with Semi-Retrieval” Technique in Acute Ischemic Stroke

Autor: Liu, Zhen-Sheng ^*, Zhou, Long-Jiang, Sun, Yong, Kuang, Xiong-Wei, Wang, Jia-Xiang, Zhang, Xin-Jiang

Publikováno v: In Journal of Stroke and Cerebrovascular Diseases March 2018 27(3):733-739