Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

Autor: Sun, Xingwu, Chen, Yanfeng, Huang, Yiqing, Xie, Ruobing, Zhu, Jiaqi, Zhang, Kai, Li, Shuaipeng, Yang, Zhen, Han, Jonny, Shu, Xiaobo, Bu, Jiahao, Chen, Zhongzhi, Huang, Xuemeng, Lian, Fengzong, Yang, Saiyong, Yan, Jianfeng, Zeng, Yuyuan, Ren, Xiaoqin, Yu, Chao, Wu, Lulu, Mao, Yue, Xia, Jun, Yang, Tao, Zheng, Suncong, Wu, Kan, Jiao, Dian, Xue, Jinbao, Zhang, Xipeng, Wu, Decheng, Liu, Kai, Wu, Dengpeng, Xu, Guanghui, Chen, Shaohua, Chen, Shuang, Feng, Xiao, Hong, Yigeng, Zheng, Junqiang, Xu, Chengcheng, Li, Zongwei, Kuang, Xiong, Hu, Jianglu, Chen, Yiqi, Deng, Yuchi, Li, Guiyang, Liu, Ao, Zhang, Chenchen, Hu, Shihui, Zhao, Zilong, Wu, Zifan, Ding, Yao, Wang, Weichao, Liu, Han, Wang, Roberts, Fei, Hao, Yu, Peijie, Zhao, Ze, Cao, Xun, Wang, Hai, Xiang, Fusheng, Huang, Mengyuan, Xiong, Zhiyuan, Hu, Bin, Hou, Xuebin, Jiang, Lei, Ma, Jianqiang, Wu, Jiajia, Deng, Yaping, Shen, Yi, Wang, Qian, Liu, Weijie, Liu, Jie, Chen, Meng, Dong, Liang, Jia, Weiwen, Chen, Hu, Liu, Feifei, Yuan, Rui, Xu, Huilin, Yan, Zhenxiang, Cao, Tengfei, Hu, Zhichao, Feng, Xinhua, Du, Dong, Yu, Tinghao, Tao, Yangyu, Zhang, Feng, Zhu, Jianchen, Xu, Chengzhong, Li, Xirui, Zha, Chong, Ouyang, Wen, Xia, Yinben, Li, Xiang, He, Zekun, Chen, Rongpeng, Song, Jiawei, Chen, Ruibin, Jiang, Fan, Zhao, Chongqing, Wang, Bo, Gong, Hao, Gan, Rong, Hu, Winston, Kang, Zhanhui, Yang, Yong, Liu, Yuhong, Wang, Di, Jiang, Jie

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We c

Externí odkaz: http://arxiv.org/abs/2411.02265

Predictions and Measurements of Thermal Conductivity of Ceramic Materials at High Temperature

Autor: Han, Zherui, Xiong, Zixin, Riffe, William T., Schonfeld, Hunter B., Segovia, Mauricio, Song, Jiawei, Wang, Haiyan, Xu, Xianfan, Hopkins, Patrick E., Marconnet, Amy, Ruan, Xiulin

Publikováno v: Phys. Rev. B 108, 184306 (2023)

The lattice thermal conductivity ($\kappa$) of two ceramic materials, cerium dioxide (CeO$_2$) and magnesium oxide (MgO), is computed up to 1500 K using first principles and the phonon Boltzmann Transport Equation (PBTE) and compared to time-domain t

Externí odkaz: http://arxiv.org/abs/2305.10918

Validating quantum-supremacy experiments with exact and fast tensor network contraction

Autor: Liu, Yong, Chen, Yaojian, Guo, Chu, Song, Jiawei, Shi, Xinmin, Gan, Lin, Wu, Wenzhao, Wu, Wei, Fu, Haohuan, Liu, Xin, Chen, Dexun, Zhao, Zhifeng, Yang, Guangwen, Gao, Jiangang

Publikováno v: Physical Review Letters, 132, 030601 (2024)

The quantum supremacy experiment, such as Google Sycamore [Nature \textbf{574}, 505 (2019)], poses great challenge for classical verification due to the exponentially-increasing compute cost. Using a new-generation Sunway supercomputer within $8.5$ d

Externí odkaz: http://arxiv.org/abs/2212.04749

Lifetime-based Optimization for Simulating Quantum Circuits on a New Sunway Supercomputer

Autor: Chen, Yaojian, Liu, Yong, Shi, Xinmin, Song, Jiawei, Liu, Xin, Gan, Lin, Guo, Chu, Fu, Haohuan, Gao, Jie, Chen, Dexun, Yang, Guangwen

Publikováno v: Proceedings of the 28th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (2023) 148-159

High-performance classical simulator for quantum circuits, in particular the tensor network contraction algorithm, has become an important tool for the validation of noisy quantum computing. In order to address the memory limitations, the slicing tec

Externí odkaz: http://arxiv.org/abs/2205.00393

Buyang Huanwu decoction promotes angiogenesis and improves hemorheological parameters after cervical spinal cord injury

Autor: Xu, Luchun, Yang, Yongdong, Jiang, Guozheng, Gao, Yushan, Song, Jiawei, Ma, Yukun, Fan, Jiaojiao, Wang, Guanlong, Yu, Xing, Tang, Xiangsheng

Publikováno v: In Journal of Traditional Chinese Medical Sciences October 2024 11(4):456-465