Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

Autor: Sun, Xingwu, Chen, Yanfeng, Huang, Yiqing, Xie, Ruobing, Zhu, Jiaqi, Zhang, Kai, Li, Shuaipeng, Yang, Zhen, Han, Jonny, Shu, Xiaobo, Bu, Jiahao, Chen, Zhongzhi, Huang, Xuemeng, Lian, Fengzong, Yang, Saiyong, Yan, Jianfeng, Zeng, Yuyuan, Ren, Xiaoqin, Yu, Chao, Wu, Lulu, Mao, Yue, Xia, Jun, Yang, Tao, Zheng, Suncong, Wu, Kan, Jiao, Dian, Xue, Jinbao, Zhang, Xipeng, Wu, Decheng, Liu, Kai, Wu, Dengpeng, Xu, Guanghui, Chen, Shaohua, Chen, Shuang, Feng, Xiao, Hong, Yigeng, Zheng, Junqiang, Xu, Chengcheng, Li, Zongwei, Kuang, Xiong, Hu, Jianglu, Chen, Yiqi, Deng, Yuchi, Li, Guiyang, Liu, Ao, Zhang, Chenchen, Hu, Shihui, Zhao, Zilong, Wu, Zifan, Ding, Yao, Wang, Weichao, Liu, Han, Wang, Roberts, Fei, Hao, Yu, Peijie, Zhao, Ze, Cao, Xun, Wang, Hai, Xiang, Fusheng, Huang, Mengyuan, Xiong, Zhiyuan, Hu, Bin, Hou, Xuebin, Jiang, Lei, Ma, Jianqiang, Wu, Jiajia, Deng, Yaping, Shen, Yi, Wang, Qian, Liu, Weijie, Liu, Jie, Chen, Meng, Dong, Liang, Jia, Weiwen, Chen, Hu, Liu, Feifei, Yuan, Rui, Xu, Huilin, Yan, Zhenxiang, Cao, Tengfei, Hu, Zhichao, Feng, Xinhua, Du, Dong, Yu, Tinghao, Tao, Yangyu, Zhang, Feng, Zhu, Jianchen, Xu, Chengzhong, Li, Xirui, Zha, Chong, Ouyang, Wen, Xia, Yinben, Li, Xiang, He, Zekun, Chen, Rongpeng, Song, Jiawei, Chen, Ruibin, Jiang, Fan, Zhao, Chongqing, Wang, Bo, Gong, Hao, Gan, Rong, Hu, Winston, Kang, Zhanhui, Yang, Yong, Liu, Yuhong, Wang, Di, Jiang, Jie

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We c

Externí odkaz: http://arxiv.org/abs/2411.02265

A study on the scaled intelligent supply mode of biomass briquette fuel in China

Autor: Ke, Hang, Zhu, Xiaolei, Ding, Mingyue, Xu, Guanghui, Li, Baoqian, Li, Jin, Sun, Yufeng, Xu, Guangyin, Zhang, Runkai

Publikováno v: In Science of the Total Environment 15 December 2024 956

MgO anchored N-doping biochar enhances the bensulfuron-methyl biodegradation by Acinetobacter YH0317: Higher reactive oxygen species level and bacterial viability

Autor: Yang, Yang, Kang, Zhichao, Xu, Guanghui, Wang, Jian, Yu, Yong

Publikováno v: In Journal of Hazardous Materials 5 December 2024 480

Boost Test-Time Performance with Closed-Loop Inference

Autor: Niu, Shuaicheng, Wu, Jiaxiang, Zhang, Yifan, Xu, Guanghui, Li, Haokun, Zhao, Peilin, Huang, Junzhou, Wang, Yaowei, Tan, Mingkui

Conventional deep models predict a test sample with a single forward propagation, which, however, may not be sufficient for predicting hard-classified samples. On the contrary, we human beings may need to carefully check the sample many times before

Externí odkaz: http://arxiv.org/abs/2203.10853

Nickel oxide nanoparticles decrease the accumulation of atrazine in earthworms

Autor: Gao, Wenqi, Yu, Yong, Xu, Guanghui

Publikováno v: In Journal of Hazardous Materials 5 August 2024 474