Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

Autor: Sun, Xingwu, Chen, Yanfeng, Huang, Yiqing, Xie, Ruobing, Zhu, Jiaqi, Zhang, Kai, Li, Shuaipeng, Yang, Zhen, Han, Jonny, Shu, Xiaobo, Bu, Jiahao, Chen, Zhongzhi, Huang, Xuemeng, Lian, Fengzong, Yang, Saiyong, Yan, Jianfeng, Zeng, Yuyuan, Ren, Xiaoqin, Yu, Chao, Wu, Lulu, Mao, Yue, Xia, Jun, Yang, Tao, Zheng, Suncong, Wu, Kan, Jiao, Dian, Xue, Jinbao, Zhang, Xipeng, Wu, Decheng, Liu, Kai, Wu, Dengpeng, Xu, Guanghui, Chen, Shaohua, Chen, Shuang, Feng, Xiao, Hong, Yigeng, Zheng, Junqiang, Xu, Chengcheng, Li, Zongwei, Kuang, Xiong, Hu, Jianglu, Chen, Yiqi, Deng, Yuchi, Li, Guiyang, Liu, Ao, Zhang, Chenchen, Hu, Shihui, Zhao, Zilong, Wu, Zifan, Ding, Yao, Wang, Weichao, Liu, Han, Wang, Roberts, Fei, Hao, Yu, Peijie, Zhao, Ze, Cao, Xun, Wang, Hai, Xiang, Fusheng, Huang, Mengyuan, Xiong, Zhiyuan, Hu, Bin, Hou, Xuebin, Jiang, Lei, Ma, Jianqiang, Wu, Jiajia, Deng, Yaping, Shen, Yi, Wang, Qian, Liu, Weijie, Liu, Jie, Chen, Meng, Dong, Liang, Jia, Weiwen, Chen, Hu, Liu, Feifei, Yuan, Rui, Xu, Huilin, Yan, Zhenxiang, Cao, Tengfei, Hu, Zhichao, Feng, Xinhua, Du, Dong, Yu, Tinghao, Tao, Yangyu, Zhang, Feng, Zhu, Jianchen, Xu, Chengzhong, Li, Xirui, Zha, Chong, Ouyang, Wen, Xia, Yinben, Li, Xiang, He, Zekun, Chen, Rongpeng, Song, Jiawei, Chen, Ruibin, Jiang, Fan, Zhao, Chongqing, Wang, Bo, Gong, Hao, Gan, Rong, Hu, Winston, Kang, Zhanhui, Yang, Yong, Liu, Yuhong, Wang, Di, Jiang, Jie

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We c

Externí odkaz: http://arxiv.org/abs/2411.02265

COSMIC: A Galaxy Cluster Finding Algorithm Using Machine Learning

Autor: Tian, Da-Chuan, Yang, Yang, Wen, Zhong-Lue, Xia, Jun-Qing

Building a comprehensive catalog of galaxy clusters is a fundamental task for the studies on the structure formation and galaxy evolution. In this paper, we present COSMIC (Cluster Optical Search using Machine Intelligence in Catalogs), an algorithm

Externí odkaz: http://arxiv.org/abs/2410.20083

On the asymptotics of real solutions for the Painlev\'{e} I equation

Autor: Long, Wen-Gao, Xia, Jun

In this paper, we revisit the asymptotic formulas of real Painlev\'e I transcendents as the independent variable tends to negative infinity, which were initially derived by Kapaev with the complex WKB method. Using the Riemann-Hilbert method, we impr

Externí odkaz: http://arxiv.org/abs/2409.03313

Constraints on Primordial Magnetic Fields from High Redshift Stellar Mass Density

Autor: Zhang, Qile, Li, Shang, Tan, Xiu-Hui, Xia, Jun-Qing

Primordial magnetic fields (PMFs) play a pivotal role in influencing small-scale fluctuations within the primordial density field, thereby enhancing the matter power spectrum within the context of the $\Lambda$CDM model at small scales. These amplifi

Externí odkaz: http://arxiv.org/abs/2408.03584

NovoBench: Benchmarking Deep Learning-based De Novo Peptide Sequencing Methods in Proteomics

Autor: Zhou, Jingbo, Chen, Shaorong, Xia, Jun, Liu, Sizhe, Ling, Tianze, Du, Wenjie, Liu, Yue, Yin, Jianwei, Li, Stan Z.

Tandem mass spectrometry has played a pivotal role in advancing proteomics, enabling the high-throughput analysis of protein composition in biological tissues. Many deep learning methods have been developed for \emph{de novo} peptide sequencing task,

Externí odkaz: http://arxiv.org/abs/2406.11906