Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning

Autor: An, Wei, Bi, Xiao, Chen, Guanting, Chen, Shanhuang, Deng, Chengqi, Ding, Honghui, Dong, Kai, Du, Qiushi, Gao, Wenjun, Guan, Kang, Guo, Jianzhong, Guo, Yongqiang, Fu, Zhe, He, Ying, Huang, Panpan, Li, Jiashi, Liang, Wenfeng, Liu, Xiaodong, Liu, Xin, Liu, Yiyuan, Liu, Yuxuan, Lu, Shanghao, Lu, Xuan, Nie, Xiaotao, Pei, Tian, Qiu, Junjie, Qu, Hui, Ren, Zehui, Sha, Zhangli, Su, Xuecheng, Sun, Xiaowen, Tan, Yixuan, Tang, Minghui, Wang, Shiyu, Wang, Yaohui, Wang, Yongji, Xie, Ziwei, Xiong, Yiliang, Xu, Yanhong, Ye, Shengfeng, Yu, Shuiping, Zha, Yukun, Zhang, Liyue, Zhang, Haowei, Zhang, Mingchuan, Zhang, Wentao, Zhang, Yichao, Zhao, Chenggang, Zhao, Yao, Zhou, Shangyan, Zhou, Shunfeng, Zou, Yuheng

The rapid progress in Deep Learning (DL) and Large Language Models (LLMs) has exponentially increased demands of computational power and bandwidth. This, combined with the high costs of faster computing chips and interconnects, has significantly infl

Externí odkaz: http://arxiv.org/abs/2408.14158

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Autor: DeepSeek-AI, Liu, Aixin, Feng, Bei, Wang, Bin, Wang, Bingxuan, Liu, Bo, Zhao, Chenggang, Dengr, Chengqi, Ruan, Chong, Dai, Damai, Guo, Daya, Yang, Dejian, Chen, Deli, Ji, Dongjie, Li, Erhang, Lin, Fangyun, Luo, Fuli, Hao, Guangbo, Chen, Guanting, Li, Guowei, Zhang, H., Xu, Hanwei, Yang, Hao, Zhang, Haowei, Ding, Honghui, Xin, Huajian, Gao, Huazuo, Li, Hui, Qu, Hui, Cai, J. L., Liang, Jian, Guo, Jianzhong, Ni, Jiaqi, Li, Jiashi, Chen, Jin, Yuan, Jingyang, Qiu, Junjie, Song, Junxiao, Dong, Kai, Gao, Kaige, Guan, Kang, Wang, Lean, Zhang, Lecong, Xu, Lei, Xia, Leyi, Zhao, Liang, Zhang, Liyue, Li, Meng, Wang, Miaojun, Zhang, Mingchuan, Zhang, Minghua, Tang, Minghui, Li, Mingming, Tian, Ning, Huang, Panpan, Wang, Peiyi, Zhang, Peng, Zhu, Qihao, Chen, Qinyu, Du, Qiushi, Chen, R. J., Jin, R. L., Ge, Ruiqi, Pan, Ruizhe, Xu, Runxin, Chen, Ruyi, Li, S. S., Lu, Shanghao, Zhou, Shangyan, Chen, Shanhuang, Wu, Shaoqing, Ye, Shengfeng, Ma, Shirong, Wang, Shiyu, Zhou, Shuang, Yu, Shuiping, Zhou, Shunfeng, Zheng, Size, Wang, T., Pei, Tian, Yuan, Tian, Sun, Tianyu, Xiao, W. L., Zeng, Wangding, An, Wei, Liu, Wen, Liang, Wenfeng, Gao, Wenjun, Zhang, Wentao, Li, X. Q., Jin, Xiangyue, Wang, Xianzu, Bi, Xiao, Liu, Xiaodong, Wang, Xiaohan, Shen, Xiaojin, Chen, Xiaokang, Chen, Xiaosha, Nie, Xiaotao, Sun, Xiaowen, Wang, Xiaoxiang, Liu, Xin, Xie, Xin, Yu, Xingkai, Song, Xinnan, Zhou, Xinyi, Yang, Xinyu, Lu, Xuan, Su, Xuecheng, Wu, Y., Li, Y. K., Wei, Y. X., Zhu, Y. X., Xu, Yanhong, Huang, Yanping, Li, Yao, Zhao, Yao, Sun, Yaofeng, Li, Yaohui, Wang, Yaohui, Zheng, Yi, Zhang, Yichao, Xiong, Yiliang, Zhao, Yilong, He, Ying, Tang, Ying, Piao, Yishi, Dong, Yixin, Tan, Yixuan, Liu, Yiyuan, Wang, Yongji, Guo, Yongqiang, Zhu, Yuchen, Wang, Yuduan, Zou, Yuheng, Zha, Yukun, Ma, Yunxian, Yan, Yuting, You, Yuxiang, Liu, Yuxuan, Ren, Z. Z., Ren, Zehui, Sha, Zhangli, Fu, Zhe, Huang, Zhen, Zhang, Zhen, Xie, Zhenda, Hao, Zhewen, Shao, Zhihong, Wen, Zhiniu, Xu, Zhipeng, Zhang, Zhongyu, Li, Zhuoshu, Wang, Zihan, Gu, Zihui, Li, Zilin, Xie, Ziwei

We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128

Externí odkaz: http://arxiv.org/abs/2405.04434

The comparison of microstructure and oxidation behaviors of (SiC-C)/PyC/SiC and C/PyCHT/SiC composites in air

Autor: Liu Shanhua, Zhang Litong, Yin Xiaowei, Liu Yongsheng, Cheng Laifei, Li Hui, Zhao Chunnian, Guan Kang

Publikováno v: Science and Engineering of Composite Materials, Vol 22, Iss 4, Pp 417-423 (2015)

Silicon carbide matrix composite reinforced by both SiC and carbon fibers [(SiC-C)/PyC/SiC] to alleviate the thermal residual stresses (TRS) between carbon fiber and SiC matrix, then reduce the microcracks in the SiC coating as well as in the matrix,

Externí odkaz: https://doaj.org/article/d13d937c81cf47e4b423adbc04191d91

A numerical-experimental approach to simulate the sintering behavior of “cer-cer” fuels by NITE process

Autor: Guan, Kang, He, Zongbei, Zeng, Qingfeng, Liu, Jiantao, Zhang, Chuxin, Peng, Cheng

Publikováno v: In Journal of Nuclear Materials January 2024 588

A multiscale model for CVD growth of silicon carbide

Autor: Guan, Kang, Zeng, Qingfeng, Liu, Yongsheng, Luan, Xin'gang, Lu, Zhenya, Wu, Jianqing

Publikováno v: In Computational Materials Science August 2021 196