MiniMax-01: Scaling Foundation Models with Lightning Attention

Autor: MiniMax, Li, Aonian, Gong, Bangwei, Yang, Bo, Shan, Boji, Liu, Chang, Zhu, Cheng, Zhang, Chunhao, Guo, Congchao, Chen, Da, Li, Dong, Jiao, Enwei, Li, Gengxin, Zhang, Guojun, Sun, Haohai, Dong, Houze, Zhu, Jiadai, Zhuang, Jiaqi, Song, Jiayuan, Zhu, Jin, Han, Jingtao, Li, Jingyang, Xie, Junbin, Xu, Junhao, Yan, Junjie, Zhang, Kaishun, Xiao, Kecheng, Kang, Kexi, Han, Le, Wang, Leyang, Yu, Lianfei, Feng, Liheng, Zheng, Lin, Chai, Linbo, Xing, Long, Ju, Meizhi, Chi, Mingyuan, Zhang, Mozhi, Huang, Peikai, Niu, Pengcheng, Li, Pengfei, Zhao, Pengyu, Yang, Qi, Xu, Qidi, Wang, Qiexiang, Wang, Qin, Li, Qiuhui, Leng, Ruitao, Shi, Shengmin, Yu, Shuqi, Li, Sichen, Zhu, Songquan, Huang, Tao, Liang, Tianrun, Sun, Weigao, Sun, Weixuan, Cheng, Weiyu, Li, Wenkai, Song, Xiangjun, Su, Xiao, Han, Xiaodong, Zhang, Xinjie, Hou, Xinzhu, Min, Xu, Zou, Xun, Shen, Xuyang, Gong, Yan, Zhu, Yingjie, Zhou, Yipeng, Zhong, Yiran, Hu, Yongyi, Fan, Yuanxiang, Yu, Yue, Yang, Yufeng, Li, Yuhao, Huang, Yunan, Li, Yunji, Huang, Yunpeng, Xu, Yunzhi, Mao, Yuxin, Li, Zehan, Li, Zekang, Tao, Zewei, Ying, Zewen, Cong, Zhaoyang, Qin, Zhen, Fan, Zhenhua, Yu, Zhihang, Jiang, Zhuo, Wu, Zijia

We introduce MiniMax-01 series, including MiniMax-Text-01 and MiniMax-VL-01, which are comparable to top-tier models while offering superior capabilities in processing longer contexts. The core lies in lightning attention and its efficient scaling. T

Externí odkaz: http://arxiv.org/abs/2501.08313

Bounded cohomology property on smooth projective fibered surfaces

Autor: Li, Sichen

Let $X$ be a smooth projective surface and the closed Mori cone $\overline{\mathrm{NE}}(X)=\sum\mathbb R_{\ge0}[C_i]$ with some curves $C_i$ on $X$. We say that $X$ satisfies the bounded cohomology property if there exists a constant $c_X>0$ such tha

Externí odkaz: http://arxiv.org/abs/2306.07830

Review of Time Series Forecasting Methods and Their Applications to Particle Accelerators

Autor: Li, Sichen, Adelmann, Andreas

Particle accelerators are complex facilities that produce large amounts of structured data and have clear optimization goals as well as precisely defined control requirements. As such they are naturally amenable to data-driven research methodologies.

Externí odkaz: http://arxiv.org/abs/2209.10705

A note on Zariski dense orbit conjecture

Autor: Li, Sichen

In this paper we first note a result of birational automorphisms with bounded degree of projective varieties related with the Zariski dense orbit conjecture (ZDO) and the Zariski density of periodic points. Next, we give a reduced result of ZDO for a

Externí odkaz: http://arxiv.org/abs/2208.02616

A novel fluorescence sensing strategy for identification and quantitation of C60 and C70 by multi-emission lanthanide-disalicylaldehyde hybrid

Autor: Wu, Jinyu, Han, Shaolong, Li, Sichen, Zhu, Rui, Shi, Shuaibo, Zhang, Shishen, Zhang, Kun

Publikováno v: In Dyes and Pigments December 2024 231