Zobrazeno 1 - 10
of 442
pro vyhledávání: '"Chen, Lizhang"'
In this study, we introduce a novel adaptive optimizer, H-Fac, which incorporates a factorized approach to momentum and scaling parameters. Our algorithm demonstrates competitive performances on both ResNets and Vision Transformers, while achieving s
Externí odkaz:
http://arxiv.org/abs/2406.09958
Autor:
Liu, Bo, Wu, Lemeng, Chen, Lizhang, Liang, Kaizhao, Zhu, Jiaxu, Liang, Chen, Krishnamoorthi, Raghuraman, Liu, Qiang
The Lion optimizer has been a promising competitor with the AdamW for training large AI models, with advantages on memory, computation, and sample efficiency. In this paper, we introduce Distributed Lion, an innovative adaptation of Lion for distribu
Externí odkaz:
http://arxiv.org/abs/2404.00438
Lion (Evolved Sign Momentum), a new optimizer discovered through program search, has shown promising results in training large AI models. It performs comparably or favorably to AdamW but with greater memory efficiency. As we can expect from the resul
Externí odkaz:
http://arxiv.org/abs/2310.05898
Publikováno v:
In Journal of Affective Disorders 1 June 2024 354:36-43
Publikováno v:
In Diabetes & Metabolic Syndrome: Clinical Research & Reviews March 2024 18(3)
Publikováno v:
In Clinical Neurology and Neurosurgery January 2024 236
Deep learning models suffer from the problem of semantic discontinuity: small perturbations in the input space tend to cause semantic-level interference to the model output. We argue that the semantic discontinuity results from these inappropriate tr
Externí odkaz:
http://arxiv.org/abs/2011.09789
Autor:
Xia, Suwei, Zhou, Qixing, Sun, Ruoxu, Chen, Lizhang, Zhang, Mingyi, Pang, Huan, Xu, Lin *, Yang, Jun, Tang, Yawen *
Publikováno v:
In Chinese Journal of Catalysis November 2023 54:278-289
Autor:
Wang, Tingting, Li, Qiongxuan, Chen, Lizhang, Ni, Bin, Sheng, Xiaoqi, Huang, Peng, Zhang, Senmao, Chen, Letao, Qin, Jiabi
Publikováno v:
In Preventive Medicine February 2022 155
Publikováno v:
Quality of Life Research, 2020 Aug 01. 29(8), 2219-2229.
Externí odkaz:
https://www.jstor.org/stable/48733831