Zobrazeno 1 - 2
of 2
pro vyhledávání: '"Huang, Lianming"'
Autor:
Wu, Shangyu, Xiong, Ying, Cui, Yufei, Wu, Haolun, Chen, Can, Yuan, Ye, Huang, Lianming, Liu, Xue, Kuo, Tei-Wei, Guan, Nan, Xue, Chun Jason
Large language models (LLMs) have demonstrated great success in various fields, benefiting from their huge amount of parameters that store knowledge. However, LLMs still suffer from several key issues, such as hallucination problems, knowledge update
Externí odkaz:
http://arxiv.org/abs/2407.13193
Autor:
Huang, Lianming, Wu, Shangyu, Cui, Yufei, Xiong, Ying, Liu, Xue, Kuo, Tei-Wei, Guan, Nan, Xue, Chun Jason
Deploying large language model inference remains challenging due to their high computational overhead. Early exiting optimizes model inference by adaptively reducing the number of inference layers. Existing methods typically train internal classifier
Externí odkaz:
http://arxiv.org/abs/2405.15198