Zobrazeno 1 - 2
of 2
pro vyhledávání: '"Sagan, Naomi"'
Autor:
Sagan, Naomi, Weissman, Tsachy
We propose and study a family of universal sequential probability assignments on individual sequences, based on the incremental parsing procedure of the Lempel-Ziv (LZ78) compression algorithm. We show that the normalized log loss under any of these
Externí odkaz:
http://arxiv.org/abs/2410.06589
The prohibitive sizes of Large Language Models (LLMs) today make it difficult to deploy them on memory-constrained edge devices. This work introduces $\rm CALDERA$ -- a new post-training LLM compression algorithm that harnesses the inherent low-rank
Externí odkaz:
http://arxiv.org/abs/2405.18886