Zobrazeno 1 - 1
of 1
pro vyhledávání: '"Clotan, Paul-Ioan"'
Autor:
Dumitru, Razvan-Gabriel, Yadav, Vikas, Maheshwary, Rishabh, Clotan, Paul-Ioan, Madhusudhan, Sathwik Tejaswi, Surdeanu, Mihai
We present a simple variable quantization approach that quantizes different layers of a large language model (LLM) at different bit levels. Specifically, we quantize the most important layers to higher bit precision and less important layers to lower
Externí odkaz:
http://arxiv.org/abs/2406.17415