Zobrazeno 1 - 5
of 5
pro vyhledávání: '"Sarda, Nikhil"'
We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have overlapping text segments, such as system messages, prompt templates, an
Externí odkaz:
http://arxiv.org/abs/2311.04934
Autor:
Golovin, Daniel, Bartok, Gabor, Chen, Eric, Donahue, Emily, Huang, Tzu-Kuo, Kokiopoulou, Efi, Qin, Ruoyan, Sarda, Nikhil, Sybrandt, Justin, Tjeng, Vincent
In many software systems, heuristics are used to make decisions - such as cache eviction, task scheduling, and information presentation - that have a significant impact on overall system behavior. While machine learning may outperform these heuristic
Externí odkaz:
http://arxiv.org/abs/2304.13033
Autor:
Carbune, Victor, Coppey, Thierry, Daryin, Alexander, Deselaers, Thomas, Sarda, Nikhil, Yagnik, Jay
We present SmartChoices, an approach to making machine learning (ML) a first class citizen in programming languages which we see as one way to lower the entrance cost to applying ML to problems in new domains. There is a growing divide in approaches
Externí odkaz:
http://arxiv.org/abs/1810.00619
When programs fail in the field, developers are often left with limited information to diagnose the failure. Automated error reporting tools can assist in bug report generation but without precise steps from the end user it is often difficult for dev
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::1b389f2ea56d4e96dad29291cae452e5
Publikováno v:
ICSE: International Conference on Software Engineering; Feb2013, p362-371, 10p