Zobrazeno 1 - 10
of 3 131
pro vyhledávání: '"Zandieh SO"'
Serving LLMs requires substantial memory due to the storage requirements of Key-Value (KV) embeddings in the KV cache, which grows with sequence length. An effective approach to compress KV cache is quantization. However, traditional quantization met
Externí odkaz:
http://arxiv.org/abs/2406.03482
Despite the significant success of large language models (LLMs), their extensive memory requirements pose challenges for deploying them in long-context token generation. The substantial memory footprint of LLM decoders arises from the necessity to st
Externí odkaz:
http://arxiv.org/abs/2402.06082
In today's construction industry, poor performance often arises due to various factors related to time, finances, and quality. These factors frequently lead to project delays and resource losses, particularly in terms of financial resources. This res
Externí odkaz:
http://arxiv.org/abs/2401.12388
Autor:
Han, Insu, Jayaram, Rajesh, Karbasi, Amin, Mirrokni, Vahab, Woodruff, David P., Zandieh, Amir
We present an approximate attention mechanism named HyperAttention to address the computational challenges posed by the growing complexity of long contexts used in Large Language Models (LLMs). Recent work suggests that in the worst-case scenario, qu
Externí odkaz:
http://arxiv.org/abs/2310.05869
Autor:
Jianfeng Jin, Behrouz Zandieh-Doulabi
Publikováno v:
Current Issues in Molecular Biology, Vol 46, Iss 11, Pp 12428-12441 (2024)
Matrix extracellular phosphoglycoprotein (Mepe), present in bone and dentin, plays important multifunctional roles in cell signaling, bone mineralization, and phosphate homeostasis. Mepe expression in bone cells changes in response to pulsating fluid
Externí odkaz:
https://doaj.org/article/c55941e988c44578be11d6cc651fd71d
Publikováno v:
علوم آب و خاک, Vol 28, Iss 3, Pp 161-177 (2024)
The objective of this study was to investigate the effect of wildfire in the rangelands of the Gonbad region of Hamedan on soil organic carbon storage in two control and fire areas after three years of fire, and the feasibility of using remote sensin
Externí odkaz:
https://doaj.org/article/f72bf799f0694031b9e4357f04fda1b2
Autor:
Azam Govahi, Sahar Eghbali, Naser Elmi Ghiasi, Zahra Zandieh, Marziyeh Ajdary, Rana Mehdizadeh, Mehdi Mehdizadeh
Publikováno v:
Scientific Reports, Vol 14, Iss 1, Pp 1-9 (2024)
Abstract Pre-incubation of the cumulus-oocyte complex (COCs) may lead to better function of cumulus cells (CCs) and higher oocyte quality by changing the transcriptomic profile of CCs. 140 cumulus cell samples were isolated from 12 participants and d
Externí odkaz:
https://doaj.org/article/f71ee6ee2e1c488a887415918fd7b951
Autor:
Jack J. W. A. van Loon, Olga P. Berezovska, Theodorus J. M. Bervoets, Dina Montufar-Solis, Cor M. Semeins, Behrouz Zandieh-Doulabi, P. Natalia V. Rodionova, Jackie Duke, J. Paul Veldhuijzen
Publikováno v:
npj Microgravity, Vol 10, Iss 1, Pp 1-9 (2024)
Abstract In a previous Space Shuttle/Spacelab experiment (STS-42), we observed direct responses of isolated fetal mouse long bones to near weightlessness. This paper aimed to verify those results and study the effects of daily 1×g exposure during mi
Externí odkaz:
https://doaj.org/article/26401e664c4f47e89d84a5e313f4ac14
Dot-product attention mechanism plays a crucial role in modern deep architectures (e.g., Transformer) for sequence modeling, however, na\"ive exact computation of this model incurs quadratic time and memory complexities in sequence length, hindering
Externí odkaz:
http://arxiv.org/abs/2302.02451
Publikováno v:
Social Determinants of Health, Vol 10, Iss 1 (2024)
Background: The current research was conducted with the aim of identifying and validating the dimensions and components of online curriculum implementation. Methods: The research was conducted with a mixed approach. In order to collect information
Externí odkaz:
https://doaj.org/article/b0fc83e0725b41f78a04e266c491c88f