Zobrazeno 1 - 10
of 1 004
pro vyhledávání: '"Mikhalev P"'
Autor:
Chekalina, Viktoriia, Rudenko, Anna, Mezentsev, Gleb, Mikhalev, Alexander, Panchenko, Alexander, Oseledets, Ivan
The performance of Transformer models has been enhanced by increasing the number of parameters and the length of the processed text. Consequently, fine-tuning the entire model becomes a memory-intensive process. High-performance methods for parameter
Externí odkaz:
http://arxiv.org/abs/2410.07383
Autor:
Merkulov, Daniil, Cherniuk, Daria, Rudikov, Alexander, Oseledets, Ivan, Muravleva, Ekaterina, Mikhalev, Aleksandr, Kashin, Boris
In this paper, we introduce an algorithm for data quantization based on the principles of Kashin representation. This approach hinges on decomposing any given vector, matrix, or tensor into two factors. The first factor maintains a small infinity nor
Externí odkaz:
http://arxiv.org/abs/2404.09737
In this paper we generalize and extend an idea of low-rank adaptation (LoRA) of large language models (LLMs) based on Transformer architecture. Widely used LoRA-like methods of fine-tuning LLMs are based on matrix factorization of gradient update. We
Externí odkaz:
http://arxiv.org/abs/2402.01376
LoRA is a technique that reduces the number of trainable parameters in a neural network by introducing low-rank adapters to linear layers. This technique is used both for fine-tuning and full training of large language models. This paper presents the
Externí odkaz:
http://arxiv.org/abs/2312.03415
Publikováno v:
RUDN Journal of Agronomy and Animal Industries, Vol 19, Iss 3, Pp 507-516 (2024)
One of the main aspects of obtaining milk of high sanitary quality is functioning of milking equipment. Currently, the main volume of dairy products produced comes from dairy complexes equipped with milking parlors with automatic milking system. Howe
Externí odkaz:
https://doaj.org/article/975ff02c62d2445386c12593d6c14e30
Publikováno v:
Nuclear Energy and Technology, Vol 10, Iss 2, Pp 97-104 (2024)
The probability of a large early release is one of the safety indicators that reflects the risk of fatalities during an accident at a nuclear power plant. Despite the fact that this indicator is very important, it is not defined in the federal rules
Externí odkaz:
https://doaj.org/article/c720f105f5a5483b81027a317b9fb1b1
We show that free algebras of the variety of algebras generated by the Witt algebra $W_n$, the left-symmetric Witt algebra $L_n$, and the symplectic Poisson algebra $P_n$ can be described as subalgebras of differential polynomial algebras with respec
Externí odkaz:
http://arxiv.org/abs/2301.06693
In this paper, we prove a criterion of elementary equivalence of stable linear groups over fields of characteristic two.
Comment: 10 pages
Comment: 10 pages
Externí odkaz:
http://arxiv.org/abs/2301.05613
Auroras during extreme geomagnetic storms: Some features of mid-latitude aurora on February 11, 1958
Autor:
Mikhalev A. V.
Publikováno v:
Solar-Terrestrial Physics, Vol 10, Iss 2, Pp 55-61 (2024)
This paper discusses peculiarities of the great mid-latitude aurora that occurred during the extreme magnetic storm on February 11, 1958. This mid-latitude aurora had unusual optical and spectral characteristics, among which, first of all, were very
Externí odkaz:
https://doaj.org/article/a51770bf447c4f568da0ea9761b48391
Autor:
Daniil Mikhalev, Siamak Fakhrayee Nejad, Serina Ng, Baishakhi Bose, Robyn De Schryver, Ana Brunčič, Manu K. Mohan, Yanwei Wang, AV Rahul, Atta Ur Rehman, Dengwu Jiao, Viktor Mechtcherine, Geert De Schutter, Dimitri Feys
Publikováno v:
RILEM Technical Letters, Vol 9 (2024)
This technical letter gives a concise overview of the state-of-the-art in concrete pumping. It outlines the different pump systems, briefly describes the general flow behavior of concrete in pipes, and addresses the main challenges of pumping. It als
Externí odkaz:
https://doaj.org/article/076ba78e6c8145898306e2411ee26211