Zobrazeno 1 - 7
of 7
pro vyhledávání: '"Goncharova, Elizaveta"'
Autor:
Razzhigaev, Anton, Mikhalchuk, Matvey, Goncharova, Elizaveta, Gerasimenko, Nikolai, Oseledets, Ivan, Dimitrov, Denis, Kuznetsov, Andrey
This paper reveals a novel linear characteristic exclusive to transformer decoders, including models such as GPT, LLaMA, OPT, BLOOM and others. We analyze embedding transformations between sequential layers, uncovering a near-perfect linear relations
Externí odkaz:
http://arxiv.org/abs/2405.12250
Autor:
Goncharova, Elizaveta, Razzhigaev, Anton, Mikhalchuk, Matvey, Kurkin, Maxim, Abdullaeva, Irina, Skripkin, Matvey, Oseledets, Ivan, Dimitrov, Denis, Kuznetsov, Andrey
Last year, multimodal architectures served up a revolution in AI-based approaches and solutions, extending the capabilities of large language models (LLM). We propose an \textit{OmniFusion} model based on a pretrained LLM and adapters for visual moda
Externí odkaz:
http://arxiv.org/abs/2404.06212
Autor:
Fenogenova, Alena, Chervyakov, Artem, Martynov, Nikita, Kozlova, Anastasia, Tikhonova, Maria, Akhmetgareeva, Albina, Emelyanov, Anton, Shevelev, Denis, Lebedev, Pavel, Sinev, Leonid, Isaeva, Ulyana, Kolomeytseva, Katerina, Moskovskiy, Daniil, Goncharova, Elizaveta, Savushkin, Nikita, Mikhailova, Polina, Dimitrov, Denis, Panchenko, Alexander, Markov, Sergei
Over the past few years, one of the most notable advancements in AI research has been in foundation models (FMs), headlined by the rise of language models (LMs). As the models' size increases, LMs demonstrate enhancements in measurable aspects and th
Externí odkaz:
http://arxiv.org/abs/2401.04531
Autor:
Fadeeva, Ekaterina, Vashurin, Roman, Tsvigun, Akim, Vazhentsev, Artem, Petrakov, Sergey, Fedyanin, Kirill, Vasilev, Daniil, Goncharova, Elizaveta, Panchenko, Alexander, Panov, Maxim, Baldwin, Timothy, Shelmanov, Artem
Recent advancements in the capabilities of large language models (LLMs) have paved the way for a myriad of groundbreaking applications in various fields. However, a significant challenge arises as these models often "hallucinate", i.e., fabricate fac
Externí odkaz:
http://arxiv.org/abs/2311.07383
Autor:
Razzhigaev, Anton, Mikhalchuk, Matvey, Goncharova, Elizaveta, Oseledets, Ivan, Dimitrov, Denis, Kuznetsov, Andrey
In this study, we present an investigation into the anisotropy dynamics and intrinsic dimension of embeddings in transformer architectures, focusing on the dichotomy between encoders and decoders. Our findings reveal that the anisotropy profile in tr
Externí odkaz:
http://arxiv.org/abs/2311.05928
Akademický článek
Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.
K zobrazení výsledku je třeba se přihlásit.
Autor:
Belinskaya Daria, Goncharova Elizaveta
Publikováno v:
E3S Web of Conferences, Vol 210, p 19028 (2020)
The article is devoted to the study of the formation and manifestation of gender identity in deviant adolescents. The authors analyzed the works devoted to the psychological development of adolescents, taking into account the acceptance or rejection
Externí odkaz:
https://doaj.org/article/49f888c7dec1423185bd42e910643642
