Zobrazeno 1 - 10
of 452
pro vyhledávání: '"A. P. Csordas"'
Models that rely on subword tokenization have significant drawbacks, such as sensitivity to character-level noise like spelling errors and inconsistent compression rates across different languages and scripts. While character- or byte-level models li
Externí odkaz:
http://arxiv.org/abs/2410.20771
Spectral properties of bounded linear operators play a crucial role in several areas of mathematics and physics. For each self-adjoint, trace-class operator $O$ we define a set $\Lambda_n\subset \mathbb{R}$, and we show that it converges to the spect
Externí odkaz:
http://arxiv.org/abs/2407.04478
Positivity preservation is an important issue in the dynamics of open quantum systems: positivity violations always mark the border of validity of the model. We investigate the positivity of self-adjoint polynomial Gaussian integral operators $\wideh
Externí odkaz:
http://arxiv.org/abs/2405.04438
General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF) -- previously acquired skills are
Externí odkaz:
http://arxiv.org/abs/2312.00276
Recent studies of the computational power of recurrent neural networks (RNNs) reveal a hierarchy of RNN architectures, given real-time and finite-precision assumptions. Here we study auto-regressive Transformers with linearised attention, a.k.a. line
Externí odkaz:
http://arxiv.org/abs/2310.16076
Publikováno v:
Communications Biology, Vol 7, Iss 1, Pp 1-15 (2024)
Abstract Although aging clocks predicting the age of individual organisms have been extensively studied, the age of individual cells remained largely unexplored. Most recently single-cell omics clocks were developed for the mouse, however, extensive
Externí odkaz:
https://doaj.org/article/e177bd73166246529722a912546cbae5
Autor:
Zhuge, Mingchen, Liu, Haozhe, Faccio, Francesco, Ashley, Dylan R., Csordás, Róbert, Gopalakrishnan, Anand, Hamdi, Abdullah, Hammoud, Hasan Abed Al Kader, Herrmann, Vincent, Irie, Kazuki, Kirsch, Louis, Li, Bing, Li, Guohao, Liu, Shuming, Mai, Jinjie, Piękos, Piotr, Ramesh, Aditya, Schlag, Imanol, Shi, Weimin, Stanić, Aleksandar, Wang, Wenyi, Wang, Yuhui, Xu, Mengmeng, Fan, Deng-Ping, Ghanem, Bernard, Schmidhuber, Jürgen
Both Minsky's "society of mind" and Schmidhuber's "learning to think" inspire diverse societies of large multimodal neural networks (NNs) that solve problems by interviewing each other in a "mindstorm." Recent implementations of NN-based societies of
Externí odkaz:
http://arxiv.org/abs/2305.17066
Autor:
Ruoss, Anian, Delétang, Grégoire, Genewein, Tim, Grau-Moya, Jordi, Csordás, Róbert, Bennani, Mehdi, Legg, Shane, Veness, Joel
Transformers have impressive generalization capabilities on tasks with a fixed context length. However, they fail to generalize to sequences of arbitrary length, even for seemingly simple tasks such as duplicating a string. Moreover, simply training
Externí odkaz:
http://arxiv.org/abs/2305.16843
Unsupervised learning of discrete representations in neural networks (NNs) from continuous ones is essential for many modern applications. Vector Quantisation (VQ) has become popular for this, in particular in the context of generative models, such a
Externí odkaz:
http://arxiv.org/abs/2302.07950
Publikováno v:
Phys. Rev. A 108, 012210 (2023)
We investigate the exact master equation of Hu, Paz, and Zhang for a quantum harmonic oscillator at zero temperature with a Lorentz-Drude type Ohmic spectral density. This master equation plays an important role in the study of quantum Brownian motio
Externí odkaz:
http://arxiv.org/abs/2211.15722