Zobrazeno 1 - 10
of 878
pro vyhledávání: '"A. Mohamed Osama"'
The scalability limitations of Transformers regarding sequence length have renewed interest in recurrent sequence models that are parallelizable during training. As a result, many novel recurrent architectures, such as S4, Mamba, and Aaren, have been
Externí odkaz:
http://arxiv.org/abs/2410.01201
Autor:
Feng, Leo, Tung, Frederick, Hajimirsadeghi, Hossein, Ahmed, Mohamed Osama, Bengio, Yoshua, Mori, Greg
The advent of Transformers marked a significant breakthrough in sequence modelling, providing a highly performant architecture capable of leveraging GPU parallelism. However, Transformers are computationally expensive at inference time, limiting thei
Externí odkaz:
http://arxiv.org/abs/2405.13956
Cross Attention is a popular method for retrieving information from a set of context tokens for making predictions. At inference time, for each prediction, Cross Attention scans the full set of $\mathcal{O}(N)$ tokens. In practice, however, often onl
Externí odkaz:
http://arxiv.org/abs/2309.17388
Modern foundation model architectures rely on attention mechanisms to effectively capture context. However, these methods require linear or quadratic memory in terms of the number of inputs/datapoints, limiting their applicability in low-compute doma
Externí odkaz:
http://arxiv.org/abs/2306.12599
Neural Processes (NPs) are popular meta-learning methods for efficiently modelling predictive uncertainty. Recent state-of-the-art methods, however, leverage expensive attention mechanisms, limiting their applications, particularly in low-resource se
Externí odkaz:
http://arxiv.org/abs/2305.14567
A temporal point process (TPP) is a stochastic process where its realization is a sequence of discrete events in time. Recent work in TPPs model the process using a neural network in a supervised learning framework, where a training set is a collecti
Externí odkaz:
http://arxiv.org/abs/2301.12023
Publikováno v:
Plastic and Reconstructive Surgery, Global Open, Vol 12, Iss 10, p e6222 (2024)
Background:. Tissue expansion to treat of alopecia of the scalp is the corner stone to restore a hairy scalp, although the process of expansion takes time to achieve a satisfactory result. Overexpansion could help in managing limited areas of donor s
Externí odkaz:
https://doaj.org/article/0bac63f540f64dcf983788905b9294a1
Autor:
Abdesattar Mohamed, Osama Ahmed1 oa4107810@gmail.com, Hassanin, Hassan Mahmoud1, Nawara, Abdalla M.1
Publikováno v:
Zagazig University Medical Journal. Sep2024, Vol. 30 Issue 6, p2497-2508. 12p.
ML models often operate within the context of a larger system that can adapt its response when the ML model is uncertain, such as falling back on safe defaults or a human in the loop. This commonly encountered operational context calls for principled
Externí odkaz:
http://arxiv.org/abs/2211.10564
Neural Processes (NPs) are popular methods in meta-learning that can estimate predictive uncertainty on target datapoints by conditioning on a context dataset. Previous state-of-the-art method Transformer Neural Processes (TNPs) achieve strong perfor
Externí odkaz:
http://arxiv.org/abs/2211.08458