Zobrazeno 1 - 10
of 7 421
pro vyhledávání: '"Nawrot A."'
Publikováno v:
Proceedings of the 41st International Conference on Machine Learning (2024) 37396-37412
Transformers have emerged as the backbone of large language models (LLMs). However, generation remains inefficient due to the need to store in memory a cache of key-value representations for past tokens, whose size scales linearly with the input sequ
Externí odkaz:
http://arxiv.org/abs/2403.09636
Autor:
Nawrot, Piotr
State-of-the-art language models like T5 have revolutionized the NLP landscape, but their computational demands hinder a large portion of the research community. To address this challenge, we present nanoT5, a specially-optimized PyTorch framework fo
Externí odkaz:
http://arxiv.org/abs/2309.02373
The computation necessary for training Transformer-based language models has skyrocketed in recent years. This trend has motivated research on efficient training algorithms designed to improve training, validation, and downstream performance faster t
Externí odkaz:
http://arxiv.org/abs/2307.06440
Autor:
Vahid Rostami, Thomas Rost, Felix Johannes Schmitt, Sacha Jennifer van Albada, Alexa Riehle, Martin Paul Nawrot
Publikováno v:
Nature Communications, Vol 15, Iss 1, Pp 1-17 (2024)
Abstract When preparing a movement, we often rely on partial or incomplete information, which can decrement task performance. In behaving monkeys we show that the degree of cued target information is reflected in both, neural variability in motor cor
Externí odkaz:
https://doaj.org/article/4e4f951a61b44b65809437737ba10b84
Autor:
Emily A. Christopher, Yvette Christopher-de Vries, Anitha Devadoss, Laurens D.B. Mandemaker, Jeske van Boxel, Helena M. Copsey, Hanna M. Dusza, Juliette Legler, Florian Meirer, Jane Muncke, Tim S. Nawrot, Nelly D. Saenen, Barbara M. Scholz-Böttcher, Lang Tran, Bert M. Weckhuysen, Runyu Zou, Lisa Zimmermann, Karen S. Galea, Roel Vermeulen, Matthew S. P. Boyles
Publikováno v:
Microplastics and Nanoplastics, Vol 4, Iss 1, Pp 1-28 (2024)
Abstract Micro- and nanoplastics (MNPs) are ubiquitous environmental pollutants representing a concern for human health. MNPs have been detected in human placentas, indicating that during pregnancy maternal exposure may lead to placental transfer and
Externí odkaz:
https://doaj.org/article/2521a0151cc14004b21bd9be0485ec28
Autor:
Joanna E. Klećkowska-Nawrot, Karolina Goździewska-Harłajczuk, Karolina Barszcz, Krzysztof O. Stegmann
Publikováno v:
BMC Veterinary Research, Vol 20, Iss 1, Pp 1-19 (2024)
Abstract Objectives The red panda is currently the only surviving member of the Ailuridae family in the Caniformia suborder. In this study, we provide data on anatomical, morphometric, histological and histochemical examination of the orbital region,
Externí odkaz:
https://doaj.org/article/213f49614dac4ae5903386b3a5611a07
Publikováno v:
Biogeosciences, Vol 21, Pp 2177-2188 (2024)
The youngest fossil record is a crucial source of data documenting the recent history of marine ecosystems and their long-term alteration by humans. However, human activities that reshape communities and habitats also alter sedimentary and biological
Externí odkaz:
https://doaj.org/article/b8ee76be4e7941d1831d58cb1045e48c
Publikováno v:
Proceedings of the 61st (Toronto 2023) Annual Meeting of the Association for Computational Linguistics (Volume 1 Long Papers) Pages 6403 to 6417
Transformers achieve unrivalled performance in modelling language, but remain inefficient in terms of memory and time complexity. A possible remedy is to reduce the sequence length in the intermediate layers by pooling fixed-length segments of tokens
Externí odkaz:
http://arxiv.org/abs/2211.09761
Autor:
Hanne Croons, Dries S. Martens, Charlotte Vanderstukken, Hanne Sleurs, Leen Rasking, Martien Peusens, Eleni Renaers, Michelle Plusquin, Tim S. Nawrot
Publikováno v:
Frontiers in Pediatrics, Vol 12 (2024)
Telomere length (TL), a marker of cellular aging, has been studied in adults with regard to its connection to cognitive function. However, little is known about the association between TL and cognitive development in children. This study investigated
Externí odkaz:
https://doaj.org/article/1cf5498772ce443ab19ac79f3c3c7160
Autor:
Sofia Aguilar-Lacasaña, Irene Fontes Marques, Montserrat de Castro, Payam Dadvand, Xavier Escribà, Serena Fossati, Juan R González, Mark Nieuwenhuijsen, Rossella Alfano, Isabella Annesi-Maesano, Sonia Brescianini, Kimberley Burrows, Lucinda Calas, Ahmed Elhakeem, Barbara Heude, Amy Hough, Elena Isaevska, Vincent W V Jaddoe, Deborah A Lawlor, Genevieve Monaghan, Tim Nawrot, Michelle Plusquin, Lorenzo Richiardi, Aidan Watmuff, Tiffany C. Yang, Martine Vrijheid, Janine F Felix, Mariona Bustamante
Publikováno v:
Environment International, Vol 188, Iss , Pp 108684- (2024)
Green space exposure has been associated with improved mental, physical and general health. However, the underlying biological mechanisms remain largely unknown. The aim of this study was to investigate the association between green space exposure an
Externí odkaz:
https://doaj.org/article/1106260a166c4a2f9a3f061f89e1a65a