Výsledky vyhledávání

Report

Large Language Model Compression with Neural Architecture Search

Autor: Sukthanker, Rhea Sanjay, Staffler, Benedikt, Hutter, Frank, Klein, Aaron

Large language models (LLMs) exhibit remarkable reasoning abilities, allowing them to generalize across a wide range of downstream tasks, such as commonsense reasoning or instruction following. However, as LLMs scale, inference costs become increasin

Externí odkaz: http://arxiv.org/abs/2410.06479

Zobrazit plný text záznamu

Report

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models

Autor: Sukthanker, Rhea Sanjay, Zela, Arber, Staffler, Benedikt, Klein, Aaron, Purucker, Lennart, Franke, Joerg K. H., Hutter, Frank

The increasing size of language models necessitates a thorough analysis across multiple dimensions to assess trade-offs among crucial hardware metrics such as latency, energy consumption, GPU memory usage, and performance. Identifying optimal model c

Externí odkaz: http://arxiv.org/abs/2405.10299

Zobrazit plný text záznamu

Report

Multi-objective Differentiable Neural Architecture Search

Autor: Sukthanker, Rhea Sanjay, Zela, Arber, Staffler, Benedikt, Dooley, Samuel, Grabocka, Josif, Hutter, Frank

Pareto front profiling in multi-objective optimization (MOO), i.e. finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives like neural network training. Typically, in MOO neural architecture search (NAS

Externí odkaz: http://arxiv.org/abs/2402.18213

Zobrazit plný text záznamu

Akademický článek

Comparison of 'IN-REC-SUR-E' and LISA in preterm neonates with respiratory distress syndrome: a randomized controlled trial (IN-REC-LISA trial)

Autor: Giovanni Vento, Angela Paladini, C. Aurilia, S. Alkan Ozdemir, V. P. Carnielli, F. Cools, S. Costa, F. Cota, C. Dani, P. G. Davis, S. Fattore, C. Fè, N. Finer, F. P. Fusco, C. Gizzi, E. Herting, M. Jian, A. Lio, G. Lista, F. Mosca, S. Nobile, A. Perri, S. Picone, J. J. Pillow, G. Polglase, T. Pasciuto, R. Pastorino, M. Tana, D. Tingay, C. Tirone, A. H. van Kaam, M. L. Ventura, A. Aceti, M. Agosti, G. Alighieri, G. Ancora, V. Angileri, G. Ausanio, S. Aversa, E. Balestri, E. Baraldi, M. C. Barbini, C. Barone, R. Beghini, C. Bellan, A. Berardi, I. Bernardo, P. Betta, M. Binotti, B. Bizzarri, G. Borgarello, S. Borgione, A. Borrelli, R. Bottino, G. Bracaglia, I. Bresesti, I. Burattini, C. Cacace, F. Calzolari, M. F. Campagnoli, L. Capasso, M. Capozza, M. G. Capretti, J. Caravetta, C. Carbonara, V. Cardilli, M. Carta, F. Castoldi, A. Castronovo, E. Cavalleri, F. Cavigioli, S. Cecchi, V. Chierici, C. Cimino, F. Cocca, C. Cocca, P. Cogo, M. Coma, V. Comito, V. Condò, C. Consigli, R. Conti, M. Corradi, G. Corsello, L. T. Corvaglia, A. Costa, A. Coscia, F. Cresi, F. Crispino, P. D’Amico, L. De Cosmo, C. De Maio, G. Del Campo, S. Di Credico, S. Di Fabio, P. Di Nicola, A. Di Paolo, S. Di Valerio, A. Distilo, V. Duca, A. Falcone, R. Falsaperla, V. A. Fasolato, V. Fatuzzo, F. Favini, M. P. Ferrarello, S. Ferrari, F. Fiori Nastro, C. A. Forcellini, A. Fracchiolla, A. Gabriele, F. Galdo, F. Gallini, A. Gangemi, G. Gargano, D. Gazzolo, M. P. Gentile, S. Ghirardello, F. Giardina, L. Giordano, E. Gitto, M. Giuffrè, L. Grappone, F. Grasso, I. Greco, A. Grison, R. Guglielmino, I. Guidotti, I. Guzzo, N. La Forgia, S. La Placa, G. La Torre, P. Lago, L. Lanciotti, A. Lavizzari, F. Leo, V. Leonardi, D. Lestingi, J. Li, P. Liberatore, D. Lodin, R. Lubrano, M. Lucente, S. Luciani, D. Luvarà, G. Maffei, A. Maggio, L. Maggio, K. Maiolo, L. Malaigia, G. Mangili, A. Manna, E. Maranella, A. Marciano, P. Marcozzi, M. Marletta, L. Marseglia, D. Martinelli, S. Martinelli, S. Massari, L. Massenzi, F. Matina, L. Mattia, G. Mescoli, I. V. Migliore, D. Minghetti, I. Mondello, S. Montano, G. Morandi, N. Mores, S. Morreale, I. Morselli, M. Motta, M. Napolitano, D. Nardo, A. Nicolardi, S. Nider, G. Nigro, M. Nuccio, L. Orfeo, C. Ottaviano, P. Paganin, S. Palamides, S. Palatta, P. Paolillo, M. G. Pappalardo, E. Pasta, L. Patti, G. Paviotti, R. Perniola, G. Perotti, S. Perrone, F. Petrillo, M. S. Piazza, A. Piccirillo, M. Pierro, E. Piga, G. A. Pingitore, S. Pisu, C. Pittini, F. Pontiggia, G. Pontrelli, A. Primavera, A. Proto, L. Quartulli, F. Raimondi, L. Ramenghi, M. Rapsomaniki, A. Ricotti, C. Rigotti, M. Rinaldi, F. M. Risso, E. Roma, E. Romanini, V. Romano, E. Rosati, V. Rosella, I. Rulli, V. Salvo, C. Sanfilippo, A. Sannia, A. Saporito, A. Sauna, E. Scapillati, F. Schettini, A. Scorrano, S. Semeria Mantelli, V. Sepporta, P. Sindico, A. Solinas, E. Sorrentino, E. Spaggiari, A. Staffler, M. Stella, D. Termini, G. Terrin, A. Testa, G. Tina, M. Tirantello, B. Tomasini, F. Tormena, L. Travan, D. Trevisanuto, G. Tuling, V. Tulino, L. Valenzano, S. Vedovato, S. Vendramin, P. E. Villani, S. Viola, V. Viola, G. Vitaliti, M. Vitaliti, P. Wanker, Y. Yang, S. Zanetta, E. Zannin

Publikováno v: Trials, Vol 25, Iss 1, Pp 1-18 (2024)

Abstract Background Surfactant is a well-established therapy for preterm neonates affected by respiratory distress syndrome (RDS). The goals of different methods of surfactant administration are to reduce the duration of mechanical ventilation and th

Externí odkaz: https://doaj.org/article/6d25d8972ebb4da7aceccdf7e22b30d8

Zobrazit plný text záznamu

Plný text ve formátu HTML

Report

Neural Architecture Search for Dense Prediction Tasks in Computer Vision

Autor: Elsken, Thomas, Zela, Arber, Metzen, Jan Hendrik, Staffler, Benedikt, Brox, Thomas, Valada, Abhinav, Hutter, Frank

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in a data-dri

Externí odkaz: http://arxiv.org/abs/2202.07242

Zobrazit plný text záznamu

Akademický článek

Corrigendum to 'Reducing huntingtin by immunotherapy delays disease progression in a mouse model of Huntington disease' [Neurobiology of Disease, 2024 Jan:190:106376]

Autor: Stefan Bartl, Yuanyun Xie, Nalini Potluri, Ratnesh Kesineni, Katlin Hencak, Louisa Dal Cengio, Katja Balazs, Abid Oueslati, Michela Parth, Nina Salhat, Alberto Siddu, Oskar Smrzka, Francesca Cicchetti, Günther Staffler, Michael R. Hayden, Amber L. Southwell

Publikováno v: Neurobiology of Disease, Vol 193, Iss , Pp 106444- (2024)

Externí odkaz: https://doaj.org/article/9f127a6b6c0642d8b90cf4f316b4916a

Zobrazit plný text záznamu

Report

Bag of Tricks for Neural Architecture Search

Autor: Elsken, Thomas, Staffler, Benedikt, Zela, Arber, Metzen, Jan Hendrik, Hutter, Frank

While neural architecture search methods have been successful in previous years and led to new state-of-the-art performance on various problems, they have also been criticized for being unstable, being highly sensitive with respect to their hyperpara

Externí odkaz: http://arxiv.org/abs/2107.03719

Zobrazit plný text záznamu

Akademický článek

Lung UltrasouNd Guided surfactant therapy in preterm infants: an international multicenter randomized control trial (LUNG study)

Publikováno v: Trials, Vol 24, Iss 1, Pp 1-11 (2023)

Abstract Background The management of respiratory distress syndrome (RDS) in premature newborns is based on different types of non-invasive respiratory support and on surfactant replacement therapy (SRT) to avoid mechanical ventilation as it may even

Externí odkaz: https://doaj.org/article/50efaf74943742af9f3a794a9fc9c3e3

Zobrazit plný text záznamu

Report

Bosch Deep Learning Hardware Benchmark

Autor: Runge, Armin, Wenzel, Thomas, Bariamis, Dimitrios, Staffler, Benedikt Sebastian, Drumond, Lucas Rego, Pfeiffer, Michael

The widespread use of Deep Learning (DL) applications in science and industry has created a large demand for efficient inference systems. This has resulted in a rapid increase of available Hardware Accelerators (HWAs) making comparison challenging an

Externí odkaz: http://arxiv.org/abs/2008.10293

Zobrazit plný text záznamu

Vyhledávací nástroje:

Upřesnit hledání