Zobrazeno 1 - 10
of 55
pro vyhledávání: '"Besiroglu, Tamay"'
Accurately modeling the production of new ideas is crucial for innovation theory and endogenous growth models. This paper provides a comprehensive methodological survey of strategies for estimating idea production functions. We explore various method
Externí odkaz:
http://arxiv.org/abs/2405.10494
Autor:
McAndrew, Thomas, Majumder, Maimuna S., Lover, Andrew A., Venkatramanan, Srini, Bocchini, Paolo, Besiroglu, Tamay, Codi, Allison, Dempsey, Gaia, Abbott, Sam, Chevalier, Sylvain, Bosse, Nikos I., Cambeiro, Juan, Braun, David
In May 2022, mpox (formerly monkeypox) spread to non-endemic countries rapidly. Human judgment is a forecasting approach that has been sparsely evaluated during the beginning of an outbreak. We collected -- between May 19, 2022 and July 31, 2022 -- 1
Externí odkaz:
http://arxiv.org/abs/2404.14686
Hoffmann et al. (2022) propose three methods for estimating a compute-optimal scaling law. We attempt to replicate their third estimation procedure, which involves fitting a parametric loss function to a reconstruction of data from their plots. We fi
Externí odkaz:
http://arxiv.org/abs/2404.10102
Autor:
Ho, Anson, Besiroglu, Tamay, Erdil, Ege, Owen, David, Rahman, Robi, Guo, Zifan Carl, Atkinson, David, Thompson, Neil, Sevilla, Jaime
We investigate the rate at which algorithms for pre-training language models have improved since the advent of deep learning. Using a dataset of over 200 language model evaluations on Wikitext and Penn Treebank spanning 2012-2023, we find that the co
Externí odkaz:
http://arxiv.org/abs/2403.05812
Autor:
Besiroglu, Tamay, Bergerson, Sage Andrus, Michael, Amelia, Heim, Lennart, Luo, Xueyun, Thompson, Neil
There are pronounced differences in the extent to which industrial and academic AI labs use computing resources. We provide a data-driven survey of the role of the compute divide in shaping machine learning research. We show that a compute divide has
Externí odkaz:
http://arxiv.org/abs/2401.02452
CMOS microprocessors have achieved massive energy efficiency gains but may reach limits soon. This paper presents an approach to estimating the limits on the maximum floating point operations per Joule (FLOP/J) for CMOS microprocessors. We analyze th
Externí odkaz:
http://arxiv.org/abs/2312.08595
AI research is increasingly industry-driven, making it crucial to understand company contributions to this field. We compare leading AI companies by research publications, citations, size of training runs, and contributions to algorithmic innovations
Externí odkaz:
http://arxiv.org/abs/2312.00043
Autor:
Erdil, Ege, Besiroglu, Tamay
We examine whether substantial AI automation could accelerate global economic growth by about an order of magnitude, akin to the economic growth effects of the Industrial Revolution. We identify three primary drivers for such growth: 1) the scalabili
Externí odkaz:
http://arxiv.org/abs/2309.11690
Since its emergence around 2010, deep learning has rapidly become the most important technique in Artificial Intelligence (AI), producing an array of scientific firsts in areas as diverse as protein folding, drug discovery, integrated chip design, an
Externí odkaz:
http://arxiv.org/abs/2212.08198
Autor:
Erdil, Ege, Besiroglu, Tamay
We investigate algorithmic progress in image classification on ImageNet, perhaps the most well-known test bed for computer vision. We estimate a model, informed by work on neural scaling laws, and infer a decomposition of progress into the scaling of
Externí odkaz:
http://arxiv.org/abs/2212.05153