Zobrazeno 1 - 10
of 22
pro vyhledávání: '"Krieger, Christopher"'
Scaling Studies for Efficient Parameter Search and Parallelism for Large Language Model Pre-training
Autor:
Benington, Michael, Phan, Leo, Paul, Chris Pierre, Shoemaker, Evan, Ranade, Priyanka, Collett, Torstein, Perez, Grant Hodgson, Krieger, Christopher
Publikováno v:
Supercomputing 2023 (SC23) Student Research Poster Track
AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art, transformer-based m
Externí odkaz:
http://arxiv.org/abs/2310.05350
Irregular memory access patterns pose performance and user productivity challenges on distributed-memory systems. They can lead to fine-grained remote communication and the data access patterns are often not known until runtime. The Partitioned Globa
Externí odkaz:
http://arxiv.org/abs/2303.13954
Applications for deep learning and big data analytics have compute and memory requirements that exceed the limits of a single GPU. However, effectively scaling out an application to multiple GPUs is challenging due to the complexities of communicatio
Externí odkaz:
http://arxiv.org/abs/1812.05964
In big-data analytics, using tensor decomposition to extract patterns from large, sparse multivariate data is a popular technique. Many challenges exist for designing parallel, high performance tensor decomposition algorithms due to irregular data ac
Externí odkaz:
http://arxiv.org/abs/1812.05961
Achieving high performance for sparse applications is challenging due to irregular access patterns and weak locality. These properties preclude many static optimizations and degrade cache performance on traditional systems. To address these challenge
Externí odkaz:
http://arxiv.org/abs/1812.05955
Publikováno v:
In Journal of Parallel and Distributed Computing July 2019 129:83-98
Akademický článek
Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.
K zobrazení výsledku je třeba se přihlásit.
Akademický článek
Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.
K zobrazení výsledku je třeba se přihlásit.