Zobrazeno 1 - 1
of 1
pro vyhledávání: '"Sitdikov, Timur"'
Autor:
Alabed, Sami, Belov, Daniel, Chrzaszcz, Bart, Franco, Juliana, Grewe, Dominik, Maclaurin, Dougal, Molloy, James, Natan, Tom, Norman, Tamara, Pan, Xiaoyue, Paszke, Adam, Rink, Norman A., Schaarschmidt, Michael, Sitdikov, Timur, Swietlik, Agnieszka, Vytiniotis, Dimitrios, Wee, Joel
Training of modern large neural networks (NN) requires a combination of parallelization strategies encompassing data, model, or optimizer sharding. When strategies increase in complexity, it becomes necessary for partitioning tools to be 1) expressiv
Externí odkaz:
http://arxiv.org/abs/2401.11202