Zobrazeno 1 - 2
of 2
pro vyhledávání: '"Rong, Haidong"'
Autor:
Rong, Haidong, Wang, Yangzihao, Zhou, Feihu, Zhai, Junjie, Wu, Haiyang, Lan, Rui, Li, Fan, Zhang, Han, Yang, Yuekui, Guo, Zhenyu, Wang, Di
We present Distributed Equivalent Substitution (DES) training, a novel distributed training framework for large-scale recommender systems with dynamic sparse features. DES introduces fully synchronous training to large-scale recommendation system for
Externí odkaz:
http://arxiv.org/abs/1909.04823
Autor:
Jia, Xianyan, Song, Shutao, He, Wei, Wang, Yangzihao, Rong, Haidong, Zhou, Feihu, Xie, Liqiang, Guo, Zhenyu, Yang, Yuanzhou, Yu, Liwei, Chen, Tiegang, Hu, Guangxiao, Shi, Shaohuai, Chu, Xiaowen
Synchronized stochastic gradient descent (SGD) optimizers with data parallelism are widely used in training large-scale deep neural networks. Although using larger mini-batch sizes can improve the system scalability by reducing the communication-to-c
Externí odkaz:
http://arxiv.org/abs/1807.11205