Large Scale Artificial Neural Network Training Using Multi-GPUs

Autor:	Wang, Linnan, Wu, Wei, Xiao, Jianxiong, Yi, Yang
Rok vydání:	2015
Předmět:	Computer Science - Distributed Parallel and Cluster Computing Computer Science - Neural and Evolutionary Computing
Druh dokumentu:	Working Paper
Popis:	This paper describes a method for accelerating large scale Artificial Neural Networks (ANN) training using multi-GPUs by reducing the forward and backward passes to matrix multiplication. We propose an out-of-core multi-GPU matrix multiplication and integrate the algorithm with the ANN training. The experiments demonstrate that our matrix multiplication algorithm achieves linear speedup on multiple inhomogeneous GPUs. The full paper of this project can be found at [1]. Comment: SC 15 Poster
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/1511.04348 Zobrazit plný text záznamu View this record from Arxiv