High-Performance Recommender System Training Using Co-Clustering on CPU/GPU Clusters
| Autor: | Thomas Parnell, Michail Vlachos, Kubilay Atasu, Celestine Dünner, Haralampos Pozidis |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
business.industry
Computer science Distributed computing 02 engineering and technology Recommender system Matrix decomposition Biclustering Data set Computer engineering 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing The Internet business Cluster analysis |
| Zdroj: | ICPP |
| Popis: | Recommender systems are becoming the crystal ball of the Internet because they can anticipate what the users may want, even before the users know they want it. However, the machine-learning algorithms typically involved in the training of such systems can be computationally expensive, and often may require several days for retraining. Here, we present a distributed approach for load-balancing the training of a recommender system based on state-of-art non-negative matrix factorization principles. The approach can exploit the presence of a cluster of mixed CPUs and GPUs, and results in a 466-fold performance improvement compared with the serial CPU implementation, and a 15-fold performance improvement compared with the best previously reported results for the popular Netflix data set. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|