Kernel Operations on the GPU, with Autodiff, without Memory Overflows
| Autor: | Charlier, Benjamin, Feydy, Jean, Glaunès, Joan Alexis, Collin, François-David, Durif, Ghislain |
|---|---|
| Rok vydání: | 2020 |
| Předmět: | |
| Zdroj: | Journal of Machine Learning Research 22, 1-6 (2021). https://jmlr.org/papers/v22/20-275.html |
| Druh dokumentu: | Working Paper |
| Popis: | The KeOps library provides a fast and memory-efficient GPU support for tensors whose entries are given by a mathematical formula, such as kernel and distance matrices. KeOps alleviates the major bottleneck of tensor-centric libraries for kernel and geometric applications: memory consumption. It also supports automatic differentiation and outperforms standard GPU baselines, including PyTorch CUDA tensors or the Halide and TVM libraries. KeOps combines optimized C++/CUDA schemes with binders for high-level languages: Python (Numpy and PyTorch), Matlab and GNU R. As a result, high-level "quadratic" codes can now scale up to large data sets with millions of samples processed in seconds. KeOps brings graphics-like performances for kernel methods and is freely available on standard repositories (PyPi, CRAN). To showcase its versatility, we provide tutorials in a wide range of settings online at \url{www.kernel-operations.io}. Comment: 6 pages |
| Databáze: | arXiv |
| Externí odkaz: |
|