Towards a Malleable Tensorflow Implementation
| Autor: | Libutti, Leandro Ariel, Igual, Francisco, Piñuel, Luis, De Giusti, Laura Cristina, Naiouf, Marcelo, Rucci, Enzo, Chichizola, Franco |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: |
Flexibility (engineering)
020203 distributed computing Co-scheduling Computer science TensorFlow Distributed computing Resource management Inference Ciencias Informáticas Malleability 02 engineering and technology 010501 environmental sciences 01 natural sciences Containers Elasticity (cloud computing) 0202 electrical engineering electronic engineering information engineering Parallelism (grammar) Hardware acceleration Leverage (statistics) 0105 earth and related environmental sciences |
| Zdroj: | SEDICI (UNLP) Universidad Nacional de La Plata instacron:UNLP Communications in Computer and Information Science ISBN: 9783030612177 |
| Popis: | The TensorFlow framework was designed since its inception to provide multi-thread capabilities, extended with hardware accelerator support to leverage the potential of modern architectures. The amount of parallelism in current versions of the framework can be selected at multiple levels (intra- and inter-paralellism) under demand. However, this selection is fixed, and cannot vary during the execution of training/inference sessions. This heavily restricts the flexibility and elasticity of the framework, especially in scenarios in which multiple TensorFlow instances co-exist in a parallel architecture. In this work, we propose the necessary modifications within TensorFlow to support dynamic selection of threads, in order to provide transparent malleability to the infrastructure. Experimental results show that this approach is effective in the variation of parallelism, and paves the road towards future co-scheduling techniques for multi-TensorFlow scenarios. Instituto de Investigación en Informática |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|