Provisioning Input and Output Data Rates in Data Processing Frameworks
| Autor: | Tien Van Do, Nam H. Do, Csaba Rotter, Lorant Farkas |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
020203 distributed computing
Data processing Computer Networks and Communications Computer science Distributed computing Control (management) Provisioning 02 engineering and technology Yarn Data rate Hardware and Architecture 020204 information systems visual_art 0202 electrical engineering electronic engineering information engineering visual_art.visual_art_medium Cellular network Software Information Systems |
| Zdroj: | Journal of Grid Computing. 18:491-506 |
| ISSN: | 1572-9184 1570-7873 |
| DOI: | 10.1007/s10723-020-09508-0 |
| Popis: | This paper is motivated by the need of deadline-bounded applications in live mobile network environments to obtain the guarantee and the appropriate share of an input and output (I/O) data rate. However, data processing frameworks only support the request of memory and the computing capacity at present. In this paper, we propose a solution that allows the control of disk I/O and network I/O for data processing applications in YARN and Mesos frameworks. Experimental results show that our tool can provision the I/O data rate sharing of competing data processing applications. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink