On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics
| Autor: | Tom Z. J. Fu, Xin Wang, Richard T. B. Ma, Walid Aljoby |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
FOS: Computer and information sciences
OpenFlow Dynamic bandwidth allocation Computer Networks and Communications Computer science Distributed computing Cloud computing Throughput 02 engineering and technology TCP congestion-avoidance algorithm Bottleneck Computer Science - Networking and Internet Architecture Stream processing 0202 electrical engineering electronic engineering information engineering Resource management Electrical and Electronic Engineering Networking and Internet Architecture (cs.NI) Channel allocation schemes business.industry Testbed 020206 networking & telecommunications Application layer Bandwidth allocation Analytics 020201 artificial intelligence & image processing business |
| Zdroj: | ICNP |
| ISSN: | 1558-0008 0733-8716 |
| DOI: | 10.1109/jsac.2019.2927062 |
| Popis: | Data communication in cloud-based distributed stream data analytics often involves a collection of parallel and pipelined TCP flows. As the standard TCP congestion control mechanism is designed for achieving "fairness" among competing flows and is agnostic to the application layer contexts, the bandwidth allocation among a set of TCP flows traversing bottleneck links often leads to sub-optimal application-layer performance measures, e.g., stream processing throughput or average tuple complete latency. Motivated by this and enabled by the rapid development of the Software-Defined Networking (SDN) techniques, in this paper, we re-investigate the design space of the bandwidth allocation problem and propose a cross-layer framework which utilizes the additional information obtained from the application layer and provides on-the-fly and dynamic bandwidth adjustment algorithms for helping the stream analytics applications achieving better performance during the runtime. We implement a prototype cross-layer bandwidth allocation framework based on a popular open-source distributed stream processing platform, Apache Storm, together with the OpenDaylight controller, and carry out extensive experiments with real-world analytical workloads on top of a local cluster consisting of 10 workstations interconnected by a SDN-enabled switch. The experiment results clearly validate the effectiveness and efficiency of our proposed framework and algorithms. IEEE Journal On Selected Areas In Communications, VOL. 37, NO. 8, August 2019 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|