Impacts of task placement and bandwidth allocation on stream analytics
| Autor: | Walid Aljoby, Tom Z. J. Fu, Richard T. B. Ma |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
020203 distributed computing
Channel allocation schemes Computer science business.industry Real-time computing 020206 networking & telecommunications Throughput 02 engineering and technology Bottleneck Task (project management) Stream processing Bandwidth allocation Computer cluster 0202 electrical engineering electronic engineering information engineering Bandwidth (computing) business Computer network |
| Zdroj: | ICNP |
| DOI: | 10.1109/icnp.2017.8117589 |
| Popis: | We consider data intensive cloud-based stream analytics where data transmission through the underlying communication network is the cause of the performance bottleneck. Two key inter-related problems are investigated: task placement and bandwidth allocation. We seek to answer the following questions. How does task placement make impact on the application-level throughput? Does a careful bandwidth allocation among data flows traversing a bottleneck link results in better performance? In this paper, we address these questions by conducting measurement-driven analysis in a SDN-enabled computer cluster running stream processing applications on top of Apache Storm. The results reveal (i) how tasks are assigned to computing nodes make large difference in application level performance; (ii) under certain task placement, a proper bandwidth allocation helps further improve the performance as compared to the default TCP mechanism; and (iii) task placement and bandwidth allocation are collaboratively making effects in overall performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|