Improving the Network Performance of a Container-Based Cloud Environment for Hadoop Systems
| Autor: | Luiz Gustavo Fernandes, Cassiano Rista, Dalvan Griebler, Carlos A. F. Maron |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
021103 operations research
business.industry Computer science Big data 0211 other engineering and technologies Cloud computing 02 engineering and technology Virtualization computer.software_genre Link aggregation Bandwidth utilization Embedded system 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Network performance Latency (engineering) business computer Resource utilization |
| Zdroj: | HPCS |
| DOI: | 10.1109/hpcs.2017.97 |
| Popis: | Cloud computing has emerged as an important paradigm to improve resource utilization, efficiency, flexibility, and the pay-per-use billing structure. However, cloud platforms cause performance degradations due to their virtualization layer and may not be appropriate for the requirements of high-performance applications, such as big data. This paper tackles the problem of improving network performance in container-based cloud instances to create a viable alternative to run network intensive Hadoop applications. Our approach consists of deploying link aggregation via the IEEE 802.3ad standard to increase the available bandwidth and using LXC (Linux Container) cloud instances to create a Hadoop cluster. In order to evaluate the efficiency of our approach and the overhead added by the container-based cloud environment, we ran a set of experiments to measure throughput, latency, bandwidth utilization, and completion times. The results prove that our approach adds minimal overhead in cloud environment as well as increases throughput and reduces latency. Moreover, our approach demonstrates a suitable alternative for running Hadoop applications, reducing completion times up to 33.73%. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|