Accurate Hierarchical Traffic Measurement in Datacenters Through Differentiated Memory Allocation
| Autor: | Yuanda Wang, Dimitrios Melissourgos, Shigang Chen, Olufemi Odegbile |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Computer science
Aggregate (data warehouse) 020206 networking & telecommunications 02 engineering and technology Base (topology) Computational science Physics::Fluid Dynamics Memory management Flow (mathematics) Shared memory Server 0202 electrical engineering electronic engineering information engineering Resource management Resource management (computing) |
| Zdroj: | BigCom |
| DOI: | 10.1109/bigcom51056.2020.00025 |
| Popis: | A hierarchical flow model provides us the opportunity to monitor network traffic in datacenters, at once, from coarser (aggregate flows) to finer granularity (individual flows). Per-flow traffic measurement based on an idea of counter-sharing is memory-efficient by recording the sizes of all flows in a shared array of physical counters. Through this approach, flows at the same level record their sizes in uniformly sized virtual counter arrays constructed from the shared memory. However, flows at the same level have vastly different sizes. The virtual counter arrays for large flows must be big enough to uniformly distribute errors it contains. However, when large virtual counter arrays are used to record small flow sizes, the arrays accumulate more errors than the recorded flows’ sizes, thereby affecting the accuracy of the estimations. The paper introduces the concept of differentiated virtual counter arrays, where the number of virtual counters allocated to each flow is based on its historical size. We derive a mathematical formula for flow-size estimation when recording flow sizes with flexible number of virtual counters and develop a heuristic algorithm to calculate how many virtual counters are assigned to each flow. Through experiments, we demonstrate that our solution is more accurate by up to 75% for aggregate flows and by up to 100% for small base flows compared with the prior art. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|