Programmable Event Detection for In-Band Network Telemetry
| Autor: | Jonathan Vestin, Andreas Kassler, Karl-Johan Grinnemo, Deval Bhamare, Gergely Pongracz, Jan-Olof Andersson |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Networking and Internet Architecture (cs.NI)
FOS: Computer and information sciences Edge device business.industry Network packet Computer science 020206 networking & telecommunications 02 engineering and technology Network monitoring Telekommunikation Stream processing Computer Science - Networking and Internet Architecture 020210 optoelectronics & photonics Telemetry Scalability Telecommunications 0202 electrical engineering electronic engineering information engineering Forwarding plane Data center business Computer hardware |
| Zdroj: | CloudNet |
| DOI: | 10.48550/arxiv.1909.12101 |
| Popis: | In-Band Network Telemetry (INT) is a novel framework for collecting telemetry items and switch internal state information from the data plane at line rate. With the suppor programmable data planes and programming language P4,switches parse telemetry instruction headers and determine which telemetry items to attach using custom metadata. At the network edge, telemetry information is removed and the original packets are forwarded while telemetry reports are sent to a distributed stream processor for further processing by a network monitoring platform. In order to avoid excessive load on the stream processor, telemetry items should not be sent for each individual packet but rather when certain events are triggered. In this paper, we develop a programmable INT event detection mechanism in P4 that allows customization of which events to report to the monitoring system, on a per-flow basis, from the control plane. At the stream processor, we implement a fast INT report collector using the kernel bypass technique AF XDP, which parses telemetry reports and streams them to a distributed Kafka cluster, which can apply machine learning, visualization and further monitoring tasks. In our evaluation, we use realworld traces from different data center workloads and show that our approach is highly scalable and significantly reduces the network overhead and stream processor load due to effective event pre-filtering inside the switch data plane. While the INT report collector can process around 3 Mpps telemetry reports per core, using event pre-filtering increases the capacity by 10-15x. HITS, 4707 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|