Langlet, Jonatan;
Ben Basat, Ran;
Oliaro, Gabriele;
Mitzenmacher, Michael;
Yu, Minlan;
Antichi, Gianni;
(2023)
Direct Telemetry Access.
In:
ACM SIGCOMM '23: Proceedings of the ACM SIGCOMM 2023 Conference.
(pp. pp. 832-849).
ACM
Preview |
PDF
2202.02270.pdf - Accepted Version Download (1MB) | Preview |
Abstract
Fine-grained network telemetry is becoming a modern datacenter standard and is the basis of essential applications such as congestion control, load balancing, and advanced troubleshooting. As network size increases and telemetry gets more fine-grained, there is a tremendous growth in the amount of data needed to be reported from switches to collectors to enable network-wide view. As a consequence, it is progressively hard to scale data collection systems. We introduce Direct Telemetry Access (DTA), a solution optimized for aggregating and moving hundreds of millions of reports per second from switches into queryable data structures in collectors' memory. DTA is lightweight and it is able to greatly reduce overheads at collectors. DTA is built on top of RDMA, and we propose novel and expressive reporting primitives to allow easy integration with existing state-of-the-art telemetry mechanisms such as INT or Marple. We show that DTA significantly improves telemetry collection rates. For example, when used with INT, it can collect and aggregate over 400M reports per second with a single server, improving over the Atomic MultiLog by up to 16x.
| Type: | Proceedings paper |
|---|---|
| Title: | Direct Telemetry Access |
| Event: | ACM SIGCOMM 2023 Conference |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3603269.3604827 |
| Publisher version: | https://doi.org/10.1145/3603269.3604827 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10183233 |
Archive Staff Only
 |
View Item |
