Scaling data-plane logging in large scale networks

Ahsan Arefin, Ahmed Khurshid, Matthew Caesar, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Understanding and troubleshooting wide area networks (such as military backbone networks and ISP networks) are challenging tasks due to their large, distributed, and highly dynamic nature. Building a system that can record and replay fine-grained behaviors of such networks would simplify this problem by allowing operators to recreate the sequence and precise ordering of events (e.g., packet-level forwarding decisions, route changes, failures) taking place in their networks. However, doing this at large scales seems intractable due to the vast amount of information that would need to be logged. In this paper, we propose a scalable and reliable framework to monitor fine-grained data-plane behavior within a large network. We give a feasible architecture for a distributed logging facility, a tree-based data structure for log compression and show how this logged information helps network operators to detect and debug anomalous behavior of the network. Experimental results obtained through trace-driven simulations and Click software router experiments show that our design is lightweight in terms of processing time, memory requirement and control overhead, yet still achieves over 99% precision in capturing network events.

Original languageEnglish (US)
Title of host publication2010 Military Communications Conference, MILCOM 2010
Pages1308-1314
Number of pages7
DOIs
StatePublished - Dec 1 2011
Event2011 IEEE Military Communications Conference, MILCOM 2011 - Baltimore, MD, United States
Duration: Nov 7 2011Nov 10 2011

Publication series

NameProceedings - IEEE Military Communications Conference MILCOM

Other

Other2011 IEEE Military Communications Conference, MILCOM 2011
CountryUnited States
CityBaltimore, MD
Period11/7/1111/10/11

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Scaling data-plane logging in large scale networks'. Together they form a unique fingerprint.

  • Cite this

    Arefin, A., Khurshid, A., Caesar, M., & Nahrstedt, K. (2011). Scaling data-plane logging in large scale networks. In 2010 Military Communications Conference, MILCOM 2010 (pp. 1308-1314). [6127483] (Proceedings - IEEE Military Communications Conference MILCOM). https://doi.org/10.1109/MILCOM.2011.6127483