Router support for fine-grained latency measurements

Ramana Rao Kompella, Kirill Levchenko, Alex C. Snoeren, George Varghese

Research output: Contribution to journalArticle

Abstract

An increasing number of datacenter network applications, including automated trading and high-performance computing, have stringent end-to-end latency requirements where even microsecond variations may be intolerable. The resulting fine-grained measurement demands cannot be met effectively by existing technologies, such as SNMP, NetFlow, or active probing. We propose instrumenting routers with a hash-based primitive that we call a Lossy Difference Aggregator (LDA) to measure latencies down to tens of microseconds even in the presence of packet loss. Because LDA does not modify or encapsulate the packet, it can be deployed incrementally without changes along the forwarding path. When compared to Poisson-spaced active probing with similar overheads, our LDA mechanism delivers orders of magnitude smaller relative error; active probing requires 50-60 times as much bandwidth to deliver similar levels of accuracy. Although ubiquitous deployment is ultimately desired, it may be hard to achieve in the shorter term; we discuss a partial deployment architecture called mPlane using LDAs for intrarouter measurements and localized segment measurements for interrouter measurements.

Original languageEnglish (US)
Article number6093710
Pages (from-to)811-824
Number of pages14
JournalIEEE/ACM Transactions on Networking
Volume20
Issue number3
DOIs
StatePublished - Jun 1 2012
Externally publishedYes

Fingerprint

Routers
Packet loss
Bandwidth

Keywords

  • Communication technology
  • computer networks
  • coordinated streaming
  • latency measurement
  • router

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this

Router support for fine-grained latency measurements. / Kompella, Ramana Rao; Levchenko, Kirill; Snoeren, Alex C.; Varghese, George.

In: IEEE/ACM Transactions on Networking, Vol. 20, No. 3, 6093710, 01.06.2012, p. 811-824.

Research output: Contribution to journalArticle

Kompella, Ramana Rao ; Levchenko, Kirill ; Snoeren, Alex C. ; Varghese, George. / Router support for fine-grained latency measurements. In: IEEE/ACM Transactions on Networking. 2012 ; Vol. 20, No. 3. pp. 811-824.
@article{17ac33197f2648c685e57164e0677e6d,
title = "Router support for fine-grained latency measurements",
abstract = "An increasing number of datacenter network applications, including automated trading and high-performance computing, have stringent end-to-end latency requirements where even microsecond variations may be intolerable. The resulting fine-grained measurement demands cannot be met effectively by existing technologies, such as SNMP, NetFlow, or active probing. We propose instrumenting routers with a hash-based primitive that we call a Lossy Difference Aggregator (LDA) to measure latencies down to tens of microseconds even in the presence of packet loss. Because LDA does not modify or encapsulate the packet, it can be deployed incrementally without changes along the forwarding path. When compared to Poisson-spaced active probing with similar overheads, our LDA mechanism delivers orders of magnitude smaller relative error; active probing requires 50-60 times as much bandwidth to deliver similar levels of accuracy. Although ubiquitous deployment is ultimately desired, it may be hard to achieve in the shorter term; we discuss a partial deployment architecture called mPlane using LDAs for intrarouter measurements and localized segment measurements for interrouter measurements.",
keywords = "Communication technology, computer networks, coordinated streaming, latency measurement, router",
author = "Kompella, {Ramana Rao} and Kirill Levchenko and Snoeren, {Alex C.} and George Varghese",
year = "2012",
month = "6",
day = "1",
doi = "10.1109/TNET.2012.2188905",
language = "English (US)",
volume = "20",
pages = "811--824",
journal = "IEEE/ACM Transactions on Networking",
issn = "1063-6692",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Router support for fine-grained latency measurements

AU - Kompella, Ramana Rao

AU - Levchenko, Kirill

AU - Snoeren, Alex C.

AU - Varghese, George

PY - 2012/6/1

Y1 - 2012/6/1

N2 - An increasing number of datacenter network applications, including automated trading and high-performance computing, have stringent end-to-end latency requirements where even microsecond variations may be intolerable. The resulting fine-grained measurement demands cannot be met effectively by existing technologies, such as SNMP, NetFlow, or active probing. We propose instrumenting routers with a hash-based primitive that we call a Lossy Difference Aggregator (LDA) to measure latencies down to tens of microseconds even in the presence of packet loss. Because LDA does not modify or encapsulate the packet, it can be deployed incrementally without changes along the forwarding path. When compared to Poisson-spaced active probing with similar overheads, our LDA mechanism delivers orders of magnitude smaller relative error; active probing requires 50-60 times as much bandwidth to deliver similar levels of accuracy. Although ubiquitous deployment is ultimately desired, it may be hard to achieve in the shorter term; we discuss a partial deployment architecture called mPlane using LDAs for intrarouter measurements and localized segment measurements for interrouter measurements.

AB - An increasing number of datacenter network applications, including automated trading and high-performance computing, have stringent end-to-end latency requirements where even microsecond variations may be intolerable. The resulting fine-grained measurement demands cannot be met effectively by existing technologies, such as SNMP, NetFlow, or active probing. We propose instrumenting routers with a hash-based primitive that we call a Lossy Difference Aggregator (LDA) to measure latencies down to tens of microseconds even in the presence of packet loss. Because LDA does not modify or encapsulate the packet, it can be deployed incrementally without changes along the forwarding path. When compared to Poisson-spaced active probing with similar overheads, our LDA mechanism delivers orders of magnitude smaller relative error; active probing requires 50-60 times as much bandwidth to deliver similar levels of accuracy. Although ubiquitous deployment is ultimately desired, it may be hard to achieve in the shorter term; we discuss a partial deployment architecture called mPlane using LDAs for intrarouter measurements and localized segment measurements for interrouter measurements.

KW - Communication technology

KW - computer networks

KW - coordinated streaming

KW - latency measurement

KW - router

UR - http://www.scopus.com/inward/record.url?scp=84862521428&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862521428&partnerID=8YFLogxK

U2 - 10.1109/TNET.2012.2188905

DO - 10.1109/TNET.2012.2188905

M3 - Article

AN - SCOPUS:84862521428

VL - 20

SP - 811

EP - 824

JO - IEEE/ACM Transactions on Networking

JF - IEEE/ACM Transactions on Networking

SN - 1063-6692

IS - 3

M1 - 6093710

ER -