Shortest paths in less than a millisecond

Rachit Agarwal, Matthew Caesar, Philip Brighten Godfrey, Ben Y. Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the problem of answering point-to-point shortest path queries on massive social networks. The goal is to answer queries within tens of milliseconds while minimizing the memory requirements. We present a technique that achieves this goal for an extremely large fraction of path queries by exploiting the structure of the social networks. Using evaluations on real-world datasets, we argue that our technique offers a unique trade-off between latency, memory and accuracy. For instance, for the LiveJournal social network (roughly 5 million nodes and 69 million edges), our technique can answer 99.9 of the queries in less than a millisecond. In comparison to storing all pair shortest paths, our technique requires at least 550x less memory; the average query time is roughly 365 microseconds - - 430x faster than the state-of-the-art shortest path algorithm. Furthermore, the relative performance of our technique improves with the size (and density) of the network. For the Orkut social network (3 million nodes and 220 million edges), for instance, our technique is roughly 2588x faster than the state-of-the-art algorithm for computing shortest paths.

Original languageEnglish (US)
Title of host publicationWOSN'12 - Proceedings of the ACM Workshop on Online Social Networks
Pages37-42
Number of pages6
DOIs
StatePublished - 2012
Event2012 Workshop on Online Social Networks, WOSN 2012 Co-located with SIGCOMM 2012 - Helsinki, Finland
Duration: Aug 17 2012Aug 17 2012

Publication series

NameWOSN'12 - Proceedings of the ACM Workshop on Online Social Networks

Other

Other2012 Workshop on Online Social Networks, WOSN 2012 Co-located with SIGCOMM 2012
Country/TerritoryFinland
CityHelsinki
Period8/17/128/17/12

Keywords

  • distance queries
  • graph databases
  • shortest paths
  • social networks

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Shortest paths in less than a millisecond'. Together they form a unique fingerprint.

Cite this