CrossRoI: Cross-camera region of interest optimization for efficient real time video analytics at scale

Hongpeng Guo, Shuochao Yao, Zhe Yang, Qian Zhou, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Video cameras are pervasively deployed in city scale for public good or community safety (i.e.Traffic monitoring or suspected person tracking). However, analyzing large scale video feeds in real time is data intensive and poses severe challenges to today's network and computation systems. We present CrossRoI, a resource-efficient system that enables real time video analytics at scale via harnessing the videos content associations and redundancy across a fleet of cameras. CrossRoI exploits the intrinsic physical correlations of cross-camera viewing fields to drastically reduce the communication and computation costs. CrossRoI removes the repentant appearances of same objects in multiple cameras without harming comprehensive coverage of the scene. CrossRoI operates in two phases-an offline phase to establish cross-camera correlations, and an efficient online phase for real time video inference. Experiments on real-world video feeds show that CrossRoI achieves 42% ∼ 65% reduction for network overhead and 25% ∼ 34% reduction for response delay in real time video analytics applications with more than 99% query accuracy, when compared to baseline methods. If integrated with SotA frame filtering systems, the performance gains of CrossRoI reaches 50% ∼ 80% (network overhead) and 33% ∼ 61% (end-To-end delay).

Original languageEnglish (US)
Title of host publicationMMSys 2021 - Proceedings of the 2021 Multimedia Systems Conference
PublisherAssociation for Computing Machinery
Pages187-199
Number of pages13
ISBN (Electronic)9781450384346
DOIs
StatePublished - Jul 15 2021
Event12th ACM Multimedia Systems Conference, MMSys 2021 - Virtual, Online, Turkey
Duration: Sep 28 2021Oct 1 2021

Publication series

NameMMSys 2021 - Proceedings of the 2021 Multimedia Systems Conference

Conference

Conference12th ACM Multimedia Systems Conference, MMSys 2021
Country/TerritoryTurkey
CityVirtual, Online
Period9/28/2110/1/21

Keywords

  • convolutional neural networks
  • video analytics
  • video streaming

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'CrossRoI: Cross-camera region of interest optimization for efficient real time video analytics at scale'. Together they form a unique fingerprint.

Cite this