Unlocking Efficiency: Understanding End-to-End Performance in Distributed Analytics Pipelines

Abel Souza, Nathan Ng, Tarek Abdelzaher, Don Towsley, Prashant Shenoy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Internet of Things (IoT) devices have proliferated across a wide range of smart environments that generate vast amounts of data, necessitating the emergence of distributed edge-cloud infrastructures. However, these IoT-edge-cloud infrastructures encounter several challenges in providing efficient and effective services to users, such as real-time service delivery, robustness and resilience, and efficient deployment. Moreover, recent advancements in machine learning, particularly within the realm of deep learning, have ushered in a new era for IoT applications. These applications increasingly lean on data-intensive models to perform a multitude of functions, including classification, detection, data analytics, and decision-making. A key aspect is that many of these tasks exhibit sensitivity to latency and hinge on the deployment of models at the network's edge and on how to efficiently handle data-intensive workloads, especially when network conditions are constrained. In response to these challenges, we present an analytical discussion that delves into the intricacies of distributed IoT pipelines and workloads deployed across both edge and cloud computing environments.

Original languageEnglish (US)
Title of host publicationMILCOM 2023 - 2023 IEEE Military Communications Conference
Subtitle of host publicationCommunications Supporting Military Operations in a Contested Environment
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages150-155
Number of pages6
ISBN (Electronic)9798350321814
DOIs
StatePublished - 2023
Event2023 IEEE Military Communications Conference, MILCOM 2023 - Boston, United States
Duration: Oct 30 2023Nov 3 2023

Publication series

NameMILCOM 2023 - 2023 IEEE Military Communications Conference: Communications Supporting Military Operations in a Contested Environment

Conference

Conference2023 IEEE Military Communications Conference, MILCOM 2023
Country/TerritoryUnited States
CityBoston
Period10/30/2311/3/23

Keywords

  • Analytical Pipelines
  • Edge computing
  • IoT
  • ML inference

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Signal Processing
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Unlocking Efficiency: Understanding End-to-End Performance in Distributed Analytics Pipelines'. Together they form a unique fingerprint.

Cite this