Diamont: dynamic monitoring of uncertainty for distributed asynchronous programs

Vimuth Fernando, Keyur Joshi, Jacob Laurel, Sasa Misailovic

Research output: Contribution to journalArticlepeer-review

Abstract

Many application domains including graph analytics, the Internet-of-Things, precision agriculture, and media processing operate on noisy data and/or produce approximate results. These applications can distribute computation across multiple (often resource-constrained) processing units. Analyzing the reliability and accuracy of such applications is challenging, since most existing techniques operate on specific fixed-error models, check for individual properties, or can only be applied to sequential programs. We present Diamont, a system for dynamic monitoring of uncertainty properties in distributed programs. Diamont programs consist of distributed processes that communicate via asynchronous message passing. Diamont includes datatypes that dynamically monitor uncertainty in data and provides support for checking predicates over the monitored uncertainty at runtime. We also present a general methodology for verifying the soundness of the runtime system and optimizations using canonical sequentialization. We implemented Diamont for a subset of the Go language and evaluated eight programs from precision agriculture, graph analytics, and media processing. We show that Diamont can prove important end-to-end properties of program outputs for significantly larger inputs compared to prior work, with modest execution time overhead: 3% on average (max 16.3%) for our main evaluation input set and 15% on average for 8x larger inputs.

Original languageEnglish (US)
Pages (from-to)521-539
Number of pages19
JournalInternational Journal on Software Tools for Technology Transfer
Volume25
Issue number4
DOIs
StatePublished - Aug 2023

Keywords

  • Distributed Programs
  • Runtime Analysis
  • Uncertainty

ASJC Scopus subject areas

  • Software
  • Information Systems

Fingerprint

Dive into the research topics of 'Diamont: dynamic monitoring of uncertainty for distributed asynchronous programs'. Together they form a unique fingerprint.

Cite this