On exploiting structured human interactions to enhance sensing accuracy in cyber-physical systems

Hongwei Wang, Yunlong Gao, Shaohan Hu, Shiguang Wang, Renato Mancuso, Minje Kim, Poliang Wu, Lu Su, Lui Sha, Tarek Abdelzaher

Research output: Contribution to journalArticle


In this article, we describe a general methodology for enhancing sensing accuracy in cyber-physical systems that involve structured human interactions in noisy physical environment. We define structured human interactions as domain-specific workflow. A novel workflow-aware sensing model is proposed to jointly correct unreliable sensor data and keep track of states in a workflow. We also propose a new inference algorithm to handle cases with partially known states and objects as supervision. Our model is evaluated with extensive simulations. As a concrete application, we develop a novel log service called Emergency Transcriber, which can automatically document operational procedures followed by teams of first responders in emergency response scenarios. Evaluation shows that our system has significant improvement over commercial off-theshelf (COTS) sensors and keeps track of workflow states with high accuracy in noisy physical environment.

Original languageEnglish (US)
Article number16
JournalACM Transactions on Cyber-Physical Systems
Issue number3
StatePublished - Jan 1 2017



  • Medical
  • Sensing
  • Workflow

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Human-Computer Interaction
  • Control and Optimization

Cite this