QualityDeepSense: Quality-aware deep learning framework for internet of things applications with sensor-temporal attention

Shuochao Yao, Shaohan Hu, Yiran Zhao, Tarek Abdelzaher

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep neural networks are becoming increasingly popular in mobile sensing and computing applications. Their capability of fusing multiple sensor inputs and extracting temporal relationships can enhance intelligence in a wide range of applications. One key problem however is the noisy on-device sensors, whose characters are heterogeneous and varying over time. The existing mobile deep learning frameworks usually treat every sensor input equally over time, lacking the ability of identifying and exploiting the heterogeneity of sensor noise. In this work, we propose QualityDeepSense, a deep learning framework that can automatically balance the contribution of sensor inputs over time by their sensing qualities. We propose a sensor-temporal attention mechanism to learn the dependencies among sensor inputs over time. These correlations are used to infer the qualities and reassign the contribution of sensor inputs. QualityDeepSense can thus focus on more informative sensor inputs for prediction. We demonstrate the effectiveness of QualityDeepSense using the noise-augmented heterogeneous human activity recognition task. QualityDeepSense outperforms the state-of-the-art methods by a clear margin. In addition, we show QualityDeepSense only impose limited resource-consumption burden on embedded devices.

Original languageEnglish (US)
Title of host publicationEMDL 2018 - Proceedings of the 2018 International Workshop on Embedded and Mobile Deep Learning
PublisherAssociation for Computing Machinery, Inc
Pages42-47
Number of pages6
ISBN (Electronic)9781450358446
DOIs
StatePublished - Jun 15 2018
Event2nd International Workshop on Embedded and Mobile Deep Learning, EMDL 2018 - Munich, Germany
Duration: Jun 15 2018 → …

Publication series

NameEMDL 2018 - Proceedings of the 2018 International Workshop on Embedded and Mobile Deep Learning

Other

Other2nd International Workshop on Embedded and Mobile Deep Learning, EMDL 2018
CountryGermany
CityMunich
Period6/15/18 → …

Keywords

  • Deep Learning
  • Internet of Things
  • Mobile Computing
  • Sensing Quality

ASJC Scopus subject areas

  • Information Systems
  • Software
  • Hardware and Architecture
  • Computer Science Applications

Fingerprint Dive into the research topics of 'QualityDeepSense: Quality-aware deep learning framework for internet of things applications with sensor-temporal attention'. Together they form a unique fingerprint.

  • Cite this

    Yao, S., Hu, S., Zhao, Y., & Abdelzaher, T. (2018). QualityDeepSense: Quality-aware deep learning framework for internet of things applications with sensor-temporal attention. In EMDL 2018 - Proceedings of the 2018 International Workshop on Embedded and Mobile Deep Learning (pp. 42-47). (EMDL 2018 - Proceedings of the 2018 International Workshop on Embedded and Mobile Deep Learning). Association for Computing Machinery, Inc. https://doi.org/10.1145/3212725.3212729