YouHome System and Dataset: Making Your Home Know You Better

Junhao Pan, Zehua Yuan, Xiaofan Zhang, Deming Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent research has actively investigated technolo-gies, such as artificial intelligence (AI), energy-efficient computing, and privacy protection, to bring us more advanced smart home experiences. However, existing work has failed to integrate these key technologies to provide a complete smart home solution to understand user behaviors, protect user pri-vacy, and provide personalized suggestions. In addition, there are not many available smart home datasets that can support thorough studies of user behaviors in household environments. To address these critical problems, we present YouHome: the first smart home framework for developing integrated smart systems with a strong emphasis on usability, scalability, user privacy, edge/cloud coordination, and a comprehensive activities-of-daily-living (ADL) dataset to assist the smart home research. YouHome includes a flexible framework with three levels of system abstraction to collect sensor data, recognize user behavior, and generate personalized suggestions. We also establish multi-stage approaches in this work to protect user privacy effectively from threats such as data leaks. Finally, we implement an end-to-end prototype system to demonstrate the efficacy of our proposed framework. The accompanying YouHome ADL dataset is the first annotated dataset with multiple sensing data types tailored for smart home research and applications, including video, illuminance, temperature, humidity, motion, and sound. It covers two household settings, 20 users, and 31 different activities. We have released our comprehensive dataset to enable numerous research opportunities in both smart home and machine learning communities. We also intend to open-source the framework in the future.

Original languageEnglish (US)
Title of host publicationProceedings - 2022 IEEE International Symposium on Smart Electronic Systems, iSES 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages414-420
Number of pages7
ISBN (Electronic)9798350399226
DOIs
StatePublished - 2022
Event8th IEEE International Symposium on Smart Electronic Systems, iSES 2022 - Warangal, India
Duration: Dec 19 2022Dec 21 2022

Publication series

NameProceedings - 2022 IEEE International Symposium on Smart Electronic Systems, iSES 2022

Conference

Conference8th IEEE International Symposium on Smart Electronic Systems, iSES 2022
Country/TerritoryIndia
CityWarangal
Period12/19/2212/21/22

Keywords

  • Smart home
  • cloud computing
  • data set
  • machine learning
  • privacy protection

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Control and Optimization
  • Instrumentation

Fingerprint

Dive into the research topics of 'YouHome System and Dataset: Making Your Home Know You Better'. Together they form a unique fingerprint.

Cite this