Investigating Self-supervised Learning for Predicting Stress and Stressors from Passive Sensing

Harish Haresamudram, Jina Suh, Javier Hernandez, Jenna Butler, Ahad Chaudhry, Longqi Yang, Koustuv Saha, Mary Czerwinski

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The application of machine learning (ML) techniques for well-being tasks has grown in popularity due to the abundance of passively-sensed data generated by devices. However, the performance of ML models are often limited by the cost associated with obtaining ground truth labels and the variability of well-being annotations. Self-supervised representations learned from large-scale unlabeled datasets have been shown to accelerate the training process, with subsequent fine-tuning to the specific downstream tasks with a relatively small set of annotations. In this paper, we investigate the potential and effectiveness of self-supervised pre-training for well-being tasks, specifically predicting both workplace daily stress as well as the most impactful stressors. Through a series of experiments, we find that self-supervised methods are effective when predicting on unseen users, relative to supervised baselines. Scaling both data size and encoder depth, we observe the superior performance obtained by self-supervised methods, further showcasing their utility for well-being applications. In addition, we present future research directions and insights for applying self-supervised representation learning on well-being tasks.

Original languageEnglish (US)
Title of host publication2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, ACIIW 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350327458
DOIs
StatePublished - 2023
Event11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, ACIIW 2023 - Cambridge, United States
Duration: Sep 10 2023Sep 13 2023

Publication series

Name2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, ACIIW 2023

Conference

Conference11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, ACIIW 2023
Country/TerritoryUnited States
CityCambridge
Period9/10/239/13/23

Keywords

  • self-supervised learning
  • well-being
  • workplace stress prediction

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Media Technology
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Investigating Self-supervised Learning for Predicting Stress and Stressors from Passive Sensing'. Together they form a unique fingerprint.

Cite this