Visual 3D tracking of child-adult social interactions

Eunji Chong, Audrey Southerland, Abhijit Kundu, Rebecca M. Jones, Agata Rozga, James M. Rehg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe an approach to continuously capture children's 3D head pose and location during a tabletop social interaction with an adult examiner. Our approach, called face plus context, utilizes a fixed room camera in conjunction with a head-worn camera on the examiner to simultaneously capture the child's face along with the toys and social partners that provide context. Our system performs head tracking and pose estimation along with multi-target tracking to provide 3D localization and disambiguate identity. We evaluated our method on a dataset of 16 children, including both typically developing and autistic children. We present encouraging results for measuring children's social behaviors, along with validation results using an IMU.

Original languageEnglish (US)
Title of host publication7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages399-406
Number of pages8
ISBN (Electronic)9781538637159
DOIs
StatePublished - Jul 2 2017
Externally publishedYes
Event7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017 - Lisbon, Portugal
Duration: Sep 18 2017Sep 21 2017

Publication series

Name7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
Volume2018-January

Conference

Conference7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
Country/TerritoryPortugal
CityLisbon
Period9/18/179/21/17

ASJC Scopus subject areas

  • Artificial Intelligence
  • Mechanical Engineering
  • Control and Optimization
  • Developmental Neuroscience

Fingerprint

Dive into the research topics of 'Visual 3D tracking of child-adult social interactions'. Together they form a unique fingerprint.

Cite this