TY - GEN
T1 - InfantMotion2Vec
T2 - 20th IEEE International Conference on Body Sensor Networks, BSN 2024
AU - Hossain Khan, Mohammad Nur
AU - McElwain, Nancy L.
AU - Hasegawa-Johnson, Mark
AU - Islam, Bashima
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Early identification of neuro-developmental risks in infants is crucial for timely intervention and improved quality of life. Current screening methods are costly, intrusive, and limited by artificial environments or require the infant to wear multiple sensors. To address these challenges, we propose a novel approach leveraging inertial measurement units (IMUs) to monitor infants' spontaneous motor abilities in natural settings. Our method introduces a hierarchical semi-supervised classifier and the InfantMotion2Vec embedding to capture detailed motion patterns, accommodating a wide age range (up to 36 months) while minimizing reliance on labeled data and cumbersome sensor setups. We collected labeled IMU data from 25 families and unlabeled data from 42 families using a single wearable sensor. Pretraining an embedding network using unlabeled data with a hierarchical pose estimator resulted in a 26% increase in F1-score and a 77.7% increase in Cohen's Kappa score compared to using only labeled data. The InfantMotion2Vec embedding adequately handles highly unbalanced labeled data, demonstrating its effectiveness in infant posture classification.
AB - Early identification of neuro-developmental risks in infants is crucial for timely intervention and improved quality of life. Current screening methods are costly, intrusive, and limited by artificial environments or require the infant to wear multiple sensors. To address these challenges, we propose a novel approach leveraging inertial measurement units (IMUs) to monitor infants' spontaneous motor abilities in natural settings. Our method introduces a hierarchical semi-supervised classifier and the InfantMotion2Vec embedding to capture detailed motion patterns, accommodating a wide age range (up to 36 months) while minimizing reliance on labeled data and cumbersome sensor setups. We collected labeled IMU data from 25 families and unlabeled data from 42 families using a single wearable sensor. Pretraining an embedding network using unlabeled data with a hierarchical pose estimator resulted in a 26% increase in F1-score and a 77.7% increase in Cohen's Kappa score compared to using only labeled data. The InfantMotion2Vec embedding adequately handles highly unbalanced labeled data, demonstrating its effectiveness in infant posture classification.
KW - Hierarchical Classification
KW - Posture Detection
KW - Representation Learning
KW - Self-supervised Model
UR - http://www.scopus.com/inward/record.url?scp=85215076761&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85215076761&partnerID=8YFLogxK
U2 - 10.1109/BSN63547.2024.10780750
DO - 10.1109/BSN63547.2024.10780750
M3 - Conference contribution
AN - SCOPUS:85215076761
T3 - 2024 IEEE 20th International Conference on Body Sensor Networks, BSN 2024 - Proceedings
BT - 2024 IEEE 20th International Conference on Body Sensor Networks, BSN 2024 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 October 2024 through 17 October 2024
ER -