Feasible Stylized Motion: Robotic Manipulator Imitation of a Human Demonstration with Collision Avoidance and Style Parameters in Increasingly Cluttered Environments

Roshni Kaushik, Anant Kumar Mishra, Amy Laviers

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Socially intelligent robots are a priority for large manufacturing companies that want to deploy collaborative robots in many countries around the world. This paper presents an approach to robot motion generation in which a human demonstration is imitated, collisions are avoided, and a "style" is applied to subtly modify the feasible motion. The framework integrates three subsystems to create a holistic method that navigates the trade-off between form and function. The first subsystem uses depth camera information to track a human skeleton and create a low dimensional motion model. The second subsystem applies these angles to a simulated UR3 robot, modifying them to produce a feasible trajectory. The generated trajectory avoids physically infeasible configurations and collisions with the environment, while remaining as close to the original demonstration as possible. The final subsystem applies four style parameters, based on prior work using Laban Effort Factors, to endow the trajectory with a specific "style". This approach creates adaptive robot behavior in which one human demonstration can result in many subtly different robot motions. The effectiveness of the hybrid approach, which considers functional as well as expressive goals, is demonstrated on three environments of increasing clutter. As expected, in more cluttered environments, the desired imitation is not as pronounced as in unconstrained environments. Potential applications of this framework include programming robot motion on a factory floor with greater efficiency as well as creating feasible motion on multiple robots with a single demonstration. This quantitative work highlights the Function/Expression duality named in the Laban/Bartenieff Movement System, illuminating how the arts are critical for "practical" spaces like the factory.

Original languageEnglish (US)
Title of host publicationProceedings of the 7th International Conference on Movement and Computing, MOCO 2020
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450375054
DOIs
StatePublished - Jul 15 2020
Event7th International Conference on Movement and Computing, MOCO 2020 - Jersey City, Virtual, United States
Duration: Jul 15 2020Jul 17 2020

Publication series

NameACM International Conference Proceeding Series

Conference

Conference7th International Conference on Movement and Computing, MOCO 2020
CountryUnited States
CityJersey City, Virtual
Period7/15/207/17/20

Keywords

  • collaborative robots
  • coordination
  • imitation
  • Laban Movement Analysis
  • manufacturing
  • optimization
  • robotics
  • social robots
  • style

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Feasible Stylized Motion: Robotic Manipulator Imitation of a Human Demonstration with Collision Avoidance and Style Parameters in Increasingly Cluttered Environments'. Together they form a unique fingerprint.

Cite this