TY - JOUR
T1 - Task Learning, Intent Prediction, and Adaptive Blended Shared Control with Application to Excavators
AU - Jin, Zongyao
AU - Pagilla, Prabhakar R.
AU - Maske, Harshal
AU - Chowdhary, Girish
N1 - Funding Information:
Manuscript received October 16, 2018; revised September 4, 2019; accepted November 18, 2019. Date of publication January 7, 2020; date of current version December 17, 2020. Manuscript received in final form December 10, 2019. This work was supported by the NSF NRI under Grant 1527828. Recommended by Associate Editor Y. Pan. (Corresponding author: Prabhakar R. Pagilla.) Z. Jin and P. R. Pagilla are with the Department of Mechanical Engineering, Texas A&M University, College Station, TX 77840 USA (e-mail: zongyaojin@tamu.edu; ppagilla@tamu.edu).
Publisher Copyright:
© 1993-2012 IEEE.
PY - 2021/1
Y1 - 2021/1
N2 - Human operators of construction equipment usually exhibit strong situational awareness, which enables them to execute tasks while handling unexpected uncertainties and adapting to environmental changes. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. In dynamic and uncertain environments, significant safety and performance benefits can be derived by collaboratively achieving the tasks via the blending of control inputs from the human operator and automatic control. The focus of this article is on developing efficient methods for such blending and its application to hydraulic excavators, which involves the developments in task learning, intent prediction, and human-machine shared control. We propose a new task learning method by segmenting the tasks with the operator primitive-based segmentation (OPbS) and clustering of subgoals via Bayesian nonparametric clustering with temporal ordering (BNPC/TO). We introduce a method for dynamically predicting the operator's intent in seeking a particular subgoal by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then propose a method for blended shared control with conflict awareness extended from dynamic angle difference. Finally, we apply our algorithms and evaluate the results on a scaled hydraulic excavator test platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.
AB - Human operators of construction equipment usually exhibit strong situational awareness, which enables them to execute tasks while handling unexpected uncertainties and adapting to environmental changes. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. In dynamic and uncertain environments, significant safety and performance benefits can be derived by collaboratively achieving the tasks via the blending of control inputs from the human operator and automatic control. The focus of this article is on developing efficient methods for such blending and its application to hydraulic excavators, which involves the developments in task learning, intent prediction, and human-machine shared control. We propose a new task learning method by segmenting the tasks with the operator primitive-based segmentation (OPbS) and clustering of subgoals via Bayesian nonparametric clustering with temporal ordering (BNPC/TO). We introduce a method for dynamically predicting the operator's intent in seeking a particular subgoal by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then propose a method for blended shared control with conflict awareness extended from dynamic angle difference. Finally, we apply our algorithms and evaluate the results on a scaled hydraulic excavator test platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.
KW - Blended shared control (BSC)
KW - collaborative robotics
KW - human performance augmentation
KW - human-centered automation
KW - robotics in construction
UR - http://www.scopus.com/inward/record.url?scp=85085970104&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085970104&partnerID=8YFLogxK
U2 - 10.1109/TCST.2019.2959536
DO - 10.1109/TCST.2019.2959536
M3 - Article
AN - SCOPUS:85085970104
SN - 1063-6536
VL - 29
SP - 18
EP - 28
JO - IEEE Transactions on Control Systems Technology
JF - IEEE Transactions on Control Systems Technology
IS - 1
M1 - 8951084
ER -