Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction

Zongyao Jin, Prabhakar R. Pagilla, Harshal Maske, Girish Chowdhary

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Human operators of construction and farming equipment exhibit strong situational awareness which enables them to execute tasks while robustly handling unexpected uncertainties in the environment. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. Collaboratively achieving the tasks by combining the benefits of critical situational awareness and decision making capabilities of human operators and the efficiency and accuracy of automatic control is expected to provide improved performance of these tasks. Development of methods in learning, prediction and human-machine shared control to improve such collaborative task execution and application to hydraulic excavators is the focus of this work. In this paper, we propose a task learning method based on an operator primitives based segmentation (OPbS) and Bayesian non-parametric clustering with temporal ordering (BNPC/TO). Then, we introduce a method for predicting the operator's intent in a dynamical environment by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then provide a design for blended shared control with conflict-awareness (BSC/CA) extended from the dynamic angle difference. Finally, we evaluate the approach on a scaled hydraulic excavator test-platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.

Original languageEnglish (US)
Title of host publication2018 IEEE Conference on Decision and Control, CDC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1973-1978
Number of pages6
ISBN (Electronic)9781538613955
DOIs
StatePublished - Jan 18 2019
Event57th IEEE Conference on Decision and Control, CDC 2018 - Miami, United States
Duration: Dec 17 2018Dec 19 2018

Publication series

NameProceedings of the IEEE Conference on Decision and Control
Volume2018-December
ISSN (Print)0743-1546

Conference

Conference57th IEEE Conference on Decision and Control, CDC 2018
CountryUnited States
CityMiami
Period12/17/1812/19/18

Fingerprint

Excavators
Hydraulics
Prediction
Operator
Situational Awareness
Automatic Control
Mathematical operators
Angle
Bayesian Nonparametrics
Stochastic Matrix
Demonstrations
Decision making
Earth (planet)
Transition Matrix
Learning
Well-defined
Segmentation
Decision Making
Clustering
Uncertainty

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Cite this

Jin, Z., Pagilla, P. R., Maske, H., & Chowdhary, G. (2019). Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction. In 2018 IEEE Conference on Decision and Control, CDC 2018 (pp. 1973-1978). [8619826] (Proceedings of the IEEE Conference on Decision and Control; Vol. 2018-December). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CDC.2018.8619826

Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction. / Jin, Zongyao; Pagilla, Prabhakar R.; Maske, Harshal; Chowdhary, Girish.

2018 IEEE Conference on Decision and Control, CDC 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1973-1978 8619826 (Proceedings of the IEEE Conference on Decision and Control; Vol. 2018-December).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jin, Z, Pagilla, PR, Maske, H & Chowdhary, G 2019, Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction. in 2018 IEEE Conference on Decision and Control, CDC 2018., 8619826, Proceedings of the IEEE Conference on Decision and Control, vol. 2018-December, Institute of Electrical and Electronics Engineers Inc., pp. 1973-1978, 57th IEEE Conference on Decision and Control, CDC 2018, Miami, United States, 12/17/18. https://doi.org/10.1109/CDC.2018.8619826
Jin Z, Pagilla PR, Maske H, Chowdhary G. Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction. In 2018 IEEE Conference on Decision and Control, CDC 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1973-1978. 8619826. (Proceedings of the IEEE Conference on Decision and Control). https://doi.org/10.1109/CDC.2018.8619826
Jin, Zongyao ; Pagilla, Prabhakar R. ; Maske, Harshal ; Chowdhary, Girish. / Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction. 2018 IEEE Conference on Decision and Control, CDC 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1973-1978 (Proceedings of the IEEE Conference on Decision and Control).
@inproceedings{694eed1aa0e146f4a37c3e8d6393a5ae,
title = "Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction",
abstract = "Human operators of construction and farming equipment exhibit strong situational awareness which enables them to execute tasks while robustly handling unexpected uncertainties in the environment. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. Collaboratively achieving the tasks by combining the benefits of critical situational awareness and decision making capabilities of human operators and the efficiency and accuracy of automatic control is expected to provide improved performance of these tasks. Development of methods in learning, prediction and human-machine shared control to improve such collaborative task execution and application to hydraulic excavators is the focus of this work. In this paper, we propose a task learning method based on an operator primitives based segmentation (OPbS) and Bayesian non-parametric clustering with temporal ordering (BNPC/TO). Then, we introduce a method for predicting the operator's intent in a dynamical environment by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then provide a design for blended shared control with conflict-awareness (BSC/CA) extended from the dynamic angle difference. Finally, we evaluate the approach on a scaled hydraulic excavator test-platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.",
author = "Zongyao Jin and Pagilla, {Prabhakar R.} and Harshal Maske and Girish Chowdhary",
year = "2019",
month = "1",
day = "18",
doi = "10.1109/CDC.2018.8619826",
language = "English (US)",
series = "Proceedings of the IEEE Conference on Decision and Control",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1973--1978",
booktitle = "2018 IEEE Conference on Decision and Control, CDC 2018",
address = "United States",

}

TY - GEN

T1 - Methods for Blended Shared Control of Hydraulic Excavators with Learning and Prediction

AU - Jin, Zongyao

AU - Pagilla, Prabhakar R.

AU - Maske, Harshal

AU - Chowdhary, Girish

PY - 2019/1/18

Y1 - 2019/1/18

N2 - Human operators of construction and farming equipment exhibit strong situational awareness which enables them to execute tasks while robustly handling unexpected uncertainties in the environment. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. Collaboratively achieving the tasks by combining the benefits of critical situational awareness and decision making capabilities of human operators and the efficiency and accuracy of automatic control is expected to provide improved performance of these tasks. Development of methods in learning, prediction and human-machine shared control to improve such collaborative task execution and application to hydraulic excavators is the focus of this work. In this paper, we propose a task learning method based on an operator primitives based segmentation (OPbS) and Bayesian non-parametric clustering with temporal ordering (BNPC/TO). Then, we introduce a method for predicting the operator's intent in a dynamical environment by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then provide a design for blended shared control with conflict-awareness (BSC/CA) extended from the dynamic angle difference. Finally, we evaluate the approach on a scaled hydraulic excavator test-platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.

AB - Human operators of construction and farming equipment exhibit strong situational awareness which enables them to execute tasks while robustly handling unexpected uncertainties in the environment. Automatic control, on the other hand, is generally capable of executing repetitive and well-defined tasks more efficiently and precisely. Collaboratively achieving the tasks by combining the benefits of critical situational awareness and decision making capabilities of human operators and the efficiency and accuracy of automatic control is expected to provide improved performance of these tasks. Development of methods in learning, prediction and human-machine shared control to improve such collaborative task execution and application to hydraulic excavators is the focus of this work. In this paper, we propose a task learning method based on an operator primitives based segmentation (OPbS) and Bayesian non-parametric clustering with temporal ordering (BNPC/TO). Then, we introduce a method for predicting the operator's intent in a dynamical environment by proposing an empirical stochastic transition matrix (ESTM) and a dynamic angle difference exponential (DADE). We then provide a design for blended shared control with conflict-awareness (BSC/CA) extended from the dynamic angle difference. Finally, we evaluate the approach on a scaled hydraulic excavator test-platform for a typical earth-moving task with novice learning operators and a skilled demonstration operator.

UR - http://www.scopus.com/inward/record.url?scp=85062173899&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062173899&partnerID=8YFLogxK

U2 - 10.1109/CDC.2018.8619826

DO - 10.1109/CDC.2018.8619826

M3 - Conference contribution

AN - SCOPUS:85062173899

T3 - Proceedings of the IEEE Conference on Decision and Control

SP - 1973

EP - 1978

BT - 2018 IEEE Conference on Decision and Control, CDC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -