Enhanced Robotic Teleoperation in Construction Using a GAN-Based Physiological Signal Augmentation Framework

Y. Liu, H. Jebelli

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Communication channels between humans and robots can alleviate safety hazards (collisions, interference) during human–robot collaboration (HRC) at construction sites. Recently, the authors demonstrated the feasibility of improving HRC by using electroencephalogram (EEG) signals to establish hands-free, nonverbal communication. Despite the potential of EEG to provide reliable means of communication, there is a concern regarding the quality of the collection of EEG signals, especially low spatial resolution. EEG signals collected from wearable devices suffer from this problem because the number of electrodes (5–32) is much lower than traditional clinical EEG systems (64–256). More importantly, the low spatial resolution may reduce the reliability of human–robot communication driven by EEG signals. To address this challenge, this study seeks to increase the spatial resolution of EEG signals by proposing a generative adversarial network (GAN)-based data augmentation framework. In it, artificial EEG signals will be produced from actual signals. To examine the feasibility of increasing the spatial resolution of EEG signals for an improved HRC, the EEG dataset of four subjects was collected using a wearable 32-channel device. The results show that the framework can enhance the spatial resolution of the collected dataset by 39.1% by generating realistic artificial signals. It also increased the accuracy of the EEG-based robotic teleoperation by 4.9%. It is expected that increasing the spatial resolution of EEG signals will improve the reliability of EEG-based human–robot communication.

Original languageEnglish (US)
Title of host publicationProceedings of the Canadian Society of Civil Engineering Annual Conference 2021 - CSCE21 General Track Volume 1
EditorsScott Walbridge, Mazdak Nik-Bakht, Kelvin Tsun Ng, Manas Shome, M. Shahria Alam, Ashraf el Damatty, Gordon Lovegrove
PublisherSpringer
Pages295-307
Number of pages13
ISBN (Print)9789811905025
DOIs
StatePublished - 2023
Externally publishedYes
EventAnnual Conference of the Canadian Society of Civil Engineering, CSCE 2021 - Virtual, Online
Duration: May 26 2021May 29 2021

Publication series

NameLecture Notes in Civil Engineering
Volume239
ISSN (Print)2366-2557
ISSN (Electronic)2366-2565

Conference

ConferenceAnnual Conference of the Canadian Society of Civil Engineering, CSCE 2021
CityVirtual, Online
Period5/26/215/29/21

Keywords

  • Construction robots
  • Electroencephalogram
  • Generative adversarial networks
  • Human–robot collaboration
  • Spatial resolution

ASJC Scopus subject areas

  • Civil and Structural Engineering

Fingerprint

Dive into the research topics of 'Enhanced Robotic Teleoperation in Construction Using a GAN-Based Physiological Signal Augmentation Framework'. Together they form a unique fingerprint.

Cite this