Bio-inspired Learning of Sensorimotor Control for Locomotion

Tixian Wang, Amirhossein Taghvaei, Prashant G. Mehta

Research output: Chapter in Book/Report/Conference proceedingConference contribution


This paper presents a bio-inspired central pattern generator (CPG)-type architecture for learning optimal maneuvering control of periodic locomotory gaits. The architecture is presented here with the aid of a snake robot model problem involving planar locomotion of coupled rigid body systems. The maneuver involves clockwise or counterclockwise turning from a nominally straight path. The CPG circuit is realized as a coupled oscillator feedback particle filter. The collective dynamics of the filter are used to approximate a posterior distribution that is used to construct the optimal control input for maneuvering the robot. A Q-learning algorithm is applied to learn the approximate optimal control law. The issues surrounding the parametrization of the Q-function are discussed. The theoretical results are illustrated with numerics for a 5-link snake robot system.

Original languageEnglish (US)
Title of host publication2020 American Control Conference, ACC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Electronic)9781538682661
StatePublished - Jul 2020
Event2020 American Control Conference, ACC 2020 - Denver, United States
Duration: Jul 1 2020Jul 3 2020

Publication series

NameProceedings of the American Control Conference
ISSN (Print)0743-1619


Conference2020 American Control Conference, ACC 2020
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Electrical and Electronic Engineering


Dive into the research topics of 'Bio-inspired Learning of Sensorimotor Control for Locomotion'. Together they form a unique fingerprint.

Cite this