Exploiting domain knowledge in planning for uncertain robot systems modeled as POMDPs

Salvatore Candido, James Davidson, Seth Hutchinson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a planning algorithm that allows user-supplied domain knowledge to be exploited in the synthesis of information feedback policies for systems modeled as partially observable Markov decision processes (POMDPs). POMDP models, which are increasingly popular in the robotics literature, permit a planner to consider future uncertainty in both the application of actions and sensing of observations. With our approach, domain experts can inject specialized knowledge into the planning process by providing a set of local policies that are used as primitives by the planner. If the local policies are chosen appropriately, the planner can evaluate further into the future, even for large problems, which can lead to better overall policies at decreased computational cost. We use a structured approach to encode the provided domain knowledge into the value function approximation. We demonstrate our approach on a multi-robot fire fighting problem, in which a team of robots cooperates to extinguish a spreading fire, modeled as a stochastic process. The state space for this problem is significantly larger than is typical in the POMDP literature, and the geometry of the problem allows for the application of an intuitive set of local policies, thus demonstrating the effectiveness of our approach.

Original languageEnglish (US)
Title of host publication2010 IEEE International Conference on Robotics and Automation, ICRA 2010
Pages3596-3603
Number of pages8
DOIs
StatePublished - Aug 26 2010
Event2010 IEEE International Conference on Robotics and Automation, ICRA 2010 - Anchorage, AK, United States
Duration: May 3 2010May 7 2010

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
ISSN (Print)1050-4729

Other

Other2010 IEEE International Conference on Robotics and Automation, ICRA 2010
CountryUnited States
CityAnchorage, AK
Period5/3/105/7/10

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Exploiting domain knowledge in planning for uncertain robot systems modeled as POMDPs'. Together they form a unique fingerprint.

Cite this