Aggregation-based model reduction of a hidden Markov model

Kun Deng, Prashant G. Mehta, Sean P. Meyn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper is concerned with developing an information-theoretic framework to aggregate the state space of a Hidden Markov Model (HMM) on discrete state and observation spaces. The optimal aggregation is obtained by minimizing the Kullback-Leibler (K-L) divergence rate between joint laws describing the state and observation processes. The solution to this optimization problem is just the optimal aggregated Hidden Markov Model. This optimization problem is solved in two steps: The first step is to formulate the optimal solution for any fixed partition. The second step is to find the optimal partition by using an approximate dynamic programming framework. The algorithm can be implemented using a single sample path of the HMM and is illustrated with the aid of examples.

Original languageEnglish (US)
Title of host publication2010 49th IEEE Conference on Decision and Control, CDC 2010
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6183-6188
Number of pages6
ISBN (Print)9781424477456
DOIs
StatePublished - 2010
Event49th IEEE Conference on Decision and Control, CDC 2010 - Atlanta, United States
Duration: Dec 15 2010Dec 17 2010

Publication series

NameProceedings of the IEEE Conference on Decision and Control
ISSN (Print)0743-1546
ISSN (Electronic)2576-2370

Conference

Conference49th IEEE Conference on Decision and Control, CDC 2010
Country/TerritoryUnited States
CityAtlanta
Period12/15/1012/17/10

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Aggregation-based model reduction of a hidden Markov model'. Together they form a unique fingerprint.

Cite this