Completing state representations using spectral learning

Nan Jiang, Alex Kulesza, Satinder Singh

Research output: Contribution to journalConference article

Abstract

A central problem in dynamical system modeling is state discovery-that is, finding a compact summary of the past that captures the information needed to predict the future. Predictive State Representations (PSRs) enable clever spectral methods for state discovery; however, while consistent in the limit of infinite data, these methods often suffer from poor performance in the low data regime. In this paper we develop a novel algorithm for incorporating domain knowledge, in the form of an imperfect state representation, as side information to speed spectral learning for PSRs. We prove theoretical results characterizing the relevance of a user-provided state representation, and design spectral algorithms that can take advantage of a relevant representation. Our algorithm utilizes principal angles to extract the relevant components of the representation, and is robust to mis-specification. Empirical evaluation on synthetic HMMs, an aircraft identification domain, and a gene splice dataset shows that, even with weak domain knowledge, the algorithm can significantly outperform standard PSR learning.

Original languageEnglish (US)
Pages (from-to)4328-4337
Number of pages10
JournalAdvances in Neural Information Processing Systems
Volume2018-December
StatePublished - Jan 1 2018
Event32nd Conference on Neural Information Processing Systems, NeurIPS 2018 - Montreal, Canada
Duration: Dec 2 2018Dec 8 2018

Fingerprint

Dynamical systems
Genes
Aircraft
Specifications

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing

Cite this

Completing state representations using spectral learning. / Jiang, Nan; Kulesza, Alex; Singh, Satinder.

In: Advances in Neural Information Processing Systems, Vol. 2018-December, 01.01.2018, p. 4328-4337.

Research output: Contribution to journalConference article

Jiang, Nan ; Kulesza, Alex ; Singh, Satinder. / Completing state representations using spectral learning. In: Advances in Neural Information Processing Systems. 2018 ; Vol. 2018-December. pp. 4328-4337.
@article{ee188eacb25e4b5496758df039d7152e,
title = "Completing state representations using spectral learning",
abstract = "A central problem in dynamical system modeling is state discovery-that is, finding a compact summary of the past that captures the information needed to predict the future. Predictive State Representations (PSRs) enable clever spectral methods for state discovery; however, while consistent in the limit of infinite data, these methods often suffer from poor performance in the low data regime. In this paper we develop a novel algorithm for incorporating domain knowledge, in the form of an imperfect state representation, as side information to speed spectral learning for PSRs. We prove theoretical results characterizing the relevance of a user-provided state representation, and design spectral algorithms that can take advantage of a relevant representation. Our algorithm utilizes principal angles to extract the relevant components of the representation, and is robust to mis-specification. Empirical evaluation on synthetic HMMs, an aircraft identification domain, and a gene splice dataset shows that, even with weak domain knowledge, the algorithm can significantly outperform standard PSR learning.",
author = "Nan Jiang and Alex Kulesza and Satinder Singh",
year = "2018",
month = "1",
day = "1",
language = "English (US)",
volume = "2018-December",
pages = "4328--4337",
journal = "Advances in Neural Information Processing Systems",
issn = "1049-5258",

}

TY - JOUR

T1 - Completing state representations using spectral learning

AU - Jiang, Nan

AU - Kulesza, Alex

AU - Singh, Satinder

PY - 2018/1/1

Y1 - 2018/1/1

N2 - A central problem in dynamical system modeling is state discovery-that is, finding a compact summary of the past that captures the information needed to predict the future. Predictive State Representations (PSRs) enable clever spectral methods for state discovery; however, while consistent in the limit of infinite data, these methods often suffer from poor performance in the low data regime. In this paper we develop a novel algorithm for incorporating domain knowledge, in the form of an imperfect state representation, as side information to speed spectral learning for PSRs. We prove theoretical results characterizing the relevance of a user-provided state representation, and design spectral algorithms that can take advantage of a relevant representation. Our algorithm utilizes principal angles to extract the relevant components of the representation, and is robust to mis-specification. Empirical evaluation on synthetic HMMs, an aircraft identification domain, and a gene splice dataset shows that, even with weak domain knowledge, the algorithm can significantly outperform standard PSR learning.

AB - A central problem in dynamical system modeling is state discovery-that is, finding a compact summary of the past that captures the information needed to predict the future. Predictive State Representations (PSRs) enable clever spectral methods for state discovery; however, while consistent in the limit of infinite data, these methods often suffer from poor performance in the low data regime. In this paper we develop a novel algorithm for incorporating domain knowledge, in the form of an imperfect state representation, as side information to speed spectral learning for PSRs. We prove theoretical results characterizing the relevance of a user-provided state representation, and design spectral algorithms that can take advantage of a relevant representation. Our algorithm utilizes principal angles to extract the relevant components of the representation, and is robust to mis-specification. Empirical evaluation on synthetic HMMs, an aircraft identification domain, and a gene splice dataset shows that, even with weak domain knowledge, the algorithm can significantly outperform standard PSR learning.

UR - http://www.scopus.com/inward/record.url?scp=85064847844&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064847844&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85064847844

VL - 2018-December

SP - 4328

EP - 4337

JO - Advances in Neural Information Processing Systems

JF - Advances in Neural Information Processing Systems

SN - 1049-5258

ER -