Exact simulation of continuous time Markov jump processes with anticorrelated variance reduced Monte Carlo estimation

Peter A. Maginnis, Matthew West, Geir E. Dullerud

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We provide an exact, continuous time extension to previous work in anticorrelated stochastic process simulation that was performed in an approximate, discrete time setting. These methods reduce the variance of continuous time Monte Carlo for Markov jump process systems. We rigorously construct antithetic Poisson processes and analytically prove the negative correlation between pairs. We then show how these anticorrelated Poisson processes can be used to drive Markov jump processes via a random time change representation. Finally, we provide a sufficient condition for variance reduction in the jump process context as well as demonstrate a simple example.

Original languageEnglish (US)
Title of host publication53rd IEEE Conference on Decision and Control,CDC 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3401-3407
Number of pages7
EditionFebruary
ISBN (Electronic)9781479977468
DOIs
StatePublished - 2014
Event2014 53rd IEEE Annual Conference on Decision and Control, CDC 2014 - Los Angeles, United States
Duration: Dec 15 2014Dec 17 2014

Publication series

NameProceedings of the IEEE Conference on Decision and Control
NumberFebruary
Volume2015-February
ISSN (Print)0743-1546
ISSN (Electronic)2576-2370

Other

Other2014 53rd IEEE Annual Conference on Decision and Control, CDC 2014
Country/TerritoryUnited States
CityLos Angeles
Period12/15/1412/17/14

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Exact simulation of continuous time Markov jump processes with anticorrelated variance reduced Monte Carlo estimation'. Together they form a unique fingerprint.

Cite this