Stochastic stability and drift criteria for Markov chains in networked control

Serdar Yüksel, Tamer Başar

Research output: Chapter in Book/Report/Conference proceedingChapter


This chapter presents an overview of the theory of Markov chains and drift criteria to establish stochastic stability of Markov chains. Random-time state-dependent stochastic drift criteria are presented together with a class of application areas in networked control systems. Criteria for transience and other forms of stochastic stability are presented.

Original languageEnglish (US)
Title of host publicationSystems and Control
Subtitle of host publicationFoundations and Applications
Number of pages10
StatePublished - 2013
Externally publishedYes

Publication series

NameSystems and Control: Foundations and Applications
ISSN (Print)2324-9749
ISSN (Electronic)2324-9757


  • Ergodic theorem
  • Invariant probability measure
  • Markov chain
  • Network control system
  • Stochastic stability

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Computer Science Applications
  • Control and Optimization
  • Computational Mathematics


Dive into the research topics of 'Stochastic stability and drift criteria for Markov chains in networked control'. Together they form a unique fingerprint.

Cite this