Control of non-equilibrium dynamics in communication networks

Tansu Alpcan, Prashant G. Mehta, Tamer Başar, Umesh Vaidya

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We propose a novel, dynamical systems-based approach for analysis and control of the complex dynamic behavior arising in communication networks. Specifically, we consider the Active Queue Management (AQM) problem and study the non-equilibrium behavior observed as a result of the interaction between deterministic queueing and nonlinear flow-control dynamics using a stochastic characterization. The asymptotic dynamics are interpreted using invariant measures of certain stochastic operators. For computational tractability, we use set-oriented numerical methods to construct finite-dimensional Markov models including control Markov chains and hidden Markov models. Based on the stochastic model constructed, we pose and solve the AQM control problem using Markov Decision Processes (MDPs). The framework developed is demonstrated through a numerical study of an example AQM scheme, which shows persistent non-equilibrium queue behavior under the optimal control strategy.

Original languageEnglish (US)
Title of host publicationProceedings of the 45th IEEE Conference on Decision and Control 2006, CDC
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Print)1424401712, 9781424401710
StatePublished - 2006
Event45th IEEE Conference on Decision and Control 2006, CDC - San Diego, CA, United States
Duration: Dec 13 2006Dec 15 2006

Publication series

NameProceedings of the IEEE Conference on Decision and Control
ISSN (Print)0743-1546
ISSN (Electronic)2576-2370


Other45th IEEE Conference on Decision and Control 2006, CDC
Country/TerritoryUnited States
CitySan Diego, CA

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization


Dive into the research topics of 'Control of non-equilibrium dynamics in communication networks'. Together they form a unique fingerprint.

Cite this