Control of non-equilibrium dynamics in communication networks

Tansu Alpcan, Prashant G. Mehta, Tamer Başar, Umesh Vaidya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a novel, dynamical systems-based approach for analysis and control of the complex dynamic behavior arising in communication networks. Specifically, we consider the Active Queue Management (AQM) problem and study the non-equilibrium behavior observed as a result of the interaction between deterministic queueing and nonlinear flow-control dynamics using a stochastic characterization. The asymptotic dynamics are interpreted using invariant measures of certain stochastic operators. For computational tractability, we use set-oriented numerical methods to construct finite-dimensional Markov models including control Markov chains and hidden Markov models. Based on the stochastic model constructed, we pose and solve the AQM control problem using Markov Decision Processes (MDPs). The framework developed is demonstrated through a numerical study of an example AQM scheme, which shows persistent non-equilibrium queue behavior under the optimal control strategy.

Original languageEnglish (US)
Title of host publicationProceedings of the 45th IEEE Conference on Decision and Control 2006, CDC
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5216-5221
Number of pages6
ISBN (Print)1424401712, 9781424401710
DOIs
StatePublished - 2006
Event45th IEEE Conference on Decision and Control 2006, CDC - San Diego, CA, United States
Duration: Dec 13 2006Dec 15 2006

Publication series

NameProceedings of the IEEE Conference on Decision and Control
ISSN (Print)0191-2216

Other

Other45th IEEE Conference on Decision and Control 2006, CDC
CountryUnited States
CitySan Diego, CA
Period12/13/0612/15/06

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Fingerprint Dive into the research topics of 'Control of non-equilibrium dynamics in communication networks'. Together they form a unique fingerprint.

Cite this