TY - JOUR
T1 - Congestion control as a stochastic control problem with action delays
AU - Altman, Eitan
AU - Başar, Tamer
AU - Srikant, R.
N1 - Funding Information:
This paper was not presented at any IFAC meeting. This paper was recommended for publication in revised form by Guest Editors Venkat Anantharam and Jean Walrand. Research supported by NSF Grants NSF ECS 93-12807, NSF NCR 9701525 and NSF ANI 98-13710, and AFOSR MURI Grant AF DC 5-36128.
Copyright:
Copyright 2017 Elsevier B.V., All rights reserved.
PY - 1999/12
Y1 - 1999/12
N2 - We consider the design of explicit rate-based congestion control for high-speed communication networks and show that this can be formulated as a stochastic control problem where the controls of different users enter the system dynamics with different delays. We discuss the existence, derivation and the structure of the optimal controller, as well as of suboptimal controllers of the certainty-equivalent type - a terminology that is precisely defined in the paper for the specific context of the congestion control problem considered. We consider, in particular, two certainty-equivalent controllers which are easy to implement, and show that they are stabilizing, i.e., they lead to bounded infinite-horizon average cost, and stable queue dynamics. Further, these controllers perform well in simulations.
AB - We consider the design of explicit rate-based congestion control for high-speed communication networks and show that this can be formulated as a stochastic control problem where the controls of different users enter the system dynamics with different delays. We discuss the existence, derivation and the structure of the optimal controller, as well as of suboptimal controllers of the certainty-equivalent type - a terminology that is precisely defined in the paper for the specific context of the congestion control problem considered. We consider, in particular, two certainty-equivalent controllers which are easy to implement, and show that they are stabilizing, i.e., they lead to bounded infinite-horizon average cost, and stable queue dynamics. Further, these controllers perform well in simulations.
UR - http://www.scopus.com/inward/record.url?scp=0343183028&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0343183028&partnerID=8YFLogxK
U2 - 10.1016/S0005-1098(99)00127-2
DO - 10.1016/S0005-1098(99)00127-2
M3 - Article
AN - SCOPUS:0343183028
SN - 0005-1098
VL - 35
SP - 1937
EP - 1950
JO - Automatica
JF - Automatica
IS - 12
ER -