Optimal Control of Two Interacting Service Stations

Research output: Contribution to journalArticlepeer-review


Optimal controls described by switching curves in the two-dimensional state space are shown to exist for the optimal control of a Markov network with two service stations and linear cost. The controls govern routing and service priorities. Finite horizon and long run average cost problems are considered and value iteration is a key tool. Nonconvex value functions are shown to exist for slightly more general networks. Nonconvex value functions are also shown to arise for a simple single station control problem in which the instantaneous cost is convex but not monotone. Nevertheless, optimality of threshold policies is established for the single station problem. The proof is based on a novel use of stochastic coupling and policy iteration.

Original languageEnglish (US)
Pages (from-to)491-499
Number of pages9
JournalIEEE Transactions on Automatic Control
Issue number6
StatePublished - Jun 1984

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Optimal Control of Two Interacting Service Stations'. Together they form a unique fingerprint.

Cite this