Control over noisy forward and reverse channels

Serdar Yüksel, M Tamer Basar

Research output: Contribution to journalArticle

Abstract

We consider the problem of remotely controlling a continuous-time linear time-invariant system driven by Brownian motion process, when communication takes place over noisy memoryless discrete- or continuous-alphabet channels. What makes this class of remote control problems different from most of the previously studied models is the presence of noise in both the forward channel (connecting sensors to the controller) and the reverse channel (connecting the controller to the plant). For stability of the closed-loop system, we look for the existence of an invariant distribution for the state, for which we show that it is necessary that the entire control space and the state space be encoded, and that the reverse channel be at least as reliable as the forward channel. We obtain necessary conditions and sufficient conditions on the channels and the controllers for stabilizability. Using properties of the underlying sampled Markov chain, we show that under variable-length coding and some realistic channel conditions, stability can be achieved over discrete-alphabet channels even if the entire state and control spaces are to be encoded and the number of bits that can be transmitted per unit time is strictly bounded. For control over continuous-alphabet channels, however, a variable rate scheme is not necessary. We also show that memoryless policies are rate-efficient for Gaussian channels.

Original languageEnglish (US)
Article number5586646
Pages (from-to)1014-1029
Number of pages16
JournalIEEE Transactions on Automatic Control
Volume56
Issue number5
DOIs
StatePublished - May 1 2011

Fingerprint

Controllers
Brownian movement
Remote control
Closed loop systems
Markov processes
Communication
Sensors

Keywords

  • Information theory
  • networked control systems
  • stochastic control
  • stochastic stability

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Control over noisy forward and reverse channels. / Yüksel, Serdar; Basar, M Tamer.

In: IEEE Transactions on Automatic Control, Vol. 56, No. 5, 5586646, 01.05.2011, p. 1014-1029.

Research output: Contribution to journalArticle

@article{d876c9be3cef488580c9cf2ee87aaa90,
title = "Control over noisy forward and reverse channels",
abstract = "We consider the problem of remotely controlling a continuous-time linear time-invariant system driven by Brownian motion process, when communication takes place over noisy memoryless discrete- or continuous-alphabet channels. What makes this class of remote control problems different from most of the previously studied models is the presence of noise in both the forward channel (connecting sensors to the controller) and the reverse channel (connecting the controller to the plant). For stability of the closed-loop system, we look for the existence of an invariant distribution for the state, for which we show that it is necessary that the entire control space and the state space be encoded, and that the reverse channel be at least as reliable as the forward channel. We obtain necessary conditions and sufficient conditions on the channels and the controllers for stabilizability. Using properties of the underlying sampled Markov chain, we show that under variable-length coding and some realistic channel conditions, stability can be achieved over discrete-alphabet channels even if the entire state and control spaces are to be encoded and the number of bits that can be transmitted per unit time is strictly bounded. For control over continuous-alphabet channels, however, a variable rate scheme is not necessary. We also show that memoryless policies are rate-efficient for Gaussian channels.",
keywords = "Information theory, networked control systems, stochastic control, stochastic stability",
author = "Serdar Y{\"u}ksel and Basar, {M Tamer}",
year = "2011",
month = "5",
day = "1",
doi = "10.1109/TAC.2010.2081730",
language = "English (US)",
volume = "56",
pages = "1014--1029",
journal = "IEEE Transactions on Automatic Control",
issn = "0018-9286",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "5",

}

TY - JOUR

T1 - Control over noisy forward and reverse channels

AU - Yüksel, Serdar

AU - Basar, M Tamer

PY - 2011/5/1

Y1 - 2011/5/1

N2 - We consider the problem of remotely controlling a continuous-time linear time-invariant system driven by Brownian motion process, when communication takes place over noisy memoryless discrete- or continuous-alphabet channels. What makes this class of remote control problems different from most of the previously studied models is the presence of noise in both the forward channel (connecting sensors to the controller) and the reverse channel (connecting the controller to the plant). For stability of the closed-loop system, we look for the existence of an invariant distribution for the state, for which we show that it is necessary that the entire control space and the state space be encoded, and that the reverse channel be at least as reliable as the forward channel. We obtain necessary conditions and sufficient conditions on the channels and the controllers for stabilizability. Using properties of the underlying sampled Markov chain, we show that under variable-length coding and some realistic channel conditions, stability can be achieved over discrete-alphabet channels even if the entire state and control spaces are to be encoded and the number of bits that can be transmitted per unit time is strictly bounded. For control over continuous-alphabet channels, however, a variable rate scheme is not necessary. We also show that memoryless policies are rate-efficient for Gaussian channels.

AB - We consider the problem of remotely controlling a continuous-time linear time-invariant system driven by Brownian motion process, when communication takes place over noisy memoryless discrete- or continuous-alphabet channels. What makes this class of remote control problems different from most of the previously studied models is the presence of noise in both the forward channel (connecting sensors to the controller) and the reverse channel (connecting the controller to the plant). For stability of the closed-loop system, we look for the existence of an invariant distribution for the state, for which we show that it is necessary that the entire control space and the state space be encoded, and that the reverse channel be at least as reliable as the forward channel. We obtain necessary conditions and sufficient conditions on the channels and the controllers for stabilizability. Using properties of the underlying sampled Markov chain, we show that under variable-length coding and some realistic channel conditions, stability can be achieved over discrete-alphabet channels even if the entire state and control spaces are to be encoded and the number of bits that can be transmitted per unit time is strictly bounded. For control over continuous-alphabet channels, however, a variable rate scheme is not necessary. We also show that memoryless policies are rate-efficient for Gaussian channels.

KW - Information theory

KW - networked control systems

KW - stochastic control

KW - stochastic stability

UR - http://www.scopus.com/inward/record.url?scp=79955898325&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79955898325&partnerID=8YFLogxK

U2 - 10.1109/TAC.2010.2081730

DO - 10.1109/TAC.2010.2081730

M3 - Article

AN - SCOPUS:79955898325

VL - 56

SP - 1014

EP - 1029

JO - IEEE Transactions on Automatic Control

JF - IEEE Transactions on Automatic Control

SN - 0018-9286

IS - 5

M1 - 5586646

ER -