TY - GEN
T1 - Mutual information saddle points in channels of exponential family type
AU - Coleman, Todd P.
AU - Raginsky, Maxim
PY - 2010/8/23
Y1 - 2010/8/23
N2 - This paper extends our prior work on "E-type" (exponential family type) channels. The channels considered here have transition kernels induced by an exponential family with a two-component sufficient statistic composed of an input-output distortion function and an output cost function. We demonstrate the existence of a mutual information saddle point in any E-type channel for which there exists a source distribution such that the induced output distribution is maximum-entropy under an output cost constraint. For additive-noise E-type channels, we provide necessary and sufficient conditions on the existence of saddle points which coincide with convolution divisibility of the additive noise law. This machinery generalizes many well-known saddle-point, capacity, and rate-distortion theorems, including those for the additive Gaussian and exponential-noise channels, and leads to a saddle point result on the non-additive exponential server timing channel, which appears to be new.
AB - This paper extends our prior work on "E-type" (exponential family type) channels. The channels considered here have transition kernels induced by an exponential family with a two-component sufficient statistic composed of an input-output distortion function and an output cost function. We demonstrate the existence of a mutual information saddle point in any E-type channel for which there exists a source distribution such that the induced output distribution is maximum-entropy under an output cost constraint. For additive-noise E-type channels, we provide necessary and sufficient conditions on the existence of saddle points which coincide with convolution divisibility of the additive noise law. This machinery generalizes many well-known saddle-point, capacity, and rate-distortion theorems, including those for the additive Gaussian and exponential-noise channels, and leads to a saddle point result on the non-additive exponential server timing channel, which appears to be new.
UR - http://www.scopus.com/inward/record.url?scp=77955708047&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77955708047&partnerID=8YFLogxK
U2 - 10.1109/ISIT.2010.5513481
DO - 10.1109/ISIT.2010.5513481
M3 - Conference contribution
AN - SCOPUS:77955708047
SN - 9781424469604
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 1355
EP - 1359
BT - 2010 IEEE International Symposium on Information Theory, ISIT 2010 - Proceedings
T2 - 2010 IEEE International Symposium on Information Theory, ISIT 2010
Y2 - 13 June 2010 through 18 June 2010
ER -