TY - GEN
T1 - Soft Minoration
T2 - 2021 IEEE International Symposium on Information Theory, ISIT 2021
AU - Liu, Jingbo
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/7/12
Y1 - 2021/7/12
N2 - In 1987, Cover raised a question about the minimum relay rate needed for achieving the maximum capacity in a symmetric discrete-memoryless relay channel. Despite the many efforts over the past and recent years, this problem was previously only solved for the binary symmetric case or the Gaussian counterpart, where arguments specialized to these particular channel distributions were used. In this paper, through different information-theoretic expansions highlighting the unique capacity-achieving output distribution, we demonstrate an interesting connection between Cover's problem and the minoration problem (i.e., lower bounding the supremum of a stochastic process) from high dimensional probability. In particular, we show that the minimum relay rate for maximum capacity in a general discrete memoryless symmetric relay channel is the conditional entropy of a certain equivalence class determined by the capacity-achieving output distribution, thus completely resolving Cover's original problem. On the probability part, the main innovation is a robust method of lower bounding a soft-max (soft-minoration), which is based on mixed-volume inequalities and estimates of the Banach-Mazur distance to subspaces of \ell_{\infty}.
AB - In 1987, Cover raised a question about the minimum relay rate needed for achieving the maximum capacity in a symmetric discrete-memoryless relay channel. Despite the many efforts over the past and recent years, this problem was previously only solved for the binary symmetric case or the Gaussian counterpart, where arguments specialized to these particular channel distributions were used. In this paper, through different information-theoretic expansions highlighting the unique capacity-achieving output distribution, we demonstrate an interesting connection between Cover's problem and the minoration problem (i.e., lower bounding the supremum of a stochastic process) from high dimensional probability. In particular, we show that the minimum relay rate for maximum capacity in a general discrete memoryless symmetric relay channel is the conditional entropy of a certain equivalence class determined by the capacity-achieving output distribution, thus completely resolving Cover's original problem. On the probability part, the main innovation is a robust method of lower bounding a soft-max (soft-minoration), which is based on mixed-volume inequalities and estimates of the Banach-Mazur distance to subspaces of \ell_{\infty}.
KW - A full version of this paper is accessible at [11]
UR - http://www.scopus.com/inward/record.url?scp=85115116879&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85115116879&partnerID=8YFLogxK
U2 - 10.1109/ISIT45174.2021.9517756
DO - 10.1109/ISIT45174.2021.9517756
M3 - Conference contribution
AN - SCOPUS:85115116879
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 1648
EP - 1652
BT - 2021 IEEE International Symposium on Information Theory, ISIT 2021 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 12 July 2021 through 20 July 2021
ER -