TY - JOUR
T1 - Channel Polarization through the Lens of Blackwell Measures
AU - Goela, Naveen
AU - Raginsky, Maxim
N1 - This work was supported in part by the Center for Science of Information (CSoI) and in part by the NSF Science and Technology Center under Grant CCF-0939370.
Manuscript received November 8, 2018; revised January 31, 2020; accepted July 15, 2020. Date of publication August 13, 2020; date of current version September 22, 2020. This work was supported in part by the Center for Science of Information (CSoI) and in part by the NSF Science and Technology Center under Grant CCF\u20130939370. This article was presented in part at the IEEE International Symposium on Information Theory, and in part at the Allerton Conference on Communication, Control, and Computing. (Corresponding author: Naveen Goela.) Naveen Goela was with the Department of Electrical Engineering and Computer Science, University of California at Berkeley, Berkeley, CA 94720 USA. He is now with Tanium, Emeryville, CA 94608 USA (e-mail: [email protected]).
PY - 2020/10
Y1 - 2020/10
N2 - Each memoryless binary-input channel (BIC) can be uniquely described by its Blackwell measure, which is a probability distribution on the unit interval [0, 1] with mean 1/2. Conversely, any such probability distribution defines a BIC. The evolution of the Blackwell measure under Arikan's polar transform is derived for general BICs, and is analogous to density evolution as cited in the literature. The present analysis emphasizes functional equations. Consequently, the evolution of a variety of channel functionals is characterized, including the symmetric capacity, Bhattacharyya parameter, moments of information density, Hellinger affinity, Gallager's reliability function, the Hirschfeld-Gebelein-Rényi maximal correlation, and the Bayesian information gain. The evolution of measure is specialized for symmetric BICs according to their decomposition into binary symmetric (sub)-channels (BSCs), which simplifies iterative computations and the construction of polar codes. It is verified that, as a consequence of the Blackwell-Sherman-Stein theorem, all channel functionals I_f that can be expressed as an expectation of a convex function f with respect to the Blackwell measure of a channel polarize in each iteration due to the polar transformation on the class of symmetric BICs. Moreover, for f either convex or non-convex, a necessary and sufficient condition is established to determine whether the random process associated with each I_f is a martingale, submartingale, or supermartingale. Represented via functional inequalities in terms of f, this condition is numerically verifiable for all If, and can generate analytical proofs. To exhibit one such proof, it is shown that the random process associated with the squared maximal correlation parameter is a supermartingale, and converges almost surely on the unit interval [0, 1].
AB - Each memoryless binary-input channel (BIC) can be uniquely described by its Blackwell measure, which is a probability distribution on the unit interval [0, 1] with mean 1/2. Conversely, any such probability distribution defines a BIC. The evolution of the Blackwell measure under Arikan's polar transform is derived for general BICs, and is analogous to density evolution as cited in the literature. The present analysis emphasizes functional equations. Consequently, the evolution of a variety of channel functionals is characterized, including the symmetric capacity, Bhattacharyya parameter, moments of information density, Hellinger affinity, Gallager's reliability function, the Hirschfeld-Gebelein-Rényi maximal correlation, and the Bayesian information gain. The evolution of measure is specialized for symmetric BICs according to their decomposition into binary symmetric (sub)-channels (BSCs), which simplifies iterative computations and the construction of polar codes. It is verified that, as a consequence of the Blackwell-Sherman-Stein theorem, all channel functionals I_f that can be expressed as an expectation of a convex function f with respect to the Blackwell measure of a channel polarize in each iteration due to the polar transformation on the class of symmetric BICs. Moreover, for f either convex or non-convex, a necessary and sufficient condition is established to determine whether the random process associated with each I_f is a martingale, submartingale, or supermartingale. Represented via functional inequalities in terms of f, this condition is numerically verifiable for all If, and can generate analytical proofs. To exhibit one such proof, it is shown that the random process associated with the squared maximal correlation parameter is a supermartingale, and converges almost surely on the unit interval [0, 1].
KW - Blackwell measure
KW - Channel polarization
KW - channel functional
KW - functional inequality
KW - martingale
KW - polar transform
KW - random process
UR - https://www.scopus.com/pages/publications/85094114394
UR - https://www.scopus.com/pages/publications/85094114394#tab=citedBy
U2 - 10.1109/TIT.2020.3016605
DO - 10.1109/TIT.2020.3016605
M3 - Article
AN - SCOPUS:85094114394
SN - 0018-9448
VL - 66
SP - 6222
EP - 6241
JO - IEEE Transactions on Information Theory
JF - IEEE Transactions on Information Theory
IS - 10
M1 - 9166546
ER -