TY - GEN
T1 - A new information-theoretic lower bound for distributed function computation
AU - Xu, Aolin
AU - Raginsky, Maxim
PY - 2014
Y1 - 2014
N2 - This paper presents an information-theoretic lower bound on the minimum time required by any scheme for distributed computation over a network of point-to-point channels with finite capacity to achieve a given accuracy with a given probability. This bound improves upon earlier results by Ayaso et al. and by Como and Dahleh, and is derived using a combination of cutset bounds and a novel lower bound on conditional mutual information via so-called small ball probabilities. In the particular case of linear functions, the small ball probability can be expressed in terms of Lévy concentration functions of sums of independent random variables, for which tight estimates are available under various regularity conditions, leading to strict improvements over existing results in certain regimes.
AB - This paper presents an information-theoretic lower bound on the minimum time required by any scheme for distributed computation over a network of point-to-point channels with finite capacity to achieve a given accuracy with a given probability. This bound improves upon earlier results by Ayaso et al. and by Como and Dahleh, and is derived using a combination of cutset bounds and a novel lower bound on conditional mutual information via so-called small ball probabilities. In the particular case of linear functions, the small ball probability can be expressed in terms of Lévy concentration functions of sums of independent random variables, for which tight estimates are available under various regularity conditions, leading to strict improvements over existing results in certain regimes.
UR - http://www.scopus.com/inward/record.url?scp=84906568534&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84906568534&partnerID=8YFLogxK
U2 - 10.1109/ISIT.2014.6875229
DO - 10.1109/ISIT.2014.6875229
M3 - Conference contribution
AN - SCOPUS:84906568534
SN - 9781479951864
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 2227
EP - 2231
BT - 2014 IEEE International Symposium on Information Theory, ISIT 2014
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2014 IEEE International Symposium on Information Theory, ISIT 2014
Y2 - 29 June 2014 through 4 July 2014
ER -