Papers
Topics
Authors
Recent
Search
2000 character limit reached

The Capacity of 3 User Linear Computation Broadcast

Published 20 Jun 2022 in cs.IT and math.IT | (2206.10049v3)

Abstract: The $K$ User Linear Computation Broadcast (LCBC) problem is comprised of $d$ dimensional data (from $\mathbb{F}_q$), that is fully available to a central server, and $K$ users, who require various linear computations of the data, and have prior knowledge of various linear functions of the data as side-information. The optimal broadcast cost is the minimum number of $q$-ary symbols to be broadcast by the server per computation instance, for every user to retrieve its desired computation. The reciprocal of the optimal broadcast cost is called the capacity. The main contribution of this paper is the exact capacity characterization for the $K=3$ user LCBC for all cases, i.e., for arbitrary finite fields $\mathbb{F}_q$, arbitrary data dimension $d$, and arbitrary linear side-informations and demands at each user. A remarkable aspect of the converse is that unlike the $2$ user LCBC whose capacity was determined previously, the entropic formulation (where the entropies of demands and side-informations are specified, but not their functional forms) is insufficient to obtain a tight converse for the $3$ user LCBC. Instead, the converse exploits functional submodularity. Notable aspects of achievability include a decomposition of the users' collective signal space into subspaces that allow different degrees of efficiency in broadcast cost, revealing a tradeoff that leads to a constrained water-filling solution. Random coding arguments are invoked to resolve compatibility issues that arise as each user has a different view of these subspaces, conditioned on its own side-information.

Authors (2)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (65)
  1. Y. Yao and S. A. Jafar, “Capacity of 3333-user linear computation broadcast over 𝔽qsubscript𝔽𝑞\mathbb{F}_{q}blackboard_F start_POSTSUBSCRIPT italic_q end_POSTSUBSCRIPT with 1D demand and side-information,” IEEE International Symposium on Information Theory (ISIT) 2022, June 2022.
  2. S. Research, “The next hyper — connected experience for all,” White Paper, July 2020. [Online]. Available: {https://cdn.codeground.org/nsr/downloads/researchareas/6GVision.pdf}
  3. H. Witsenhausen, “The zero-error side information problem and chromatic numbers (corresp.),” IEEE Trans. Inf. Theory, vol. 22, no. 5, pp. 592–593, Sep. 1976.
  4. J. Korner and K. Marton, “How to encode the modulo-two sum of binary sources,” IEEE Trans. Inf. Theory, vol. 25, pp. 219–221, Mar. 1979.
  5. R. Ahlswede and N. Cai, “On communication complexity of vector-valued functions,” IEEE Trans. Inf. Theory, vol. 40, no. 6, pp. 2062–2067, Nov. 1994.
  6. A. Orlitsky and J. R. Roche, “Coding for computing,” IEEE Trans. Inf. Theory, vol. 47, no. 3, pp. 903–917, Mar. 2001.
  7. V. Doshi, D. Shah, M. Medard, and M. Effros, “Functional compression through coloring,” IEEE Trans. Inf. Theory, vol. 56, no. 8, pp. 3901–3917, Aug. 2010.
  8. B. K. Rai and B. K. Dey, “On network coding for sum-networks,” IEEE Trans. Inf. Theory, vol. 58, no. 1, pp. 50–63, 2012.
  9. A. Giridhar and P. R. Kumar, “Computing and communicating functions over sensor networks,” IEEE J. Sel. Areas in Commun., vol. 23, no. 23, pp. 755–764, Apr. 2005.
  10. H. Kowshik and P. R. Kumar, “Optimal function computation in directed and undirected graphs,” IEEE Trans. Inf. Theory, vol. 58, no. 6, pp. 3407–3418, Jun. 2012.
  11. A. Ramamoorthy and M. Langberg, “Communicating the sum of sources over a network,” IEEE J. Sel. Areas in Commun., vol. 31, no. 4, pp. 655–665, Apr. 2013.
  12. S. Feizi and M. Medard, “On network function compression,” IEEE Trans. Inf. Theory, vol. 60, no. 9, pp. 5387–5401, Sep. 2014.
  13. R. Appuswamy, M. Franceschetti, N. Karamchandani, and K. Zeger, “Network coding for computing: Cut-set bounds,” IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 1015–1030, Feb. 2011.
  14. ——, “Linear codes, target function classes, and network computing capacity,” IEEE Trans. Inf. Theory, vol. 59, no. 9, pp. 5741–5753, Sep. 2013.
  15. R. Appuswamy and M. Franceschetti, “Computing linear functions by linear coding over networks,” IEEE Trans. Inf. Theory, vol. 60, no. 1, pp. 422–431, Jan. 2014.
  16. X. Guang, R. W. Yeung, S. Yang, and C. Li, “Improved upper bound on the network function computing capacity,” IEEE Trans. Inf. Theory, vol. 65, no. 6, pp. 3790–3811, Jun. 2019.
  17. M. Maddah-Ali and U. Niesen, “Fundamental limits of caching,” IEEE Trans. Inf. Theory, vol. 60, no. 5, pp. 2856–2867, May 2014.
  18. Q. Yu, M. A. Maddah-Ali, and A. S. Avestimehr, “The exact rate-memory tradeoff for caching with uncoded prefetching,” IEEE Trans. Inf. Theory, vol. 66, no. 2, pp. 1281–1296, Feb 2018.
  19. Mingyue Ji, G. Caire, and A. F. Molisch, “Fundamental limits of caching in wireless d2d networks,” IEEE Trans. Inf. Theory, vol. 62, no. 2, pp. 849–869, Feb 2016.
  20. B. Chor, E. Kushilevitz, O. Goldreich, and M. Sudan, “Private information retrieval,” J. ACM, vol. 45, no. 6, pp. 965–981, 1998.
  21. S. Ulukus, S. Avestimehr, M. Gastpar, S. A. Jafar, R. Tandon, and C. Tian, “Private retrieval, computing, and learning: Recent progress and future challenges,” IEEE J. Sel. Areas Commun., vol. 40, no. 3, pp. 729–748, 2022.
  22. S. Li, M. A. Maddah-Ali, Q. Yu, and A. S. Avestimehr, “A fundamental tradeoff between computation and communication in distributed computing,” IEEE Trans. Inf. Theory, vol. 64, no. 1, pp. 109–128, Jan 2018.
  23. A. G. Dimakis, K. Ramchandran, Y. Wu, and C. Suh, “A survey on network codes for distributed storage,” Proceedings of the IEEE, vol. 99, no. 3, pp. 476–489, 2011.
  24. S. Liu and F. Oggier, “An overview of coding for distributed storage systems,” Network Coding and Subspace Designs, pp. 363–383, 2018.
  25. T. Ernvall, “Codes between MBR and MSR points with exact repair property,” IEEE Trans. Inf. Theory, vol. 60, no. 11, pp. 6993–7005, 2014.
  26. Y. Birk and T. Kol, “Coding on demand by an informed source (ISCOD) for efficient broadcast of different supplemental data to caching clients,” IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2825–2830, June 2006.
  27. F. Arbabjolfaei and Y.-H. Kim, “Fundamentals of index coding,” Found. Trends Commun. Inf. Theory, vol. 14, no. 3–4, p. 163–346, 2018. [Online]. Available: https://doi.org/10.1561/0100000094
  28. J. S. Ng, W. Y. B. Lim, N. C. Luong, Z. Xiong, A. Asheralieva, D. Niyato, C. Leung, and C. Miao, “A comprehensive survey on coded distributed computing: Fundamentals, challenges, and networking applications,” IEEE Communications Surveys and Tutorials, vol. 23, no. 3, pp. 1800–1837, June 2021.
  29. S. Li, M. A. Maddah-Ali, and A. S. Avestimehr, “Coding for distributed fog computing,” IEEE Communications Magazine, vol. 55, no. 4, pp. 34–40, April 2017.
  30. K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran, “Speeding up distributed machine learning using codes,” IEEE Trans. Inf. Theory, vol. 64, no. 3, pp. 1514–1529, 2017.
  31. P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings et al., “Advances and open problems in federated learning,” Foundations and Trends in Machine Learning, vol. 14, no. 1-2, pp. 1–210, 2021.
  32. S. Kadhe, N. Rajaraman, O. O. Koyluoglu, and K. Ramchandran, “FastSecAgg: Scalable secure aggregation for privacy-preserving federated learning,” ArXiv:2009.11248, Sep. 2020.
  33. J. Ruan and D. Xie, “Networked VR: State of the art, solutions and challenges,” Electronics, vol. 10, no. 2, January 2021.
  34. F. Hu, Y. Deng, W. Saad, M. Bennis, and A. H. Aghvami, “Cellular-connected wireless virtual reality: Requirements, challenges, and solutions,” IEEE Communications Magazine, vol. 58, no. 5, pp. 105–111, May 2020.
  35. E. Bastug, M. Bennis, M. Medard, and M. Debbah, “Toward interconnected virtual reality: Opportunities, challenges, and enablers,” IEEE Communications Magazine, vol. 55, no. 6, pp. 110–116, Aug. 2017.
  36. L. Zhao, Y. Cui, S. Yang, and S. S. Shitz, “An optimization framework for general rate splitting for general multicast,” IEEE Trans. on Wireless Commun., vol. 22, no. 3, pp. 1573–1587, 2022.
  37. W. Saad, M. Bennis, and M. Chen, “A vision of 6G wireless systems: Applications, trends, technologies, and open research problems,” IEEE Networks, vol. 34, no. 3, pp. 134–142, May/June 2020.
  38. Y. Geng, S. Liu, Z. Yin, A. Naik, B. Prabhakar, M. Rosunblum, and A. Vahdat, “Exploiting a natural network effect for scalable, fine-grained clock synchronization,” Proceedings of the 15th USENIX Conference on Networked Systems Design and Implementation, pp. 81–94, 2018.
  39. P. Fei, Z. Chen, Z. Wang, and S. A. Jafar, “Communication-efficient clock synchronization,” in Proc. IEEE Int. Conf. on Commun. (ICC), 2022, pp. 2592–2597.
  40. T. M. C. Paul Cuff, Haim H. Permuter, “Coordination capacity,” IEEE Trans. Inf. Theory, vol. 56, no. 9, pp. 4181–4206, 2010.
  41. H. Sun and S. Jafar, “On the capacity of computation broadcast,” IEEE Trans. Inf. Theory, vol. 66, no. 6, pp. 3417–3434, Jun. 2020.
  42. T. S. J. Z. Bar-Yossef, Y. Birk and T. Kol, “Index coding with side information,” IEEE Trans. Inf. Theory, vol. 57, no. 3, pp. 1479 – 1494, Mar. 2011.
  43. S. Rouayheb, A. Sprintson, and C. Georghiades, “On the index coding problem and its relation to network coding and matroid theory,” IEEE Trans. Inf. Theory, vol. 56, no. 7, pp. 3187–3195, Jul. 2010.
  44. Y. Berliner and M. Langberg, “Index coding with outerplanar side information,” Proceedings of IEEE International Symposium on Information Theory, pp. 806–810, Jul./Aug. 2011.
  45. L. Ong, C. K. Ho, and F. Lim, “The single-uniprior index-coding problem: The single-sender case and the multi-sender extension,” IEEE Trans. Inf. Theory, vol. 62, no. 6, pp. 3165–3182, Jun. 2016.
  46. S. A. Jafar, “Topological interference management through index coding,” IEEE Trans. Inf. Theory, vol. 60, no. 1, pp. 529–568, Jan. 2014.
  47. A. Agarwal, L. Flodin, and A. Mazumdar, “Linear programming approximations for index coding,” IEEE Trans. Inf. Theory, vol. 65, no. 9, pp. 5547–5564, Sep. 2019.
  48. A. Blasiak, R. Kleinberg, and E. Lubetzky, “Index coding via linear programming,” Apr. 2010. [Online]. Available: https://arxiv.org/pdf/1004.1379.pdf
  49. N. Lee, A. Dimakis, and R. W. Heath, “Index coding with coded side-information,” IEEE Communication Letters, vol. 19, no. 3, pp. 319–322, Mar. 2015.
  50. R. Peeters, “Orthogonal representations over finite fields and the chromatic number of graphs,” Combinatorica, pp. 417–431, Sept. 1996.
  51. D. Chawin and I. Haviv, “Improved np-hardness of approximation for orthogonality dimension and minrank,” SIAM Journal on Discrete Mathematics, vol. 37, no. 4, pp. 2670–2688, 2023. [Online]. Available: https://doi.org/10.1137/23M155760X
  52. M. Langberg and A. Sprintson, “On the hardness of approximating the network coding capacity,” IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 1008–1014, 2011.
  53. E. Lubetzky and U. Stav, “Nonlinear index coding outperforming the linear optimum,” IEEE Trans. Inf. Theory, vol. 55, no. 8, pp. 3544–3551, Aug. 2009.
  54. A. Blasiak, R. Kleinberg, and E. Lubetzky, “Lexicographic products and the power of non-linear network coding,” IEEE symposium on Foundations of Computer Science (FOCS), Palm Springs, CA, pp. 609–618, Oct. 2011. [Online]. Available: http://arxiv.org/abs/1108.2489
  55. H. Maleki, V. Cadambe, and S. Jafar, “Index coding – an interference alignment perspective,” IEEE Trans. Inf. Theory, vol. 60, no. 9, pp. 5402–5432, Sep. 2014.
  56. Y. Wang, “Degrees of freedom of mimo wireless networks with general message sets: Channel decomposition, message splitting and beamformer allocation,” Ph.D. dissertation, University of Colorado at Boulder, 2017.
  57. T. Tao, “Sumset and inverse sumset theory for shannon entropy,” Combinatorics, Probability and Computing, vol. 19, no. 4, pp. 603–639, 2010.
  58. M. M. I. Kontoyiannis, “Sumset and inverse sumset inequalities for differential entropy and mutual information,” IEEE Trans. Inf. Theory, vol. 60, no. 8, pp. 4503–4514, Aug. 2014.
  59. S. A. Jafar, “Interference alignment: A new look at signal dimensions in a communication network,” Found. Trends Commun. Inf. Theory, vol. 7, 2011.
  60. C. Wang, T. Gou, and S. Jafar, “Subspace alignment chains and the degrees of freedom of the three user mimo interference channel,” IEEE Trans. Inf. Theory, vol. 60, no. 5, pp. 2432–2479, May 2014.
  61. Q. Yu, M. A. Maddah-Ali, and A. S. Avestimehr, “Characterizing the rate-memory tradeoff in cache networks within a factor of 2,” IEEE Trans. Inf. Theory, vol. 65, no. 1, pp. 647–663, 2018.
  62. J. Edmonds, “Submodular functions, matroids and certain polyhedra,” Combinatorial Structures and Their Applications, vol. 38, pp. 69–87, 1970.
  63. H. P. Romero, “Fundamental limits of network communication with general message sets: A combinatorial approach,” Ph.D. dissertation, University of Colorado at Boulder, 2014.
  64. S. T. Goh, “Prove that if the constraints to a linear program are integer, then the optimal solution is rational.” [Online]. Available: https://math.stackexchange.com/q/2999239
  65. Y. Yao and S. A. Jafar, “Capacity of 2-user linear computation broadcast with partially informed server,” IEEE Communications Letters, vol. 26, no. 9, pp. 2014–2017, 2022.
Citations (7)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.