The Local Information Cost of Distributed Graph Spanners (2003.09895v5)
Abstract: We introduce the \emph{local information cost} (LIC), which quantifies the amount of information that nodes in a network need to learn when solving a graph problem. We show that the local information cost presents a natural lower bound on the communication complexity of distributed algorithms. For the synchronous CONGEST KT1 model, where each node has initial knowledge of its neighbors' IDs, we prove that $\Omega(\frac{\text{LIC}_\gamma(P)}{\log\tau \log n})$ bits are required for solving a graph problem $P$ with a $\tau$-round algorithm that errs with probability at most $\gamma$. Our result is the first lower bound that yields a general trade-off between communication and time for graph problems in the CONGEST KT1 model. We demonstrate how to apply the local information cost by deriving a lower bound on the communication complexity of computing a spanner with multiplicative stretch $2t-1$ that consists of at most $O(n{1+\frac{1}{t} + \epsilon})$ edges, where $\epsilon = O( {1}/{t2} )$. More concretely, we show that any $O(\text{poly}(n))$-time spanner algorithm must send at least $\tilde\Omega(\tfrac{1}{t2} n{1+{1}/{2t}})$ bits. Previously, only a trivial lower bound of $\tilde \Omega(n)$ bits was known for this problem. (See PDF for the full abstract.)
- Distributed computation in node-capacitated networks. In Christian Scheideler and Petra Berenbrink, editors, The 31st ACM on Symposium on Parallelism in Algorithms and Architectures, SPAA 2019, Phoenix, AZ, USA, June 22-24, 2019, pages 69–79. ACM, 2019.
- A trade-off between information and communication in broadcast protocols. J. ACM, 37(2):238–256, 1990.
- Baruch Awerbuch. Complexity of network synchronization. J. ACM, 32(4):804–823, 1985.
- How to compress interactive communication. SIAM J. Comput., 42(3):1327–1363, 2013.
- Message reduction in the LOCAL model is a free lunch. In 33rd International Symposium on Distributed Computing, DISC 2019, October 14-18, 2019, Budapest, Hungary, pages 7:1–7:15, 2019.
- A tight bound for set disjointness in the message-passing model. In 54th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2013, 26-29 October, 2013, Berkeley, CA, USA, pages 668–677. IEEE Computer Society, 2013.
- An information statistics approach to data stream and communication complexity. J. Comput. Syst. Sci., 68(4):702–732, 2004.
- A simple and linear time randomized algorithm for computing sparse spanners in weighted graphs. Random Struct. Algorithms, 30(4):532–563, 2007.
- An information statistics approach to data stream and communication complexity. Journal of Computer and System Sciences, 68(4):702–732, 2004.
- Distributed spanner approximation. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing, pages 139–148, 2018.
- Global computation in a poorly connected world: fast rumor spreading with no dependence on conductance. In Howard J. Karloff and Toniann Pitassi, editors, Proceedings of the 44th Symposium on Theory of Computing Conference, STOC 2012, New York, NY, USA, May 19 - 22, 2012, pages 961–970. ACM, 2012.
- Informational complexity and the direct sum problem for simultaneous message complexity. In Proceedings 42nd IEEE Symposium on Foundations of Computer Science, pages 270–278. IEEE, 2001.
- T. Cover and J.A. Thomas. Elements of Information Theory, second edition. Wiley, 2006.
- On the locality of distributed sparse spanner construction. In Proceedings of the twenty-seventh ACM symposium on Principles of distributed computing, pages 273–282, 2008.
- Michael Elkin. A near-optimal distributed fully dynamic algorithm for maintaining sparse spanners. In Indranil Gupta and Roger Wattenhofer, editors, Proceedings of the Twenty-Sixth Annual ACM Symposium on Principles of Distributed Computing, PODC 2007, Portland, Oregon, USA, August 12-15, 2007, pages 185–194. ACM, 2007.
- Michael Elkin. A simple deterministic distributed MST algorithm, with near-optimal time and message complexities. In Elad Michael Schiller and Alexander A. Schwarzmann, editors, Proceedings of the ACM Symposium on Principles of Distributed Computing, PODC 2017, Washington, DC, USA, July 25-27, 2017, pages 157–163. ACM, 2017.
- Efficient algorithms for constructing very sparse spanners and emulators. ACM Trans. Algorithms, 15(1):4:1–4:29, 2019.
- Paul Erdös. Extremal problems in graph theory. In Proc. Symp. Theory of Graphs and its Applications, page 2936, 1963.
- Possibilities and impossibilities for distributed subgraph detection. In Christian Scheideler and Jeremy T. Fineman, editors, Proceedings of the 30th on Symposium on Parallelism in Algorithms and Architectures, SPAA 2018, Vienna, Austria, July 16-18, 2018, pages 153–162. ACM, 2018.
- Networks cannot compute their diameter in sublinear time. In Yuval Rabani, editor, Proceedings of the Twenty-Third Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2012, Kyoto, Japan, January 17-19, 2012, pages 1150–1162. SIAM, 2012.
- Graph spanners in the message-passing model. In Thomas Vidick, editor, 11th Innovations in Theoretical Computer Science Conference, ITCS 2020, January 12-14, 2020, Seattle, Washington, USA, volume 151 of LIPIcs, pages 77:1–77:18. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2020.
- Distributed MST and broadcast with fewer messages, and faster gossiping. In 32nd International Symposium on Distributed Computing, DISC 2018, New Orleans, LA, USA, October 15-19, 2018, volume 121 of LIPIcs, pages 30:1–30:12. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2018.
- Time-message trade-offs in distributed algorithms. In 32nd International Symposium on Distributed Computing, DISC 2018, New Orleans, LA, USA, October 15-19, 2018, volume 121 of LIPIcs, pages 32:1–32:18. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2018.
- Round- and message-optimal distributed graph algorithms. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing, PODC 2018, Egham, United Kingdom, July 23-27, 2018, pages 119–128, 2018.
- Optimal gossip algorithms for exact and approximate quantile computations. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing, PODC 2018, Egham, United Kingdom, July 23-27, 2018, pages 179–188, 2018.
- Toward optimal bounds in the congested clique: Graph connectivity and mst. In Proceedings of the 2015 ACM Symposium on Principles of Distributed Computing, pages 91–100, 2015.
- Triangle finding and listing in CONGEST networks. In Elad Michael Schiller and Alexander A. Schwarzmann, editors, Proceedings of the ACM Symposium on Principles of Distributed Computing, PODC 2017, Washington, DC, USA, July 25-27, 2017, pages 381–389. ACM, 2017.
- Construction and impromptu repair of an MST in a distributed network with o(m) communication. In Chryssis Georgiou and Paul G. Spirakis, editors, Proceedings of the 2015 ACM Symposium on Principles of Distributed Computing, PODC 2015, Donostia-San Sebastián, Spain, July 21 - 23, 2015, pages 71–80. ACM, 2015.
- Distributed computation of large-scale graph problems. In Proceedings of the Twenty-Sixth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2015, San Diego, CA, USA, January 4-6, 2015, pages 391–410, 2015.
- Interactive compression for multi-party protocol. In Andréa W. Richa, editor, 31st International Symposium on Distributed Computing, DISC 2017, October 16-20, 2017, Vienna, Austria, volume 91 of LIPIcs, pages 31:1–31:15. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2017.
- On the complexity of universal leader election. J. ACM, 62(1):7:1–7:27, 2015.
- Distributed MST for constant diameter graphs. Distributed Computing, 18(6):453–460, 2006.
- Time-communication trade-offs for minimum spanning tree construction. In Proceedings of the 18th International Conference on Distributed Computing and Networking, Hyderabad, India, January 5-7, 2017, page 8. ACM, 2017.
- Broadcast and minimum spanning tree with o(m) messages in the asynchronous CONGEST model. In 32nd International Symposium on Distributed Computing, DISC 2018, New Orleans, LA, USA, October 15-19, 2018, volume 121 of LIPIcs, pages 37:1–37:17. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2018.
- Brief announcement: Faster asynchronous MST and low diameter tree construction with sublinear communication. In Jukka Suomela, editor, 33rd International Symposium on Distributed Computing, DISC 2019, October 14-18, 2019, Budapest, Hungary, volume 146 of LIPIcs, pages 49:1–49:3. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2019.
- Probability and Computing: Randomized Algorithms and Probabilistic Analysis. Cambridge University Press, 2005.
- James Munkres. Topology: Pearson New International Edition. Pearson, 2013.
- David Peleg. Distributed Computing: A Locality-Sensitive Approach. Society for Industrial and Applied Mathematics, 2000.
- Symmetry breaking in the congest model: Time- and message-efficient algorithms for ruling sets. In Andréa W. Richa, editor, 31st International Symposium on Distributed Computing, DISC 2017, October 16-20, 2017, Vienna, Austria, volume 91 of LIPIcs, pages 38:1–38:16. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2017.
- Can we break symmetry with o(m) communication? In Avery Miller, Keren Censor-Hillel, and Janne H. Korhonen, editors, PODC ’21: ACM Symposium on Principles of Distributed Computing, Virtual Event, Italy, July 26-30, 2021, pages 247–257. ACM, 2021.
- Message lower bounds via efficient network synchronization. In Jukka Suomela, editor, Structural Information and Communication Complexity - 23rd International Colloquium, SIROCCO 2016, Helsinki, Finland, July 19-21, 2016, Revised Selected Papers, volume 9988 of Lecture Notes in Computer Science, pages 75–91, 2016.
- A time- and message-optimal distributed algorithm for minimum spanning trees. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, STOC 2017, Montreal, QC, Canada, June 19-23, 2017, pages 743–756, 2017.
- On the distributed complexity of large-scale graph computations. In Christian Scheideler and Jeremy T. Fineman, editors, Proceedings of the 30th on Symposium on Parallelism in Algorithms and Architectures, SPAA 2018, Vienna, Austria, July 16-18, 2018, pages 405–414. ACM, 2018.
- Local computation algorithms for spanners. In Avrim Blum, editor, 10th Innovations in Theoretical Computer Science Conference, ITCS 2019, January 10-12, 2019, San Diego, California, USA, volume 124 of LIPIcs, pages 58:1–58:21. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2019.
- Graph spanners. Journal of Graph Theory, 13(1):99–116, 1989.
- Lower bounds for number-in-hand multiparty communication complexity, made easy. SIAM J. Comput., 45(1):174–196, 2016.
- Distributed algorithms made secure: A graph theoretic approach. In Timothy M. Chan, editor, Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2019, San Diego, California, USA, January 6-9, 2019, pages 1693–1710. SIAM, 2019.
- Secure distributed computing made (nearly) optimal. In Peter Robinson and Faith Ellen, editors, Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing, PODC 2019, Toronto, ON, Canada, July 29 - August 2, 2019, pages 107–116. ACM, 2019.
- Communication Complexity: and Applications. Cambridge University Press, 2020.
- Distributed verification and hardness of distributed approximation. SIAM J. Comput., 41(5):1235–1265, 2012.
- Jukka Suomela. Survey of local algorithms. ACM Comput. Surv., 45(2):24:1–24:40, 2013.
- When distributed computation is communication expensive. Distributed Computing, 30(5):309–323, 2017.