Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
143 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Universally Optimal Information Dissemination and Shortest Paths in the HYBRID Distributed Model (2311.09548v2)

Published 16 Nov 2023 in cs.DC and cs.DS

Abstract: In this work we consider the HYBRID model of distributed computing, introduced recently by Augustine, Hinnenthal, Kuhn, Scheideler, and Schneider (SODA 2020), where nodes have access to two different communication modes: high-bandwidth local communication along the edges of the graph and low-bandwidth all-to-all communication, capturing the non-uniform nature of modern communication networks. Prior work in HYBRID has focused on showing existentially optimal algorithms, meaning there exists a pathological family of instances on which no algorithm can do better. This neglects the fact that such worst-case instances often do not appear or can be actively avoided in practice. In this work, we focus on the notion of universal optimality, first raised by Garay, Kutten, and Peleg (FOCS 1993). Roughly speaking, a universally optimal algorithm is one that, given any input graph, runs as fast as the best algorithm designed specifically for that graph. We show the first universally optimal algorithms in HYBRID. We present universally optimal solutions for fundamental information dissemination tasks, such as broadcasting and unicasting multiple messages in HYBRID. Furthermore, we apply these tools to obtain universally optimal solutions for various shortest paths problems in HYBRID. A main conceptual contribution of this work is the conception of a new graph parameter called neighborhood quality that captures the inherent complexity of many fundamental graph problems in HYBRID. We also show new existentially optimal shortest paths algorithms in HYBRID, which are utilized as key subroutines in our universally optimal algorithms and are of independent interest. Our new algorithms for $k$-source shortest paths match the existing $\tilde{\Omega}(\sqrt{k})$ lower bound for all $k$. Previously, the lower bound was only known to be tight when $k \in \tilde{\Omega}(n{2/3})$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Distributed graph realizations. IEEE transactions on parallel and distributed systems, 33(6):1321–1337, 2021.
  2. Deterministic Distributed Algorithms and Lower Bounds in the Hybrid Model. In Proceedings of the 35th International Symposium on Distributed Computing (DISC), volume 209, pages 5:1–5:19, 2021.
  3. Deterministic distributed algorithms and lower bounds in the hybrid model. In 35th International Symposium on Distributed Computing, pages 5:1–5:19, 2021.
  4. Distributed computation in node-capacitated networks. In Proceedings of the 31st ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), pages 69–79, 2019.
  5. Network decomposition and locality in distributed computation. In Proceedings of the 30th Symposium on Foundation of Computer Science (FOCS), pages 364–369, 1989.
  6. Distributed computing with the cloud. Distributed Computing, 37:1–18, 2024.
  7. Shortest paths in a hybrid network model. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1280–1299. SIAM, 2020.
  8. The power of multimedia: Combining point-to-point and multiaccess networks. Information and Computation, 84(1):97–118, 1990.
  9. Sublogarithmic distributed MIS algorithm for sparse graphs using Nash-Williams decomposition. Distributed Computing, 22(5-6):363–379, 2010.
  10. Locally-iterative distributed (ΔΔ\Deltaroman_Δ+1)-coloring below szegedy-vishwanathan barrier, and applications to self-stabilization and to restricted-bandwidth models. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing (PODC), pages 437–446, 2018.
  11. Brief announcement: A hierarchy of congested clique models, from broadcast to unicast. In Proceedings of the 2015 ACM Symposium on Principles of Distributed Computing (PODC), pages 167–169, 2015.
  12. The impact of locality in the broadcast congested clique model. SIAM Journal on Discrete Mathematics, 34(1):682–700, 2020.
  13. Near-Shortest Path Routing in Hybrid Communication Networks. In Proceedings of the 25th International Conference on Principles of Distributed Systems (OPODIS 2021), pages 11:1–11:23, 2022.
  14. Routing schemes for hybrid communication networks. In Proceedings of the 30th International Colloquium on Structural Information and Communication Complexity (SIROCCO), pages 317–338. Springer, 2023.
  15. Broadcast congested clique: Planted cliques and pseudorandom generators. In Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing (PODC), pages 248–255, 2019.
  16. Distance computations in the hybrid network model via oracle simulations. In Proceedings of the 38th Symposium on Theoretical Aspects of Computer Science (STACS), pages 21:1–21:19. Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2021.
  17. On sparsity awareness in distributed computations. In Proceedings of the 33rd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), pages 151–161, 2021.
  18. Brief Announcement: Minimizing Congestion in Hybrid Demand-Aware Network Topologies. In Proceedings of the 36th International Symposium on Distributed Computing (DISC), pages 42:1–42:3, 2022.
  19. On the power of the congested clique model. In Proceedings of the 2014 ACM Symposium on Principles of Distributed Computing (PODC), pages 367–376, 2014.
  20. Michael Elkin. A faster distributed protocol for constructing a minimum spanning tree. Journal of Computer and System Sciences, 72(8):1282–1308, 2006.
  21. Fast hybrid network algorithms for shortest paths in sparse graphs. In Proceedings of the 24th International Conference on Principles of Distributed Systems (OPODIS 2020), pages 31:1–31:16, 2021.
  22. Helios: a hybrid electrical/optical switch architecture for modular data centers. In Proceedings of the ACM SIGCOMM 2010 Conference, pages 339–350, 2010.
  23. Mohsen Ghaffari. Distributed broadcast revisited: Towards universal optimality. In Proceedings of the 42nd International Colloquium on Automata, Languages, and Programming (ICALP), pages 638–649, 2015.
  24. Distributed monitoring of network properties: The power of hybrid networks. In Proceedings of the 44th International Colloquium on Automata, Languages, and Programming (ICALP), pages 137:1–137:15, 2017.
  25. Time-optimal construction of overlay networks. In Proceedings of the 2021 Symposium on Principles of Distributed Computing (PODC), pages 457–468, 2021.
  26. A SubLinear time distributed algorithm for minimum-weight spanning trees. SIAM Journal on Computing, 27(1):302–316, February 1998.
  27. New Distributed Algorithms in Almost Mixing Time via Transformations from Parallel Algorithms. In Proceedings of the 32nd International Symposium on Distributed Computing (DISC), pages 31:1–31:16, 2018.
  28. Near-Optimal Distributed DFS in Planar Graphs. In Proceedings of the 31st International Symposium on Distributed Computing (DISC), pages 21:1–21:16, 2017.
  29. Universally-optimal distributed exact min-cut. In Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing (PODC), pages 281–291. ACM, 2022.
  30. Near-optimal low-congestion shortcuts on bounded parameter graphs. In Proceedings of the 30th International Symposium on distributed Computing (DISC), pages 158–172, 2016.
  31. Low-congestion shortcuts without embedding. Distributed Computing, 34(1):79–90, 2021.
  32. Augmenting data center networks with multi-gigabit wireless links. In Proceedings of the ACM SIGCOMM 2011 Conference, pages 38–49, 2011.
  33. Faster Distributed Shortest Path Approximations via Shortcuts. In Ulrich Schmid and Josef Widder, editors, 32nd International Symposium on Distributed Computing (DISC), volume 121 of Leibniz International Proceedings in Informatics (LIPIcs), pages 33:1–33:14, Dagstuhl, Germany, 2018. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
  34. Minor excluded network families admit fast distributed algorithms. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing (PODC), pages 465–474, 2018.
  35. Approximation of Distances and Shortest Paths in the Broadcast Congest Clique. In Emmanuelle Anceaume, Christian Cachin, and Maria Potop-Butucaru, editors, Proceedings of the 19th International Conference on Principles of Distributed Systems (OPODIS 2015), volume 46 of Leibniz International Proceedings in Informatics (LIPIcs), pages 1–16, Dagstuhl, Germany, 2016. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
  36. Hop-constrained expander decompositions, oblivious routing, and distributed universal optimality. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing (STOC), pages 1325–1338, 2022.
  37. Universally-optimal distributed algorithms for known topologies. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing (STOC), pages 1166–1179, 2021.
  38. Connectivity and minimum cut approximation in the broadcast congested clique. In Proceedings of the 25th International Colloquium on Structural Information and Communication Complexity (SIROCCO), pages 331–344. Springer, 2018.
  39. Low-congestion shortcut and graph parameters. Distributed Computing, 34(5):349–365, 2021.
  40. Deterministic distributed ruling sets of line graphs. In Proceedings of the 25th International Colloquium on Structural Information and Communication Complexity (SIROCCO), pages 193–208, 2018.
  41. An overview of device-to-device communication in cellular networks. ICT express, 4(4):203–208, 2018.
  42. Computing shortest paths and diameter in the hybrid network model. In Proceedings of the 39th Symposium on Principles of Distributed Computing (PODC), pages 109–118, 2020.
  43. Routing Schemes and Distance Oracles in the Hybrid Model. In International Symposium on Distributed Computing (DISC), volume 246, pages 28:1–28:22, 2022.
  44. Simple parallel and distributed algorithms for spectral graph sparsification. ACM Transactions on Parallel Computing (TOPC), 3(2):1–14, 2016.
  45. Christoph Lenzen. Optimal deterministic routing and sorting on the congested clique. In Principles of Distr. Comp. (PODC), pages 42–50, 2013.
  46. Nathan Linial. Locality in distributed graph algorithms. SIAM Journal on computing, 21(1):193–201, 1992.
  47. Brief announcement: deterministic graph connectivity in the broadcast congested clique. In Proceedings of the 2016 ACM Symposium on Principles of Distributed Computing (PODC), pages 245–247, 2016.
  48. Polylogarithmic-time deterministic network decomposition and distributed derandomization. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC), pages 350–363, 2020.
  49. Undirected (1+ϵ)1italic-ϵ(1+\epsilon)( 1 + italic_ϵ )-shortest paths via minor-aggregates: near-optimal deterministic parallel and distributed algorithms. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing (STOC), pages 478–487, 2022.
  50. A survey on automatic configuration of virtual private networks. Computer Networks, 55(8):1684–1699, 2011.
  51. Philipp Schneider. Power and Limitations of Hybrid Communication Networks. PhD thesis, University of Freiburg, 2023.
  52. Claude Elwood Shannon. A mathematical theory of communication. The Bell system technical journal, 27(3):379–423, 1948.
  53. Chernoff–Hoeffding bounds for applications with limited independence. Journal on Discrete Mathematics, 8(2):223–250, 1995.
  54. Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In Proceedings of the thirty-sixth annual ACM symposium on Theory of computing (STOC), pages 81–90, 2004.
  55. High-probability parallel transitive-closure algorithms. SIAM Journal on Computing, 20(1):100–125, 1991.
  56. Salil P. Vadhan. Pseudorandomness. Foundations and Trends® in Theoretical Computer Science, 7(1–3):1–336, 2012.
  57. Capacity and coverage enhancement in heterogeneous networks. IEEE Wirel. Commun., 18(3):32–38, 2011.
  58. Universally-optimal distributed shortest paths and transshipment via graph-based l1-oblivious routing. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 2549–2579. SIAM, 2022.
  59. Goran Žužic. Towards Universal Optimality in Distributed Optimization. PhD thesis, Carnegie Mellon University, 2018.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets