Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
117 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Parallel Unconstrained Local Search for Partitioning Irregular Graphs (2308.15494v3)

Published 28 Aug 2023 in cs.SI and cs.DC

Abstract: We present new refinement heuristics for the balanced graph partitioning problem that break with an age-old rule. Traditionally, local search only permits moves that keep the block sizes balanced (below a size constraint). In this work, we demonstrate that admitting large temporary balance violations drastically improves solution quality. The effects are particularly strong on irregular instances such as social networks. Designing efficient implementations of this general idea involves both careful selection of candidates for unconstrained moves as well as algorithms for rebalancing the solution later on. We explore a wide array of design choices to achieve this, in addition to our third goal of high parallel scalability. We present compelling experimental results, demonstrating that our parallel unconstrained local search techniques outperform the prior state of the art by a substantial margin. Compared with four state-of-the-art solvers, our new technique finds 75\% of the best solutions on irregular graphs. We achieve a 9.6\% improvement in edge cut over the next best competitor, while being only 7.7\% slower in the geometric mean.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. High-Quality Shared-Memory Graph Partitioning. In European Conference on Parallel Processing (Euro-Par), pages 659–671. Springer, 8 2017. doi:10.1007/978-3-319-96983-1_47.
  2. Graph Partitioning. Wiley, 2013.
  3. Finding Good Approximate Vertex and Edge Partitions is NP-Hard. Information Processing Letters, 42(3):153–159, 1992. doi:10.1016/0020-0190(92)90140-Q.
  4. Recent Advances in Graph Partitioning. In Algorithm Engineering, volume 9220, pages 117–158. 2016. doi:10.1007/978-3-319-49487-6_4.
  5. Iterative Partitioning with Varying Node Weights. 13th International Conference on VLSI Design (VLSID), 11(3):249–258, 2000. doi:10.1155/2000/15862.
  6. More Recent Advances in (Hyper)Graph Partitioning. ACM Computing Surveys, 55(12):253–253, 2023. doi:10.1145/3571808.
  7. PT-Scotch: A Tool for Efficient Parallel Graph Ordering. Parallel Computing, 34(6-8):318–331, 2008. doi:10.1016/j.parco.2007.12.001.
  8. Schism: a Workload-Driven Approach to Database Replication and Partitioning. Proceedings of the VLDB Endowment, 3(1):48–57, 2010. doi:10.14778/1920841.1920853.
  9. The University of Florida Sparse Matrix Collection. ACM Transactions on Mathematical Software, 38(1):1:1–1:25, 11 2011. doi:10.1145/2049662.2049663.
  10. Benchmarking Optimization Software with Performance Profiles. Mathematical Programming, 91(2):201–213, 2002. doi:10.1007/s101070100263.
  11. Partitioning Around Roadblocks: Tackling Constraints with Intermediate Relaxations. In ICCAD 1997, pages 350–355. IEEE, 1997. doi:10.1109/ICCAD.1997.643546.
  12. Pizza&Chili Corpus (Compressed Indexes and their Testbeds). URL: http://pizzachili.dcc.uchile.cl/index.html.
  13. A Linear-Time Heuristic for Improving Network Partitions. In 19th Conference on Design Automation (DAC), pages 175–181, 1982. doi:10.1145/800263.809204.
  14. Jet: Multilevel Graph Partitioning on GPUs, 2023. arXiv:2304.13194, doi:10.48550/arXiv.2304.13194.
  15. Deterministic parallel hypergraph partitioning. In Euro-Par 2022, volume 13440 of Lecture Notes in Computer Science, pages 301–316. Springer, 2022. doi:10.1007/978-3-031-12597-3_19.
  16. Advanced Flow-Based Multilevel Hypergraph Partitioning. 18th International Symposium on Experimental Algorithms (SEA), 2020. doi:10.4230/LIPIcs.SEA.2020.11.
  17. Parallel Flow-Based Hypergraph Partitioning. In 20th International Symposium on Experimental Algorithms (SEA), volume 233, pages 5:1–5:21. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2022. doi:10.4230/LIPIcs.SEA.2022.5.
  18. Shared-Memory n𝑛nitalic_n-level Hypergraph Partitioning. In 24th Workshop on Algorithm Engineering and Experiments (ALENEX). SIAM, 01 2022. doi:10.1137/1.9781611977042.11.
  19. Deep Multilevel Graph Partitioning. In 29th European Symposium on Algorithms (ESA), volume 204, pages 48:1–48:17. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.ESA.2021.48.
  20. Scalable High-Quality Hypergraph Partitioning. 2023. arXiv:2303.17679, doi:10.48550/arXiv.2303.17679.
  21. Scalable Shared-Memory Hypergraph Partitioning. In 23st Workshop on Algorithm Engineering & Experiments (ALENEX). SIAM, 01 2021. doi:10.1137/1.9781611976472.2.
  22. Engineering a Scalable High Quality Graph Partitioner. IEEE Transactions on Parallel and Distributed Systems, pages 1–12, 2010. doi:10.1109/IPDPS.2010.5470485.
  23. Artur Jez. Faster Fully Compressed Pattern Matching by Recompression. ACM, 11(3):20:1–20:43, 2015. doi:10.1145/2631920.
  24. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. SIAM Journal on Scientific Computing, 20(1):359–392, 1998. doi:10.1137/S1064827595287997.
  25. Multi-Threaded Graph Partitioning. In 27th International Parallel and Distributed Processing Symposium (IPDPS), pages 225–236. IEEE, 2013. doi:10.1109/IPDPS.2013.50.
  26. Parallel Hill-Climbing Refinement Algorithm for Graph Partitioning. In 45th International Conference on Parallel Processing (ICPP), pages 236–241. IEEE, 2016. doi:10.1109/ICPP.2016.34.
  27. Parallel Unconstrained Local Search for Partitioning Irregular Graphs. CoRR, abs/2308.15494, 2023. arXiv:2308.15494, doi:10.48550/arXiv.2308.15494.
  28. Partitioning Complex Networks via Size-Constrained Clustering. In 13th International Symposium on Experimental Algorithms (SEA), volume 8504, pages 351–363. Springer, 2014. doi:10.1007/978-3-319-07959-2_30.
  29. Chuck Pheatt. Intel Threading Building Blocks. Journal of Computing Sciences in Colleges, 23(4):298–298, 2008.
  30. Near Linear Time Algorithm to Detect Community Structures in Large-Scale Networks. Physical Review E, 76(3):036106, 2007.
  31. Brief Announcement: MultiQueues: Simple Relaxed Concurrent Priority Queues. In SPAA 2015, pages 80–82. ACM, 2015. doi:10.1145/2755573.2755616.
  32. The Network Data Repository with Interactive Graph Analytics and Visualization. In AAAI, 2015. URL: https://networkrepository.com.
  33. Graph Partitioning for High-Performance Scientific Simulations. In Sourcebook of Parallel Computing, pages 491–541. 2003.
  34. Mesh Partitioning: A Multilevel Balancing and Refinement Algorithm. SIAM J. Sci. Comput., 22(1):63–80, 2000. doi:10.1137/S1064827598337373.
  35. Parallel Dynamic Graph Partitioning for Adaptive Unstructured Meshes. Journal of Parallel and Distributed Computing, 47(2):102–108, 1997. doi:10.1006/jpdc.1997.1407.
  36. Engineering MultiQueues: Fast Relaxed Concurrent Priority Queues. In ESA 2021, volume 204 of LIPIcs, pages 81:1–81:17. Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2021. doi:10.4230/LIPIcs.ESA.2021.81.
Citations (1)

Summary

We haven't generated a summary for this paper yet.