Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

An Efficient Learning-based Solver Comparable to Metaheuristics for the Capacitated Arc Routing Problem (2403.07028v1)

Published 11 Mar 2024 in cs.LG, cs.AI, and math.OC

Abstract: Recently, neural networks (NN) have made great strides in combinatorial optimization. However, they face challenges when solving the capacitated arc routing problem (CARP) which is to find the minimum-cost tour covering all required edges on a graph, while within capacity constraints. In tackling CARP, NN-based approaches tend to lag behind advanced metaheuristics, since they lack directed arc modeling and efficient learning methods tailored for complex CARP. In this paper, we introduce an NN-based solver to significantly narrow the gap with advanced metaheuristics while exhibiting superior efficiency. First, we propose the direction-aware attention model (DaAM) to incorporate directionality into the embedding process, facilitating more effective one-stage decision-making. Second, we design a supervised reinforcement learning scheme that involves supervised pre-training to establish a robust initial policy for subsequent reinforcement fine-tuning. It proves particularly valuable for solving CARP that has a higher complexity than the node routing problems (NRPs). Finally, a path optimization method is proposed to adjust the depot return positions within the path generated by DaAM. Experiments illustrate that our approach surpasses heuristics and achieves decision quality comparable to state-of-the-art metaheuristics for the first time while maintaining superior efficiency.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. An efficiency-based path-scanning heuristic for the capacitated arc routing problem. Computers & Operations Research, 103:288–295, 2019.
  2. Neural combinatorial optimization with reinforcement learning. arXiv preprint arXiv:1611.09940, 2016.
  3. A comprehensive survey of graph embedding: Problems, techniques, and applications. IEEE transactions on knowledge and data engineering, 30(9):1616–1637, 2018.
  4. Measuring and relieving the over-smoothing problem for graph neural networks from the topological view. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pages 3438–3445, 2020.
  5. Discriminative embeddings of latent variable models for structured data. In International conference on machine learning, pages 2702–2711. PMLR, 2016.
  6. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018.
  7. Capacitated arc routing problems. Networks, 11(3):305–315, 1981.
  8. Computational experiments with algorithms for a class of routing problems. Computers & Operations Research, 10(1):47–59, 1983.
  9. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pages 855–864, 2016.
  10. Openstreetmap: User-generated street maps. IEEE Pervasive computing, 7(4):12–18, 2008.
  11. Inductive representation learning on large graphs. Advances in neural information processing systems, 30, 2017.
  12. Faster capacitated arc routing: A sequence-to-sequence approach. IEEE Access, 10:4777–4785, 2022.
  13. Rafael Kendy Arakaki and Fábio Luiz Usberti. An efficiency-based path-scanning heuristic for the capacitated arc routing problem. Computers & Operations Research, 103:288–295, 2019.
  14. Learning combinatorial optimization algorithms over graphs. Advances in neural information processing systems, 30, 2017.
  15. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  16. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
  17. Actor-critic algorithms. Advances in neural information processing systems, 12, 1999.
  18. Attention, learn to solve routing problems! In International Conference on Learning Representations, 2019.
  19. A tutorial for competent memetic algorithms: model, taxonomy, and design issues. IEEE transactions on Evolutionary Computation, 9(5):474–488, 2005.
  20. Learning to solve capacitated arc routing problems by policy gradient. In 2019 IEEE Congress on Evolutionary Computation (CEC), pages 1291–1298. IEEE, 2019.
  21. Human-level control through deep reinforcement learning. nature, 518(7540):529–533, 2015.
  22. Asynchronous methods for deep reinforcement learning. In International conference on machine learning, pages 1928–1937. PMLR, 2016.
  23. Reinforcement learning for solving the vehicle routing problem. Advances in neural information processing systems, 31, 2018.
  24. Transforming arc routing into node routing problems. Computers & operations research, 14(4):285–288, 1987.
  25. Learning heuristics for arc routing problems. Intelligent Systems with Applications, 21:200300, 2024.
  26. Self-critical sequence training for image captioning. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7008–7024, 2017.
  27. An improved heuristic for the capacitated arc routing problem. Computers & Operations Research, 36(9):2632–2637, 2009.
  28. Modeling relational data with graph convolutional networks. In The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, Proceedings 15, pages 593–607. Springer, 2018.
  29. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017.
  30. Sequence to sequence learning with neural networks. Advances in neural information processing systems, 27, 2014.
  31. Memetic algorithm with extended neighborhood search for capacitated arc routing problems. IEEE Transactions on Evolutionary Computation, 13(5):1151–1166, 2009.
  32. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  33. Graph Attention Networks. International Conference on Learning Representations, 2018.
  34. Pointer networks. Advances in neural information processing systems, 28, 2015.
  35. Ronald J Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8:229–256, 1992.
  36. Simplifying graph convolutional networks. In International conference on machine learning, pages 6861–6871. PMLR, 2019.
  37. A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems, 32(1):4–24, 2020.
  38. Graph neural networks: A review of methods and applications. AI open, 1:57–81, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Runze Guo (2 papers)
  2. Feng Xue (60 papers)
  3. Anlong Ming (21 papers)
  4. Nicu Sebe (270 papers)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com