Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learn to Tour: Operator Design For Solution Feasibility Mapping in Pickup-and-delivery Traveling Salesman Problem (2404.11458v1)

Published 17 Apr 2024 in cs.AI

Abstract: This paper aims to develop a learning method for a special class of traveling salesman problems (TSP), namely, the pickup-and-delivery TSP (PDTSP), which finds the shortest tour along a sequence of one-to-one pickup-and-delivery nodes. One-to-one here means that the transported people or goods are associated with designated pairs of pickup and delivery nodes, in contrast to that indistinguishable goods can be delivered to any nodes. In PDTSP, precedence constraints need to be satisfied that each pickup node must be visited before its corresponding delivery node. Classic operations research (OR) algorithms for PDTSP are difficult to scale to large-sized problems. Recently, reinforcement learning (RL) has been applied to TSPs. The basic idea is to explore and evaluate visiting sequences in a solution space. However, this approach could be less computationally efficient, as it has to potentially evaluate many infeasible solutions of which precedence constraints are violated. To restrict solution search within a feasible space, we utilize operators that always map one feasible solution to another, without spending time exploring the infeasible solution space. Such operators are evaluated and selected as policies to solve PDTSPs in an RL framework. We make a comparison of our method and baselines, including classic OR algorithms and existing learning methods. Results show that our approach can find tours shorter than baselines.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Exploratory Combinatorial Optimization with Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence 34 (04 2020), 3243–3250.
  2. Neural Combinatorial Optimization with Reinforcement Learning.
  3. Variable Neighborhood Search for the Pickup and Delivery Traveling Salesman Problem with LIFO Loading. Informs Journal on Computing 19 (11 2007), 618–632. https://doi.org/10.1287/ijoc.1060.0202
  4. Xinyun Chen and Yuandong Tian. 2019. Learning to Perform Local Rewriting for Combinatorial Optimization. In Proceedings of the 33rd International Conference on Neural Information Processing Systems.
  5. Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learning. In Asian Conference on Machine Learning.
  6. Learning Combinatorial Optimization Algorithms over Graphs (NIPS’17). 6351–6361.
  7. Learning Heuristics for the TSP by Policy Gradient. In Integration of Constraint Programming, Artificial Intelligence, and Operations Research, Willem-Jan van Hoeve (Ed.). Springer International Publishing, Cham, 170–181.
  8. Efficiently Solving the Practical Vehicle Routing Problem: A Novel Joint Learning Approach. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2020).
  9. The traveling salesman problem with pickup and delivery: Polyhedral results and a branch-and-cut algorithm. Mathematical Programming 121 (07 2009), 269–305. https://doi.org/10.1007/s10107-008-0234-9
  10. Google. 2023. OR-tools, Google optimization tools. https://developers.google.com/optimization
  11. Gurobi. 2023. Mixed Integer Programming Basics. https://www.gurobi.com/resources/mixed-integer-programming-mip-a-primer-on-the-basics/
  12. Keld Helsgaun. 2017. An Extension of the Lin-Kernighan-Helsgaun TSP Solver for Constrained Traveling Salesman and Vehicle Routing Problems.
  13. An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problem. ArXiv abs/1906.01227 (2019).
  14. Attention, Learn to Solve Routing Problems!. In International Conference on Learning Representations.
  15. Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems 23, 3 (2022), 2306–2315. https://doi.org/10.1109/TITS.2021.3056120
  16. Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). 2511–2522. https://doi.org/10.1109/ICDE51399.2021.00283
  17. Shen Lin and Brian W. Kernighan. 1973. An Effective Heuristic Algorithm for the Traveling-Salesman Problem. Oper. Res. 21 (1973), 498–516.
  18. A Learning-based Iterative Method for Solving Vehicle Routing Problems. In International Conference on Learning Representations.
  19. A Hierarchical Reinforcement Learning Based Optimization Framework for Large-scale Dynamic Pickup and Delivery Problems. In Advances in Neural Information Processing Systems, A. Beygelzimer, Y. Dauphin, P. Liang, and J. Wortman Vaughan (Eds.).
  20. Efficient Neural Neighborhood Search for Pickup and Delivery Problems. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22. 4776–4784.
  21. Applying Deep Learning and Reinforcement Learning to Traveling Salesman Problem. In 2018 International Conference on Computing, Electronics & Communications Engineering (iCCECE). 65–70.
  22. Reinforcement Learning for Solving the Vehicle Routing Problem. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS’18). Curran Associates Inc., 9861–9871.
  23. Exponential-Size Neighborhoods for the Pickup-and-Delivery Traveling Salesman Problem. Transportation Science 57 (10 2022). https://doi.org/10.1287/trsc.2022.1176
  24. Perturbation heuristics for the pickup and delivery traveling salesman problem. Computers & Operations Research 29, 9 (2002), 1129–1141. https://doi.org/10.1016/S0305-0548(00)00109-X
  25. A heuristic for the pickup and delivery traveling salesman problem. Computers & Operations Research 27, 9 (2000), 905–916. https://doi.org/10.1016/S0305-0548(99)00066-0
  26. K.S. Ruland and E.Y. Rodin. 1997. The pickup and delivery problem: Faces and branch-and-cut algorithm. Computers & Mathematics with Applications 33, 12 (1997), 1–13. https://doi.org/10.1016/S0898-1221(97)00090-4
  27. M.W.P. Savelsbergh. 1990. An efficient implementation of local search algorithms for constrained routing problems. European Journal of Operational Research 47, 1 (1990), 75–85.
  28. Steven Skiena. 1991. Implementing Discrete Mathematics: Combinatorics and Graph Theory with Mathematica. Addison-Wesley Longman Publishing Co., Inc., USA.
  29. The pickup and delivery traveling salesman problem with handling costs. European Journal of Operational Research 257, 1 (2017), 118–132. https://doi.org/10.1016/j.ejor.2016.07.009
  30. Pointer Networks. In Advances in Neural Information Processing Systems, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett (Eds.), Vol. 28. Curran Associates, Inc.
  31. Learning Improvement Heuristics for Solving Routing Problems. IEEE Transactions on Neural Networks and Learning Systems 33 (03 2021), 5057–5069.
  32. NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problem. In Advances in Neural Information Processing Systems.
  33. Solve Traveling Salesman Problem by Monte Carlo Tree Search and Deep Neural Network. ArXiv abs/2005.06879 (2020).
  34. Combining Reinforcement Learning with Lin-Kernighan-Helsgaun Algorithm for the Traveling Salesman Problem. ArXiv abs/2012.04461 (2020).
  35. Reinforced Lin-Kernighan-Helsgaun algorithms for the traveling salesman problems. Knowledge-Based Systems 260 (2023), 110144.
  36. MAPDP: Cooperative Multi-Agent Reinforcement Learning to Solve Pickup and Delivery Problems. Proceedings of the AAAI Conference on Artificial Intelligence 36, 9 (2022), 9980–9988. https://doi.org/10.1609/aaai.v36i9.21236
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Bowen Fang (5 papers)
  2. Xu Chen (415 papers)
  3. Xuan Di (32 papers)

Summary

We haven't generated a summary for this paper yet.