A Reinforcement-Learning-Based Multiple-Column Selection Strategy for Column Generation (2312.14213v2)
Abstract: Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider only a subset of columns and iteratively add potential columns to improve the objective value. While adding the column with the most negative reduced cost can guarantee the convergence of CG, it has been shown that adding multiple columns per iteration rather than a single column can lead to faster convergence. However, it remains a challenge to design a multiple-column selection strategy to select the most promising columns from a large number of candidate columns. In this paper, we propose a novel reinforcement-learning-based (RL) multiple-column selection strategy. To the best of our knowledge, it is the first RL-based multiple-column selection strategy for CG. The effectiveness of our approach is evaluated on two sets of problems: the cutting stock problem and the graph coloring problem. Compared to several widely used single-column and multiple-column selection strategies, our RL-based multiple-column selection strategy leads to faster convergence and achieves remarkable reductions in the number of CG iterations and runtime.
- Neural column generation for capacitated vehicle routing. In AAAI-22 Workshop on Machine Learning for Operations Research.
- Branch-and-price: Column generation for solving huge integer programs. Operations Research, 46(3): 316–329.
- Machine learning for combinatorial optimization: A methodological tour d’horizon. European Journal of Operational Research, 290(2): 405–421.
- A deep reinforcement learning framework for column generation. In Advances in Neural Information Processing Systems.
- Bin packing and cutting stock problems: Mathematical models and exact algorithms. European Journal of Operational Research, 255(1): 1–20.
- BPPLIB: A library for bin packing and cutting stock problems. Optimization Letters, 12(2): 235–250.
- Accelerating strategies in column generation methods for vehicle routing and crew scheduling problems. Essays and Surveys in Metaheuristics, 309–324.
- Column generation. Springer Science & Business Media.
- Stabilized column generation. Discrete Mathematics, 194(1-3): 229–237.
- Exact combinatorial optimization with graph convolutional neural networks. In Advances in Neural Information Processing Systems.
- A linear programming approach to the cutting-stock problem. Operations Research, 9(6): 849–859.
- Multiple cuts in the analytic center cutting plane method. SIAM Journal on Optimization, 11(1): 266–288.
- Gurobi Optimization, LLC. 2023. Gurobi optimizer reference manual.
- Rossmann-toolbox: A deep learning-based protocol for the prediction and design of cofactor specificity in Rossmann fold proteins. Briefings in Bioinformatics, 23(1): bbab371.
- Selected topics in column generation. Operations Research, 53(6): 1007–1023.
- A survey on vertex coloring problems. International Transactions in Operational Research, 17(1): 1–34.
- Reinforcement learning for combinatorial optimization: A survey. Computers & Operations Research, 134: 105400.
- A column generation approach for graph coloring. INFORMS Journal on Computing, 8(4): 344–354.
- Machine-learning-based column selection for column generation. Transportation Science, 55(4): 815–831.
- Solutions diversification in a column generation algorithm. Algorithmic Operations Research, 5(2): 86–95.
- Automation and combination of linear-programming based stabilization techniques in column generation. INFORMS Journal on Computing, 30(2): 339–360.
- Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347.
- Enhancing column generation by a machine-learning-based pricing heuristic for graph coloring. In AAAI Conference on Artificial Intelligence.
- An improved integral column generation algorithm using machine learning for aircrew pairing. Transportation Science, 55(6): 1411–1429.
- Vanderbeck, F. 1994. Decomposition and column generation for integer programs. Ph.D. thesis, UCL-Université Catholique de Louvain.
- Graph attention networks. In International Conference on Learning Representations.
- How powerful are graph neural networks? In International Conference on Learning Representations.
- High-speed Train Timetabling Based on Reinforcement Learning. In IEEE Symposium Series on Computational Intelligence, 1187–1193.
- The neural-prediction based acceleration algorithm of column generation for graph-based set covering problems. In IEEE International Conference on Systems, Man, and Cybernetics, 1115–1120.
- Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learning. In Advances in Neural Information Processing Systems.