Machine Learning for the Multi-Dimensional Bin Packing Problem: Literature Review and Empirical Evaluation (2312.08103v1)
Abstract: The Bin Packing Problem (BPP) is a well-established combinatorial optimization (CO) problem. Since it has many applications in our daily life, e.g. logistics and resource allocation, people are seeking efficient bin packing algorithms. On the other hand, researchers have been making constant advances in ML, which is famous for its efficiency. In this article, we first formulate BPP, introducing its variants and practical constraints. Then, a comprehensive survey on ML for multi-dimensional BPP is provided. We further collect some public benchmarks of 3D BPP, and evaluate some online methods on the Cutting Stock Dataset. Finally, we share our perspective on challenges and future directions in BPP. To the best of our knowledge, this is the first systematic review of ML-related methods for BPP.
- Apprenticeship learning via inverse reinforcement learning. In ICML, 2004.
- Eitan Altman. Constrained Markov decision processes. CRC Press, 1999.
- Neural combinatorial optimization with reinforcement learning. arXiv:1611.09940, 2016.
- Machine learning for combinatorial optimization: a methodological tour d’horizon. EJOR, 2021.
- Two-dimensional finite bin-packing algorithms. Journal of the operational research society, 1987.
- Constraints in container loading–a state-of-the-art review. EJOR, 2013.
- Reinforcement learning driven heuristic optimization. arXiv:1906.06639, 2019.
- Shapenet: An information-rich 3d model repository. arXiv:1512.03012, 2015.
- An analytical model for the container loading problem. European Journal of operational research, 80(1):68–76, 1995.
- Approximation and online algorithms for multidimensional bin packing: A survey. Computer Science Review, 2017.
- Repack: Dense object packing using deep cnn with reinforcement learning. In International Automatic Control Conference, 2019.
- Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555, 2014.
- Bin packing: Maximizing the number of pieces packed. Acta Informatica, 1978a.
- Approximation algorithms for bin-packing—an updated survey. In Algorithm design for computer system design. 1984.
- Bin packing approximation algorithms: survey and classification. In Handbook of combinatorial optimization. 2013.
- An application of bin-packing to multiprocessor scheduling. SIAM Journal on Computing, 1978b.
- IBM ILOG Cplex. V12. 1: User’s manual for cplex. International Business Machines Corporation, 46(53):157, 2009.
- Extreme point-based heuristics for three-dimensional bin packing. Informs Journal on computing, 2008.
- Bpplib: a library for bin packing and cutting stock problems. Optimization Letters, 12:235–250, 2018.
- Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
- A multi-task selected learning approach for solving 3d flexible bin packing problem. In AAMAS, 2018.
- Three-dimensional bin packing and mixed-case palletization. Informs Journal on Optimization, 2019.
- Applications of bin packing models through the supply chain. International Journal of Business and Management Studies, 2009.
- Emanuel Falkenauer. A hybrid grouping genetic algorithm for bin packing. Journal of heuristics, 1996.
- A genetic algorithm for bin packing and line balancing. In ICRA, 1992.
- Guided local search for the three-dimensional bin-packing problem. Informs journal on computing, 2003.
- Computers and intractability. Freeman San Francisco, 1979.
- Tabu search. In Handbook of combinatorial optimization. 1998.
- Will Goldstone. Unity game development essentials. Packt Publishing Ltd, 2009.
- A biased random key genetic algorithm for 2d and 3d bin packing problems. International Journal of Production Economics, 2013.
- Deep learning. MIT press, 2016.
- Packit: A virtual environment for geometric planning. In ICML, 2020.
- Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual, 2023. URL https://www.gurobi.com.
- The pallet loading problem: Three-dimensional bin packing with practical constraints. EJOR, 2020.
- An online packing heuristic for the three-dimensional container loading problem in dynamic environments and the physical internet. pp. 140–155, 03 2017. ISBN 978-3-319-55791-5. doi: 10.1007/978-3-319-55792-2_10.
- E Hopper and B Turton. A genetic algorithm for a 2d industrial packing problem. Computers & Industrial Engineering, 1999.
- Solving a new 3d bin packing problem with deep reinforcement learning method. arXiv:1708.05930, 2017.
- Tap-net: transport-and-pack using reinforcement learning. ACM TOG, 2020.
- Stefan Jakobs. On genetic algorithms for the packing of polygons. EJOR, 1996.
- Learning to solve 3-d bin packing problem via deep reinforcement learning and constraint programming. IEEE transactions on cybernetics, 2021a.
- Solving 3d bin packing problem via multimodal deep reinforcement learning. In AAMAS, 2021b.
- David S Johnson. Near-optimal bin packing algorithms. PhD thesis, 1973.
- David S Johnson. Fast algorithms for bin packing. Journal of Computer and System Sciences, 1974.
- Worst-case performance bounds for simple one-dimensional packing algorithms. SIAM Journal on computing, 1974.
- A hybrid genetic algorithm for packing in 3d with deepest bottom left with fill method. In NeurIPS, 2004.
- Actor-critic algorithms. Advances in neural information processing systems, 12, 1999.
- Imagenet classification with deep convolutional neural networks. In NeurIPS, 2012.
- Ranked reward: Enabling self-play reinforcement learning for combinatorial optimization. In AAAI-19 Workshop on Reinforcement Learning in Games, 2019.
- Solving packing problems by conditional query learning. In openreview.net, 2020. URL https://openreview.net/forum?id=BkgTwRNtPB.
- Quasi-monte-carlo tree search for 3d bin packing. In PRCV, 2018.
- Policy learning with constraints in model-free reinforcement learning: A survey. In IJCAI, 2021.
- Heuristic and metaheuristic approaches for a class of two-dimensional bin packing problems. INFORMS Journal on Computing, 1999.
- Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3431–3440, 2015.
- Small boxes big data: A deep learning approach to optimize variable sized bin packing. In BigDataService, 2017.
- Lower bounds and reduction procedures for the bin packing problem. Discrete applied mathematics, 1990.
- Exact solution of the two-dimensional finite bin packing problem. Management science, 1998.
- The three-dimensional bin packing problem. Operations research, 2000.
- Reinforcement learning for combinatorial optimization: A survey. Computers & Operations Research, 2021.
- Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
- Asynchronous methods for deep reinforcement learning. In International conference on machine learning, pp. 1928–1937. PMLR, 2016.
- Online 3d bin packing reinforcement learning solution with buffer. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8902–8909. IEEE, 2022.
- A container loading algorithm with static mechanical equilibrium stability constraints. Transportation Research Part B: Methodological, 2016a.
- A physical packing sequence algorithm for the container loading problem with static mechanical equilibrium conditions. International Transactions in Operational Research, 2016b.
- Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015.
- High-dimensional continuous control using generalized advantage estimation. arXiv preprint arXiv:1506.02438, 2015.
- Steven S Seiden. On the online bin packing problem. Journal of the ACM, 2002.
- Adaptive resource provisioning for the cloud using online bin packing. IEEE Transactions on Computers, 2013.
- Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12, 1999.
- Simultaneous planning for item picking and placing by deep reinforcement learning. In IROS, 2020.
- A fast and efficient compact packing algorithm for free-form objects. In IDETC-CIE, 2008.
- Graph attention networks. arXiv preprint arXiv:1710.10903, 2017.
- A generalized reinforcement learning algorithm for online 3d bin-packing. arXiv:2007.00463, 2020.
- Pointer networks. Proc. of NeurIPS, 2015.
- Stable bin packing of non-convex 3d objects with a robot manipulator. In ICRA, 2019.
- Three-dimensional bin packing problem with variable bin height. European journal of operational research, 202(2):347–355, 2010.
- Scalable trust-region method for deep reinforcement learning using kronecker-factored approximation. Advances in neural information processing systems, 30, 2017.
- A comprehensive survey on graph neural networks. IEEE TNNLS, 2020.
- Learning for graph matching and related combinatorial optimization problems. In IJCAI, 2020.
- Heuristics integrated deep reinforcement learning for online 3d bin packing. IEEE Transactions on Automation Science and Engineering, 2023.
- Attend2pack: Bin packing through deep reinforcement learning with attention. arXiv:2107.04333, 2021.
- Learning efficient online 3d bin packing on packing configuration trees. In ICLR, 2022.
- Online 3d bin packing with constrained deep reinforcement learning. In Proc. of AAAI, 2021.
- Learning practically feasible policies for online 3d bin packing. Science China Information Sciences, 2022.
- Learning to pack: A data-driven tree search algorithm for large-scale 3d bin packing problem. In CIKM, 2021.