Automatic programming via large language models with population self-evolution for dynamic job shop scheduling problem
Abstract: Heuristic dispatching rules (HDRs) are widely regarded as effective methods for solving dynamic job shop scheduling problems (DJSSP) in real-world production environments. However, their performance is highly scenario-dependent, often requiring expert customization. To address this, genetic programming (GP) and gene expression programming (GEP) have been extensively used for automatic algorithm design. Nevertheless, these approaches often face challenges due to high randomness in the search process and limited generalization ability, hindering the application of trained dispatching rules to new scenarios or dynamic environments. Recently, the integration of LLMs with evolutionary algorithms has opened new avenues for prompt engineering and automatic algorithm design. To enhance the capabilities of LLMs in automatic HDRs design, this paper proposes a novel population self-evolutionary (SeEvo) method, a general search framework inspired by the self-reflective design strategies of human experts. The SeEvo method accelerates the search process and enhances exploration capabilities. Experimental results show that the proposed SeEvo method outperforms GP, GEP, end-to-end deep reinforcement learning methods, and more than 10 common HDRs from the literature, particularly in unseen and dynamic scenarios.
- S. Shady, T. Kaihara, N. Fujii, and D. Kokuryo, “Feature selection approach for evolving reactive scheduling policies for dynamic job shop scheduling problem using gene expression programming,” International Journal of Production Research, vol. 61, no. 15, pp. 5029–5052, 2023.
- J. Branke, S. Nguyen, C. W. Pickardt, and M. Zhang, “Automated design of production scheduling heuristics: A review,” IEEE Transactions on Evolutionary Computation, vol. 20, no. 1, pp. 110–124, 2015.
- J. A. Gromicho, J. J. Van Hoorn, F. Saldanha-da Gama, and G. T. Timmer, “Solving the job-shop scheduling problem optimally by dynamic programming,” Computers & Operations Research, vol. 39, no. 12, pp. 2968–2977, 2012.
- P. Brucker, B. Jurisch, and B. Sievers, “A branch and bound algorithm for the job-shop scheduling problem,” Discrete Applied Mathematics, vol. 49, no. 1, pp. 107–127, 1994.
- L. Zhang, Z. Li, G. Królczyk, D. Wu, and Q. Tang, “Mathematical modeling and multi-attribute rule mining for energy efficient job-shop scheduling,” Journal of Cleaner Production, vol. 241, p. 118289, 2019.
- A. Baykasoğlu, A. Hamzadayi, and S. Y. Köse, “Testing the performance of teaching–learning based optimization (tlbo) algorithm on combinatorial problems: Flow shop and job shop scheduling cases,” Information Sciences, vol. 276, pp. 204–218, 2014.
- J. Xie, X. Li, L. Gao, and L. Gui, “A new neighbourhood structure for job shop scheduling problems,” International Journal of Production Research, vol. 61, no. 7, pp. 2147–2161, 2023.
- L. Wang and D.-Z. Zheng, “An effective hybrid optimization strategy for job-shop scheduling problems,” Computers & Operations Research, vol. 28, no. 6, pp. 585–596, 2001.
- O. Holthaus and C. Rajendran, “Efficient dispatching rules for scheduling in a job shop,” International Journal of Production Economics, vol. 48, no. 1, pp. 87–105, 1997.
- S. Rahal, D. J. Papageorgiou, and Z. Li, “Hybrid strategies using linear and piecewise-linear decision rules for multistage adaptive linear optimization,” European Journal of Operational Research, vol. 290, no. 3, pp. 1014–1030, 2021.
- F. Zhang, Y. Mei, S. Nguyen, and M. Zhang, “Survey on Genetic Programming and Machine Learning Techniques for Heuristic Design in Job Shop Scheduling,” IEEE Transactions on Evolutionary Computation, vol. 28, no. 1, pp. 147–167, 2024.
- S. Luke and L. Panait, “A comparison of bloat control methods for genetic programming,” Evolutionary Computation, vol. 14, no. 3, pp. 309–344, 2006.
- M. Xu, Y. Mei, F. Zhang, and M. Zhang, “Genetic programming and reinforcement learning on learning heuristics for dynamic scheduling: A preliminary comparison,” IEEE Computational Intelligence Magazine, vol. 19, no. 2, pp. 18–33, 2024.
- J. Park, J. Chun, S. H. Kim, Y. Kim, and J. Park, “Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learning,” International Journal of Production Research, vol. 59, no. 11, pp. 3360–3377, 2021.
- P. Tassel, M. Gebser, and K. Schekotihin, “A reinforcement learning environment for job-shop scheduling,” arXiv preprint arXiv:2104.03760, 2021.
- Y. Li, W. Gu, M. Yuan, and Y. Tang, “Real-time data-driven dynamic scheduling for flexible job shop with insufficient transportation resources using hybrid deep Q network,” Robotics and Computer-Integrated Manufacturing, vol. 74, p. 102283, 2022.
- R. Chen, W. Li, and H. Yang, “A deep reinforcement learning framework based on an attention mechanism and disjunctive graph embedding for the job-shop scheduling problem,” IEEE Transactions on Industrial Informatics, vol. 19, no. 2, pp. 1322–1331, 2023.
- C.-L. Liu, C.-J. Tseng, and P.-H. Weng, “Dynamic job-shop scheduling via graph attention networks and deep reinforcement learning,” IEEE Transactions on Industrial Informatics, vol. 20, no. 6, pp. 8662–8672, 2024.
- Y. Chang, X. Wang, J. Wang, Y. Wu, L. Yang, K. Zhu, H. Chen, X. Yi, C. Wang, Y. Wang, et al., “A survey on evaluation of large language models,” ACM Transactions on Intelligent Systems and Technology, vol. 15, no. 3, pp. 1–45, 2024.
- H. Ye, J. Wang, Z. Cao, and G. Song, “Reevo: Large language models as hyper-heuristics with reflective evolution,” arXiv preprint arXiv:2402.01145, 2024.
- B. Romera-Paredes, M. Barekatain, A. Novikov, M. Balog, M. P. Kumar, E. Dupont, F. J. R. Ruiz, J. S. Ellenberg, P. Wang, O. Fawzi, P. Kohli, and A. Fawzi, “Mathematical discoveries from program search with large language models,” Nature, vol. 625, no. 7995, pp. 468–475, 2024.
- J. Mohan, K. Lanka, and A. N. Rao, “A review of dynamic job shop scheduling techniques,” Procedia Manufacturing, vol. 30, pp. 34–39, 2019.
- C. Özgüven, L. Özbakır, and Y. Yavuz, “Mathematical models for job-shop scheduling problems with routing and process plan flexibility,” Applied Mathematical Modelling, vol. 34, no. 6, pp. 1539–1548, 2010.
- Y.-J. Yao, Q.-H. Liu, X.-Y. Li, and L. Gao, “A novel milp model for job shop scheduling problem with mobile robots,” Robotics and Computer-Integrated Manufacturing, vol. 81, p. 102506, 2023.
- J. A. S. Gromicho, J. J. van Hoorn, F. Saldanha-da-Gama, and G. T. Timmer, “Solving the job-shop scheduling problem optimally by dynamic programming,” Computers & Operations Research, vol. 39, no. 12, pp. 2968–2977, 2012.
- J. Xie, X. Li, L. Gao, and L. Gui, “A hybrid algorithm with a new neighborhood structure for job shop scheduling problems,” Computers & Industrial Engineering, vol. 169, p. 108205, 2022.
- N. Kundakcı and O. Kulak, “Hybrid genetic algorithms for minimizing makespan in dynamic job shop scheduling problem,” Computers & Industrial Engineering, vol. 96, pp. 31–51, 2016.
- L. Gao, X. Li, X. Wen, C. Lu, and F. Wen, “A hybrid algorithm based on a new neighborhood structure evaluation method for job shop scheduling problem,” Computers & Industrial Engineering, vol. 88, pp. 417–429, 2015.
- Z. Wang, J. Zhang, and S. Yang, “An improved particle swarm optimization algorithm for dynamic job shop scheduling problems with random job arrivals,” Swarm and Evolutionary Computation, vol. 51, p. 100594, 2019.
- L. Gao, G. Zhang, L. Zhang, and X. Li, “An efficient memetic algorithm for solving the job shop scheduling problem,” Computers & Industrial Engineering, vol. 60, no. 4, pp. 699–705, 2011.
- M. DHurasević and D. Jakobović, “A survey of dispatching rules for the dynamic unrelated machines environment,” Expert Systems with Applications, vol. 113, pp. 555–569, 2018.
- S. Nguyen, Y. Mei, B. Xue, and M. Zhang, “A hybrid genetic programming algorithm for automated design of dispatching rules,” Evolutionary Computation, vol. 27, no. 3, pp. 467–496, 2019.
- F. Zhang, Y. Mei, S. Nguyen, K. C. Tan, and M. Zhang, “Instance-rotation-based surrogate in genetic programming with brood recombination for dynamic job-shop scheduling,” IEEE Transactions on Evolutionary Computation, vol. 27, no. 5, pp. 1192–1206, 2023.
- Y. Mei, S. Nguyen, B. Xue, and M. Zhang, “An efficient feature selection algorithm for evolving job shop scheduling rules with genetic programming,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 1, no. 5, pp. 339–353, 2017.
- B. M. Kayhan and G. Yildiz, “Reinforcement learning applications to machine scheduling problems: A comprehensive literature review,” Journal of Intelligent Manufacturing, vol. 34, no. 3, pp. 905–929, 2023.
- X. Wu, X. Yan, D. Guan, and M. Wei, “A deep reinforcement learning model for dynamic job-shop scheduling problem with uncertain processing time,” Engineering Applications of Artificial Intelligence, vol. 131, p. 107790, 2024.
- X. Chen, M. Lin, N. Schärli, and D. Zhou, “Teaching large language models to self-debug,” arXiv preprint arXiv:2304.05128, 2023.
- A. Shypula, A. Madaan, Y. Zeng, U. Alon, J. Gardner, M. Hashemi, G. Neubig, P. Ranganathan, O. Bastani, and A. Yazdanbakhsh, “Learning performance-improving code edits,” arXiv preprint arXiv:2302.07867, 2023.
- J.-B. Mouret, “Large language models help computer programs to evolve,” Nature, vol. 625, no. 7995, pp. 452–453, 2024.
- Y. Li, D. Choi, J. Chung, N. Kushman, J. Schrittwieser, R. Leblond, T. Eccles, J. Keeling, F. Gimeno, A. D. Lago, T. Hubert, P. Choy, C. d. M. d’Autume, I. Babuschkin, X. Chen, P.-S. Huang, J. Welbl, S. Gowal, A. Cherepanov, J. Molloy, D. J. Mankowitz, E. S. Robson, P. Kohli, N. de Freitas, K. Kavukcuoglu, and O. Vinyals, “Competition-level code generation with AlphaCode,” Science, 2022.
- N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao, “Reflexion: Language agents with verbal reinforcement learning,” Advances in Neural Information Processing Systems, vol. 36, pp. 8634–8652, 2023.
- I. Shumailov, Z. Shumaylov, Y. Zhao, N. Papernot, R. Anderson, and Y. Gal, “Ai models collapse when trained on recursively generated data,” Nature, vol. 631, no. 8022, pp. 755–759, 2024.
- J. Liang, W. Huang, F. Xia, P. Xu, K. Hausman, B. Ichter, P. Florence, and A. Zeng, “Code as policies: Language model programs for embodied control,” in 2023 IEEE International Conference on Robotics and Automation (ICRA). London, United Kingdom: IEEE, 2023, pp. 9493–9500.
- Q. Guo, R. Wang, J. Guo, B. Li, K. Song, X. Tan, G. Liu, J. Bian, and Y. Yang, “Connecting large language models with evolutionary algorithms yields powerful prompt optimizers,” arXiv preprint arXiv:2309.08532, 2023.
- Y. J. Ma, W. Liang, G. Wang, D.-A. Huang, O. Bastani, D. Jayaraman, Y. Zhu, L. Fan, and A. Anandkumar, “Eureka: Human-level reward design via coding large language models,” arXiv preprint arXiv:2310.12931, 2023.
- F. Liu, X. Tong, M. Yuan, and Q. Zhang, “Algorithm evolution using large language model,” arXiv preprint arXiv:2311.15249, 2023.
- F. Liu, X. Tong, M. Yuan, X. Lin, F. Luo, Z. Wang, Z. Lu, and Q. Zhang, “An example of evolutionary computation + large language model beating human: Design of efficient guided local search,” arXiv.org, 2024.
- L. Nie, L. Gao, P. Li, and X. Shao, “Reactive scheduling in a job shop where jobs arrive over time,” Computers & Industrial Engineering, vol. 66, no. 2, pp. 389–405, 2013.
- F. Zhang, Y. Mei, and M. Zhang, “Genetic programming with multi-tree representation for dynamic flexible job shop scheduling,” in AI 2018: Advances in Artificial Intelligence, T. Mitrovic, B. Xue, and X. Li, Eds. Cham: Springer International Publishing, 2018, pp. 472–484.
- C. Zhang, W. Song, Z. Cao, J. Zhang, P. S. Tan, and X. Chi, “Learning to dispatch for job shop scheduling via deep reinforcement learning,” in Advances in Neural Information Processing Systems, vol. 33. Curran Associates, Inc., 2020, pp. 1621–1632.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.