2000 character limit reached
RLEMMO: Evolutionary Multimodal Optimization Assisted By Deep Reinforcement Learning (2404.08242v1)
Published 12 Apr 2024 in cs.NE and cs.AI
Abstract: Solving multimodal optimization problems (MMOP) requires finding all optimal solutions, which is challenging in limited function evaluations. Although existing works strike the balance of exploration and exploitation through hand-crafted adaptive strategies, they require certain expert knowledge, hence inflexible to deal with MMOP with different properties. In this paper, we propose RLEMMO, a Meta-Black-Box Optimization framework, which maintains a population of solutions and incorporates a reinforcement learning agent for flexibly adjusting individual-level searching strategies to match the up-to-date optimization status, hence boosting the search performance on MMOP. Concretely, we encode landscape properties and evolution path information into each individual and then leverage attention networks to advance population information sharing. With a novel reward mechanism that encourages both quality and diversity, RLEMMO can be effectively trained using a policy gradient algorithm. The experimental results on the CEC2013 MMOP benchmark underscore the competitive optimization performance of RLEMMO against several strong baselines.
- Sunith Bandaru and Kalyanmoy Deb. 2013. A parameterless-niching-assisted bi-objective approach to multimodal optimization. In 2013 IEEE congress on evolutionary computation.
- SYMBOL: Generating Flexible Black-Box Optimizers through Symbolic Equation Learning. In The Twelfth International Conference on Learning Representations.
- Learning to learn without gradient descent by gradient descent. In International Conference on Machine Learning.
- Evolutionary multiobjective optimization-based multimodal optimization: Fitness landscape approximation and peak detection. IEEE Transactions on Evolutionary Computation (2017).
- Thomas Cover and Peter Hart. 1967. Nearest neighbor pattern classification. IEEE transactions on information theory (1967).
- Kalyanmoy Deb and Surendra Gulati. 2001. Design of truss-structures for minimum weight using genetic algorithms. Finite elements in analysis and design (2001).
- Kalyanmoy Deb and Amit Saha. 2012. Multimodal optimization using a bi-objective evolutionary algorithm. Evolutionary computation (2012).
- A dynamic archive niching differential evolution algorithm for multimodal optimization. In 2013 IEEE Congress on Evolutionary Computation.
- A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd.
- Genetic algorithms with sharing for multimodal function optimization. In Genetic algorithms and their applications: Proceedings of the Second International Conference on Genetic Algorithms.
- Meta learning black-box population-based optimizers. arXiv preprint arXiv:2103.03526 (2021).
- Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution. arXiv preprint arXiv:2403.02131 (2024).
- A probabilistic niching evolutionary computation framework based on binary space partitioning. IEEE transactions on cybernetics (2020).
- Discovering attention-based genetic algorithms via meta-black-box optimization. In Proceedings of the Genetic and Evolutionary Computation Conference.
- Discovering evolution strategies via meta-black-box optimization. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation.
- A species conserving genetic algorithm for multimodal function optimization. Evolutionary computation (2002).
- Xiaodong Li. 2009. Niching without niching parameters: particle swarm optimization using a ring topology. IEEE Transactions on Evolutionary Computation (2009).
- Benchmark functions for CEC’2013 special session and competition on niching methods for multimodal function optimization. RMIT University, Evolutionary Computation and Machine Learning Group, Australia, Tech. Rep (2013).
- History archive assisted niching differential evolution with variable neighborhood for multimodal optimization. Swarm and Evolutionary Computation (2023).
- Guan-Chun Luh and Chun-Yi Lin. 2011. Optimal design of truss-structures using particle swarm optimization. Computers & structures (2011).
- Hybridizing niching, particle swarm optimization, and evolution strategy for multimodal optimization. IEEE Transactions on Cybernetics (2020).
- MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learning. In Advances in Neural Information Processing Systems.
- Exploratory landscape analysis. In Proceedings of the 13th annual conference on Genetic and evolutionary computation.
- Human-level control through deep reinforcement learning. nature (2015).
- Analysis of new niching genetic algorithms for finding multiple solutions in the job shop scheduling. Journal of Intelligent manufacturing (2012).
- Erik Pitzer and Michael Affenzeller. 2012. A comprehensive survey on fitness landscape analysis. Recent advances in intelligent engineering systems (2012).
- A distance-based locally informed particle swarm model for multimodal optimization. IEEE Transactions on Evolutionary Computation (2012).
- Trust region policy optimization. In International conference on machine learning.
- Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).
- Deep reinforcement learning based parameter control in differential evolution. In Proceedings of the Genetic and Evolutionary Computation Conference.
- Yuhui Shi. 2004. Particle swarm optimization. IEEE connections (2004).
- Rainer Storn and Kenneth Price. 1997. Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization (1997).
- Learning adaptive differential evolution algorithm from optimization experiences by policy gradient. IEEE Transactions on Evolutionary Computation (2021).
- Richard S Sutton and Andrew G Barto. 1999. Reinforcement learning: An introduction. Robotica (1999).
- Zhiping Tan and Kangshun Li. 2021. Differential evolution with mixed mutation strategy based on deep reinforcement learning. Applied Soft Computing (2021).
- Rene Thomsen. 2004. Multimodal optimization using crowding-based differential evolution. In Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No. 04TH8753).
- Meta-learning for black-box optimization. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases.
- Attention is all you need. Advances in neural information processing systems (2017).
- MOMMOP: Multiobjective optimization for locating multiple optimal solutions of multimodal optimization problems. IEEE transactions on cybernetics (2014).
- Adaptive estimation distribution distributed differential evolution for multimodal optimization problems. IEEE transactions on cybernetics (2020).
- Ronald J Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning (1992).
- Di Wu and G Gary Wang. 2022. Employing reinforcement learning to enhance particle swarm optimization methods. Engineering Optimization (2022).
- A reinforcement-learning-based evolutionary algorithm using solution space clustering for multimodal optimization problems. In 2021 IEEE Congress on Evolutionary Computation (CEC).
- A novel multimodal optimization algorithm for the design of electromagnetic machines. IEEE Transactions on Magnetics (2015).
- Proximity ranking-based multimodal differential evolution. Swarm and Evolutionary Computation (2023).
- Parameter-free voronoi neighborhood for evolutionary multimodal optimization. IEEE Transactions on Evolutionary Computation (2019).
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
