MToP: A MATLAB Optimization Platform for Evolutionary Multitasking (2312.08134v3)
Abstract: Evolutionary multitasking (EMT) has emerged as a popular topic of evolutionary computation over the past years. It aims to concurrently address multiple optimization tasks within limited computing resources, leveraging inter-task knowledge transfer techniques. Despite the abundance of multitask evolutionary algorithms (MTEAs) proposed for multitask optimization (MTO), there remains a comprehensive software platform to help researchers evaluate MTEA performance on benchmark MTO problems as well as explore real-world applications. To bridge this gap, we introduce the first open-source optimization platform, named MTO-Platform (MToP), for EMT. MToP incorporates over 40 MTEAs, more than 150 MTO problem cases with real-world applications, and over 20 performance metrics. Moreover, to facilitate comparative analyses between MTEAs and traditional evolutionary algorithms, we adapted over 40 popular single-task evolutionary algorithms to address MTO problems. MToP boasts a user-friendly graphical interface, facilitating results analysis, data export, and schematics visualization. More importantly, MToP is designed with extensibility in mind, allowing users to develop new algorithms and tackle emerging problem domains. The source code of MToP is available at https://github.com/intLyc/MTO-Platform.
- Y. Wang, J.-P. Li, X. Xue, and B.-C. Wang, “Utilizing the correlation between constraints and objective function for constrained evolutionary optimization,” IEEE Transactions on Evolutionary Computation, vol. 24, no. 1, pp. 29–43, 2020.
- Y. Tian, T. Zhang, J. Xiao, X. Zhang, and Y. Jin, “A coevolutionary framework for constrained multiobjective optimization problems,” IEEE Transactions on Evolutionary Computation, vol. 25, no. 1, pp. 102–116, 2021.
- Q. Zhang and H. Li, “Moea/d: A multiobjective evolutionary algorithm based on decomposition,” IEEE Transactions on Evolutionary Computation, vol. 11, no. 6, pp. 712–731, 2007.
- K. Deb and H. Jain, “An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part i: Solving problems with box constraints,” IEEE Transactions on Evolutionary Computation, vol. 18, no. 4, pp. 577–601, 2014.
- L. Feng, L. Zhou, A. Gupta, J. Zhong, Z. Zhu, K.-C. Tan, and K. Qin, “Solving generalized vehicle routing problem with occasional drivers via evolutionary multitasking,” IEEE Transactions on Cybernetics, vol. 51, no. 6, pp. 3171–3184, 2021.
- L. Feng, Y. Huang, L. Zhou, J. Zhong, A. Gupta, K. Tang, and K. C. Tan, “Explicit evolutionary multitasking for combinatorial optimization: A case study on capacitated vehicle routing problem,” IEEE Transactions on Cybernetics, vol. 51, no. 6, pp. 3143–3156, 2021.
- T. Wei, S. Wang, J. Zhong, D. Liu, and J. Zhang, “A review on evolutionary multi-task optimization: Trends and challenges,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 5, pp. 941–960, 2022.
- K. Chen, B. Xue, M. Zhang, and F. Zhou, “Evolutionary multitasking for feature selection in high-dimensional classification via particle swarm optimisation,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 3, pp. 446–460, 2022.
- C. Wang, K. Wu, and J. Liu, “Evolutionary multitasking auc optimization,” IEEE Computational Intelligence Magazine, vol. 17, no. 2, pp. 67–82, 2022.
- Y. Wu, H. Ding, M. Gong, A. K. Qin, W. Ma, Q. Miao, and K. C. Tan, “Evolutionary multiform optimization with two-stage bidirectional knowledge transfer strategy for point cloud registration,” IEEE Transactions on Evolutionary Computation, pp. 1–1, 2022.
- N. Zhang, A. Gupta, Z. Chen, and Y.-S. Ong, “Multitask neuroevolution for reinforcement learning with long and short episodes,” IEEE Transactions on Cognitive and Developmental Systems, pp. 1–1, 2022.
- Z. Tan, L. Luo, and J. Zhong, “Knowledge transfer in evolutionary multi-task optimization: A survey,” Applied Soft Computing, vol. 138, p. 110182, 2023.
- K. C. Tan, L. Feng, and M. Jiang, “Evolutionary transfer optimization - a new frontier in evolutionary computation research,” IEEE Computational Intelligence Magazine, vol. 16, no. 1, pp. 22–33, 2021.
- A. Gupta, Y.-S. Ong, and L. Feng, “Multifactorial evolution: Toward evolutionary multitasking,” IEEE Transactions on Evolutionary Computation, vol. 20, no. 3, pp. 343–357, 2016.
- K. K. Bali, Y.-S. Ong, A. Gupta, and P. S. Tan, “Multifactorial evolutionary algorithm with online transfer parameter estimation: Mfea-ii,” IEEE Transactions on Evolutionary Computation, vol. 24, no. 1, pp. 69–83, 2020.
- L. Zhou, L. Feng, K. C. Tan, J. Zhong, Z. Zhu, K. Liu, and C. Chen, “Toward adaptive knowledge transfer in multifactorial evolutionary computation,” IEEE Transactions on Cybernetics, vol. 51, no. 5, pp. 2563–2576, 2021.
- G. Li, Q. Lin, and W. Gao, “Multifactorial optimization via explicit multipopulation evolutionary framework,” Information Sciences, vol. 512, pp. 1555–1570, 2020.
- C. Wang, J. Liu, K. Wu, and Z. Wu, “Solving multi-task optimization problems with adaptive knowledge transfer via anomaly detection,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 304–318, 2022.
- L. Feng, L. Zhou, J. Zhong, A. Gupta, Y.-S. Ong, K.-C. Tan, and A. K. Qin, “Evolutionary multitasking via explicit autoencoding,” IEEE Transactions on Cybernetics, vol. 49, no. 9, pp. 3457–3470, 2019.
- L. Zhou, L. Feng, A. Gupta, and Y.-S. Ong, “Learnable evolutionary search across heterogeneous problems via kernelized autoencoding,” IEEE Transactions on Evolutionary Computation, vol. 25, no. 3, pp. 567–581, 2021.
- X. Xue, K. Zhang, K. C. Tan, L. Feng, J. Wang, G. Chen, X. Zhao, L. Zhang, and J. Yao, “Affine transformation-enhanced multifactorial optimization for heterogeneous problems,” IEEE Transactions on Cybernetics, vol. 52, no. 7, pp. 6217–6231, 2022.
- W. Lin, Q. Lin, L. Feng, and K. C. Tan, “Ensemble of domain adaptation-based knowledge transfer for evolutionary multitasking,” IEEE Transactions on Evolutionary Computation, pp. 1–1, 2023.
- Z. Liang, Y. Zhu, X. Wang, Z. Li, and Z. Zhu, “Evolutionary multitasking for optimization based on generative strategies,” IEEE Transactions on Evolutionary Computation, vol. 27, no. 4, pp. 1042–1056, 2023.
- Y. Jiang, Z.-H. Zhan, K. C. Tan, and J. Zhang, “A bi-objective knowledge transfer framework for evolutionary many-task optimization,” IEEE Transactions on Evolutionary Computation, pp. 1–1, 2022.
- Z. Liang, X. Xu, L. Liu, Y. Tu, and Z. Zhu, “Evolutionary many-task optimization based on multi-source knowledge transfer,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 319–333, 2022.
- G. Li, Q. Zhang, and Z. Wang, “Evolutionary competitive multitasking optimization,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 278–289, 2022.
- J. Lin, H.-L. Liu, K. C. Tan, and F. Gu, “An effective knowledge transfer approach for multiobjective multitasking optimization,” IEEE Transactions on Cybernetics, vol. 51, no. 6, pp. 3238–3248, 2021.
- Y. Tian, R. Cheng, X. Zhang, and Y. Jin, “Platemo: A matlab platform for evolutionary multi-objective optimization [educational forum],” IEEE Computational Intelligence Magazine, vol. 12, no. 4, pp. 73–87, 2017.
- B. Huang, R. Cheng, Z. Li, Y. Jin, and K. C. Tan, “EvoX: A Distributed GPU-accelerated Framework for Scalable Evolutionary Computation,” arXiv preprint arXiv:2301.12457, 2023.
- Y. Chen, J. Zhong, L. Feng, and J. Zhang, “An adaptive archive-based evolutionary framework for many-task optimization,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 4, no. 3, pp. 369–384, 2020.
- R.-T. Liaw and C.-K. Ting, “Evolutionary manytasking optimization based on symbiosis in biocoenosis,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 4295–4303, Jul. 2019.
- A. Gupta, Y.-S. Ong, L. Feng, and K. C. Tan, “Multiobjective multifactorial optimization in evolutionary multitasking,” IEEE Transactions on Cybernetics, vol. 47, no. 7, pp. 1652–1665, 2017.
- Z. Liang, W. Liang, Z. Wang, X. Ma, L. Liu, and Z. Zhu, “Multiobjective evolutionary multitasking with two-stage adaptive knowledge transfer based on population distribution,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 52, no. 7, pp. 4457–4469, 2022.
- Y. Li, W. Gong, and S. Li, “Evolutionary competitive multitasking optimization via improved adaptive differential evolution,” Expert Systems with Applications, vol. 217, p. 119550, 2023.
- ——, “Evolutionary constrained multi-task optimization: Benchmark problems and preliminary results,” in Proceedings of the Genetic and Evolutionary Computation Conference Companion, ser. GECCO ’22. New York, NY, USA: Association for Computing Machinery, 2022, p. 443–446.
- K. K. Bali, A. Gupta, L. Feng, Y. S. Ong, and T. P. Siew, “Linearized domain adaptation in evolutionary multitasking,” in 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, pp. 1295–1302.
- L. Feng, W. Zhou, L. Zhou, S. W. Jiang, J. H. Zhong, B. S. Da, Z. X. Zhu, and Y. Wang, “An empirical study of multifactorial pso and multifactorial de,” in 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, pp. 921–928.
- R. Hashimoto, H. Ishibuchi, N. Masuyama, and Y. Nojima, “Analysis of evolutionary multi-tasking as an island model,” in Proceedings of the Genetic and Evolutionary Computation Conference Companion, ser. GECCO ’18. New York, NY, USA: Association for Computing Machinery, 2018, p. 1894–1897.
- J. Ding, C. Yang, Y. Jin, and T. Chai, “Generalized multi-tasking for evolutionary optimization of expensive problems,” IEEE Transactions on Evolutionary Computation, vol. 23, no. 1, pp. 44–58, 2019.
- Z. Liang, J. Zhang, L. Feng, and Z. Zhu, “A hybrid of genetic transform and hyper-rectangle search strategies for evolutionary multi-tasking,” Expert Systems with Applications, vol. 138, 2019.
- J. Yin, A. Zhu, Z. Zhu, Y. Yu, and X. Ma, “Multifactorial evolutionary algorithm enhanced with cross-task search direction,” IEEE Congress on Evolutionary Computation, pp. 2244–2251, 2019.
- X. Zheng, A. K. Qin, M. Gong, and D. Zhou, “Self-regulated evolutionary multitask optimization,” IEEE Transactions on Evolutionary Computation, vol. 24, no. 1, pp. 16–28, 2020.
- X. Ma, Q. Chen, Y. Yu, Y. Sun, L. Ma, and Z. Zhu, “A two-level transfer learning algorithm for evolutionary multitasking,” Frontiers in neuroscience, vol. 13, p. 1408, 2020.
- Z. Liu, G. Li, H. Zhang, Z. Liang, and Z. Zhu, “Multifactorial evolutionary algorithm based on diffusion gradient descent,” IEEE Transactions on Cybernetics, pp. 1–13, 2023.
- L. Bai, W. Lin, A. Gupta, and Y.-S. Ong, “From multitask gradient descent to gradient-free evolutionary multitasking: A proof of faster convergence,” IEEE Transactions on Cybernetics, vol. 52, no. 8, pp. 8561–8573, 2022.
- Y. Li, W. Gong, and S. Li, “Multitask evolution strategy with knowledge-guided external sampling,” IEEE Transactions on Evolutionary Computation, pp. 1–1, 2023.
- Y. Jiang, Z.-H. Zhan, K. C. Tan, and J. Zhang, “Block-level knowledge transfer for evolutionary multitask optimization,” IEEE Transactions on Cybernetics, pp. 1–14, 2023.
- Y. Li, W. Gong, and S. Li, “Multitasking optimization via an adaptive solver multitasking evolutionary framework,” Information Sciences, vol. 630, pp. 688–712, 2023.
- Y. Chen, J. Zhong, and M. Tan, “A fast memetic multi-objective differential evolution for multi-tasking optimization,” in 2018 IEEE Congress on Evolutionary Computation (CEC), 2018, pp. 1–8.
- B. Da, A. Gupta, and Y.-S. Ong, “Curbing negative influences online for seamless transfer evolutionary optimization,” IEEE Transactions on Cybernetics, vol. 49, no. 12, pp. 4365–4378, 2019.
- K. K. Bali, A. Gupta, Y.-S. Ong, and P. S. Tan, “Cognizant multitasking in multiobjective multifactorial evolution: Mo-mfea-ii,” IEEE Transactions on Cybernetics, vol. 51, no. 4, pp. 1784–1796, 2021.
- Z. Liang, H. Dong, C. Liu, W. Liang, and Z. Zhu, “Evolutionary multitasking for multiobjective optimization with subspace alignment and adaptive differential evolution,” IEEE Transactions on Cybernetics, vol. 52, no. 4, pp. 2096–2109, 2022.
- X. Wang, Z. Dong, L. Tang, and Q. Zhang, “Multiobjective multitask optimization - neighborhood as a bridge for knowledge transfer,” IEEE Transactions on Evolutionary Computation, vol. 27, no. 1, pp. 155–169, 2023.
- J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of ICNN’95 - International Conference on Neural Networks, vol. 4, 1995, pp. 1942–1948 vol.4.
- N. Hansen and A. Ostermeier, “Completely derandomized self-adaptation in evolution strategies,” Evolutionary Computation, vol. 9, no. 2, pp. 159–195, 2001.
- J. Brest, S. Greiner, B. Boskovic, M. Mernik, and V. Zumer, “Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems,” IEEE Transactions on Evolutionary Computation, vol. 10, no. 6, pp. 646–657, 2006.
- E. Mezura-Montes, C. A. C. Coello, J. Velázquez-Reyes, and L. Muñoz-Dávila, “Multiple trial vectors in differential evolution for engineering design,” Engineering Optimization, vol. 39, no. 5, pp. 567–589, 2007.
- J. Zhang and A. C. Sanderson, “Jade: Adaptive differential evolution with optional external archive,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 5, pp. 945–958, 2009.
- R. Mallipeddi and P. N. Suganthan, “Ensemble of constraint handling techniques,” IEEE Transactions on Evolutionary Computation, vol. 14, no. 4, pp. 561–579, 2010.
- T. Schaul, “Benchmarking natural evolution strategies with adaptation sampling on the noiseless and noisy black-box optimization testbeds,” in Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation, ser. GECCO ’12. New York, NY, USA: Association for Computing Machinery, 2012, p. 229–236. [Online]. Available: https://doi.org/10.1145/2330784.2330818
- W. Gong and Z. Cai, “Differential evolution with ranking-based mutation operators,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 2066–2081, 2013.
- R. Tanabe and A. Fukunaga, “Success-history based parameter adaptation for differential evolution,” in 2013 IEEE Congress on Evolutionary Computation, 2013, pp. 71–78.
- Y. Sun, T. Schaul, F. Gomez, and J. Schmidhuber, “A linear time natural evolution strategy for non-separable functions,” in Proceedings of the 15th Annual Conference Companion on Genetic and Evolutionary Computation, ser. GECCO ’13 Companion. New York, NY, USA: Association for Computing Machinery, 2013, p. 61–62. [Online]. Available: https://doi.org/10.1145/2464576.2464608
- D. Wierstra, T. Schaul, T. Glasmachers, Y. Sun, J. Peters, and J. Schmidhuber, “Natural evolution strategies,” Journal of Machine Learning Research, vol. 15, no. 27, pp. 949–980, 2014.
- R. Tanabe and A. S. Fukunaga, “Improving the search performance of shade using linear population size reduction,” in 2014 IEEE Congress on Evolutionary Computation (CEC), 2014, pp. 1658–1665.
- R. Cheng and Y. Jin, “A competitive swarm optimizer for large scale optimization,” IEEE Transactions on Cybernetics, vol. 45, no. 2, pp. 191–204, 2015.
- Y. Wang, B.-C. Wang, H.-X. Li, and G. G. Yen, “Incorporating objective function information into the feasibility rule for constrained evolutionary optimization,” IEEE Transactions on Cybernetics, vol. 46, no. 12, pp. 2938–2952, 2016.
- J. Brest, M. S. Maučec, and B. Bošković, “Single objective real-parameter optimization: Algorithm jso,” in 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, pp. 1311–1318.
- R. Poláková, “L-shade with competing strategies applied to constrained optimization,” in 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, pp. 1683–1689.
- A. Zamuda, “Adaptive constraint handling and success history differential evolution for cec 2017 constrained real-parameter optimization,” in 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, pp. 2443–2450.
- T. Salimans, J. Ho, X. Chen, S. Sidor, and I. Sutskever, “Evolution strategies as a scalable alternative to reinforcement learning,” 2017.
- B.-C. Wang, H.-X. Li, J.-P. Li, and Y. Wang, “Composite differential evolution for constrained evolutionary optimization,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 49, no. 7, pp. 1482–1495, 2019.
- J. Arabas and D. Jagodziński, “Toward a matrix-free covariance matrix adaptation evolution strategy,” IEEE Transactions on Evolutionary Computation, vol. 24, no. 1, pp. 84–98, 2020.
- A. Faramarzi, M. Heidarinejad, S. Mirjalili, and A. H. Gandomi, “Marine predators algorithm: A nature-inspired metaheuristic,” Expert Systems with Applications, vol. 152, p. 113377, 2020.
- A. Faramarzi, M. Heidarinejad, B. Stephens, and S. Mirjalili, “Equilibrium optimizer: A novel optimization algorithm,” Knowledge-Based Systems, vol. 191, p. 105190, 2020.
- V. Stanovov, S. Akhmedova, and E. Semenkin, “Nl-shade-rsp algorithm with adaptive archive and selective pressure for cec 2021 numerical optimization,” in 2021 IEEE Congress on Evolutionary Computation (CEC), 2021, pp. 809–816.
- L. Abualigah, D. Yousri, M. Abd Elaziz, A. A. Ewees, M. A. Al-qaness, and A. H. Gandomi, “Aquila optimizer: A novel meta-heuristic optimization algorithm,” Computers and Industrial Engineering, vol. 157, p. 107250, 2021.
- B.-C. Wang, H.-X. Li, Q. Zhang, and Y. Wang, “Decomposition-based multiobjective optimization for constrained evolutionary optimization,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 1, pp. 574–587, 2021.
- G. Wu, X. Wen, L. Wang, W. Pedrycz, and P. N. Suganthan, “A voting-mechanism-based ensemble framework for constraint handling techniques,” IEEE Transactions on Evolutionary Computation, vol. 26, no. 4, pp. 646–660, 2022.
- Z. Hu, W. Gong, W. Pedrycz, and Y. Li, “Deep reinforcement learning assisted co-evolutionary differential evolution for constrained optimization,” Swarm and Evolutionary Computation, vol. 83, p. 101387, 2023.
- E. Zitzler, M. Laumanns, and L. Thiele, “Spea2: Improving the strength pareto evolutionary algorithm for multiobjective optimization,” in Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems. Proceedings of the EUROGEN’2001. Athens. Greece, September 19-21, 2001.
- K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: Nsga-ii,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182–197, 2002.
- C. Igel, N. Hansen, and S. Roth, “Covariance matrix adaptation for multi-objective optimization,” Evolutionary Computation, vol. 15, no. 1, pp. 1–28, 2007.
- H. Li and Q. Zhang, “Multiobjective optimization problems with complicated pareto sets, moea/d and nsga-ii,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 2, pp. 284–302, 2009.
- Y. Tian, X. Zheng, X. Zhang, and Y. Jin, “Efficient large-scale multiobjective optimization based on a competitive swarm optimizer,” IEEE Transactions on Cybernetics, vol. 50, no. 8, pp. 3696–3708, 2020.
- F. Ming, W. Gong, D. Li, L. Wang, and L. Gao, “A competitive and cooperative swarm optimizer for constrained multi-objective optimization problems,” IEEE Transactions on Evolutionary Computation, pp. 1–1, 2022.
- B. Da, Y.-S. Ong, L. Feng, A. K. Qin, A. Gupta, Z. Zhu, C.-K. Ting, K. Tang, and X. Yao, “Evolutionary multitasking for single-objective continuous optimization: Benchmark problems, performance metric, and baseline results,” arXiv preprint arXiv:1706.03470, 2017.
- L. Feng, K. Qin, A. Gupta, Y. Yuan, Y.-S. Ong, and X. Chi, “Cec2019 competition on evolutionary multi-task optimization,” 2019 IEEE Congress on Evolutionary Computation (CEC), 2019. [Online]. Available: http://www.bdsc.site/websites/MTO_competiton_2019/MTO_Competition_CEC_2019.html
- ——, “Wcci2020 competition on evolutionary multi-task optimization,” 2020 IEEE World Congress on Computational Intelligence (WCCI), 2020. [Online]. Available: http://www.bdsc.site/websites/MTO_competition_2020/MTO_Competition_WCCI_2020.html
- Y. Yuan, Y.-S. Ong, L. Feng, A. K. Qin, A. Gupta, B. Da, Q. Zhang, K. C. Tan, Y. Jin, and H. Ishibuchi, “Evolutionary multitasking for multiobjective continuous optimization: Benchmark problems, performance metrics and baseline results,” arXiv preprint arXiv:1706.02766, 2017.
- L. Feng, K. Qin, A. Gupta, Y. Yuan, E. Scott, Y.-S. Ong, and X. Chi, “Cec2021 competition on evolutionary multi-task optimization,” 2021 IEEE Congress on Evolutionary Computation (CEC), 2021. [Online]. Available: http://www.bdsc.site/websites/MTO_competition_2021/MTO_Competition_CEC_2021.html