Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Temporal True and Surrogate Fitness Landscape Analysis for Expensive Bi-Objective Optimisation (2404.06557v1)

Published 9 Apr 2024 in cs.NE

Abstract: Many real-world problems have expensive-to-compute fitness functions and are multi-objective in nature. Surrogate-assisted evolutionary algorithms are often used to tackle such problems. Despite this, literature about analysing the fitness landscapes induced by surrogate models is limited, and even non-existent for multi-objective problems. This study addresses this critical gap by comparing landscapes of the true fitness function with those of surrogate models for multi-objective functions. Moreover, it does so temporally by examining landscape features at different points in time during optimisation, in the vicinity of the population at that point in time. We consider the BBOB bi-objective benchmark functions in our experiments. The results of the fitness landscape analysis reveals significant differences between true and surrogate features at different time points during optimisation. Despite these differences, the true and surrogate landscape features still show high correlations between each other. Furthermore, this study identifies which landscape features are related to search and demonstrates that both surrogate and true landscape features are capable of predicting algorithm performance. These findings indicate that temporal analysis of the landscape features may help to facilitate the design of surrogate switching approaches to improve performance in multi-objective optimisation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Local optima networks for continuous fitness landscapes. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. 1407–1414.
  2. Dynamic landscape analysis for constrained multi-objective pptimization problems. In Australasian Joint Conference on Artificial Intelligence. Springer, 429–441.
  3. Online selection of surrogate models for constrained black-box optimization. In 2016 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1–8.
  4. Algorithm selection based on exploratory landscape analysis and cost-sensitive learning. In Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation. 313–320.
  5. Using well-understood single-objective functions in multi-objective black-box optimization test suites. Evolutionary Computation 30, 2 (2022), 165–193.
  6. DynamoRep: Trajectory-based population dynamics for classification of black-box optimization problems. arXiv preprint arXiv:2306.05438 (2023).
  7. A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Transactions on Evolutionary Computation 20, 5 (2016), 773–791.
  8. A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Transactions on Evolutionary Computation 22, 1 (2016), 129–142.
  9. Simulated binary crossover for continuous search space. Complex Systems 9, 2 (1995), 115–148.
  10. A combined genetic adaptive search (GeneAS) for engineering design. Computer Science and Informatics 26 (1996), 30–45.
  11. Kalyanmoy Deb and Himanshu Jain. 2013. An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Transactions on Evolutionary Computation 18, 4 (2013), 577–601.
  12. Leonardo Ramos Emmendorfer and Graçaliz Pereira Dimuro. 2020. A novel formulation for inverse distance weighting from weighted linear regression. In International Conference on Computational Science. Springer, 576–589.
  13. Evolutionary optimization of high-dimensional multiobjective and many-objective expensive problems assisted by a dropout neural network. IEEE Transactions on Systems, Man, and Cybernetics: Systems 52, 4 (2021), 2084–2097.
  14. COCO: A Platform for comparing continuous optimizers in a black-box setting. Optimization Methods and Software 36 (2021), 114–144. Issue 1. https://doi.org/10.1080/10556788.2020.1808977
  15. Regression modelling strategies for improved prognostic prediction. Statistics in Medicine 3, 2 (1984), 143–152.
  16. Kyle Robert Harrison. 2023. Surrogate-assisted analysis of the parameter configuration landscape for meta-heuristic optimisation. Applied Soft Computing 146 (2023). https://doi.org/10.1016/j.asoc.2023.110705
  17. A review of surrogate-assisted evolutionary algorithms for expensive optimization problems. Expert Systems with Applications (2023). https://doi.org/10.1016/j.eswa.2022.119495
  18. Continuous fitness landscape analysis using a chaos-based random walk algorithm. Soft Computing 22 (2018), 921–948.
  19. Anja Janković and Carola Doerr. 2019. Adaptive landscape analysis. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. 2032–2035.
  20. Towards feature-based performance regression using trajectory data. In Applications of Evolutionary Computation: 24th International Conference, EvoApplications 2021, Held as Part of EvoStar 2021, Virtual Event, April 7–9, 2021, Proceedings 24. Springer, 601–617.
  21. Trajectory-based algorithm selection with warm-starting. In 2022 IEEE Congress on Evolutionary Computation (CEC). IEEE, 1–8.
  22. Per-run algorithm selection with warm-starting using trajectory-based features. In International Conference on Parallel Problem Solving from Nature. Springer, 46–60.
  23. Ryan Lang and Andries Engelbrecht. 2019. On the robustness of random walks for fitness landscape analysis. In 2019 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1898–1906.
  24. Ryan Dieter Lang and Andries Petrus Engelbrecht. 2020. Distributed random walks for fitness landscape analysis. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference. 612–619.
  25. Evolution by adapting surrogates. Evolutionary Computation 21, 2 (2013), 313–340.
  26. Jin Li and Andrew D Heap. 2011. A review of comparative studies of spatial interpolation methods in environmental sciences: Performance and impact factors. Ecological Informatics 6, 3-4 (2011), 228–241.
  27. Evolutionary computation for expensive optimization: A survey. Machine Intelligence Research 19, 1 (2022), 3–23.
  28. On Pareto local optimal solutions networks. In Parallel Problem Solving from Nature–PPSN XV: 15th International Conference, Coimbra, Portugal, September 8–12, 2018, Proceedings, Part II 15. Springer, 232–244.
  29. Landscape features and automated algorithm selection for multi-objective interpolated continuous optimisation problems. In Proceedings of the Genetic and Evolutionary Computation Conference. 421–429.
  30. Katherine Malan and Andries Engelbrecht. 2013. A survey of techniques for characterising fitness landscapes and some possible ways forward. Information Sciences 241 (2013), 148–163.
  31. Exploratory landscape analysis. In Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation. 829–836.
  32. Exploratory landscape analysis of continuous space optimization problems using information content. IEEE Transactions on Evolutionary Computation 19, 1 (2014), 74–87.
  33. Landscape analysis for surrogate models in the evolutionary black-box context. arXiv preprint arXiv:2203.11315 (2022).
  34. Landscape analysis of Gaussian process surrogates for the covariance matrix adaptation evolution strategy. In Proceedings of the Genetic and Evolutionary Computation Conference. 691–699.
  35. Visualizing time-dependent data using dynamic t-SNE. (2016).
  36. Donald Shepard. 1968. A two-dimensional interpolation function for irregularly-spaced data. In Proceedings of the 1968 23rd ACM National Conference. 517–524.
  37. PlatEMO: A MATLAB platform for evolutionary multi-objective optimization. IEEE Computational Intelligence Magazine 12, 4 (2017), 73–87.
  38. Marco Tomassini. 2022. A Local optima network view of real function fitness landscapes. Entropy 24, 5 (2022), 703.
  39. Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).
  40. To switch or not to switch: Predicting the benefit of switching between algorithms based on trajectory features. In International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Springer, 335–350.
  41. Surrogate-assisted fitness landscape analysis for computationally expensive optimization. In Computer Aided Systems Theory–EUROCAST 2019: 17th International Conference, Las Palmas de Gran Canaria, Spain, February 17–22, 2019, Revised Selected Papers, Part I 17. Springer, 247–254.
  42. Expensive multiobjective optimization by MOEA/D with Gaussian process model. IEEE Transactions on Evolutionary Computation 14, 3 (2009), 456–474.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. C. J. Rodriguez (1 paper)
  2. S. L. Thomson (2 papers)
  3. T. Alderliesten (11 papers)
  4. P. A. N. Bosman (12 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets