Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On the Robustness of Lexicase Selection to Contradictory Objectives (2403.06805v1)

Published 11 Mar 2024 in cs.NE

Abstract: Lexicase and epsilon-lexicase selection are state of the art parent selection techniques for problems featuring multiple selection criteria. Originally, lexicase selection was developed for cases where these selection criteria are unlikely to be in conflict with each other, but preliminary work suggests it is also a highly effective many-objective optimization algorithm. However, to predict whether these results generalize, we must understand lexicase selection's performance on contradictory objectives. Prior work has shown mixed results on this question. Here, we develop theory identifying circumstances under which lexicase selection will succeed or fail to find a Pareto-optimal solution. To make this analysis tractable, we restrict our investigation to a theoretical problem with maximally contradictory objectives. Ultimately, we find that lexicase and epsilon-lexicase selection each have a region of parameter space where they are incapable of optimizing contradictory objectives. Outside of this region, however, they perform well despite the presence of contradictory objectives. Based on these findings, we propose theoretically-backed guidelines for parameter choice. Additionally, we identify other properties that may affect whether a many-objective optimization problem is a good fit for lexicase or epsilon-lexicase selection.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (21)
  1. Sneha Aenugu and Lee Spector. 2019. Lexicase Selection in Learning Classifier Systems. In Proceedings of the Genetic and Evolutionary Computation Conference (Prague, Czech Republic) (GECCO ’19). Association for Computing Machinery, New York, NY, USA, 356–364. https://doi.org/10.1145/3321707.3321828
  2. How the Combinatorics of Neutral Spaces leads GP to discover Simple Solutions. To appear in Genetric Programming Theory and Practice XX (2024).
  3. Robots That Can Adapt like Animals. Nature 521, 7553 (May 2015), 503–507. https://doi.org/10.1038/nature14422
  4. Li Ding and Lee Spector. 2022. Optimizing Neural Networks with Gradient Lexicase Selection. In International Conference on Learning Representations. https://openreview.net/forum?id=J_2xNmVcY4
  5. Emily Dolson. 2023. Calculating Lexicase Selection Probabilities Is NP-Hard. https://doi.org/10.48550/arXiv.2301.06724 arXiv:2301.06724 [cs]
  6. Emily Dolson and Alexander Lalejini. 2023. Reachability Analysis for Lexicase Selection via Community Assembly Graphs. arXiv:2309.10973 [cs.NE]
  7. Ecological Theory Provides Insights about Evolutionary Computation. PeerJ Preprints 6 (Nov. 2018), e27315v1. https://doi.org/10.7287/peerj.preprints.27315v1
  8. The Genotype-Phenotype Map of an Evolving Digital Organism. PLOS Computational Biology 13, 2 (Feb. 2017), e1005414. https://doi.org/10.1371/journal.pcbi.1005414
  9. Thomas Helmuth. 2015. General Program Synthesis from Examples Using Genetic Programming with Parent Selection Based on Random Lexicographic Orderings of Test Cases. Ph. D. Dissertation. University of Massachusetts Amherst. https://doi.org/10.7275/7408407.0
  10. Thomas Helmuth and Amr Abdelhady. 2020. Benchmarking Parent Selection for Program Synthesis by Genetic Programming. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion (Cancún, Mexico) (GECCO ’20). Association for Computing Machinery, New York, NY, USA, 237–238. https://doi.org/10.1145/3377929.3389987
  11. What Can Phylogenetic Metrics Tell us About Useful Diversity in Evolutionary Algorithms? Springer Nature Singapore, Singapore, 63–82. https://doi.org/10.1007/978-981-16-8113-4_4
  12. A Suite of Diagnostic Metrics for Characterizing Selection Schemes. https://doi.org/10.48550/arXiv.2204.13839 arXiv:2204.13839 [cs]
  13. A Probabilistic and Multi-Objective Analysis of Lexicase Selection and ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Selection. Evolutionary Computation 27, 3 (2019), 377–402. https://doi.org/10.1162/evco_a_00224
  14. William La Cava and Jason Moore. 2017. A General Feature Engineering Wrapper for Machine Learning Using ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Survival. In Genetic Programming, James McDermott, Mauro Castelli, Lukas Sekanina, Evert Haasdijk, and Pablo García-Sánchez (Eds.). Springer International Publishing, Cham, 80–95.
  15. William La Cava and Jason H. Moore. 2018. An analysis of ϵitalic-ϵ\epsilonitalic_ϵ-lexicase selection for large-scale many-objective optimization. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO ’18). Association for Computing Machinery, New York, NY, USA, 185–186. https://doi.org/10.1145/3205651.3205656
  16. Epsilon-Lexicase Selection for Regression. In Proceedings of the Genetic and Evolutionary Computation Conference 2016 (GECCO ’16). Association for Computing Machinery, New York, NY, USA, 741–748. https://doi.org/10.1145/2908812.2908898
  17. Shakiba Shahbandegan and Emily Dolson. 2023. Theoretical Limits on the Success of Lexicase Selection Under Contradictory Objectives. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO ’23 Companion). Association for Computing Machinery, New York, NY, USA, 827–830. https://doi.org/10.1145/3583133.3590714
  18. Untangling Phylogenetic Diversity’s Role in Evolutionary Computation Using a Suite of Diagnostic Fitness Landscapes. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO ’22). Association for Computing Machinery, New York, NY, USA, 2322–2325. https://doi.org/10.1145/3520304.3534028
  19. Lee Spector. 2012. Assessment of Problem Modality by Differential Performance of Lexicase Selection in Genetic Programming: A Preliminary Report. In Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation (Philadelphia, Pennsylvania, USA) (GECCO ’12). Association for Computing Machinery, New York, NY, USA, 401–408. https://doi.org/10.1145/2330784.2330846
  20. Adam Stanton and Jared M. Moore. 2022. Lexicase Selection for Multi-Task Evolutionary Robotics. Artificial Life 28, 4 (11 2022), 479–498. https://doi.org/10.1162/artl_a_00374 arXiv:https://direct.mit.edu/artl/article-pdf/28/4/479/2043352/artl_a_00374.pdf
  21. L. A. Zadeh. 1965. Fuzzy Sets. Information and Control 8, 3 (June 1965), 338–353. https://doi.org/10.1016/S0019-9958(65)90241-X
Citations (1)

Summary

We haven't generated a summary for this paper yet.