On the Robustness of Lexicase Selection to Contradictory Objectives (2403.06805v1)
Abstract: Lexicase and epsilon-lexicase selection are state of the art parent selection techniques for problems featuring multiple selection criteria. Originally, lexicase selection was developed for cases where these selection criteria are unlikely to be in conflict with each other, but preliminary work suggests it is also a highly effective many-objective optimization algorithm. However, to predict whether these results generalize, we must understand lexicase selection's performance on contradictory objectives. Prior work has shown mixed results on this question. Here, we develop theory identifying circumstances under which lexicase selection will succeed or fail to find a Pareto-optimal solution. To make this analysis tractable, we restrict our investigation to a theoretical problem with maximally contradictory objectives. Ultimately, we find that lexicase and epsilon-lexicase selection each have a region of parameter space where they are incapable of optimizing contradictory objectives. Outside of this region, however, they perform well despite the presence of contradictory objectives. Based on these findings, we propose theoretically-backed guidelines for parameter choice. Additionally, we identify other properties that may affect whether a many-objective optimization problem is a good fit for lexicase or epsilon-lexicase selection.
- Sneha Aenugu and Lee Spector. 2019. Lexicase Selection in Learning Classifier Systems. In Proceedings of the Genetic and Evolutionary Computation Conference (Prague, Czech Republic) (GECCO ’19). Association for Computing Machinery, New York, NY, USA, 356–364. https://doi.org/10.1145/3321707.3321828
- How the Combinatorics of Neutral Spaces leads GP to discover Simple Solutions. To appear in Genetric Programming Theory and Practice XX (2024).
- Robots That Can Adapt like Animals. Nature 521, 7553 (May 2015), 503–507. https://doi.org/10.1038/nature14422
- Li Ding and Lee Spector. 2022. Optimizing Neural Networks with Gradient Lexicase Selection. In International Conference on Learning Representations. https://openreview.net/forum?id=J_2xNmVcY4
- Emily Dolson. 2023. Calculating Lexicase Selection Probabilities Is NP-Hard. https://doi.org/10.48550/arXiv.2301.06724 arXiv:2301.06724 [cs]
- Emily Dolson and Alexander Lalejini. 2023. Reachability Analysis for Lexicase Selection via Community Assembly Graphs. arXiv:2309.10973 [cs.NE]
- Ecological Theory Provides Insights about Evolutionary Computation. PeerJ Preprints 6 (Nov. 2018), e27315v1. https://doi.org/10.7287/peerj.preprints.27315v1
- The Genotype-Phenotype Map of an Evolving Digital Organism. PLOS Computational Biology 13, 2 (Feb. 2017), e1005414. https://doi.org/10.1371/journal.pcbi.1005414
- Thomas Helmuth. 2015. General Program Synthesis from Examples Using Genetic Programming with Parent Selection Based on Random Lexicographic Orderings of Test Cases. Ph. D. Dissertation. University of Massachusetts Amherst. https://doi.org/10.7275/7408407.0
- Thomas Helmuth and Amr Abdelhady. 2020. Benchmarking Parent Selection for Program Synthesis by Genetic Programming. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion (Cancún, Mexico) (GECCO ’20). Association for Computing Machinery, New York, NY, USA, 237–238. https://doi.org/10.1145/3377929.3389987
- What Can Phylogenetic Metrics Tell us About Useful Diversity in Evolutionary Algorithms? Springer Nature Singapore, Singapore, 63–82. https://doi.org/10.1007/978-981-16-8113-4_4
- A Suite of Diagnostic Metrics for Characterizing Selection Schemes. https://doi.org/10.48550/arXiv.2204.13839 arXiv:2204.13839 [cs]
- A Probabilistic and Multi-Objective Analysis of Lexicase Selection and ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Selection. Evolutionary Computation 27, 3 (2019), 377–402. https://doi.org/10.1162/evco_a_00224
- William La Cava and Jason Moore. 2017. A General Feature Engineering Wrapper for Machine Learning Using ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Survival. In Genetic Programming, James McDermott, Mauro Castelli, Lukas Sekanina, Evert Haasdijk, and Pablo García-Sánchez (Eds.). Springer International Publishing, Cham, 80–95.
- William La Cava and Jason H. Moore. 2018. An analysis of ϵitalic-ϵ\epsilonitalic_ϵ-lexicase selection for large-scale many-objective optimization. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO ’18). Association for Computing Machinery, New York, NY, USA, 185–186. https://doi.org/10.1145/3205651.3205656
- Epsilon-Lexicase Selection for Regression. In Proceedings of the Genetic and Evolutionary Computation Conference 2016 (GECCO ’16). Association for Computing Machinery, New York, NY, USA, 741–748. https://doi.org/10.1145/2908812.2908898
- Shakiba Shahbandegan and Emily Dolson. 2023. Theoretical Limits on the Success of Lexicase Selection Under Contradictory Objectives. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO ’23 Companion). Association for Computing Machinery, New York, NY, USA, 827–830. https://doi.org/10.1145/3583133.3590714
- Untangling Phylogenetic Diversity’s Role in Evolutionary Computation Using a Suite of Diagnostic Fitness Landscapes. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO ’22). Association for Computing Machinery, New York, NY, USA, 2322–2325. https://doi.org/10.1145/3520304.3534028
- Lee Spector. 2012. Assessment of Problem Modality by Differential Performance of Lexicase Selection in Genetic Programming: A Preliminary Report. In Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation (Philadelphia, Pennsylvania, USA) (GECCO ’12). Association for Computing Machinery, New York, NY, USA, 401–408. https://doi.org/10.1145/2330784.2330846
- Adam Stanton and Jared M. Moore. 2022. Lexicase Selection for Multi-Task Evolutionary Robotics. Artificial Life 28, 4 (11 2022), 479–498. https://doi.org/10.1162/artl_a_00374 arXiv:https://direct.mit.edu/artl/article-pdf/28/4/479/2043352/artl_a_00374.pdf
- L. A. Zadeh. 1965. Fuzzy Sets. Information and Control 8, 3 (June 1965), 338–353. https://doi.org/10.1016/S0019-9958(65)90241-X