Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Tight $O(4^k/p_c)$ Runtime Bound for a ($μ$+1) GA on Jump$_k$ for Realistic Crossover Probabilities (2404.07061v1)

Published 10 Apr 2024 in cs.NE

Abstract: The Jump$_k$ benchmark was the first problem for which crossover was proven to give a speedup over mutation-only evolutionary algorithms. Jansen and Wegener (2002) proved an upper bound of $O({\rm poly}(n) + 4k/p_c)$ for the ($\mu$+1)~Genetic Algorithm ($(\mu+1)$ GA), but only for unrealistically small crossover probabilities $p_c$. To this date, it remains an open problem to prove similar upper bounds for realistic~$p_c$; the best known runtime bound for $p_c = \Omega(1)$ is $O((n/\chi){k-1})$, $\chi$ a positive constant. Using recently developed techniques, we analyse the evolution of the population diversity, measured as sum of pairwise Hamming distances, for a variant of the \muga on Jump$_k$. We show that population diversity converges to an equilibrium of near-perfect diversity. This yields an improved and tight time bound of $O(\mu n \log(k) + 4k/p_c)$ for a range of~$k$ under the mild assumptions $p_c = O(1/k)$ and $\mu \in \Omega(kn)$. For all constant~$k$ the restriction is satisfied for some $p_c = \Omega(1)$. Our work partially solves a problem that has been open for more than 20 years.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (17)
  1. Black-box complexity of parallel search with distributed populations. In Proceedings of Foundations of Genetic Algorithms (FOGA 2015), pages 3–15. ACM, 2015.
  2. An extended jump functions benchmark for the analysis of randomized search heuristics. Algorithmica, 86(1):1–32, 2024.
  3. Emergence of diversity and its benefits for crossover in genetic algorithms. In Proceedings of the 14th International Conference Parallel Problem Solving From Nature (PPSN). Springer, 2016.
  4. Escaping local optima using crossover with emergent diversity. IEEE Transactions on Evolutionary Computation, 22(3):484–497, 2018.
  5. B. Doerr. Probabilistic tools for the analysis of randomized optimization heuristics. In B. Doerr and F. Neumann, editors, Theory of Evolutionary Computation: Recent Developments in Discrete Optimization, pages 1–87. Springer, 2020.
  6. B. Doerr. Lower Bounds for Non-Elitist Evolutionary Algorithms via Negative Multiplicative Drift. Evolutionary Computation, 29(2):305–329, 2021.
  7. Runtime Analysis of the (μ𝜇\muitalic_μ + 1) GA: Provable Speed-Ups from Strong Drift towards Diverse Populations. In 38th Annual AAAI Conference on Artificial Intelligence, Feb. 2024.
  8. Crossover for cardinality constrained optimization. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2022), page 1399–1407. ACM, 2022.
  9. T. Jansen and I. Wegener. On the analysis of evolutionary algorithms – a proof that crossover really can help. Algorithmica, 34(1):47–66, 2002.
  10. How crossover helps in pseudo-boolean optimization. In Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference (GECCO 2011), pages 989–996. ACM, 2011.
  11. P. K. Lehre and C. Witt. Black box search by unbiased variation. In Genetic and Evolutionary Computation Conference (GECCO 2010), pages 1441–1448. ACM, 2010.
  12. Analysing equilibrium states for population diversity. In Proceedings of the 2023 Annual Conference on Genetic and Evolutionary Computation, GECCO ’23, pages 1628–1636. ACM, 2023.
  13. X. Li and T. Kötzing. Experimental analyses of crossover and diversity on Jump. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation, GECCO ’23 Companion, page 823–826. Association for Computing Machinery, 2023. ISBN 9798400701207.
  14. A. Prügel-Bennett. When a Genetic Algorithm Outperforms Hill-Climbing. Theoretical Computer Science, 320(1):135 – 153, 2004.
  15. M. Wineberg and F. Oppacher. The underlying similarity of diversity measures used in evolutionary computation. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2003), pages 1493–1504. Springer, 2003.
  16. C. Witt. Runtime analysis of the (μ𝜇\muitalic_μ+1) EA on simple pseudo-Boolean functions. Evolutionary Computation, 14(1):65–86, 2006.
  17. C. Witt. On Crossing Fitness Valleys with Majority-Vote Crossover and Estimation-of-Distribution Algorithms. In Proceedings of the 16th ACM/SIGEVO Conference on Foundations of Genetic Algorithms (FOGA ’21). ACM, 2021. ISBN 9781450383523.
Citations (1)

Summary

We haven't generated a summary for this paper yet.