Conjugate Natural Selection (2208.13898v4)
Abstract: We prove that Fisher-Rao natural gradient descent (FR-NGD) optimally approximates the continuous time replicator equation (an essential model of evolutionary dynamics), and term this correspondence "conjugate natural selection". This correspondence promises alternative approaches for evolutionary computation over continuous or high-dimensional hypothesis spaces. As a special case, FR-NGD also provides the optimal approximation of continuous Bayesian inference when hypotheses compete on the basis of predicting actual observations. In this case, the method avoids the need to compute prior probabilities. We demonstrate our findings on a non-convex optimization problem and a system identification task for a stochastic process with time-varying parameters.
- Shun-Ichi Amari. Natural gradient works efficiently in learning. Neural computation, 10(2):251–276, 1998.
- Evolutionary computation 1: Basic algorithms and operators. CRC press, 2018.
- Evolutionary dynamics of multi-agent learning: A survey. Journal of Artificial Intelligence Research, 53:659–697, 2015.
- Gradient flow formulations of discrete and continuous evolutionary models: a unifying perspective. Acta Applicandae Mathematicae, 171(1):1–50, 2021.
- Ross Cressman and Yi Tao. The replicator equation and other game dynamics. Proceedings of the National Academy of Sciences, 111(supplement_3):10810–10817, 2014.
- Alexander L Fradkov. Early history of machine learning. IFAC-PapersOnLine, 53(2):1385–1390, 2020.
- Daniel Friedman. Evolutionary games in economics. Econometrica: journal of the econometric society, pages 637–666, 1991.
- Evolutionary games in natural, social, and virtual worlds. Oxford University Press, 2016.
- On the properties of the softmax function with application in game theory and reinforcement learning. arXiv preprint arXiv:1704.00805, 2017.
- Marc Harper. Information geometry and evolutionary game theory. arXiv preprint arXiv:0911.1383, 2009a.
- Marc Harper. The replicator equation as an inference dynamic. arXiv preprint arXiv:0911.1763, 2009b.
- Marc Harper. Escort evolutionary game theory. Physica D: Nonlinear Phenomena, 240(18):1411–1415, 2011.
- Momentum accelerates evolutionary dynamics. arXiv preprint arXiv:2007.02449, 2020.
- Neural replicator dynamics. arXiv preprint arXiv:1906.00190, 2019.
- Evolutionary games and population dynamics. Cambridge university press, 1998.
- Riemannian natural gradient methods. arXiv preprint arXiv:2207.07287, 2022.
- The Bayesian learning rule. arXiv preprint arXiv:2107.04562, 2021.
- The weighted majority algorithm. Information and computation, 108(2):212–261, 1994.
- Elisabeth Lloyd. Units and levels of selection. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. Metaphysics Research Lab, Stanford University, Spring 2020 edition, 2020.
- James Martens. New insights and perspectives on the natural gradient method. The Journal of Machine Learning Research, 21(1):5776–5851, 2020.
- Geometry and convergence of natural policy gradient methods. arXiv preprint arXiv:2211.02105, 2022.
- Efficient natural gradient descent methods for large-scale optimization problems. arXiv preprint arXiv:2202.06236, 2022.
- Information-geometric optimization with natural selection. Entropy, 22(9):967, 2020.
- Fishy: Layerwise fisher approximation for higher-order neural network optimization. In Has it Trained Yet? NeurIPS 2022 Workshop, 2022.
- David C Queller. Fundamental theorems of evolution. The American Naturalist, 189(4):345–353, 2017.
- William H Sandholm. Population games and evolutionary dynamics. MIT press, 2010.
- The developmental, physiological, neural, and genetical causes and consequences of frequency-dependent selection in the wild. Annu. Rev. Ecol. Evol. Syst., 37:581–610, 2006.
- Charles C Tappert. Frank Rosenblatt, the father of deep learning. Proceedings of Student-Faculty Research Day, CSIS, Pace University, 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.