An Investigation of the Factors Influencing Evolutionary Dynamics in the Joint Evolution of Robot Body and Control (2403.10303v1)
Abstract: In evolutionary robotics, jointly optimising the design and the controller of robots is a challenging task due to the huge complexity of the solution space formed by the possible combinations of body and controller. We focus on the evolution of robots that can be physically created rather than just simulated, in a rich morphological space that includes a voxel-based chassis, wheels, legs and sensors. On the one hand, this space offers a high degree of liberty in the range of robots that can be produced, while on the other hand introduces a complexity rarely dealt with in previous works relating to matching controllers to designs and in evolving closed-loop control. This is usually addressed by augmenting evolution with a learning algorithm to refine controllers. Although several frameworks exist, few have studied the role of the \textit{evolutionary dynamics} of the intertwined evolution+learning' processes in realising high-performing robots. We conduct an in-depth study of the factors that influence these dynamics, specifically: synchronous vs asynchronous evolution; the mechanism for replacing parents with offspring, and rewarding goal-based fitness vs novelty via selection. Results show that asynchronicity combined with goal-based selection and areplace worst' strategy results in the highest performance.
- A restart cma evolution strategy with increasing population size. In 2005 IEEE congress on evolutionary computation (2005), vol. 2, IEEE, pp. 1769–1776.
- Bootstrapping artificial evolution to design robots for autonomous fabrication. Robotics 9, 4 (2020), 106.
- On the difficulty of co-optimizing morphology and control in evolved virtual creatures. In Artificial Life Conference 2016 (2016), p. 226.
- Scalable co-optimization of morphology and control in embodied machines. Journal of The Royal Society Interface 15, 143 (2018), 20170937.
- If it evolves it needs to learn. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion (New York, NY, USA, 2020), GECCO ’20, Association for Computing Machinery, p. 1383â1384.
- Elman, J. L. Finding structure in time. Cognitive science 14, 2 (1990), 179–211.
- Embodied intelligence via learning and evolution. arXiv preprint arXiv:2102.02202 (2021).
- The are robot fabricator: How to (re) produce robots that can evolve in the real world. In The 2019 Conference on Artificial Life: A Hybrid of the European Conference on Artificial Life (ECAL) and the International Conference on the Synthesis and Simulation of Living Systems (ALIFE) (2019), MIT Press, pp. 95–102.
- Hansen, N. The cma evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 (2016).
- Cma-es: evolution strategies and covariance matrix adaptation. In Proceedings of the 13th annual conference companion on Genetic and evolutionary computation (2011), pp. 991–1010.
- Analysis of semi-asynchronous multi-objective evolutionary algorithm with different asynchronies. Soft Computing 24 (2020), 2917–2939.
- Artificial evolution of robot bodies and control: on the interaction between evolution, learning and culture. Philosophical Transactions of the Royal Society B 377, 1843 (2022), 20210117.
- Lamarckian evolution of simulated modular robots. Frontiers in Robotics and AI 6 (2019), 9.
- The transferability approach: Crossing the reality gap in evolutionary robotics. IEEE Transactions on Evolutionary Computation 17, 1 (2012), 122–145.
- A scalable pipeline for designing reconfigurable organisms. Proceedings of the National Academy of Sciences 117, 4 (2020), 1853–1859.
- Sample and time efficient policy learning with cma-es and bayesian optimisation. In Artificial Life Conference Proceedings (2020), MIT Press, pp. 432–440.
- Morpho-evolution with learning using a controller archive as an inheritance mechanism. IEEE Transactions on Cognitive and Developmental Systems (2022).
- Abandoning objectives: Evolution through the search for novelty alone. Evolutionary computation 19, 2 (2011), 189–223.
- Automatic design and manufacture of robotic lifeforms. Nature 406, 6799 (2000), 974–978.
- Evolving-controllers versus learning-controllers for morphologically evolvable robots. In International Conference on the Applications of Evolutionary Computation (Part of EvoStar) (2020), Springer, pp. 86–99.
- Emerge modular robot: a tool for fast deployment of evolved robots. Frontiers in Robotics and AI 8 (2021), 699814.
- Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909 (2015).
- Sims, K. Evolving 3d morphology and behavior by competition. Artificial life 1, 4 (1994), 353–372.
- Stanley, K. O. Compositional pattern producing networks: A novel abstraction of development. Genetic programming and evolvable machines 8, 2 (2007), 131–162.
- Syswerda, G. A study of reproduction in generational and steady-state genetic algorithms. In Foundations of genetic algorithms, vol. 1. Elsevier, 1991, pp. 94–101.