Adaptive Gait Modeling and Optimization for Principally Kinematic Systems (2310.02141v2)
Abstract: Robotic adaptation to unanticipated operating conditions is crucial to achieving persistence and robustness in complex real world settings. For a wide range of cutting-edge robotic systems, such as micro- and nano-scale robots, soft robots, medical robots, and bio-hybrid robots, it is infeasible to anticipate the operating environment a priori due to complexities that arise from numerous factors including imprecision in manufacturing, chemo-mechanical forces, and poorly understood contact mechanics. Drawing inspiration from data-driven modeling, geometric mechanics (or gauge theory), and adaptive control, we employ an adaptive system identification framework and demonstrate its efficacy in enhancing the performance of principally kinematic locomotors (those governed by Rayleigh dissipation or zero momentum conservation). We showcase the capability of the adaptive model to efficiently accommodate varying terrains and iteratively modified behaviors within a behavior optimization framework. This provides both the ability to improve fundamental behaviors and perform motion tracking to precision. Notably, we are capable of optimizing the gaits of the Purcell swimmer using approximately 10 cycles per link, which for the nine-link Purcell swimmer provides a factor of ten improvement in optimization speed over the state of the art. Beyond simply a computational speed up, this ten-fold improvement may enable this method to be successfully deployed for in-situ behavior refinement, injury recovery, and terrain adaptation, particularly in domains where simulations provide poor guides for the real world.
- R. Grandia, A. J. Taylor, A. D. Ames, and M. Hutter, “Multi-layered safety for legged robots via control barrier functions and model predictive control,” in International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 8352–8358.
- Y. Gong and J. W. Grizzle, “Zero dynamics, pendulum models, and angular momentum in feedback control of bipedal locomotion,” Journal of Dynamic Systems, Measurement, and Control, vol. 144, no. 12, p. 121006, 2022.
- J. D. Weingarten, G. A. Lopes, M. Buehler, R. E. Groff, and D. E. Koditschek, “Automated gait adaptation for legged robots,” in International Conference on Robotics and Automation, vol. 3. IEEE, 2004, pp. 2153–2158.
- G. Brambilla, J. Buchli, and A. J. Ijspeert, “Adaptive four legged locomotion control based on nonlinear dynamical systems,” in International Conference on Simulation of Adaptive Behavior. Springer, 2006, pp. 138–149.
- C. Sun, W. He, W. Ge, and C. Chang, “Adaptive neural network control of biped robots,” Transactions on Systems, Man, and Cybernetics: systems, vol. 47, no. 2, pp. 315–326, 2016.
- X. B. Peng, G. Berseth, K. Yin, and M. Van De Panne, “Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning,” ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1–13, 2017.
- N. Heess, D. Tb, S. Sriram, J. Lemmon, J. Merel, G. Wayne, Y. Tassa, T. Erez, Z. Wang, S. Eslami, et al., “Emergence of locomotion behaviours in rich environments,” arXiv preprint arXiv:1707.02286, 2017.
- J. Tan, T. Zhang, E. Coumans, A. Iscen, Y. Bai, D. Hafner, S. Bohez, and V. Vanhoucke, “Sim-to-real: Learning agile locomotion for quadruped robots,” arXiv preprint arXiv:1804.10332, 2018.
- J. Tobin, R. Fong, A. Ray, J. Schneider, W. Zaremba, and P. Abbeel, “Domain randomization for transferring deep neural networks from simulation to the real world,” in IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, 2017, pp. 23–30.
- G. E. Mullins, P. G. Stankiewicz, R. C. Hawthorne, and S. K. Gupta, “Adaptive generation of challenging scenarios for testing and evaluation of autonomous vehicles,” Journal of Systems and Software, vol. 137, pp. 197–215, 2018.
- R. Rambabu, P. Vadakkepat, K. C. Tan, and M. Jiang, “A mixture-of-experts prediction framework for evolutionary dynamic multiobjective optimization,” IEEE transactions on cybernetics, vol. 50, no. 12, pp. 5099–5112, 2019.
- B. Tsuda, K. M. Tye, H. T. Siegelmann, and T. J. Sejnowski, “A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex,” Proceedings of the National Academy of Sciences, vol. 117, no. 47, pp. 29 872–29 882, 2020.
- S. Rozen-Levy, W. Messner, and B. A. Trimmer, “The design and development of branch bot: a branch-crawling, caterpillar-inspired, soft robot,” The International Journal of Robotics Research, vol. 40, no. 1, pp. 24–36, 2021.
- A. Pantula, B. Datta, Y. Shi, M. Wang, J. Liu, S. Deng, N. J. Cowan, T. D. Nguyen, and D. H. Gracias, “Untethered unidirectionally crawling gels driven by asymmetry in contact forces,” Science Robotics, vol. 7, no. 73, p. eadd2903, 2022.
- M. Li, N. Xi, Y. Wang, and L. Liu, “Progress in nanorobotics for advancing biomedicine,” Transactions on Biomedical Engineering, vol. 68, no. 1, pp. 130–147, 2020.
- C. Park, C. Ozturk, and E. T. Roche, “Computational design of a soft robotic myocardium for biomimetic motion and function,” Advanced Functional Materials, vol. 32, no. 40, p. 2206734, 2022.
- V. A. Webster-Wood, M. Guix, N. W. Xu, B. Behkam, H. Sato, D. Sarkar, S. Sanchez, M. Shimizu, and K. K. Parker, “Biohybrid robots: Recent progress, challenges, and perspectives,” Bioinspiration & Biomimetics, 2022.
- B. Bittner, R. L. Hatton, and S. Revzen, “Geometrically optimal gaits: a data-driven approach,” Nonlinear Dynamics, vol. 94, no. 3, pp. 1933–1948, 2018.
- S. D. Kelly and R. M. Murray, “Geometric phases and robotic locomotion,” Journal of Robotic Systems, vol. 12, no. 6, pp. 417–431, 1995.
- D. Zhao, B. Bittner, G. Clifton, N. Gravish, and S. Revzen, “Walking is like slithering: A unifying, data-driven view of locomotion,” Proceedings of the National Academy of Sciences, vol. 119, no. 37, p. e2113222119, 2022.
- B. Chong, J. He, S. Li, E. Erickson, K. Diaz, T. Wang, D. Soto, and D. I. Goldman, “Self-propulsion via slipping: Frictional swimming in multilegged locomotors,” Proceedings of the National Academy of Sciences, vol. 120, no. 11, p. e2213698120, 2023.
- S. Deng, R. L. Hatton, and N. J. Cowan, “Enhancing maneuverability via gait design,” in Proc IEEE Int Conf Robot Autom, 2022, pp. 5799–5805.
- H. Cendra, J. E. Marsden, and T. S. Ratiu, “Geometric mechanics, lagrangian reduction, and nonholonomic systems,” Mathematics Unlimited—2001 and Beyond, pp. 221–273, 2001.
- J. P. Ostrowski, J. P. Desai, and V. Kumar, “Optimal gait selection for nonholonomic locomotion systems,” The International Journal of Robotics Research, vol. 19, no. 3, pp. 225–237, 2000.
- S. D. Kelly and R. M. Murray, “The geometry and control of dissipative systems,” in Proceedings of 35th IEEE Conference on Decision and Control, vol. 1. IEEE, 1996, pp. 981–986.
- J. E. Marsden and J. Ostrowski, “Symmetries in motion: Geometric foundations of motion control,” National Academies Press, 1998.
- M. D. Kvalheim, B. Bittner, and S. Revzen, “Gait modeling and optimization for the perturbed stokes regime,” Nonlinear Dynamics, vol. 97, pp. 2249–2270, 2019.
- B. Bittner, R. L. Hatton, and S. Revzen, “Data-driven geometric system identification for shape-underactuated dissipative systems,” Bioinspiration & Biomimetics, vol. 17, no. 2, p. 026004, 2022.
- S. Deng, J. Liu, B. Datta, A. Pantula, D. H. Gracias, T. D. Nguyen, B. A. Bittner, and N. J. Cowan, “A data-driven approach to geometric modeling of systems with low-bandwidth actuator dynamics,” arXiv preprint arXiv:2307.01062, 2023.
- E. M. Purcell, “Life at low reynolds number,” American journal of physics, vol. 45, no. 1, pp. 3–11, 1977.
- J. E. Avron and O. Raz, “A geometric theory of swimming: Purcell’s swimmer and its symmetrized cousin,” New Journal of Physics, vol. 10, no. 6, p. 063016, 2008.
- R. L. Hatton and H. Choset, “Geometric swimming at low and high reynolds numbers,” IEEE Transactions on Robotics, vol. 29, no. 3, pp. 615–624, 2013.
- R. G. Cox, “The motion of long slender bodies in a viscous fluid part 1. general theory,” Journal of Fluid Mechanics, vol. 44, no. 4, p. 791–810, 1970.
- B. Chong, J. He, D. Soto, T. Wang, D. Irvine, G. Blekherman, and D. I. Goldman, “Multilegged matter transport: A framework for locomotion on noisy landscapes,” Science, vol. 380, no. 6644, pp. 509–515, 2023.
- G. Williams, A. Aldrich, and E. A. Theodorou, “Model predictive path integral control: From theory to parallel computation,” Journal of Guidance, Control, and Dynamics, vol. 40, no. 2, pp. 344–357, 2017.
- A. Carron, E. Arcari, M. Wermelinger, L. Hewing, M. Hutter, and M. N. Zeilinger, “Data-driven model predictive control for trajectory tracking with a robotic arm,” Robotics and Automation Letters, vol. 4, no. 4, pp. 3758–3765, 2019.
- F. R. Hogan and A. Rodriguez, “Reactive planar non-prehensile manipulation with hybrid model predictive control,” The International Journal of Robotics Research, vol. 39, no. 7, pp. 755–773, 2020.