Convergent iLQR for Safe Trajectory Planning and Control of Legged Robots (2304.00346v3)
Abstract: In order to perform highly dynamic and agile maneuvers, legged robots typically spend time in underactuated domains (e.g. with feet off the ground) where the system has limited command of its acceleration and a constrained amount of time before transitioning to a new domain (e.g. foot touchdown). Meanwhile, these transitions can instantaneously change the system's state, possibly causing perturbations to be mapped arbitrarily far away from the target trajectory. These properties make it difficult for local feedback controllers to effectively recover from disturbances as the system evolves through underactuated domains and hybrid impact events. To address this, we utilize the fundamental solution matrix that characterizes the evolution of perturbations through a hybrid trajectory and its 2-norm, which represents the worst-case growth of perturbations. In this paper, the worst-case perturbation analysis is used to explicitly reason about the tracking performance of a hybrid trajectory and is incorporated in an iLQR framework to optimize a trajectory while taking into account the closed-loop convergence of the trajectory under an LQR tracking controller. The generated convergent trajectories recover more effectively from perturbations, are more robust to large disturbances, and use less feedback control effort than trajectories generated with traditional methods.
- A. M. Johnson and D. E. Koditschek, “Toward a vocabulary of legged leaping,” in IEEE Intl. Conference on Robotics and Automation, Karlsruhe, Germany, May 2013, pp. 2553–2560.
- H. Kolvenbach, E. Hampp, P. Barton et al., “Towards jumping locomotion for quadruped robots on the moon,” IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019.
- C. Nguyen and Q. Nguyen, “Contact-timing and trajectory optimization for 3d jumping on quadruped robots,” IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022.
- Z. Li, X. B. Peng, P. Abbeel et al., “Robust and versatile bipedal jumping control through multi-task reinforcement learning,” arXiv preprint arXiv:2302.09450, 2023.
- A. van der Schaft and J. Schumacher, “Complementarity modeling of hybrid systems,” IEEE Transactions on Automatic Control, 1998.
- J. Lygeros, K. H. Johansson, S. Simic et al., “Dynamical properties of hybrid automata,” IEEE Transactions on Automatic Control, 2003.
- N. J. Kong, J. J. Payne, J. Zhu, and A. M. Johnson, “Saltation matrices: The essential tool for linearizing hybrid dynamical systems,” arXiv preprint arXiv:2306.06862, 2023.
- J. Norby, A. Tajbakhsh, Y. Yang, and A. M. Johnson, “Adaptive complexity model predictive control,” arXiv preprint arXiv:2209.02849, 2022.
- Z. Manchester and S. Kuindersma, “Robust direct trajectory optimization using approximate invariant funnels,” Auton. Robots, 2019.
- J. Morimoto, G. Zeglin, and C. Atkeson, “Minimax differential dynamic programming: application to a biped walking robot,” IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003.
- T. Lew, R. Bonalli, and M. Pavone, “Chance-constrained sequential convex programming for robust trajectory optimization,” European Control Conference, 2020.
- B. Hammoud, M. Khadiv, and L. Righetti, “Impedance optimization for uncertain contact interactions through risk sensitive optimal control,” IEEE Robotics and Automation Letters, 2021.
- M. Ahmadi, X. Xiong, and A. D. Ames, “Risk-sensitive path planning via CVaR barrier functions: Application to bipedal locomotion,” IEEE Control Systems Letters, 2021.
- L. Drnach and Y. Zhao, “Robust trajectory optimization over uncertain terrain with stochastic complementarity,” IEEE Robotics and Automation Letters, 2021.
- S. Kousik, S. Vaskov, F. Bu et al., “Bridging the gap between safety and real-time performance in receding-horizon trajectory design for mobile robots,” The International Journal of Robotics Research, 2020.
- C.-Y. Lee, S. Yang, B. Bokser, and Z. Manchester, “Enhanced balance for legged robots using reaction wheels,” IEEE International Conference on Robotics and Automation, 2023.
- Y. Yang, J. Norby, J. K. Yim, and A. M. Johnson, “Proprioception and tail control enable extreme terrain traversal by quadruped robots,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2023.
- A. Papachristodoulou and S. Prajna, “On the construction of Lyapunov functions using the sum of squares decomposition,” IEEE Conference on Decision and Control, 2002.
- S. Chen, M. Fazlyab, M. Morari et al., “Learning Lyapunov functions for hybrid systems,” International Conference on Hybrid Systems: Computation and Control, 2021.
- R. Grandia, A. J. Taylor, A. D. Ames, and M. Hutter, “Multi-layered safety for legged robots via control barrier functions and model predictive control,” IEEE International Conference on Robotics and Automation, 2021.
- W. Lohmiller and J. Slotine, “On contraction analysis for non-linear systems,” Automatica, 1998.
- A. M. Johnson, J. E. King, and S. Srinivasa, “Convergent planning,” IEEE Robotics and Automation Letters, 2016.
- N. Kong and A. M. Johnson, “Optimally convergent trajectories for navigation,” in International Symposium on Robotics Research, October 2019.
- S. A. Burden, T. Libby, and S. D. Coogan, “On contraction analysis for hybrid systems,” arXiv preprint arXiv:1811.03956, 2018.
- J. Zhu, N. Kong, G. Council, and A. Johnson, “Hybrid event shaping to stabilize periodic hybrid orbits,” IEEE International Conference on Robotics and Automation, 2022.
- A. M. Johnson, S. A. Burden, and D. E. Koditschek, “A hybrid systems model for simple manipulation and self-manipulation systems,” The International Journal of Robotics Research, 2016.
- W. Li and E. Todorov, “Iterative linear quadratic regulator design for nonlinear biological movement systems,” International Conference on Informatics in Control, Automation and Robotics, 2004.
- M. Kelly, “An introduction to trajectory optimization: How to do your own direct collocation,” SIAM Review, 2017.
- N. J. Kong, G. Council, and A. M. Johnson, “iLQR for piecewise-smooth hybrid dynamical systems,” IEEE Conference on Decision and Control, 2021.
- N. Kong, C. Li, G. Council, and A. M. Johnson, “Hybrid iLQR model predictive control for contact implicit stabilization on legged robots,” IEEE Transactions on Robotics, 2023, to appear. Also available at arXiv:2207.04591 [cs.RO].
- J. Townsend, “Differentiating the singular value decomposition,” Tech. Rep., 2016. [Online]. Available: https://j-towns.github.io/papers/svd-derivative.pdf
- S. Singh, R. P. Russell, and P. M. Wensing, “On second-order derivatives of rigid-body dynamics: Theory & implementation,” arXiv preprint arXiv:2302.06001, 2023.
- C. G. Broyden, “The convergence of a class of double-rank minimization algorithms 1. General considerations,” IMA Journal of Applied Mathematics, 1970.
- K. Endo and H. Herr, “A model of muscle-tendon function in human walking at self-selected speed,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014.
- M. Scheint, M. Sobotka, and M. Buss, “Optimized parallel joint springs in dynamic motion: Comparison of simulation and experiment,” IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, 2010.
- K. Mombaur, “Using optimization to create self-stable human-like running,” Robotica, 2009.
- D. Lakatos, K. Ploeger, F. Loeffl et al., “Dynamic locomotion gaits of a compliantly actuated quadruped with slip-like articulated legs embodied in the mechanical design,” IEEE Robotics and Automation Letters, 2018.
- J. Ackerman and J. Seipel, “Energy efficiency of legged robot locomotion with elastically suspended loads,” IEEE Transactions on Robotics, 2013.
- M. J. Pollayil, C. D. Santina, G. Mesesan et al., “Planning natural locomotion for articulated soft quadrupeds,” IEEE International Conference on Robotics and Automation, 2022.