A Model Predictive Capture Point Control Framework for Robust Humanoid Balancing via Ankle, Hip, and Stepping Strategies (2307.13243v2)
Abstract: The robust balancing capability of humanoid robots has been considered one of the crucial requirements for their mobility in real environments. In particular, many studies have been devoted to the efficient implementation of human-inspired ankle, hip, and stepping strategies, to endow humanoids with human-level balancing capability. In this paper, a robust balance control framework for humanoids is proposed. Firstly, a Model Predictive Control (MPC) framework is proposed for Capture Point (CP) tracking control, enabling the integration of ankle, hip, and stepping strategies within a single framework. Additionally, a variable weighting method is introduced that adjusts the weighting parameters of the Centroidal Angular Momentum (CAM) damping control. Secondly, a hierarchical structure of the MPC and a stepping controller was proposed, allowing for the step time optimization. The robust balancing performance of the proposed method is validated through simulations and real robot experiments. Furthermore, a superior balancing performance is demonstrated compared to a state-of-the-art Quadratic Programming (QP)-based CP controller that employs the ankle, hip, and stepping strategies. The supplementary video is available at https://youtu.be/7Y4CykTpgrw
- L. M. Nashner and G. McCollum, “The organization of human postural movements: a formal basis and experimental synthesis,” Behavioral and brain sciences, vol. 8, no. 1, pp. 135–150, 1985.
- D. A. Winter, “Human balance and posture control during standing and walking,” Gait & posture, vol. 3, no. 4, pp. 193–214, 1995.
- B. E. Maki and W. E. McIlroy, “The role of limb movements in maintaining upright stance: the “change-in-support” strategy,” Physical therapy, vol. 77, no. 5, pp. 488–507, 1997.
- K. Barin, “Evaluation of a generalized model of human postural dynamics and control in the sagittal plane,” Biological cybernetics, vol. 61, no. 1, pp. 37–50, 1989.
- A. D. Kuo and F. E. Zajac, “Human standing posture: multi-joint movement strategies based on biomechanical constraints,” Progress in brain research, vol. 97, pp. 349–358, 1993.
- S. Park, F. B. Horak, and A. D. Kuo, “Postural feedback responses scale with biomechanical constraints in human standing,” Experimental brain research, vol. 154, no. 4, pp. 417–427, 2004.
- S. Kajita, F. Kanehiro, K. Kaneko, K. Yokoi, and H. Hirukawa, “The 3d linear inverted pendulum mode: A simple modeling for a biped walking pattern generation,” in Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No. 01CH37180), vol. 1. IEEE, 2001, pp. 239–246.
- S. Kajita, F. Kanehiro, K. Kaneko, K. Fujiwara, K. Yokoi, and H. Hirukawa, “Biped walking pattern generation by a simple three-dimensional inverted pendulum model,” Advanced Robotics, vol. 17, no. 2, pp. 131–147, 2003.
- M. Vukobratović and B. Borovac, “Zero-moment point—thirty five years of its life,” International journal of humanoid robotics, vol. 1, no. 01, pp. 157–173, 2004.
- M. B. Popovic, A. Goswami, and H. Herr, “Ground reference points in legged locomotion: Definitions, biological trajectories and control implications,” The international journal of robotics research, vol. 24, no. 12, pp. 1013–1032, 2005.
- S. Kajita, F. Kanehiro, K. Kaneko, K. Fujiwara, K. Harada, K. Yokoi, and H. Hirukawa, “Biped walking pattern generation by using preview control of zero-moment point,” in 2003 IEEE international conference on robotics and automation (Cat. No. 03CH37422), vol. 2. IEEE, 2003, pp. 1620–1626.
- Y. Choi, D. Kim, and B.-J. You, “On the walking control for humanoid robot based on the kinematic resolution of com jacobian with embedded motion,” in Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. IEEE, 2006, pp. 2655–2660.
- J.-Y. Kim, I.-W. Park, and J.-H. Oh, “Experimental realization of dynamic walking of the biped humanoid robot khr-2 using zero moment point feedback and inertial measurement,” Advanced Robotics, vol. 20, no. 6, pp. 707–736, 2006.
- S. Kajita, M. Morisawa, K. Miura, S. Nakaoka, K. Harada, K. Kaneko, F. Kanehiro, and K. Yokoi, “Biped walking stabilization based on linear inverted pendulum tracking,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2010, pp. 4489–4496.
- H.-M. Joe and J.-H. Oh, “A robust balance-control framework for the terrain-blind bipedal walking of a humanoid robot on unknown and uneven terrain,” Sensors, vol. 19, no. 19, p. 4194, 2019.
- T. Komura, H. Leung, S. Kudoh, and J. Kuffner, “A feedback controller for biped humanoids that can counteract large perturbations during gait,” in Proceedings of the 2005 IEEE International Conference on Robotics and Automation. IEEE, 2005, pp. 1989–1995.
- T. Komura, A. Nagano, H. Leung, and Y. Shinagawa, “Simulating pathological gait using the enhanced linear inverted pendulum model,” IEEE Transactions on biomedical engineering, vol. 52, no. 9, pp. 1502–1513, 2005.
- J. Pratt, J. Carff, S. Drakunov, and A. Goswami, “Capture point: A step toward humanoid push recovery,” in 2006 6th IEEE-RAS international conference on humanoid robots. IEEE, 2006, pp. 200–207.
- B. Stephens, “Humanoid push recovery,” in 2007 7th IEEE-RAS International Conference on Humanoid Robots. IEEE, 2007, pp. 589–595.
- S.-J. Yi, B.-T. Zhang, D. Hong, and D. D. Lee, “Whole-body balancing walk controller for position controlled humanoid robots,” International Journal of Humanoid Robotics, vol. 13, no. 01, p. 1650011, 2016.
- G. Wiedebach, S. Bertrand, T. Wu, L. Fiorio, S. McCrory, R. Griffin, F. Nori, and J. Pratt, “Walking on partial footholds including line contacts with the humanoid robot atlas,” in 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids). IEEE, 2016, pp. 1312–1319.
- R. Schuller, G. Mesesan, J. Englsberger, J. Lee, and C. Ott, “Online centroidal angular momentum reference generation and motion optimization for humanoid push recovery,” IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 5689–5696, 2021.
- M.-J. Kim, D. Lim, G. Park, and J. Park, “Humanoid balance control using centroidal angular momentum based on hierarchical quadratic programming,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2022, pp. 6753–6760.
- Y. Ding, C. Khazoom, M. Chignoli, and S. Kim, “Dynamic walking with footstep adaptation on the mit humanoid via linear model predictive control,” arXiv preprint arXiv:2205.15443, 2022.
- A. Herdt, H. Diedam, P.-B. Wieber, D. Dimitrov, K. Mombaur, and M. Diehl, “Online walking motion generation with automatic footstep placement,” Advanced Robotics, vol. 24, no. 5-6, pp. 719–737, 2010.
- M. Khadiv, A. Herzog, S. A. A. Moosavian, and L. Righetti, “Step timing adjustment: A step toward generating robust gaits,” in 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids). IEEE, 2016, pp. 35–42.
- H. Jeong, O. Sim, H. Bae, K. Lee, J. Oh, and J.-H. Oh, “Biped walking stabilization based on foot placement control using capture point feedback,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2017, pp. 5263–5269.
- H.-M. Joe and J.-H. Oh, “Balance recovery through model predictive control based on capture point dynamics for biped walking robot,” Robotics and Autonomous Systems, vol. 105, pp. 1–10, 2018.
- H. Jeong, I. Lee, O. Sim, K. Lee, and J.-H. Oh, “A robust walking controller optimizing step position and step time that exploit advantages of footed robot,” Robotics and Autonomous Systems, vol. 113, pp. 10–22, 2019.
- M. Khadiv, A. Herzog, S. A. A. Moosavian, and L. Righetti, “Walking control based on step timing adaptation,” IEEE Transactions on Robotics, vol. 36, no. 3, pp. 629–643, 2020.
- M.-J. Kim, D. Lim, G. Park, and J. Park, “Foot stepping algorithm of humanoids with double support time adjustment based on capture point control,” in 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023, pp. 12 198–12 204.
- P.-B. Wieber, “Trajectory free linear model predictive control for stable walking in the presence of strong perturbations,” in 2006 6th IEEE-RAS International Conference on Humanoid Robots. IEEE, 2006, pp. 137–142.
- M. Shafiee-Ashtiani, A. Yousefi-Koma, and M. Shariat-Panahi, “Robust bipedal locomotion control based on model predictive control and divergent component of motion,” in 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017, pp. 3505–3510.
- J. Ding, S. Xin, T. L. Lam, and S. Vijayakumar, “Versatile locomotion by integrating ankle, hip, stepping, and height variation strategies,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 2957–2963.
- J. Ding, L. Han, L. Ge, Y. Liu, and J. Pang, “Robust locomotion exploiting multiple balance strategies: An observer-based cascaded model predictive control approach,” IEEE/ASME Transactions on Mechatronics, vol. 27, no. 4, pp. 2089–2097, 2022.
- G. Romualdi, S. Dafarra, G. L’Erario, I. Sorrentino, S. Traversaro, and D. Pucci, “Online non-linear centroidal mpc for humanoid robot locomotion with step adjustment,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 10 412–10 419.
- Z. Aftab, T. Robert, and P.-B. Wieber, “Ankle, hip and stepping strategies for humanoid balance recovery with a single model predictive control scheme,” in 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012). IEEE, 2012, pp. 159–164.
- F. Nazemi, A. Yousefi-Koma, M. Khadiv, et al., “A reactive and efficient walking pattern generator for robust bipedal locomotion,” in 2017 5th RSI International Conference on Robotics and Mechatronics (ICRoM). IEEE, 2017, pp. 364–369.
- H. Jeong, I. Lee, J. Oh, K. K. Lee, and J.-H. Oh, “A robust walking controller based on online optimization of ankle, hip, and stepping strategies,” IEEE Transactions on Robotics, vol. 35, no. 6, pp. 1367–1386, 2019.
- J. Englsberger, C. Ott, M. A. Roa, A. Albu-Schäffer, and G. Hirzinger, “Bipedal walking control based on capture point dynamics,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2011, pp. 4420–4427.
- A. L. Hof, “The ‘extrapolated center of mass’ concept suggests a simple control of balance in walking,” Human movement science, vol. 27, no. 1, pp. 112–125, 2008.
- J. Englsberger, “Combining reduced dynamics models and whole-body control for agile humanoid locomotion,” Ph.D. dissertation, Technische Universität München, 2016.
- M. Morisawa, S. Kajita, F. Kanehiro, K. Kaneko, K. Miura, and K. Yokoi, “Balance control based on capture point error compensation for biped walking on uneven terrain,” in 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012). IEEE, 2012, pp. 734–740.
- R. J. Griffin, G. Wiedebach, S. Bertrand, A. Leonessa, and J. Pratt, “Walking stabilization using step timing and location adjustment on the humanoid robot, atlas,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2017, pp. 667–673.
- Y. Kanamiya, S. Ota, and D. Sato, “Ankle and hip balance control strategies with transitions,” in 2010 IEEE International Conference on Robotics and Automation. IEEE, 2010, pp. 3446–3451.
- C. Khazoom and S. Kim, “Humanoid arm motion planning for improved disturbance recovery using model hierarchy predictive control,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 6607–6613.
- B. Park, M.-J. Kim, E. Sung, J. Kim, and J. Park, “Whole-body walking pattern using pelvis-rotation for long stride and arm swing for yaw angular momentum compensation,” in 2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids). IEEE, 2021, pp. 47–52.
- P. Kryczka, P. Kormushev, N. G. Tsagarakis, and D. G. Caldwell, “Online regeneration of bipedal walking gait pattern optimizing footstep placement and timing,” in 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2015, pp. 3352–3357.
- E. Todorov, T. Erez, and Y. Tassa, “Mujoco: A physics engine for model-based control,” in 2012 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 2012, pp. 5026–5033.
- H. J. Ferreau, C. Kirches, A. Potschka, H. G. Bock, and M. Diehl, “qpoases: A parametric active-set algorithm for quadratic programming,” Mathematical Programming Computation, vol. 6, pp. 327–363, 2014.
- M. L. Felis, “Rbdl: an efficient rigid-body dynamics library using recursive algorithms,” Autonomous Robots, vol. 41, no. 2, pp. 495–511, 2017.
- W. McIlroy and B. Maki, “Changes in early ‘automatic’postural responses associated with the prior-planning and execution of a compensatory step,” Brain research, vol. 631, no. 2, pp. 203–211, 1993.
- A. Mansfield, E. L. Inness, J. Komar, L. Biasin, K. Brunton, B. Lakhani, and W. E. McIlroy, “Training rapid stepping responses in an individual with stroke,” Physical therapy, vol. 91, no. 6, pp. 958–969, 2011.
- J. Choe, J.-H. Kim, S. Hong, J. Lee, and H.-W. Park, “Seamless reaction strategy for bipedal locomotion exploiting real-time nonlinear model predictive control,” IEEE Robotics and Automation Letters, pp. 1–8, 2023.
- N. Bohórquez and P.-B. Wieber, “Adaptive step duration in biped walking: a robust approach to nonlinear constraints,” in 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). IEEE, 2017, pp. 724–729.
- P. Zaytsev, S. J. Hasaneini, and A. Ruina, “Two steps is enough: No need to plan far ahead for walking balance,” in 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2015, pp. 6295–6300.