Human-Robot Co-Transportation with Human Uncertainty-Aware MPC and Pose Optimization (2404.00514v2)
Abstract: This paper proposes a new control algorithm for human-robot co-transportation based on a robot manipulator equipped with a mobile base and a robotic arm. The primary focus is to adapt to human uncertainties through the robot's whole-body kinematics and pose optimization. We introduce an augmented Model Predictive Control (MPC) formulation that explicitly models human uncertainties and contains extra variables than regular MPC to optimize the pose of the robotic arm. The core of our methodology involves a two-step iterative design: At each planning horizon, we select the best pose of the robotic arm (joint angle combination) from a candidate set, aiming to achieve the lowest estimated control cost. This selection is based on solving an uncertainty-aware Discrete Algebraic Ricatti Equation (DARE), which also informs the optimal control inputs for both the mobile base and the robotic arm. To validate the effectiveness of the proposed approach, we provide theoretical derivation for the uncertainty-aware DARE and perform simulated and hardware experiments using a Fetch robot under varying conditions, including different trajectories and noise levels. The results reveal that our proposed approach outperforms baseline algorithms.
- B. Hayes and B. Scassellati, “Challenges in shared-environment human-robot collaboration,” learning, vol. 8, no. 9, 2013.
- C. Brosque, E. Galbally, O. Khatib, and M. Fischer, “Human-robot collaboration in construction: Opportunities and challenges,” in 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pp. 1–8, IEEE, 2020.
- A.-N. Sharkawy and P. N. Koustoumpardis, “Human–robot interaction: A review and analysis on variable admittance control, safety, and perspectives,” Machines, vol. 10, no. 7, p. 591, 2022.
- S. Li, H. Wang, and S. Zhang, “Human-robot collaborative manipulation with the suppression of human-caused disturbance,” Journal of Intelligent & Robotic Systems, vol. 102, no. 4, p. 73, 2021.
- S. Erhart, D. Sieber, and S. Hirche, “An impedance-based control architecture for multi-robot cooperative dual-arm mobile manipulation,” in 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 315–322, IEEE, 2013.
- F. Cursi, V. Modugno, L. Lanari, G. Oriolo, and P. Kormushev, “Bayesian neural network modeling and hierarchical mpc for a tendon-driven surgical robot with uncertainty minimization,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 2642–2649, 2021.
- G. P. Incremona, A. Ferrara, and L. Magni, “Mpc for robot manipulators with integral sliding modes generation,” IEEE/ASME Transactions on Mechatronics, vol. 22, no. 3, pp. 1299–1307, 2017.
- C. Wang, X. Liu, X. Yang, F. Hu, A. Jiang, and C. Yang, “Trajectory tracking of an omni-directional wheeled mobile robot using a model predictive control strategy,” Applied Sciences, vol. 8, no. 2, p. 231, 2018.
- X. Xiao, J. Biswas, and P. Stone, “Learning inverse kinodynamics for accurate high-speed off-road navigation on unstructured terrain,” IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 6054–6060, 2021.
- C. J. Ostafew, A. P. Schoellig, T. D. Barfoot, and J. Collier, “Learning-based nonlinear model predictive control to improve vision-based mobile robot path tracking,” Journal of Field Robotics, vol. 33, no. 1, pp. 133–152, 2016.
- H. Taghavifar and S. Rakheja, “A novel terramechanics-based path-tracking control of terrain-based wheeled robot vehicle with matched-mismatched uncertainties,” IEEE Transactions on Vehicular Technology, vol. 69, no. 1, pp. 67–77, 2019.
- A. Carron, E. Arcari, M. Wermelinger, L. Hewing, M. Hutter, and M. N. Zeilinger, “Data-driven model predictive control for trajectory tracking with a robotic arm,” IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3758–3765, 2019.
- J. Baek, S. Cho, and S. Han, “Practical time-delay control with adaptive gains for trajectory tracking of robot manipulators,” IEEE Transactions on Industrial Electronics, vol. 65, no. 7, pp. 5682–5692, 2017.
- T. Faulwasser, T. Weber, P. Zometa, and R. Findeisen, “Implementation of nonlinear model predictive path-following control for an industrial robot,” IEEE Transactions on Control Systems Technology, vol. 25, no. 4, pp. 1505–1511, 2016.
- F. Zacharias, C. Borst, and G. Hirzinger, “Capturing robot workspace structure: representing robot capabilities,” in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3229–3236, Ieee, 2007.
- A. B. Clark and N. Rojas, “Design and workspace characterisation of malleable robots,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 9021–9027, IEEE, 2020.
- J. J. Quiroz-Omaña and B. V. Adorno, “Whole-body kinematic control of nonholonomic mobile manipulators using linear programming,” Journal of Intelligent & Robotic Systems, vol. 91, pp. 263–278, 2018.
- M. Giftthaler, F. Farshidian, T. Sandy, L. Stadelmann, and J. Buchli, “Efficient kinematic planning for mobile manipulators with non-holonomic constraints using optimal control,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 3411–3417, IEEE, 2017.
- J. Kindle, F. Furrer, T. Novkovic, J. J. Chung, R. Siegwart, and J. Nieto, “Whole-body control of a mobile manipulator using end-to-end reinforcement learning,” arXiv preprint arXiv:2003.02637, 2020.
- M. Osman, M. W. Mehrez, S. Yang, S. Jeon, and W. Melek, “End-effector stabilization of a 10-dof mobile manipulator using nonlinear model predictive control,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 9772–9777, 2020.
- L. Stadelmann, T. Sandy, A. Thoma, and J. Buchli, “End-effector pose correction for versatile large-scale multi-robotic systems,” IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 546–553, 2019.
- L. Huo and L. Baron, “The joint-limits and singularity avoidance in robotic welding,” Industrial Robot: An International Journal, vol. 35, no. 5, pp. 456–464, 2008.
- H. Cheong, M. Ebrahimi, and T. Duggan, “Optimal design of continuum robots with reachability constraints,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 3902–3909, 2021.
- A. Mohammed, B. Schmidt, L. Wang, and L. Gao, “Minimizing energy consumption for robot arm movement,” Procedia Cirp, vol. 25, pp. 400–405, 2014.
- M. Soleimani Amiri and R. Ramli, “Intelligent trajectory tracking behavior of a multi-joint robotic arm via genetic–swarm optimization for the inverse kinematic solution,” Sensors, vol. 21, no. 9, p. 3171, 2021.
- L. Roveda, J. Maskani, P. Franceschi, A. Abdi, F. Braghin, L. Molinari Tosatti, and N. Pedrocchi, “Model-based reinforcement learning variable impedance control for human-robot collaboration,” Journal of Intelligent & Robotic Systems, vol. 100, no. 2, pp. 417–433, 2020.
- L. Peternel, N. Tsagarakis, D. Caldwell, and A. Ajoudani, “Robot adaptation to human physical fatigue in human–robot co-manipulation,” Autonomous Robots, vol. 42, pp. 1011–1021, 2018.
- K. Haninger, C. Hegeler, and L. Peternel, “Model predictive control with gaussian processes for flexible multi-modal physical human robot interaction,” in 2022 International Conference on Robotics and Automation (ICRA), pp. 6948–6955, IEEE, 2022.
- D. Sirintuna, A. Giammarino, and A. Ajoudani, “An object deformation-agnostic framework for human–robot collaborative transportation,” IEEE Transactions on Automation Science and Engineering, 2023.
- D. Sirintuna, I. Ozdamar, J. M. Gandarias, and A. Ajoudani, “Enhancing human-robot collaboration transportation through obstacle-aware vibrotactile feedback,” arXiv preprint arXiv:2302.02881, 2023.
- M. Zanon and S. Gros, “Safe reinforcement learning using robust mpc,” IEEE Transactions on Automatic Control, vol. 66, no. 8, pp. 3638–3652, 2020.
- M. B. Saltık, L. Özkan, J. H. Ludlage, S. Weiland, and P. M. Van den Hof, “An outlook on robust model predictive control algorithms: Reflections on performance and computational aspects,” Journal of Process Control, vol. 61, pp. 77–102, 2018.
- J. Mohammadpour and C. W. Scherer, Control of linear parameter varying systems with applications. Springer Science & Business Media, 2012.
- T. M. Howard, C. J. Green, and A. Kelly, “Receding horizon model-predictive control for mobile robot navigation of intricate paths,” in Field and Service Robotics: Results of the 7th International Conference, pp. 69–78, Springer, 2010.
- K. Kreutz-Delgado, M. Long, and H. Seraji, “Kinematic analysis of 7-dof manipulators,” The International journal of robotics research, vol. 11, no. 5, pp. 469–481, 1992.
- J. Sudharsan and L. Karunamoorthy, “Path planning and co-simulation control of 8 dof anthropomorphic robotic arm,” International journal of simulation modelling, vol. 15, no. 2, pp. 302–312, 2016.
- R. Campa and H. De La Torre, “Pose control of robot manipulators using different orientation representations: A comparative review,” in 2009 American Control Conference, pp. 2855–2860, IEEE, 2009.
- S. Kucuk and Z. Bingul, Robot kinematics: Forward and inverse kinematics. INTECH Open Access Publisher London, UK, 2006.
- H. Zheng, R. R. Negenborn, and G. Lodewijks, “Trajectory tracking of autonomous vessels using model predictive control,” IFAC Proceedings Volumes, vol. 47, no. 3, pp. 8812–8818, 2014.
- Q. Shi, J. Zhao, A. El Kamel, and I. Lopez-Juarez, “Mpc based vehicular trajectory planning in structured environment,” IEEE Access, vol. 9, pp. 21998–22013, 2021.
- J. Berberich, J. Köhler, M. A. Müller, and F. Allgöwer, “Linear tracking mpc for nonlinear systems—part ii: The data-driven case,” IEEE Transactions on Automatic Control, vol. 67, no. 9, pp. 4406–4421, 2022.
- A. Ran and R. Vreugdenhil, “Existence and comparison theorems for algebraic riccati equations for continuous-and discrete-time systems,” Linear Algebra and its applications, vol. 99, pp. 63–83, 1988.
- J. Wang, T. Zhang, Y. Wang, and D. Luo, “Optimizing robot arm reaching ability with different joints functionality,” in 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1778–1785, IEEE, 2023.
- J. Lu, F. Richter, and M. C. Yip, “Pose estimation for robot manipulators via keypoint optimization and sim-to-real transfer,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4622–4629, 2022.
- T. Li, K. Sun, Y. Jin, and H. Liu, “A novel optimal calibration algorithm on a dexterous 6 dof serial robot-with the optimization of measurement poses number,” in 2011 IEEE international conference on robotics and automation, pp. 975–981, IEEE, 2011.
- F. R. Inc., “Fetch & freight manual,” 2014.
- Al Jaber Mahmud (2 papers)
- Amir Hossain Raj (8 papers)
- Duc M. Nguyen (6 papers)
- Xuesu Xiao (91 papers)
- Xuan Wang (205 papers)