Sensorless Estimation of Contact Using Deep-Learning for Human-Robot Interaction (2309.16219v2)
Abstract: Physical human-robot interaction has been an area of interest for decades. Collaborative tasks, such as joint compliance, demand high-quality joint torque sensing. While external torque sensors are reliable, they come with the drawbacks of being expensive and vulnerable to impacts. To address these issues, studies have been conducted to estimate external torques using only internal signals, such as joint states and current measurements. However, insufficient attention has been given to friction hysteresis approximation, which is crucial for tasks involving extensive dynamic to static state transitions. In this paper, we propose a deep-learning-based method that leverages a novel long-term memory scheme to achieve dynamics identification, accurately approximating the static hysteresis. We also introduce modifications to the well-known Residual Learning architecture, retaining high accuracy while reducing inference time. The robustness of the proposed method is illustrated through a joint compliance and task compliance experiment.
- A. De Luca, A. Albu-Schaffer, S. Haddadin, and G. Hirzinger, “Collision detection and safe reaction with the dlr-iii lightweight manipulator arm,” in 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1623–1630, IEEE, 2006.
- E. Magrini, F. Flacco, and A. De Luca, “Control of generalized contact motion and force in physical human-robot interaction,” in 2015 IEEE international conference on robotics and automation (ICRA), pp. 2298–2304, IEEE, 2015.
- A. Wahrburg, J. Bös, K. D. Listmann, F. Dai, B. Matthias, and H. Ding, “Motor-current-based estimation of cartesian contact forces and torques for robotic manipulators and its application to force control,” IEEE Transactions on Automation Science and Engineering, vol. 15, no. 2, pp. 879–886, 2017.
- S. Zhang, S. Wang, F. Jing, and M. Tan, “A sensorless hand guiding scheme based on model identification and control for industrial robot,” IEEE Transactions on Industrial Informatics, vol. 15, no. 9, pp. 5204–5213, 2019.
- L. Roveda, A. Bussolan, F. Braghin, and D. Piga, “Robot joint friction compensation learning enhanced by 6d virtual sensor,” International Journal of Robust and Nonlinear Control, vol. 32, no. 9, pp. 5741–5763, 2022.
- N. Yilmaz, J. Y. Wu, P. Kazanzides, and U. Tumerdem, “Neural network based inverse dynamics identification and external force estimation on the da vinci research kit,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 1387–1393, IEEE, 2020.
- A.-N. Sharkawy, P. N. Koustoumpardis, and N. Aspragathos, “Human–robot collisions detection for safe human–robot interaction using one multi-input–output neural network,” Soft Computing, vol. 24, no. 9, pp. 6687–6719, 2020.
- X. Liu, F. Zhao, S. S. Ge, Y. Wu, and X. Mei, “End-effector force estimation for flexible-joint robots with global friction approximation using neural networks,” IEEE Transactions on Industrial Informatics, vol. 15, no. 3, pp. 1730–1741, 2018.
- J. Hu and R. Xiong, “Contact force estimation for robot manipulator using semiparametric model and disturbance kalman filter,” IEEE Transactions on Industrial Electronics, vol. 65, no. 4, pp. 3365–3375, 2017.
- S. Liu, L. Wang, and X. V. Wang, “Sensorless force estimation for industrial robots using disturbance observer and neural learning of friction approximation,” Robotics and Computer-Integrated Manufacturing, vol. 71, p. 102168, 2021.
- A. De Luca and R. Mattone, “Sensorless robot collision detection and hybrid force/motion control,” in Proceedings of the 2005 IEEE international conference on robotics and automation, pp. 999–1004, IEEE, 2005.
- C. Gaz, E. Magrini, and A. De Luca, “A model-based residual approach for human-robot collaboration during manual polishing operations,” Mechatronics, vol. 55, pp. 234–247, 2018.
- A. Wahrburg, E. Morara, G. Cesari, B. Matthias, and H. Ding, “Cartesian contact force estimation for robotic manipulators using kalman filters and the generalized momentum,” in 2015 IEEE International Conference on Automation Science and Engineering (CASE), pp. 1230–1235, IEEE, 2015.
- L. Roveda, G. Pallucca, N. Pedrocchi, F. Braghin, and L. M. Tosatti, “Iterative learning procedure with reinforcement for high-accuracy force tracking in robotized tasks,” IEEE Transactions on Industrial Informatics, vol. 14, no. 4, pp. 1753–1763, 2017.
- M. Gautier and S. Briot, “Global identification of joint drive gains and dynamic parameters of robots,” Journal of Dynamic Systems, Measurement, and Control, vol. 136, no. 5, p. 051025, 2014.
- T. Xu, J. Fan, Q. Fang, Y. Zhu, and J. Zhao, “Robot dynamic calibration on current level: modeling, identification and applications,” Nonlinear Dynamics, vol. 109, no. 4, pp. 2595–2613, 2022.
- C. Gaz, M. Cognetti, A. Oliva, P. R. Giordano, and A. De Luca, “Dynamic identification of the franka emika panda robot with retrieval of feasible parameters using penalty-based optimization,” IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 4147–4154, 2019.
- V. Lampaert, J. Swevers, and F. Al-Bender, “Modification of the leuven integrated friction model structure,” IEEE transactions on Automatic Control, vol. 47, no. 4, pp. 683–687, 2002.
- F. Al-Bender, V. Lampaert, and J. Swevers, “The generalized maxwell-slip model: a novel model for friction simulation and compensation,” IEEE Transactions on automatic control, vol. 50, no. 11, pp. 1883–1887, 2005.
- S. Liu, L. Wang, and X. V. Wang, “Sensorless haptic control for human-robot collaborative assembly,” CIRP Journal of Manufacturing Science and Technology, vol. 32, pp. 132–144, 2021.
- Determination press San Francisco, CA, USA, 2015.
- D. Kim, D. Lim, and J. Park, “Transferable collision detection learning for collaborative manipulator using versatile modularized neural network,” IEEE Transactions on Robotics, 2021.
- M. Hanafusa and J. Ishikawa, “External force estimation for nonlinear systems using recurrent neural network,” in 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 1055–1061, IEEE, 2019.
- D.-H. Lee, W. Hwang, and S.-C. Lim, “Interaction force estimation using camera and electrical current without force/torque sensor,” IEEE Sensors Journal, vol. 18, no. 21, pp. 8863–8872, 2018.
- J. Xia and K. Kiguchi, “Sensorless real-time force estimation in microsurgery robots using a time series convolutional neural network,” IEEE Access, vol. 9, pp. 149447–149455, 2021.
- D. Lim, D. Kim, and J. Park, “Momentum observer-based collision detection using lstm for model uncertainty learning,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 4516–4522, IEEE, 2021.
- D. Wu, Y. Zhang, M. Ourak, K. Niu, J. Dankelman, and E. Vander Poorten, “Hysteresis modeling of robotic catheters based on long short-term memory network for improved environment reconstruction,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 2106–2113, 2021.
- N. Hirose and R. Tajima, “Modeling of rolling friction by recurrent neural network using lstm,” in 2017 IEEE international conference on robotics and automation (ICRA), pp. 6471–6478, IEEE, 2017.
- N. Tran, J. Y. Wu, A. Deguet, and P. Kazanzides, “A deep learning approach to intrinsic force sensing on the da vinci surgical robot,” in 2020 Fourth IEEE International Conference on Robotic Computing (IRC), pp. 25–32, IEEE, 2020.
- T. Zhang, X. Liang, and Y. Zou, “Modeling of robot’s low-speed motion nonlinear dynamics based on phase space reconstruction neural network,” Journal of Computational and Nonlinear Dynamics, vol. 16, no. 9, p. 091003, 2021.
- S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778, 2016.
- S. Shan and Q.-C. Pham, “Fine robotic manipulation without force/torque sensor,” IEEE Robotics and Automation Letters, vol. 9, no. 2, pp. 1206–1213, 2024.