Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Accounting for Hysteresis in the Forward Kinematics of Nonlinearly-Routed Tendon-Driven Continuum Robots via a Learned Deep Decoder Network (2404.03816v1)

Published 4 Apr 2024 in cs.RO

Abstract: Tendon-driven continuum robots have been gaining popularity in medical applications due to their ability to curve around complex anatomical structures, potentially reducing the invasiveness of surgery. However, accurate modeling is required to plan and control the movements of these flexible robots. Physics-based models have limitations due to unmodeled effects, leading to mismatches between model prediction and actual robot shape. Recently proposed learning-based methods have been shown to overcome some of these limitations but do not account for hysteresis, a significant source of error for these robots. To overcome these challenges, we propose a novel deep decoder neural network that predicts the complete shape of tendon-driven robots using point clouds as the shape representation, conditioned on prior configurations to account for hysteresis. We evaluate our method on a physical tendon-driven robot and show that our network model accurately predicts the robot's shape, significantly outperforming a state-of-the-art physics-based model and a learning-based model that does not account for hysteresis.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. P. Dupont, N. Simaan, H. Choset, and C. Rucker, “Continuum robots for medical interventions,” Proceedings of the IEEE, vol. 110, no. 7, pp. 847–870, July 2022.
  2. J. Burgner-Kahrs, D. C. Rucker, and H. Choset, “Continuum robots for medical applications: a survey,” IEEE Transactions on Robotics, vol. 31, no. 6, pp. 1261–1280, Dec. 2015.
  3. T.-D. Nguyen and J. Burgner-Kahrs, “A tendon-driven continuum robot with extensible sections,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sept. 2015, pp. 2130–2135.
  4. T. Kato, I. Okumura, S.-E. Song, A. J. Golby, and N. Hata, “Tendon-driven continuum robot for endoscopic surgery: preclinical development and validation of a tension propagation model,” IEEE/ASME Transactions on Mechatronics, vol. 20, no. 5, pp. 2252–2263, Oct. 2015.
  5. D. C. Rucker and R. J. Webster, III, “Statics and dynamics of continuum robots with general tendon routing and external loading,” IEEE Transactions on Robotics, vol. 27, no. 6, pp. 1033–1044, Dec. 2011.
  6. K. Oliver-Butler, J. Till, and C. Rucker, “Continuum Robot Stiffness under External Loads and Prescribed Tendon Displacements,” IEEE Transactions on Robotics, vol. 35, no. 2, 2019.
  7. R. Grassmann, V. Modes, and J. Burgner-Kahrs, “Learning the forward and inverse kinematics of a 6-DOF concentric tube continuum robot in SE(3),” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 5125–5132.
  8. A. Kuntz, A. Sethi, R. J. Webster, III, and R. Alterovitz, “Learning the Complete Shape of Concentric Tube Robots,” IEEE Transactions on Medical Robotics and Bionics, vol. 2, no. 2, pp. 140–147, 2020.
  9. H.-J. Yu, W.-L. Yang, Z.-X. Yang, W. Dong, Z.-J. Du, and Z.-Y. Yan, “Hysteresis analysis of a notched continuum manipulator driven by tendon,” Mechanical Sciences, vol. 9, no. 1, pp. 211–219, June 2018.
  10. Y.-H. Kim and T. Mansi, “Shape-adaptive hysteresis compensation for tendon-driven continuum manipulators,” arXiv preprint arXiv:2109.06907, 2021.
  11. W. Wu, Z. Qi, and L. Fuxin, “PointConv: Deep Convolutional Networks on 3D Point Clouds,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 9621–9630.
  12. C. R. Qi, H. Su, K. Mo, and L. J. Guibas, “PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2017, pp. 652–660.
  13. B. Thach, B. Y. Cho, A. Kuntz, and T. Hermans, “Learning Visual Shape Control of Novel 3D Deformable Objects from Partial-View Point Clouds,” in International Conference on Robotics and Automation (ICRA), May 2022, pp. 8274–8281.
  14. M. Bentley, C. Rucker, and A. Kuntz, “Interactive-Rate Supervisory Control for Arbitrarily-Routed Multitendon Robots via Motion Planning,” IEEE Access, vol. 10, pp. 80 999–81 019, 2022.
  15. P. J. Swaney, P. A. York, H. B. Gilbert, J. Burgner-Kahrs, and R. J. Webster, “Design, fabrication, and testing of a needle-sized wrist for surgical instruments,” Journal of Medical Devices, vol. 11, no. 1, p. 014501, Mar. 2017.
  16. A. Leavitt, R. Lam, N. C. Taylor, D. S. Drew, and A. Kuntz, “Toward a millimeter-scale tendon-driven continuum wrist with integrated gripper for microsurgical applications,” arXiv preprint arXiv:2302.07252, 2023.
  17. H. Yuan, L. Zhou, and W. Xu, “A comprehensive static model of cable-driven multi-section continuum robots considering friction effect,” Mechanism and Machine Theory, vol. 135, pp. 130–149, May 2019.
  18. T. Poignonec, P. Zanne, B. Rosa, and F. Nageotte, “Towards In Situ Backlash Estimation of Continuum Robots Using an Endoscopic Camera,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 4788–4795, July 2020.
  19. T. Kato, I. Okumura, H. Kose, K. Takagi, and N. Hata, “Tendon-driven continuum robot for neuroendoscopy: validation of extended kinematic mapping for hysteresis operation,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, no. 4, pp. 589–602, Apr. 2016.
  20. D. Baek, J.-H. Seo, J. Kim, and D.-S. Kwon, “Hysteresis compensator with learning-based hybrid joint angle estimation for flexible surgery robots,” IEEE Robotics and Automation Letters, vol. 5, no. 4, pp. 6837–6844, 2020.
  21. Y. Guo, B. Pan, Y. Sun, G. Niu, Y. Fu, and M. Q.-H. Meng, “Motion hysteresis compensation based on motor current segmentation for elongated cable-driven surgical instruments,” IEEE Transactions on Automation Science and Engineering, 2023.
  22. S. Neppalli, M. A. Csencsits, B. A. Jones, and I. D. Walker, “Closed-form inverse kinematics for continuum manipulators,” Advanced Robotics, vol. 23, no. 15, pp. 2077–2091, 2009.
  23. D. Wu, Y. Zhang, M. Ourak, K. Niu, J. Dankelman, and E. Vander Poorten, “Hysteresis modeling of robotic catheters based on long short-term memory network for improved environment reconstruction,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 2106–2113, 2021.
  24. W. Bai, F. Cursi, X. Guo, B. Huang, B. Lo, G.-Z. Yang, and E. M. Yeatman, “Task-based lstm kinematic modeling for a tendon-driven flexible surgical robot,” IEEE Transactions on Medical Robotics and Bionics, vol. 4, no. 2, pp. 339–342, 2021.
  25. J. Jung, R. S. Penning, N. J. Ferrier, and M. R. Zinn, “A modeling approach for continuum robotic manipulators: Effects of nonlinear internal device friction,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, Sept. 2011, pp. 5139–5146.
  26. G. Subramani and M. R. Zinn, “Tackling friction - an analytical modeling approach to understanding friction in single tendon driven continuum manipulators,” in IEEE International Conference on Robotics and Automation (ICRA), May 2015, pp. 610–617.
  27. S. Lilge, T. D. Barfoot, and J. Burgner-Kahrs, “Continuum robot state estimation using gaussian process regression on se (3),” The International Journal of Robotics Research, vol. 41, no. 13-14, pp. 1099–1120, 2022.
  28. W. Xu, J. Chen, H. Y. Lau, and H. Ren, “Data-driven methods towards learning the highly nonlinear inverse kinematics of tendon-driven surgical manipulators,” The International Journal of Medical Robotics and Computer Assisted Surgery, vol. 13, no. 3, p. e1774, 2017.
  29. N. Liang, R. M. Grassmann, S. Lilge, and J. Burgner-Kahrs, “Learning-based Inverse Kinematics from Shape as Input for Concentric Tube Continuum Robots,” in IEEE International Conference on Robotics and Automation (ICRA), May 2021, pp. 1387–1393.
  30. C. Bergeles, F. Y. Lin, and G. Z. Yang, “Concentric tube robot kinematics using neural networks,” in Hamlyn symposium on medical robotics, June 2015, pp. 1–2.
  31. G. Fagogenis, C. Bergeles, and P. E. Dupont, “Adaptive nonparametric kinematic modeling of concentric tube robots,” in IEEE/RSJ international conference on intelligent robots and systems (IROS), Oct. 2016, pp. 4324–4329.
  32. V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in Proceedings of the 27th international conference on machine learning (ICML-10), 2010, pp. 807–814.
  33. S. Ioffe and C. Szegedy, “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift,” in Proceedings of the 32nd International Conference on Machine Learning, June 2015, pp. 448–456.
  34. K. S. Arun, T. S. Huang, and S. D. Blostein, “Least-squares fitting of two 3-D point sets,” IEEE Transactions on pattern analysis and machine intelligence, no. 5, pp. 698–700, 1987.
  35. X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics.   JMLR Workshop and Conference Proceedings, Mar. 2010, pp. 249–256.
  36. Y. Huang, M. Bentley, T. Hermans, and A. Kuntz, “Toward learning context-dependent tasks from demonstration for tendon-driven surgical robots,” in International Symposium on Medical Robotics (ISMR), Nov. 2021.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com