Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Integrating 3D Slicer with a Dynamic Simulator for Situational Aware Robotic Interventions (2401.11715v1)

Published 22 Jan 2024 in cs.RO, cs.SY, and eess.SY

Abstract: Image-guided robotic interventions represent a transformative frontier in surgery, blending advanced imaging and robotics for improved precision and outcomes. This paper addresses the critical need for integrating open-source platforms to enhance situational awareness in image-guided robotic research. We present an open-source toolset that seamlessly combines a physics-based constraint formulation framework, AMBF, with a state-of-the-art imaging platform application, 3D Slicer. Our toolset facilitates the creation of highly customizable interactive digital twins, that incorporates processing and visualization of medical imaging, robot kinematics, and scene dynamics for real-time robot control. Through a feasibility study, we showcase real-time synchronization of a physical robotic interventional environment in both 3D Slicer and AMBF, highlighting low-latency updates and improved visualization.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. G. Fichtinger, J. Troccaz, and T. Haidegger, “Image-guided interventional robotics: Lost in translation?” Proceedings of the IEEE, vol. 110, no. 7, pp. 932–950, 2022.
  2. K. Cleary and T. M. Peters, “Image-guided interventions: technology review and clinical applications,” Annual Review of Biomedical Engineering, vol. 12, pp. 119–142, 2010.
  3. R. Taylor, P. Jensen et al., “A steady-hand robotic system for microsurgical augmentation,” The International Journal of Robotics Research, vol. 18, no. 12, pp. 1201–1210, 1999.
  4. N. Simaan, R. H. Taylor, and H. Choset, “Intelligent surgical robots with situational awareness,” Mechanical Engineering, vol. 137, no. 09, pp. S3–S6, 2015.
  5. H. Choi, C. Crump et al., “On the use of simulation in robotics: Opportunities, challenges, and suggestions for moving forward,” PNAS, vol. 118, no. 1, p. e1907856118, 2021.
  6. A. Fedorov, R. Beichel et al., “3D Slicer as an image computing platform for the quantitative imaging network,” Magnetic Resonance Imaging, vol. 30, no. 9, pp. 1323–1341, 2012.
  7. T. Ungi, A. Lasso, and G. Fichtinger, “Open-source platforms for navigated image-guided interventions,” Medical Image Analysis, vol. 33, pp. 181–186, 2016.
  8. M. Quigley, K. Conley et al., “ROS: an open-source Robot Operating System,” in ICRA Workshop on Open Source Software, vol. 3, no. 3.2.   Kobe, Japan, 2009, p. 5.
  9. L. Connolly, A. Deguet et al., “An open-source platform for cooperative, semi-autonomous robotic surgery,” in IEEE International Conference on Autonomous Systems (ICAS).   IEEE, 2021, pp. 1–5.
  10. A. Munawar and G. S. Fischer, “An asynchronous multi-body simulation framework for real-time dynamics, haptics and learning with application to surgical robots.”   IROS, Nov 2019.
  11. J. Tokuda, G. S. Fischer et al., “OpenIGTLink: an open network protocol for image-guided therapy environment,” IJMRCAS, vol. 5, no. 4, pp. 423–434, 2009.
  12. A. Lasso, T. Heffter et al., “PLUS: open-source toolkit for ultrasound-guided intervention systems,” TBME, vol. 61, no. 10, pp. 2527–2537, 2014.
  13. S. Tauscher, J. Tokuda et al., “OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems,” IJCARS, vol. 10, pp. 285–292, 2015.
  14. T. Frank, A. Krieger et al., “ROS-IGTL-Bridge: an open network interface for image-guided therapy using the ROS environment,” IJCARS, vol. 12, pp. 1451–1460, 2017.
  15. L. Connolly et al., “Bridging 3D Slicer and ROS2 for image-guided robotic interventions.” Sensors, vol. 22,14 5336, Jul 2022.
  16. T. Foote, “tf: The transform library,” in TePRA.   IEEE, 2013, pp. 1–6.
  17. N. Koenig and A. Howard, “Design and use paradigms for gazebo, an open-source multi-robot simulator,” in IROS, vol. 3.   IEEE, 2004, pp. 2149–2154.
  18. E. Rohmer, S. P. Singh, and M. Freese, “V-REP: A versatile and scalable robot simulation framework,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2013, pp. 1321–1326.
  19. A. Munawar, Z. Li et al., “Fully immersive virtual reality for skull-base surgery: surgical training and beyond,” IJCARS, pp. 1–9, 2023.
  20. H. Phalen, A. Munawar et al., “Platform for investigating continuum manipulator behavior in orthopedics,” IJCARS, pp. 1–6, 2023.
  21. H. Shu, R. Liang et al., “Twin-s: a digital twin for skull base surgery,” IJCARS, pp. 1–8, 2023.
  22. A. Munawar, J. Y. Wu et al., “Open simulation environment for learning and practice of robot-assisted surgical suturing,” RAL, vol. 7, no. 2, pp. 3843–3850, 2022.
  23. C. Attig, N. Rauh et al., “System latency guidelines then and now–is zero latency really considered necessary?” in Engineering Psychology and Cognitive Ergonomics.   Springer, 2017, pp. 3–14.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now