Papers
Topics
Authors
Recent
2000 character limit reached

MiniTac: An Ultra-Compact 8 mm Vision-Based Tactile Sensor for Enhanced Palpation in Robot-Assisted Minimally Invasive Surgery (2410.22691v1)

Published 30 Oct 2024 in cs.RO

Abstract: Robot-assisted minimally invasive surgery (RAMIS) provides substantial benefits over traditional open and laparoscopic methods. However, a significant limitation of RAMIS is the surgeon's inability to palpate tissues, a crucial technique for examining tissue properties and detecting abnormalities, restricting the widespread adoption of RAMIS. To overcome this obstacle, we introduce MiniTac, a novel vision-based tactile sensor with an ultra-compact cross-sectional diameter of 8 mm, designed for seamless integration into mainstream RAMIS devices, particularly the Da Vinci surgical systems. MiniTac features a novel mechanoresponsive photonic elastomer membrane that changes color distribution under varying contact pressures. This color change is captured by an embedded miniature camera, allowing MiniTac to detect tumors both on the tissue surface and in deeper layers typically obscured from endoscopic view. MiniTac's efficacy has been rigorously tested on both phantoms and ex-vivo tissues. By leveraging advanced mechanoresponsive photonic materials, MiniTac represents a significant advancement in integrating tactile sensing into RAMIS, potentially expanding its applicability to a wider array of clinical scenarios that currently rely on traditional surgical approaches.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. K.-W. Kwok, H. Wurdemann, A. Arezzo, A. Menciassi, and K. Althoefer, “Soft robot-assisted minimally invasive surgery and interventions: Advances and outlook,” Proceedings of the IEEE, vol. 110, no. 7, pp. 871–892, 2022.
  2. J. Vilsan, S. A. Maddineni, N. Ahsan, M. Mathew, N. Chilakuri, N. Yadav, E. J. Munoz, M. A. Nadeem, K. Abbas, W. Razzaq et al., “Open, laparoscopic, and robotic approaches to treat colorectal cancer: a comprehensive review of literature,” Cureus, vol. 15, no. 5, 2023.
  3. H. Liu, J. Li, X. Song, L. D. Seneviratne, and K. Althoefer, “Rolling indentation probe for tissue abnormality identification during minimally invasive surgery,” Transactions on Robotics (T-RO), vol. 27, no. 3, pp. 450–460, 2011.
  4. S. Vaccarella, S. Franceschi, F. Bray, C. P. Wild, M. Plummer, and L. Dal Maso, “Worldwide thyroid-cancer epidemic? the increasing impact of overdiagnosis,” New England Journal of Medicine, vol. 375, no. 7, pp. 614–617, 2016.
  5. N. Riggi, M. L. Suvà, and I. Stamenkovic, “Ewing’s sarcoma,” New England Journal of Medicine, vol. 384, no. 2, pp. 154–164, 2021.
  6. A. Gerald and S. Russo, “Soft sensing and haptics for medical procedures,” Nature Reviews Materials, pp. 1–3, 2024.
  7. J. Konstantinova, A. Jiang, K. Althoefer, P. Dasgupta, and T. Nanayakkara, “Implementation of tactile sensing for palpation in robot-assisted minimally invasive surgery: A review,” IEEE Sensors Journal, vol. 14, no. 8, pp. 2490–2501, 2014.
  8. W. Othman, Z.-H. A. Lai, C. Abril, J. S. Barajas-Gamboa, R. Corcelles, M. Kroh, and M. A. Qasaimeh, “Tactile sensing for minimally invasive surgery: Conventional methods and potential emerging tactile technologies,” Frontiers in Robotics and AI, vol. 8, p. 705662, 2022.
  9. I. Surgical, “Da vinci robotic surgical systems,” accessed: 2024. [Online]. Available: https://www.intuitive.com
  10. B. H. Miller, H. Liu, and M. Kolle, “Scalable optical manufacture of dynamic structural colour in stretchable materials,” Nature Materials, vol. 21, no. 9, pp. 1014–1018, 2022.
  11. M. Kalantari, M. Ramezanifard, R. Ahmadi, J. Dargahi, and J. Kovecses, “Design, fabrication, and testing of a piezoresistive hardness sensor in minimally invasive surgery,” in IEEE Haptics Symposium.   IEEE, 2010, pp. 431–437.
  12. J. Lee, W. Choi, Y. K. Yoo, K. S. Hwang, S.-M. Lee, S. Kang, J. Kim, and J. H. Lee, “A micro-fabricated force sensor using an all thin film piezoelectric active sensor,” Sensors, vol. 14, no. 12, pp. 22 199–22 207, 2014.
  13. U. Kim, Y. B. Kim, J. So, D.-Y. Seok, and H. R. Choi, “Sensorized surgical forceps for robotic-assisted minimally invasive surgery,” IEEE Transactions on Industrial Electronics, vol. 65, no. 12, pp. 9604–9613, 2018.
  14. H. Xie, H. Liu, L. D. Seneviratne, and K. Althoefer, “An optical tactile array probe head for tissue palpation during minimally invasive surgery,” IEEE Sensors Journal, vol. 14, no. 9, pp. 3283–3291, 2014.
  15. Y. Luo, M. R. Abidian, J.-H. Ahn, D. Akinwande, A. M. Andrews, M. Antonietti, Z. Bao, M. Berggren, C. A. Berkey, C. J. Bettinger et al., “Technology roadmap for flexible sensors,” ACS Nano, vol. 17, no. 6, pp. 5211–5295, 2023.
  16. W. Yuan, S. Dong, and E. H. Adelson, “Gelsight: High-resolution robot tactile sensors for estimating geometry and force,” Sensors, vol. 17, no. 12, p. 2762, 2017.
  17. GelSight, “Gelsight-mini,” accessed: 2024. [Online]. Available: https://www.gelsight.com/gelsightmini/
  18. M. Lambeta, P.-W. Chou, S. Tian, B. Yang, B. Maloon, V. R. Most, D. Stroud, R. Santos, A. Byagowi, G. Kammerer et al., “Digit: A novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation,” IEEE Robotics and Automation Letters (RA-L), vol. 5, no. 3, pp. 3838–3845, 2020.
  19. I. H. Taylor, S. Dong, and A. Rodriguez, “Gelslim 3.0: High-resolution measurement of shape, force and slip in a compact tactile-sensing finger,” in International Conference on Robotics and Automation (ICRA).   IEEE, 2022, pp. 10 781–10 787.
  20. W. Li, M. Wang, J. Li, Y. Su, D. K. Jha, X. Qian, K. Althoefer, and H. Liu, “L3 F-TOUCH: A wireless gelsight with decoupled tactile and three-axis force sensing,” IEEE Robotics and Automation Letters (RA-L), 2023.
  21. C. Lin, H. Zhang, J. Xu, L. Wu, and H. Xu, “9dtact: A compact vision-based tactile sensor for accurate 3d shape reconstruction and generalizable 6d force estimation,” IEEE Robotics and Automation Letters (RA-L), 2023.
  22. C. Zhang, S. Cui, S. Wang, J. Hu, Y. Cai, R. Wang, and Y. Wang, “Gelstereo 2.0: An improved gelstereo sensor with multimedium refractive stereo calibration,” IEEE Transactions on Industrial Electronics, 2023.
  23. L. Luo, B. Zhang, Z. Peng, Y. K. Cheung, G. Zhang, Z. Li, M. Y. Wang, and H. Yu, “Compdvision: Combining near-field 3d visual and tactile sensing using a compact compound-eye imaging system,” arXiv preprint arXiv:2312.07146, 2023.
  24. W. Yuan, M. A. Srinivasan, and E. H. Adelson, “Estimating object hardness with a gelsight touch sensor,” in International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2016, pp. 208–215.
  25. Y. Yan, Z. Hu, Y. Shen, and J. Pan, “Surface texture recognition by deep learning-enhanced tactile sensing,” Advanced Intelligent Systems, vol. 4, no. 1, p. 2100076, 2022.
  26. Z. Zhao, Y. Li, W. Li, Z. Qi, L. Ruan, Y. Zhu, and K. Althoefer, “Tac-Man: Tactile-informed prior-free manipulation of articulated objects,” arXiv preprint arXiv:2403.01694, 2024.
  27. X. Jia, R. Li, M. A. Srinivasan, and E. H. Adelson, “Lump detection with a gelsight sensor,” in World Haptics Conference (WHC).   IEEE, 2013, pp. 175–179.
  28. S. Cui, Y. Tian, J. Hu, R. Wang, Y. Wang, and S. Wang, “Prototype of a novel visuotactile endoscope probe,” in IEEE 13th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).   IEEE, 2023, pp. 1368–1373.
  29. J. Di, Z. Dugonjic, W. Fu, T. Wu, R. Mercado, K. Sawyer, V. R. Most, G. Kammerer, S. Speidel, R. E. Fan et al., “Using fiber optic bundles to miniaturize vision-based tactile sensors,” arXiv preprint arXiv:2403.05500, 2024.
  30. Y. Yue and J. P. Gong, “Tunable one-dimensional photonic crystals from soft materials,” Journal of Photochemistry and Photobiology C: Photochemistry Reviews, vol. 23, pp. 45–67, 2015.
  31. Y. Cho, S. Y. Lee, L. Ellerthorpe, G. Feng, G. Lin, G. Wu, J. Yin, and S. Yang, “Elastoplastic inverse opals as power-free mechanochromic sensors for force recording,” Advanced Functional Materials, vol. 25, no. 38, pp. 6041–6049, 2015.
  32. S. Wang, Y. She, B. Romero, and E. Adelson, “Gelsight wedge: Measuring high-resolution 3d contact geometry with a compact robot finger,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 6468–6475.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free