Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

EVD Surgical Guidance with Retro-Reflective Tool Tracking and Spatial Reconstruction using Head-Mounted Augmented Reality Device (2306.15490v2)

Published 27 Jun 2023 in eess.IV and cs.CV

Abstract: Augmented Reality (AR) has been used to facilitate surgical guidance during External Ventricular Drain (EVD) surgery, reducing the risks of misplacement in manual operations. During this procedure, the key challenge is accurately estimating the spatial relationship between pre-operative images and actual patient anatomy in AR environment. This research proposes a novel framework utilizing Time of Flight (ToF) depth sensors integrated in commercially available AR Head Mounted Devices (HMD) for precise EVD surgical guidance. As previous studies have proven depth errors for ToF sensors, we first assessed their properties on AR-HMDs. Subsequently, a depth error model and patient-specific parameter identification method are introduced for accurate surface information. A tracking pipeline combining retro-reflective markers and point clouds is then proposed for accurate head tracking. The head surface is reconstructed using depth data for spatial registration, avoiding fixing tracking targets rigidly on the patient's skull. Firstly, $7.580\pm 1.488 mm$ depth value error was revealed on human skin, indicating the significance of depth correction. Our results showed that the error was reduced by over $85\%$ using proposed depth correction method on head phantoms in different materials. Meanwhile, the head surface reconstructed with corrected depth data achieved sub-millimetre accuracy. An experiment on sheep head revealed $0.79 mm$ reconstruction error. Furthermore, a user study was conducted for the performance in simulated EVD surgery, where five surgeons performed nine k-wire injections on a head phantom with virtual guidance. Results of this study revealed $2.09 \pm 0.16 mm$ translational accuracy and $2.97\pm 0.91$ degree orientational accuracy.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. V. M. Srinivasan, B. R. O’Neill, D. Jho, D. M. Whiting, and M. Y. Oh, “The history of external ventricular drainage: Historical vignette,” Journal of neurosurgery, vol. 120, no. 1, pp. 228–236, 2014.
  2. U. K. Kakarla, S. W. Chang, N. Theodore, R. F. Spetzler, and L. J. Kim, “Safety and accuracy of bedside external ventricular drain placement,” Operative Neurosurgery, vol. 63, no. 1, pp. ONS162–ONS167, 2008.
  3. B. Eftekhar, “App-assisted external ventricular drain insertion,” Journal of neurosurgery, vol. 125, no. 3, pp. 754–758, 2016.
  4. P. E. Pelargos, D. T. Nagasawa, C. Lagman, S. Tenn, J. V. Demos, S. J. Lee, T. T. Bui, N. E. Barnette, N. S. Bhatt, N. Ung et al., “Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery,” Journal of clinical neuroscience, vol. 35, pp. 1–4, 2017.
  5. D. R. Huyette, B. J. Turnbow, C. Kaufman, D. F. Vaslow, B. B. Whiting, and M. Y. Oh, “Accuracy of the freehand pass technique for ventriculostomy catheter placement: retrospective assessment using computed tomography scans,” Journal of neurosurgery, vol. 108, no. 1, pp. 88–91, 2008.
  6. K. Mostofi and R. K. Khouzani, “Surface anatomy for implantation of external ventricular drainage: some surgical remarks,” Surgical Neurology International, vol. 7, no. Suppl 22, p. S577, 2016.
  7. T. J. Wilson, W. R. Stetler, W. N. Al-Holou, and S. E. Sullivan, “Comparison of the accuracy of ventricular catheter placement using freehand placement, ultrasonic guidance, and stereotactic neuronavigation,” Journal of neurosurgery, vol. 119, no. 1, pp. 66–70, 2013.
  8. P. M. Foreman, P. Hendrix, C. J. Griessenauer, P. G. Schmalz, and M. R. Harrigan, “External ventricular drain placement in the intensive care unit versus operating room: evaluation of complications and accuracy,” Clinical neurology and neurosurgery, vol. 128, pp. 94–100, 2015.
  9. Y.-G. Park, H.-J. Woo, E. Kim, and J. Park, “Accuracy and safety of bedside external ventricular drain placement at two different cranial sites: Kocher’s point versus forehead,” Journal of Korean Neurosurgical Society, vol. 50, no. 4, p. 317, 2011.
  10. O. P. Gautschi, N. Smoll, M. Kotowski, B. Schatlo, M. Tosic, B. Stimec, J. Fasel, K. Schaller, and P. Bijlenga, “Non-assisted versus neuro-navigated and xperct-guided external ventricular catheter placement: a comparative cadaver study,” Acta neurochirurgica, vol. 156, pp. 777–785, 2014.
  11. A. Shtaya, J. Roach, A.-R. Sadek, B. Gaastra, J. Hempenstall, and D. Bulters, “Image guidance and improved accuracy of external ventricular drain tip position particularly in patients with small ventricles,” Journal of Neurosurgery, vol. 130, no. 4, pp. 1268–1273, 2018.
  12. B. Fisher, W. C. Soon, J. Ong, T. Chan, Y. Chowdhury, J. Hodson, and A. White, “Is image guidance essential for external ventricular drain insertion?” World neurosurgery, vol. 156, pp. e329–e337, 2021.
  13. D. Fiorella, L. Peeling, C. M. Denice, M. Sarmiento, and H. H. Woo, “Integrated flat detector ct and live fluoroscopic-guided external ventricular drain placement within the neuroangiography suite,” Journal of NeuroInterventional Surgery, vol. 6, no. 6, pp. 457–460, 2014.
  14. A. S. Jakola, I. Reinertsen, T. Selbekk, O. Solheim, F. Lindseth, S. Gulati, and G. Unsgård, “Three-dimensional ultrasound–guided placement of ventricular catheters,” World neurosurgery, vol. 82, no. 3-4, pp. 536–e5, 2014.
  15. A. AlAzri, K. Mok, J. Chankowsky, M. Mullah, and J. Marcoux, “Placement accuracy of external ventricular drain when comparing freehand insertion to neuronavigation guidance in severe traumatic brain injury,” Acta neurochirurgica, vol. 159, pp. 1399–1411, 2017.
  16. H. I. Fried, B. R. Nathan, A. S. Rowe, J. M. Zabramski, N. Andaluz, A. Bhimraj, M. M. Guanci, D. B. Seder, and J. M. Singh, “The insertion and management of external ventricular drains: an evidence-based consensus statement: a statement for healthcare professionals from the neurocritical care society,” Neurocritical care, vol. 24, pp. 61–81, 2016.
  17. T. Frantz, B. Jansen, J. Duerinck, and J. Vandemeulebroucke, “Augmenting microsoft’s hololens with vuforia tracking for neuronavigation,” Healthcare technology letters, vol. 5, no. 5, pp. 221–225, 2018.
  18. A. Meola, F. Cutolo, M. Carbone, F. Cagnazzo, M. Ferrari, and V. Ferrari, “Augmented reality in neurosurgery: a systematic review,” Neurosurgical review, vol. 40, pp. 537–548, 2017.
  19. D. Guha, N. M. Alotaibi, N. Nguyen, S. Gupta, C. McFaul, and V. X. Yang, “Augmented reality in neurosurgery: a review of current concepts and emerging applications,” Canadian Journal of Neurological Sciences, vol. 44, no. 3, pp. 235–245, 2017.
  20. Z. Qi, Y. Li, X. Xu, J. Zhang, F. Li, Z. Gan, R. Xiong, Q. Wang, S. Zhang, and X. Chen, “Holographic mixed-reality neuronavigation with a head-mounted device: technical feasibility and clinical application,” Neurosurgical Focus, vol. 51, no. 2, p. E22, 2021.
  21. Y. Li, X. Chen, N. Wang, W. Zhang, D. Li, L. Zhang, X. Qu, W. Cheng, Y. Xu, W. Chen et al., “A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside,” Journal of neurosurgery, vol. 131, no. 5, pp. 1599–1606, 2018.
  22. F. Van Gestel, T. Frantz, C. Vannerom, A. Verhellen, A. G. Gallagher, S. A. Elprama, A. Jacobs, R. Buyl, M. Bruneau, B. Jansen et al., “The effect of augmented reality on the accuracy and learning curve of external ventricular drain placement,” Neurosurgical focus, vol. 51, no. 2, p. E8, 2021.
  23. Z. Yi, B. He, Z. Deng, Y. Liu, S. Huang, and W. Hong, “A virtual reality-based data analysis for optimizing freehand external ventricular drain insertion,” International Journal of Computer Assisted Radiology and Surgery, vol. 16, pp. 269–276, 2021.
  24. M. Carbone, S. Condino, F. Cutolo, R. M. Viglialoro, O. Kaschke, U. W. Thomale, and V. Ferrari, “Proof of concept: wearable augmented reality video see-through display for neuro-endoscopy,” in Augmented Reality, Virtual Reality, and Computer Graphics: 5th International Conference, AVR 2018, Otranto, Italy, June 24–27, 2018, Proceedings, Part II 5.   Springer, 2018, pp. 95–104.
  25. W. Gu, K. Shah, J. Knopf, N. Navab, and M. Unberath, “Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft hololens 1,” Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, vol. 9, no. 3, pp. 261–270, 2021.
  26. M. C. Palumbo, S. Saitta, M. Schiariti, M. C. Sbarra, E. Turconi, G. Raccuia, J. Fu, V. Dallolio, P. Ferroli, E. Votta et al., “Mixed reality and deep learning for external ventricular drainage placement: A fast and automatic workflow for emergency treatments,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part VII.   Springer, 2022, pp. 147–156.
  27. C. Kunz, P. Maurer, F. Kees, P. Henrich, C. Marzi, M. Hlaváč, M. Schneider, and F. Mathis-Ullrich, “Infrared marker tracking with the hololens for neurosurgical interventions,” Current Directions in Biomedical Engineering, vol. 6, no. 1, 2020.
  28. A. Martin-Gomez, H. Li, T. Song, S. Yang, G. Wang, H. Ding, N. Navab, Z. Zhao, and M. Armand, “Sttar: surgical tool tracking using off-the-shelf augmented reality head-mounted displays,” IEEE Transactions on Visualization and Computer Graphics, 2023.
  29. D. Ungureanu, F. Bogo, S. Galliani, P. Sama, C. Meekhof, J. Stühmer, T. J. Cashman, B. Tekin, J. L. Schönberger, P. Olszta et al., “Hololens 2 research mode as a tool for computer vision research,” arXiv preprint arXiv:2008.11239, 2020.
  30. Y. He, B. Liang, Y. Zou, J. He, and J. Yang, “Depth errors analysis and correction for time-of-flight (tof) cameras,” Sensors, vol. 17, no. 1, p. 92, 2017.
  31. K. Tanaka, Y. Mukaigawa, T. Funatomi, H. Kubo, Y. Matsushita, and Y. Yagi, “Material classification using frequency-and depth-dependent time-of-flight distortion,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 79–88.
  32. M. E. de Oliveira, H. G. Debarba, A. Lädermann, S. Chagué, and C. Charbonnier, “A hand-eye calibration method for augmented reality applied to computer-assisted orthopedic surgery,” The international journal of medical robotics and computer assisted surgery, vol. 15, no. 2, p. e1969, 2019.
  33. S. Barai and M. Momin, “Outside-in electromagnetic tracking method for augmented and virtual reality 6-degree of freedom head-mounted displays,” in 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS).   IEEE, 2020, pp. 467–476.
  34. J.-f. Wang, R. T. Azuma, G. Bishop, V. Chi, J. Eyles, and H. Fuchs, “Tracking a head-mounted display in a room-sized environment with head-mounted cameras,” in Helmet-Mounted Displays II, vol. 1290.   SPIE, 1990, pp. 47–57.
  35. Y.-S. Dho, S. J. Park, H. Choi, Y. Kim, H. C. Moon, K. M. Kim, H. Kang, E. J. Lee, M.-S. Kim, J. W. Kim et al., “Development of an inside-out augmented reality technique for neurosurgical navigation,” Neurosurgical Focus, vol. 51, no. 2, p. E21, 2021.
  36. D. Mitsuno, K. Ueda, T. Itamiya, T. Nuri, and Y. Otsuki, “Intraoperative evaluation of body surface improvement by an augmented reality system that a clinician can modify,” Plastic and Reconstructive Surgery Global Open, vol. 5, no. 8, 2017.
  37. F. Liebmann, S. Roner, M. von Atzigen, D. Scaramuzza, R. Sutter, J. Snedeker, M. Farshad, and P. Fürnstahl, “Pedicle screw navigation using surface digitization on the microsoft hololens,” International journal of computer assisted radiology and surgery, vol. 14, pp. 1157–1165, 2019.
  38. L. Qian, X. Zhang, A. Deguet, and P. Kazanzides, “Aramis: Augmented reality assistance for minimally invasive surgery using a head-mounted display,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part V 22.   Springer, 2019, pp. 74–82.
  39. A. Lysenko, A. Razumova, A. Yaremenko, V. Ivanov, S. Strelkov, and A. Krivtsov, “The use of augmented reality navigation technology in combination with endoscopic surgery for the treatment of an odontogenic cyst of the upper jaw: A technical report,” Imaging Science in Dentistry, vol. 52, no. 2, p. 225, 2022.
  40. C. Gsaxner, J. Li, A. Pepe, D. Schmalstieg, and J. Egger, “Inside-out instrument tracking for surgical navigation in augmented reality,” in Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, 2021, pp. 1–11.
  41. Y. Hu, T.-M. Li, L. Anderson, J. Ragan-Kelley, and F. Durand, “Taichi: a language for high-performance computation on spatially sparse data structures,” ACM Transactions on Graphics (TOG), vol. 38, no. 6, pp. 1–16, 2019.
  42. S.-Y. Park and M. Subbarao, “An accurate and fast point-to-plane registration technique,” Pattern Recognition Letters, vol. 24, no. 16, pp. 2967–2976, 2003.
  43. S. Pieper, M. Halle, and R. Kikinis, “3d slicer,” in 2004 2nd IEEE international symposium on biomedical imaging: nano to macro (IEEE Cat No. 04EX821).   IEEE, 2004, pp. 632–635.
  44. A. Keller, “Hololens 2 infrared retro-reflector tracking,” https://github.com/andreaskeller96/HoloLens2-IRTracking, 2023.
  45. J. M. Spirig, S. Roner, F. Liebmann, P. Fürnstahl, and M. Farshad, “Augmented reality-navigated pedicle screw placement: a cadaveric pilot study,” European Spine Journal, vol. 30, no. 12, pp. 3731–3737, 2021.
  46. Y. Jung, Y. Wu, H. Jung, and J. Kim, “Model reconstruction of real-world 3d objects: An application with microsoft hololens,” in Intelligent Scene Modeling and Human-Computer Interaction.   Springer, 2021, pp. 89–104.
  47. Z. Wu, T. Zhao, and C. Nguyen, “3d reconstruction and object detection for hololens,” in 2020 Digital Image Computing: Techniques and Applications (DICTA).   IEEE, 2020, pp. 1–2.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now