Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

EndoGaussians: Single View Dynamic Gaussian Splatting for Deformable Endoscopic Tissues Reconstruction (2401.13352v1)

Published 24 Jan 2024 in cs.CV

Abstract: The accurate 3D reconstruction of deformable soft body tissues from endoscopic videos is a pivotal challenge in medical applications such as VR surgery and medical image analysis. Existing methods often struggle with accuracy and the ambiguity of hallucinated tissue parts, limiting their practical utility. In this work, we introduce EndoGaussians, a novel approach that employs Gaussian Splatting for dynamic endoscopic 3D reconstruction. This method marks the first use of Gaussian Splatting in this context, overcoming the limitations of previous NeRF-based techniques. Our method sets new state-of-the-art standards, as demonstrated by quantitative assessments on various endoscope datasets. These advancements make our method a promising tool for medical professionals, offering more reliable and efficient 3D reconstructions for practical applications in the medical field.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (18)
  1. Stereo correspondence and reconstruction of endoscopic data challenge. ArXiv, abs/2101.01133, 2021.
  2. Hapnet: hierarchically aggregated pyramid network for real-time stereo matching. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 9:219 – 224, 2020.
  3. 3d gaussian splatting for real-time radiance field rendering. ACM Transactions on Graphics (TOG), 42:1 – 14, 2023.
  4. Super: A surgical perception framework for endoscopic tissue manipulation with surgical robotics. IEEE Robotics and Automation Letters, 5:2294–2301, 2019.
  5. E-dssr: Efficient dynamic surgical scene reconstruction with transformer-based stereoscopic depth perception. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 2021.
  6. Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis. In 3DV, 2024.
  7. Unsupervised learning of depth estimation from imperfect rectified stereo laparoscopic images. Computers in biology and medicine, 140:105109, 2021.
  8. Nerf: Representing scenes as neural radiance fields for view synthesis. Commun. ACM, 65:99–106, 2020.
  9. Dynamicfusion: Reconstruction and tracking of non-rigid scenes in real-time. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 343–352, 2015.
  10. Based: Bundle-adjusting surgical endoscopic dynamic video reconstruction using neural radiance fields. arXiv preprint arXiv:2309.15329, 2023.
  11. Neural rendering for stereo 3d reconstruction of deformable tissues in robotic surgery. ArXiv, abs/2206.15255, 2022.
  12. Neural lerplane representations for fast 4d reconstruction of deformable tissues. MICCAI, 2023.
  13. Neural lerplane representations for fast 4d reconstruction of deformable tissues. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 2023.
  14. Endosurf: Neural surface reconstruction of deformable tissues with stereo endoscope videos. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 13–23. Springer, 2023.
  15. Inertia-guided flow completion and style fusion for video inpainting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5982–5991, June 2022.
  16. Unimatch: A unified user-item matching framework for the multi-purpose merchant marketing. 2023 IEEE 39th International Conference on Data Engineering (ICDE), pages 3309–3321, 2023.
  17. Deformable endoscopic tissues reconstruction with gaussian splatting, 2024.
  18. Fsgs: Real-time few-shot view synthesis using gaussian splatting, 2023.
Citations (6)

Summary

We haven't generated a summary for this paper yet.