Dice Question Streamline Icon: https://streamlinehq.com

Direct Mesh Extraction from 3D Gaussian Splatting

Develop a method to extract high-quality meshes or other explicit 3D geometries directly from 3D Gaussian Splatting representations without converting to alternative representations such as InstantNGP, enabling reliable geometry extraction within the Gaussian Splatting framework itself.

Information Square Streamline Icon: https://streamlinehq.com

Background

The paper adopts a two-stage pipeline: Stage I performs interactive generation using 3D Gaussian Splatting to enable direct user manipulation, while Stage II converts the Gaussian representation into InstantNGP for geometry refinement and mesh extraction. The authors note that Gaussian Splatting is well-suited for interaction but struggles with high-quality geometry formation under SDS supervision and lacks a direct pathway to extract explicit geometry.

Because mesh extraction from Gaussian Splatting is not currently available, the method relies on converting the Gaussian representation to InstantNGP via NeRF distillation to enable mesh extraction and further refinement. This highlights an unresolved problem: creating a reliable technique for direct mesh (or other explicit geometry) extraction from Gaussian Splatting without representation conversion.

References

In addition, extracting meshes or other geometries from Gaussian Splatting is still unsolved.

Interactive3D: Create What You Want by Interactive 3D Generation (2404.16510 - Dong et al., 25 Apr 2024) in Subsubsection NeRF Distillation (Section 3.2.1)