Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Explicit Neural Surfaces: Learning Continuous Geometry With Deformation Fields (2306.02956v3)

Published 5 Jun 2023 in cs.CV and cs.GR

Abstract: We introduce Explicit Neural Surfaces (ENS), an efficient smooth surface representation that directly encodes topology with a deformation field from a known base domain. We apply this representation to reconstruct explicit surfaces from multiple views, where we use a series of neural deformation fields to progressively transform the base domain into a target shape. By using meshes as discrete surface proxies, we train the deformation fields through efficient differentiable rasterization. Using a fixed base domain allows us to have Laplace-Beltrami eigenfunctions as an intrinsic positional encoding alongside standard extrinsic Fourier features, with which our approach can capture fine surface details. Compared to implicit surfaces, ENS trains faster and has several orders of magnitude faster inference times. The explicit nature of our approach also allows higher-quality mesh extraction whilst maintaining competitive surface reconstruction performance and real-time capabilities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Large-scale data for multiple-view stereopsis. International Journal of Computer Vision, pages 1–16, 2016.
  2. Building rome in a day. Communications of the ACM, 54(10):105–112, 2011.
  3. Shape reconstruction by learning differentiable surface representations, 2019. URL https://arxiv.org/abs/1911.11227.
  4. On the equivalence of regularity criteria for triangular and tetrahedral finite element partitions. Computers & Mathematics with Applications, 55(10):2227–2233, 2008.
  5. Neumesh: Learning disentangled neural mesh-based implicit field for geometry and texture editing. In European Conference on Computer Vision (ECCV), 2022.
  6. The triangle processor and normal vector shader: a vlsi system for high performance graphics. Acm siggraph computer graphics, 22(4):21–30, 1988.
  7. Accurate, dense, and robust multiview stereopsis. IEEE transactions on pattern analysis and machine intelligence, 32(8):1362–1376, 2009.
  8. Atlasnet: A papier-mâché approach to learning 3d surface generation, 2018. URL https://arxiv.org/abs/1802.05384.
  9. Multiple view geometry in computer vision. Cambridge university press, 2003.
  10. Geometric modeling in shape space. In ACM SIGGRAPH 2007 papers, pages 64–es, 2007.
  11. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  12. Intrinsic neural fields: Learning functions on manifolds. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part II, pages 622–639. Springer, 2022.
  13. Modular primitives for high-performance differentiable rendering. ACM Transactions on Graphics, 39(6), 2020.
  14. Bruno Lévy. Laplace-beltrami eigenfunctions towards an algorithm that" understands" geometry. In IEEE International Conference on Shape Modeling and Applications 2006 (SMI’06), pages 13–13. IEEE, 2006.
  15. Marching cubes: A high resolution 3d surface construction algorithm. ACM siggraph computer graphics, 21(4):163–169, 1987.
  16. Nerf: Representing scenes as neural radiance fields for view synthesis, 2020. URL https://arxiv.org/abs/2003.08934.
  17. Extracting Triangular 3D Models, Materials, and Lighting From Images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 8280–8290, June 2022.
  18. Large steps in inverse rendering of geometry. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 40(6), December 2021. 10.1145/3478513.3480501.
  19. Unisurf: Unifying neural implicit surfaces and radiance fields for multi-view reconstruction. In International Conference on Computer Vision (ICCV), 2021.
  20. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035. Curran Associates, Inc., 2019. URL http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf.
  21. Permutosdf: Fast multi-view reconstruction with implicit surfaces using permutohedral lattices. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  22. Raif M. Rustamov. Laplace-Beltrami Eigenfunctions for Deformation Invariant Shape Representation. In Alexander Belyaev and Michael Garland, editors, Geometry Processing. The Eurographics Association, 2007. ISBN 978-3-905673-46-3. 10.2312/SGP/SGP07/225-233.
  23. Orex: Object reconstruction from planner cross-sections using neural fields. arXiv preprint arXiv:2211.12886, 2022.
  24. Deep marching tetrahedra: a hybrid representation for high-resolution 3d shape synthesis. In Advances in Neural Information Processing Systems (NeurIPS), 2021.
  25. Jonathan Richard Shewchuk. What is a good linear element? interpolation, conditioning, and quality measures. In IMR, pages 115–126, 2002.
  26. Fourier features let networks learn high frequency functions in low dimensional domains, 2020. URL https://arxiv.org/abs/2006.10739.
  27. Deferred neural rendering: Image synthesis using neural textures. Acm Transactions on Graphics (TOG), 38(4):1–12, 2019.
  28. Learning three-dimensional flow for interactive aerodynamic design. ACM Transactions on Graphics (TOG), 37(4):1–10, 2018.
  29. Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction, 2021. URL https://arxiv.org/abs/2106.10689.
  30. Deep geometric prior for surface reconstruction, 2018. URL https://arxiv.org/abs/1811.10943.
  31. Multi-view mesh reconstruction with neural deferred shading. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6187–6197, 2022.
  32. Voxurf: Voxel-based efficient and accurate neural surface reconstruction. arXiv preprint arXiv:2208.12697, 2022.
  33. Multiview neural surface reconstruction by disentangling geometry and appearance. Advances in Neural Information Processing Systems, 33, 2020.
  34. Volume rendering of neural implicit surfaces. Advances in Neural Information Processing Systems, 34:4805–4815, 2021.
Citations (9)

Summary

We haven't generated a summary for this paper yet.