Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Terrain Point Cloud Inpainting via Signal Decomposition (2404.03572v1)

Published 4 Apr 2024 in cs.CV and cs.CG

Abstract: The rapid development of 3D acquisition technology has made it possible to obtain point clouds of real-world terrains. However, due to limitations in sensor acquisition technology or specific requirements, point clouds often contain defects such as holes with missing data. Inpainting algorithms are widely used to patch these holes. However, existing traditional inpainting algorithms rely on precise hole boundaries, which limits their ability to handle cases where the boundaries are not well-defined. On the other hand, learning-based completion methods often prioritize reconstructing the entire point cloud instead of solely focusing on hole filling. Based on the fact that real-world terrain exhibits both global smoothness and rich local detail, we propose a novel representation for terrain point clouds. This representation can help to repair the holes without clear boundaries. Specifically, it decomposes terrains into low-frequency and high-frequency components, which are represented by B-spline surfaces and relative height maps respectively. In this way, the terrain point cloud inpainting problem is transformed into a B-spline surface fitting and 2D image inpainting problem. By solving the two problems, the highly complex and irregular holes on the terrain point clouds can be well-filled, which not only satisfies the global terrain undulation but also exhibits rich geometric details. The experimental results also demonstrate the effectiveness of our method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. 3d point cloud hole repair based on boundary rejection method. In: Proceedings of the Seventh International Symposium of Chinese CHI. 2019, p. 105–108.
  2. Dynamic point cloud inpainting via spatial-temporal graph learning. IEEE Transactions on Multimedia 2021;23:3022–3034.
  3. Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:151203012 2015;.
  4. Pcn: Point completion network. In: 2018 international conference on 3D vision (3DV). IEEE; 2018, p. 728–737.
  5. Topnet: Structural point cloud decoder. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, p. 383–392.
  6. Defi: Detection and filling of holes in point clouds towards restoration of digitized cultural heritage models. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, p. 1603–1612.
  7. Rfnet: Region-aware fusion network for incomplete multi-modal brain tumor segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021, p. 3975–3984.
  8. Softpoolnet: Shape descriptor for point cloud completion and classification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part III 16. Springer; 2020, p. 70–85.
  9. Pc-rgnn: Point cloud completion and graph neural network for 3d object detection. In: Proceedings of the AAAI conference on artificial intelligence; vol. 35. 2021, p. 3430–3437.
  10. Snowflakenet: Point cloud completion by snowflake point deconvolution with skip-transformer. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021, p. 5499–5509.
  11. Dense point cloud completion based on generative adversarial network. IEEE Transactions on Geoscience and Remote Sensing 2021;60:1–10.
  12. 3d shapenets: A deep representation for volumetric shapes. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015, p. 1912–1920.
  13. Pointnet: Deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017, p. 652–660.
  14. Comprehensive review of deep learning-based 3d point cloud completion processing and analysis. IEEE Transactions on Intelligent Transportation Systems 2022;.
  15. Liepa, P. Filling holes in meshes. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing. 2003, p. 200–205.
  16. Geometric inpainting of 3d structures. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2015, p. 1–7.
  17. An integrated approach to filling holes in meshes. In: 2010 International Conference on Artificial Intelligence and Computational Intelligence; vol. 3. IEEE; 2010, p. 306–310.
  18. Point cloud inpainting on graphs from non-local self-similarity. In: 2018 25th IEEE International Conference on Image Processing (ICIP). IEEE; 2018, p. 2137–2141.
  19. A parallel method for open hole filling in large-scale 3d automatic modeling based on oblique photography. Remote Sensing 2021;13(17):3512.
  20. Plgp: point cloud inpainting by patch-based local geometric propagating. The Visual Computer 2023;39(2):723–732.
  21. Exemplar-based framework for 3d point cloud hole filling. In: 2017 IEEE Visual Communications and Image Processing (VCIP). IEEE; 2017, p. 1–4.
  22. Point cloud inpainting with normal-based feature matching. Multimedia Systems 2022;:1–7.
  23. Filling large holes in lidar data by inpainting depth gradients. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE; 2012, p. 65–72.
  24. Local frequency interpretation and non-local self-similarity on graph for point cloud inpainting. IEEE Transactions on Image Processing 2019;28(8):4087–4100.
  25. Complex hole-filling algorithm for 3d models. In: Proceedings of the Computer Graphics International Conference. 2017, p. 1–6.
  26. An integrated method for dem simplification with terrain structural features and smooth morphology preserved. International Journal of Geographical Information Science 2021;35(2):273–295.
  27. Nurbs curve and surface fitting for reverse engineering. The International Journal of Advanced Manufacturing Technology 1998;14:918–927.
  28. Fast and accurate nurbs fitting for reverse engineering. The International Journal of Advanced Manufacturing Technology 2011;54:691–700.
  29. Fitting b-spline curves to point clouds by curvature-based squared distance minimization. ACM Transactions on Graphics (ToG) 2006;25(2):214–238.
  30. Robust and efficient computation of the closest point on a spline curve. In: Proceedings of the 5th International Conference on Curves and Surfaces. 2002, p. 397–406.
  31. Pca versus lda. IEEE transactions on pattern analysis and machine intelligence 2001;23(2):228–233.
  32. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Trans Graph 2009;28(3):24.
  33. Halton, JH. Algorithm 247: Radical-inverse quasi-random point sequence. Communications of the ACM 1964;7(12):701–702.
  34. https://naturemanufacture.com/assets/; 2024.
  35. https://www.jianshankeji.com/; 2024.
  36. Attene, M. A lightweight approach to repairing digitized polygon meshes. The visual computer 2010;26:1393–1406.
  37. Denoise and contrast for category agnostic shape completion. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021, p. 4629–4638.
  38. Hyperbolic chamfer distance for point cloud completion. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, p. 14595–14606.
  39. Robust normal estimation and region growing segmentation of infrastructure 3d point cloud models. Advanced Engineering Informatics 2017;34:1–16.
Citations (1)

Summary

We haven't generated a summary for this paper yet.