Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Fast graph-based denoising for point cloud color information (2401.09721v3)

Published 18 Jan 2024 in cs.CV, eess.IV, and eess.SP

Abstract: Point clouds are utilized in various 3D applications such as cross-reality (XR) and realistic 3D displays. In some applications, e.g., for live streaming using a 3D point cloud, real-time point cloud denoising methods are required to enhance the visual quality. However, conventional high-precision denoising methods cannot be executed in real time for large-scale point clouds owing to the complexity of graph constructions with K nearest neighbors and noise level estimation. This paper proposes a fast graph-based denoising (FGBD) for a large-scale point cloud. First, high-speed graph construction is achieved by scanning a point cloud in various directions and searching adjacent neighborhoods on the scanning lines. Second, we propose a fast noise level estimation method using eigenvalues of the covariance matrix on a graph. Finally, we also propose a new low-cost filter selection method to enhance denoising accuracy to compensate for the degradation caused by the acceleration algorithms. In our experiments, we succeeded in reducing the processing time dramatically while maintaining accuracy relative to conventional denoising methods. Denoising was performed at 30fps, with frames containing approximately 1 million points.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. “Immersive point cloud virtual environments,” in 2014 IEEE Symposium on 3D User Interfaces (3DUI), 2014, pp. 161–162.
  2. “Experimental investigation of holographic 3D-TV approach,” in 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009, pp. 1–4.
  3. “Pixor: Real-time 3D object detection from point clouds,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 7652–7660.
  4. “Hyperpointnet for point cloud sequence-based 3D human action recognition,” in 2022 IEEE International Conference on Multimedia and Expo (ICME), 2022, pp. 1–6.
  5. “Emerging MPEG standards for point cloud compression,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 9, no. 1, pp. 133–148, 2019.
  6. “Learning graph-convolutional representations for point cloud denoising,” in The European Conference on Computer Vision (ECCV), 2020, pp. 103–118.
  7. “Differentiable manifold reconstruction for point cloud denoising,” in The 28th ACM International Conference on Multimedia, 2020, pp. 1330–1338.
  8. “Graph-based denoising for time-varying point clouds,” in 2015 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2015, pp. 1–4.
  9. “Graph-based point cloud denoising,” in 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM), 2018, pp. 1–6.
  10. “Nonlocal low-rank point cloud denoising for 3-D measurement surfaces,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–14, 2022.
  11. “Attribute artifacts removal for geometry-based point cloud compression,” IEEE Transactions on Image Processing, vol. 31, pp. 3399–3413, 2022.
  12. “3D point cloud color denoising using convex graph-signal smoothness priors,” in 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), 2019, pp. 1–6.
  13. “Joint geometry and color point cloud denoising based on graph wavelets,” IEEE Access, vol. 9, pp. 21149–21166, 2021.
  14. “Graph-based point cloud color denoising with 3-dimensional patch-based similarity,” in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, pp. 1–5.
  15. “Motion estimation and filtering for the inter prediction of dynamic point cloud compression,” in 2022 Picture Coding Symposium, 2022.
  16. “Adaptive wavelet thresholding for image denoising and compression,” IEEE Transactions on Image Processing, vol. 9, no. 9, pp. 1532–1546, 2000.
  17. “8i voxelized full bodies - a voxelized point cloud dataset,” in ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document WG11M40059/WG1M74006, 2017.
  18. “Microsoft voxelized upper bodies - a voxelized point cloud dataset,” ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document m38673/M72012, 2016.
  19. Xueyi Wang, “A fast exact k-nearest neighbors algorithm for high dimensional search using k-means clustering and triangle inequality,” in The 2011 International Joint Conference on Neural Networks, 2011, pp. 1293–1299.
  20. “Fast scalable approximate nearest neighbor search for high-dimensional data,” in 2020 IEEE International Conference on Cluster Computing (CLUSTER), 2020, pp. 294–302.
  21. “Brute-force k-nearest neighbors search on the GPU,” in Similarity Search and Applications, Giuseppe Amato, Richard Connor, Fabrizio Falchi, and Claudio Gennaro, Eds., Cham, 2015, pp. 259–270, Springer International Publishing.
  22. “Fast k nearest neighbor search using GPU,” in 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008, pp. 1–6.
  23. “GPU-accelerated nearest neighbor search for 3D registration,” in Computer Vision Systems, Mario Fritz, Bernt Schiele, and Justus H. Piater, Eds., Berlin, Heidelberg, 2009, pp. 194–203, Springer Berlin Heidelberg.
  24. J. Jakob and M. Guthe, “Optimizing LBVH-construction and hierarchy-traversal to accelerate kNN queries on point clouds using the GPU,” Computer Graphics Forum, vol. 40, no. 1, pp. 124–137, 2021.
  25. “Fast Four-Way Parallel Radix Sorting on GPUs,” Computer Graphics Forum, 2009.
  26. “Single-image noise level estimation for blind denoising,” IEEE Transactions on Image Processing, vol. 22, no. 12, pp. 5226–5237, 2013.
  27. “An efficient statistical method for image noise level estimation,” in 2015 IEEE International Conference on Computer Vision (ICCV), 2015, pp. 477–485.
  28. “Robust estimation for image noise based on eigenvalue distributions of large sample covariance matrices,” Journal of Visual Communication and Image Representation, vol. 63, pp. 102604, 2019.
Citations (2)

Summary

We haven't generated a summary for this paper yet.