Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Local region-learning modules for point cloud classification (2303.17338v2)

Published 30 Mar 2023 in cs.CV

Abstract: Data organization via forming local regions is an integral part of deep learning networks that process 3D point clouds in a hierarchical manner. At each level, the point cloud is sampled to extract representative points and these points are used to be centers of local regions. The organization of local regions is of considerable importance since it determines the location and size of the receptive field at a particular layer of feature aggregation. In this paper, we present two local region-learning modules: Center Shift Module to infer the appropriate shift for each center point, and Radius Update Module to alter the radius of each local region. The parameters of the modules are learned through optimizing the loss associated with the particular task within an end-to-end network. We present alternatives for these modules through various ways of modeling the interactions of the features and locations of 3D points in the point cloud. We integrated both modules independently and together to the PointNet++ and PointCNN object classification architectures, and demonstrated that the modules contributed to a significant increase in classification accuracy for the ScanObjectNN data set consisting of scans of real-world objects. Our further experiments on ShapeNet data set showed that the modules are also effective on 3D CAD models.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Review: Deep learning on 3D point clouds, Remote Sensing 12 (2020). doi:https://doi.org/10.3390/rs12111729.
  2. Deep learning for 3D point clouds: A survey, IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (2021) 4338–4364. doi:https://doi.org/10.1109/TPAMI.2020.3005434.
  3. Deep learning on point clouds and its application: A survey, Sensors 19 (2019). doi:https://doi.org/10.3390/s19194188.
  4. PointNet++: Deep hierarchical feature learning on point sets in a metric space, in: NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017.
  5. PointCNN: Convolution on X-transformed points, in: Advances in Neural Information Processing Systems (NIPS), 2018.
  6. KPConv: Flexible and deformable convolution for point clouds, in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 6410–6419. doi:https://doi.org/10.1109/ICCV.2019.00651.
  7. Attention is all you need, in: Advances in Neural Information Processing Systems (NIPS), 2017.
  8. Exploring self-attention for image recognition, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 10073–10082. doi:https://doi.org/10.1109/CVPR42600.2020.01009.
  9. PCT: Point cloud transformer, Computational Visual Media 7 (2021) 187–199. doi:https://doi.org/10.1007/s41095-021-0229-5.
  10. Point transformer, in: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 16259–16268. doi:10.1109/ICCV48922.2021.01595.
  11. SO-Net: Self-organizing network for point cloud analysis, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 9397–9406. doi:https://doi.org/10.1109/CVPR.2018.00979.
  12. Z. Zhang, M. Jin, AOMC: An adaptive point cloud clustering approach for feature extraction, Scientific Programming 2022 (2022) 1–13. doi:https://doi.org/10.1155/2022/3744086.
  13. L. Landrieu, M. Simonovsky, Large-scale point cloud semantic segmentation with superpoint graphs, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 4558–4567. doi:https://doi.org/10.1109/CVPR.2018.00479.
  14. Grid-GCN for fast and scalable point cloud learning, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 5660–5669. doi:https://doi.org/10.1109/CVPR42600.2020.00570.
  15. Learning to sample, in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 2755–2764. doi:https://doi.org/10.1109/CVPR.2019.00287.
  16. SampleNet: Differentiable point cloud sampling, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 7575–7585. doi:https://doi.org/10.1109/CVPR42600.2020.00760.
  17. Modeling point clouds with self-attention and Gumbel subset sampling, in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 3318–3327. doi:https://doi.org/10.1109/CVPR.2019.00344.
  18. Adaptive hierarchical down-sampling for point cloud classification, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 12953–12961. doi:https://doi.org/10.1109/CVPR42600.2020.01297.
  19. PointASNL: Robust point clouds processing using nonlocal neural networks with adaptive sampling, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 5588–5597. doi:https://doi.org/10.1109/CVPR42600.2020.00563.
  20. SK-Net: Deep learning on point cloud via end-to-end discovery of spatial keypoints, in: Proceedings of the AAAI Conference on Artificial Intelligence, 2020, pp. 6422–6429. doi:https://doi.org/10.1609/aaai.v34i04.6113.
  21. PointDAN: A multi-scale 3D domain adaption network for point cloud representation, in: Advances in Neural Information Processing Systems (NIPS), 2019.
  22. DA-Net: Density-adaptive downsampling network for point cloud classification via end-to-end learning, in: 2021 4th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), 2021, pp. 13–18. doi:https://doi.org/10.1109/PRAI53619.2021.9551070.
  23. S. V. Sheshappanavar, C. Kambhamettu, Dynamic local geometry capture in 3D point cloud classification, in: 2021 IEEE 4th International Conference on Multimedia Information Processing and Retrieval (MIPR), 2021, pp. 158–164. doi:https://doi.org/10.1109/MIPR51284.2021.00031.
  24. Dense-resolution network for point cloud classification and segmentation, in: 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), 2021, pp. 3812–3821. doi:https://doi.org/10.1109/WACV48630.2021.00386.
  25. Learning adaptive receptive fields for point clouds, in: 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), IEEE Computer Society, Los Alamitos, CA, USA, 2020, pp. 131–134. doi:https://doi.org/10.1109/MIPR49039.2020.00034.
  26. Adaptive deep learning-based neighborhood search method for point cloud, Scientific Reports 12 (2022) 2045–2322. doi:https://doi.org/10.1038/s41598-022-06200-z.
  27. PSNet: Fast data structuring for hierarchical deep learning on point cloud, IEEE Transactions on Circuits and Systems for Video Technology 32 (2022) 6835–6849. doi:https://doi.org/10.1109/TCSVT.2022.3171968.
  28. IntrA: 3D intracranial aneurysm dataset for deep learning, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020. doi:10.1109/CVPR42600.2020.00273.
  29. Classification of tree species and standing dead trees by fusing uav-based LiDAR data and multispectral imagery in the 3D deep neural network PointNet++, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences V-2-2020 (2020) 203–210. URL: https://isprs-annals.copernicus.org/articles/V-2-2020/203/2020/. doi:10.5194/isprs-annals-V-2-2020-203-2020.
  30. Intelligent classification for three-dimensional metal powder particles, Powder Technology 397 (2022) 117018. URL: https://www.sciencedirect.com/science/article/pii/S0032591021010160. doi:https://doi.org/10.1016/j.powtec.2021.11.062.
  31. Extracting urban road footprints from airborne LiDAR point clouds with PointNet++ and two-step post-processing, Remote Sensing 14 (2022). URL: https://www.mdpi.com/2072-4292/14/3/789. doi:10.3390/rs14030789.
  32. Revisiting point cloud classification: A new benchmark dataset and classification model on real-world data, in: International Conference on Computer Vision (ICCV), 2019, pp. 1588–1597. doi:https://doi.ieeecomputersociety.org/10.1109/ICCV.2019.00167.
  33. Shapenet: An information-rich 3d model repository (2015). doi:https://doi.org/10.48550/arXiv.1512.03012. arXiv:1512.03012.
  34. A robust 3D-2D interactive tool for scene segmentation and annotation, IEEE Transactions on Visualization and Computer Graphics (TVCG) (2017). doi:10.1109/TVCG.2017.2772238.
  35. ScanNet: Richly-annotated 3D reconstructions of indoor scenes, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2432–2443. doi:https://doi.org/10.1109/CVPR.2017.261.
Citations (2)

Summary

We haven't generated a summary for this paper yet.