Deep Point Cloud Normal Estimation via Triplet Learning (2110.10494v2)
Abstract: Normal estimation on 3D point clouds is a fundamental problem in 3D vision and graphics. Current methods often show limited accuracy in predicting normals at sharp features (e.g., edges and corners) and less robustness to noise. In this paper, we propose a novel normal estimation method for point clouds. It consists of two phases: (a) feature encoding which learns representations of local patches, and (b) normal estimation that takes the learned representation as input and regresses the normal vector. We are motivated that local patches on isotropic and anisotropic surfaces have similar or distinct normals, and that separable features or representations can be learned to facilitate normal estimation. To realise this, we first construct triplets of local patches on 3D point cloud data, and design a triplet network with a triplet loss for feature encoding. We then design a simple network with several MLPs and a loss function to regress the normal vector. Despite having a smaller network size compared to most other methods, experimental results show that our method preserves sharp features and achieves better normal estimation results on CAD-like shapes.
- “Pointfilter: Point cloud filtering via encoder-decoder modeling,” IEEE Transactions on Visualization and Computer Graphics, vol. 27, no. 3, pp. 2015–2027, 2021.
- “3DFeat-Net: Weakly supervised local 3D features for point cloud registration,” in Computer Vision - ECCV 2018 - 15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part XV, Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss, Eds. 2018, vol. 11219 of Lecture Notes in Computer Science, pp. 630–646, Springer.
- “Deep feature-preserving normal estimation for point cloud filtering,” Computer-Aided Design, vol. 125, pp. 102860, 2020.
- “PCPNet: Learning Local Shape Properties from Raw Point Clouds,” Computer Graphics Forum, vol. 37, no. 2, pp. 75–85, 2018.
- “Nesti-Net: Normal Estimation for Unstructured 3D Point Clouds Using Convolutional Neural Networks,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 10104–10112.
- “PointNet: Deep learning on point sets for 3D classification and segmentation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017.
- “Surface reconstruction from unorganized points,” SIGGRAPH Comput. Graph., vol. 26, no. 2, pp. 71–78, July 1992.
- “Deep learning for robust normal estimation in unstructured point clouds,” Computer Graphics Forum, vol. 35, no. 5, pp. 281–290, 2016.
- “Neighbourhood-insensitive point cloud normal estimation network,” in 31st British Machine Vision Conference 2020, BMVC 2020, Virtual Event, UK, September 7-10, 2020. 2020, BMVA Press.
- “Deep iterative surface normal estimation,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA, jun 2020, pp. 11244–11253, IEEE Computer Society.
- “Cross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network,” in 2015 IEEE International Conference on Computer Vision (ICCV), 2015, pp. 1062–1070.
- “FaceNet: A unified embedding for face recognition and clustering,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
- “Learning incremental triplet margin for person re-identification,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, July 2019.
- “PPFNet: Global context aware local features for robust 3D point matching,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
- “Transductive Zero-Shot Learning for 3D Point Cloud Classification,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Mar. 2020.
- “Meshlab: an open-source mesh processing tool.,” in Eurographics Italian chapter conference. Salerno, Italy, 2008, vol. 2008, pp. 129–136.