A Framework for Building Point Cloud Cleaning, Plane Detection and Semantic Segmentation (2402.00692v2)
Abstract: This paper presents a framework to address the challenges involved in building point cloud cleaning, plane detection, and semantic segmentation, with the ultimate goal of enhancing building modeling. We focus in the cleaning stage on removing outliers from the acquired point cloud data by employing an adaptive threshold technique based on z-score measure. Following the cleaning process, we perform plane detection using the robust RANSAC paradigm. The goal is to carry out multiple plane segmentations, and to classify segments into distinct categories, such as floors, ceilings, and walls. The resulting segments can generate accurate and detailed point clouds representing the building's architectural elements. Moreover, we address the problem of semantic segmentation, which plays a vital role in the identification and classification of different components within the building, such as walls, windows, doors, roofs, and objects. Inspired by the PointNet architecture, we propose a deep learning architecture for efficient semantic segmentation in buildings. The results demonstrate the effectiveness of the proposed framework in handling building modeling tasks, paving the way for improved accuracy and efficiency in the field of building modelization.
- Learning graph convolutional network for blind mesh visual quality assessment. IEEE Access, 9:108200–108211, 2021.
- Joint 2d-3d-semantic data for indoor scene understanding. arXiv preprint arXiv:1702.01105, 2017.
- J. Diebel and S. Thrun. An application of markov random fields to range sensing. Advances in neural information processing systems, 18, 2005.
- Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381–395, 1981.
- Pointwise convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 984–993, 2018.
- Movie script similarity using multilayer network portrait divergence. In Complex Networks & Their Applications IX: Volume 1, Proceedings of the Ninth International Conference on Complex Networks and Their Applications COMPLEX NETWORKS 2020, pages 284–295. Springer, 2021.
- Pointcnn: Convolution on x-transformed points. Advances in neural information processing systems, 31, 2018.
- From point clouds to building information models: 3d semi-automatic reconstruction of indoors of existing buildings. Applied Sciences, 7(10):1030, 2017.
- Movienet: a movie multilayer network model using visual and textual semantic cues. Applied Network Science, 4:1–37, 2019.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 652–660, 2017.
- Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems, 30, 2017.
- Fast point feature histograms (fpfh) for 3d registration. In 2009 IEEE international conference on robotics and automation, pages 3212–3217. IEEE, 2009.
- S. R. Sain. The nature of statistical learning theory, 1996.
- Segmentation of dense range information in complex urban scenes. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2033–2038. IEEE, 2010.
- Segcloud: Semantic segmentation of 3d point clouds. In 2017 international conference on 3D vision (3DV), pages 537–547. IEEE, 2017.
- Building information modeling (bim) for existing buildings—literature review and future needs. Automation in construction, 38:109–127, 2014.
- 3d point cloud recognition of substation equipment based on plane detection. Results in Engineering, 15:100545, 2022.
- Pointfilter: Point cloud filtering via encoder-decoder modeling. IEEE Transactions on Visualization and Computer Graphics, 27(3):2015–2027, 2020.