Adaptive Topological Feature via Persistent Homology: Filtration Learning for Point Clouds (2307.09259v2)
Abstract: Machine learning for point clouds has been attracting much attention, with many applications in various fields, such as shape recognition and material science. For enhancing the accuracy of such machine learning methods, it is often effective to incorporate global topological features, which are typically extracted by persistent homology. In the calculation of persistent homology for a point cloud, we choose a filtration for the point cloud, an increasing sequence of spaces. Since the performance of machine learning methods combined with persistent homology is highly affected by the choice of a filtration, we need to tune it depending on data and tasks. In this paper, we propose a framework that learns a filtration adaptively with the use of neural networks. In order to make the resulting persistent homology isometry-invariant, we develop a neural network architecture with such invariance. Additionally, we show a theoretical result on a finite-dimensional approximation of filtration functions, which justifies the proposed network architecture. Experimental results demonstrated the efficacy of our framework in several classification tasks.
- Persistence images: A stable vector representation of persistent homology. Journal of Machine Learning Research, 18, 2017.
- DTM-based filtrations. In Topological Data Analysis, pages 33–66. Springer, 2020.
- Inferring local homology from sampled stratified spaces. In 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS’07), pages 536–546. IEEE, 2007.
- M. Boutin and G. Kemper. On reconstructing n-point configurations from the distribution of distances or areas. Advances in Applied Mathematics, 32(4):709–735, 2004.
- P. Bubenik and P. T. Kim. A statistical approach to persistent homology. Homology, homotopy and Applications, 9(2):337–362, 2007.
- P. Bubenik et al. Statistical topological data analysis using persistence landscapes. Journal of Machine Learning Research, 16(1):77–102, 2015.
- Z. Cang and G.-W. Wei. Topologynet: Topology based deep convolutional and multi-task neural networks for biomolecular property predictions. PLoS computational biology, 13(7):e1005690, 2017.
- Representability of algebraic topology for biomolecules in machine learning based scoring and virtual screening. PLoS computational biology, 14(1):e1005929, 2018.
- PersLay: A neural network layer for persistence diagrams and new graph topological signatures. In International Conference on Artificial Intelligence and Statistics, pages 2786–2796. PMLR, 2020.
- Optimizing persistent homology based functions. In International Conference on Machine Learning, pages 1294–1303. PMLR, 2021.
- Persistence diagrams of cortical surface data. In International Conference on Information Processing in Medical Imaging, pages 386–397. Springer, 2009.
- RipsNet: a general architecture for fast and robust estimation of the persistent homology of point clouds. arXiv preprint arXiv:2202.01725, 2022.
- H. Edelsbrunner. Weighted alpha shapes. University of Illinois at Urbana-Champaign, 1992.
- Persistent homology machine learning for fingerprint classification. In 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), pages 1219–1226. IEEE, 2019.
- Hierarchical structures of amorphous solids characterized by persistent homology. Proceedings of the National Academy of Sciences, 113(26):7035–7040, 2016.
- Deep learning with topological signatures. Advances in Neural Information Processing Systems, 30, 2017.
- Graph filtration learning. In International Conference on Machine Learning, pages 4314–4323. PMLR, 2020.
- Topological graph neural networks. In International Conference on Learning Representations, 2021.
- Using persistent homology and dynamical distances to analyze protein binding. Statistical Applications in Genetics and Molecular Biology, 15(1):19–38, 2016.
- Kernel method for persistence diagrams via kernel embedding and weight factor. The Journal of Machine Learning Research, 18(1):6947–6987, 2017.
- TopoSeg: Topology-aware segmentation for point clouds. In L. D. Raedt, editor, Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, pages 1201–1208. International Joint Conferences on Artificial Intelligence Organization, 7 2022. doi: 10.24963/ijcai.2022/168. URL https://doi.org/10.24963/ijcai.2022/168. Main Track.
- Rethinking network design and local geometry in point cloud: A simple residual mlp framework. In International Conference on Learning Representations, 2022.
- Weighted persistent homology for biomolecular data analysis. Scientific reports, 10(1):2079, 2020.
- Persistent homology and many-body atomic structure for medium-range order in the glass. Nanotechnology, 26(30):304001, 2015.
- Persistent homology analysis for materials research and persistent homology software: HomCloud. Journal of the Physical Society of Japan, 91(9):091013, 2022.
- A roadmap for the computation of persistent homology. EPJ Data Science, 6:1–38, 2017.
- PointNet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 652–660, 2017a.
- PointNet++: Deep hierarchical feature learning on point sets in a metric space. Advances in Neural Information Processing Systems, 30, 2017b.
- Pi-Net: A deep learning approach to extract topological persistence images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pages 834–835, 2020.
- Attention is all you need. Advances in Neural Information Processing Systems, 30, 2017.
- D. Widdowson and V. Kurlin. Recognizing rigid patterns of unlabeled point clouds by complete and continuous isometry invariants with no false negatives and no false positives. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1275–1284, 2023.
- 3D ShapeNets: A deep representation for volumetric shapes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1912–1920, 2015.
- SGMNet: Learning rotation-invariant point cloud representations via sorted gram matrix. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10468–10477, 2021.
- Neural approximation of extended persistent homology on graphs. arXiv preprint arXiv:2201.12032, 2022.
- Deep Sets. Advances in Neural Information Processing Systems, 30, 2017.
- Topological descriptors for 3d surface analysis. In Computational Topology in Image Context: 6th International Workshop, CTIC 2016, Marseille, France, June 15-17, 2016, Proceedings 6, pages 77–87. Springer, 2016.
- Gefl: Extended filtration learning for graph classification. In Learning on Graphs Conference, pages 16–1. PMLR, 2022.
- Learning persistent homology of 3d point clouds. Computers & Graphics, 102:269–279, 2022.