Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ILPO-NET: Network for the invariant recognition of arbitrary volumetric patterns in 3D (2403.19612v3)

Published 28 Mar 2024 in cs.CV and cs.LG

Abstract: Effective recognition of spatial patterns and learning their hierarchy is crucial in modern spatial data analysis. Volumetric data applications seek techniques ensuring invariance not only to shifts but also to pattern rotations. While traditional methods can readily achieve translational invariance, rotational invariance possesses multiple challenges and remains an active area of research. Here, we present ILPO-Net (Invariant to Local Patterns Orientation Network), a novel approach that handles arbitrarily shaped patterns with the convolutional operation inherently invariant to local spatial pattern orientations using the Wigner matrix expansions. Our architecture seamlessly integrates the new convolution operator and, when benchmarked on diverse volumetric datasets such as MedMNIST and CATH, demonstrates superior performance over the baselines with significantly reduced parameter counts - up to 1000 times fewer in the case of MedMNIST. Beyond these demonstrations, ILPO-Net's rotational invariance paves the way for other applications across multiple disciplines. Our code is publicly available at https://gricad-gitlab.univ-grenoble-alpes.fr/GruLab/ILPO/-/tree/main/ILPONet.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Local rotation invariance in 3D CNNs. Medical Image Analysis, 65:101756, October 2020. doi: 10.1016/j.media.2020.101756. URL https://doi.org/10.1016/j.media.2020.101756.
  2. Roto-translation covariant convolutional networks for medical image analysis. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I, pages 440–448. Springer, 2018.
  3. Group equivariant convolutional networks. In International conference on machine learning, pages 2990–2999. PMLR, 2016.
  4. Gauge equivariant convolutional networks and the icosahedral CNN. In International conference on Machine learning, pages 1321–1330. PMLR, 2019.
  5. Spherical CNNs. In International Conference on Learning Representations, 2018.
  6. Automatic symmetry discovery with lie algebra convolutional network. Advances in Neural Information Processing Systems, 34:2503–2515, 2021.
  7. Auto-sklearn: Efficient and robust automated machine learning. In Automated Machine Learning, pages 113–134. Springer International Publishing, 2019. doi: 10.1007/978-3-030-05318-5_6. URL https://doi.org/10.1007/978-3-030-05318-5_6.
  8. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2016. doi: 10.1109/cvpr.2016.90. URL https://doi.org/10.1109/cvpr.2016.90.
  9. Spherical convolutions on molecular graphs for protein model quality assessment. Machine Learning: Science and Technology, 2(4):045005, 2021.
  10. Auto-keras: An efficient neural architecture search system. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, July 2019. doi: 10.1145/3292500.3330648. URL https://doi.org/10.1145/3292500.3330648.
  11. Highly accurate protein structure prediction with AlphaFold. Nature, 596(7873):583–589, July 2021. doi: 10.1038/s41586-021-03819-2. URL https://doi.org/10.1038/s41586-021-03819-2.
  12. Gauss-legendre sampling on the rotation group. IEEE Signal Processing Letters, 23(2):207–211, February 2016. doi: 10.1109/lsp.2015.2503295. URL https://doi.org/10.1109/lsp.2015.2503295.
  13. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  14. Exploiting redundancy: Separable group convolutional networks on lie groups. In International Conference on Machine Learning, pages 11359–11386. PMLR, 2022.
  15. The CATH database. Human Genomics, 4(3):207, 2010. doi: 10.1186/1479-7364-4-3-207. URL https://doi.org/10.1186/1479-7364-4-3-207.
  16. Risi Kondor. N-body networks: a covariant hierarchical neural network architecture for learning atomic potentials. ArXiv, abs/1803.01588, 2018. URL https://api.semanticscholar.org/CorpusID:3665386.
  17. Clebsch–gordan nets: a fully fourier space spherical convolutional neural network. Advances in Neural Information Processing Systems, 31, 2018.
  18. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25, 2012.
  19. Clifford group equivariant simplicial message passing networks. arXiv preprint arXiv:2402.10011, 2024.
  20. Feature pyramid vision transformer for MedMNIST classification decathlon. In 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, July 2022a. doi: 10.1109/ijcnn55064.2022.9892282. URL https://doi.org/10.1109/ijcnn55064.2022.9892282.
  21. Group convolutional neural networks for dwi segmentation. In Geometric Deep Learning in Medical Image Analysis, pages 96–106. PMLR, 2022b.
  22. Protein model quality assessment using 3D oriented convolutional neural networks. Bioinformatics, 35(18):3313–3319, February 2019. doi: 10.1093/bioinformatics/btz122. URL https://doi.org/10.1093/bioinformatics/btz122.
  23. Attentive group equivariant convolutional networks. In International Conference on Machine Learning, pages 8188–8199. PMLR, 2020.
  24. Group convolutional neural networks improve quantum state accuracy. arXiv preprint arXiv:2104.05085, 2021.
  25. Clifford group equivariant neural networks. arXiv preprint arXiv:2305.11141, 2023.
  26. Moving frame net: Se (3)-equivariant network for volumes. In NeurIPS Workshop on Symmetry and Geometry in Neural Representations, pages 81–97. PMLR, 2023.
  27. E (n) equivariant graph neural networks. In International conference on machine learning, pages 9323–9332. PMLR, 2021.
  28. Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds. ArXiv, abs/1802.08219, 2018. URL https://api.semanticscholar.org/CorpusID:3457605.
  29. Deeply supervised 3D fully convolutional networks with group dilated convolution for automatic mri prostate segmentation. Medical physics, 46(4):1707–1718, 2019.
  30. 3D steerable CNNs: Learning rotationally equivariant features in volumetric data. Advances in Neural Information Processing Systems, 31, 2018.
  31. 3D G-CNNs for pulmonary nodule detection. In Medical Imaging with Deep Learning, 2022.
  32. CubeNet: Equivariance to 3D rotation and translation. In Proceedings of the European Conference on Computer Vision (ECCV), pages 567–584, 2018.
  33. Reinventing 2D convolutions for 3D images. IEEE Journal of Biomedical and Health Informatics, 25(8):3009–3018, August 2021. doi: 10.1109/jbhi.2021.3049452. URL https://doi.org/10.1109/jbhi.2021.3049452.
  34. MedMNIST v2 - a large-scale lightweight benchmark for 2D and 3D biomedical image classification. Scientific Data, 10(1), January 2023. doi: 10.1038/s41597-022-01721-8. URL https://doi.org/10.1038/s41597-022-01721-8.
  35. Clifford-steerable convolutional neural networks. arXiv preprint arXiv:2402.14730, 2024.
  36. 6DCNN with roto-translational convolution filters for volumetric data processing. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 4707–4715, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets