A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networks (2311.18672v3)
Abstract: Machine learning algorithms are heavily relied on to understand the vast amounts of data from high-energy particle collisions at the CERN Large Hadron Collider (LHC). The data from such collision events can naturally be represented with graph structures. Therefore, deep geometric methods, such as graph neural networks (GNNs), have been leveraged for various data analysis tasks in high-energy physics. One typical task is jet tagging, where jets are viewed as point clouds with distinct features and edge connections between their constituent particles. The increasing size and complexity of the LHC particle datasets, as well as the computational models used for their analysis, greatly motivate the development of alternative fast and efficient computational paradigms such as quantum computation. In addition, to enhance the validity and robustness of deep networks, one can leverage the fundamental symmetries present in the data through the use of invariant inputs and equivariant layers. In this paper, we perform a fair and comprehensive comparison between classical graph neural networks (GNNs) and equivariant graph neural networks (EGNNs) and their quantum counterparts: quantum graph neural networks (QGNNs) and equivariant quantum graph neural networks (EQGNN). The four architectures were benchmarked on a binary classification task to classify the parton-level particle initiating the jet. Based on their AUC scores, the quantum networks were shown to outperform the classical networks. However, seeing the computational advantage of the quantum networks in practice may have to wait for the further development of quantum technology and its associated APIs.
- Decompositional quantum graph neural network. CoRR, abs/2201.05158, 2022.
- JUNIPR: a framework for unsupervised machine learning in particle physics. The European Physical Journal C, 79(2), feb 2019. doi: 10.1140/epjc/s10052-019-6607-9. URL https://doi.org/10.1140%2Fepjc%2Fs10052-019-6607-9.
- Quantum machine learning of graph-structured data. Phys. Rev. A, 108:012410, Jul 2023. doi: 10.1103/PhysRevA.108.012410. URL https://link.aps.org/doi/10.1103/PhysRevA.108.012410.
- Quantum vision transformers, 2023. URL https://openreview.net/forum?id=p7xPXoKB0H.
- Iqgan: Robust quantum generative adversarial network for image synthesis on nisq devices. In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1–5, 2023. doi: 10.1109/ICASSP49357.2023.10096772.
- All you need is spin: Su(2) equivariant variational quantum circuits based on spin networks, 2023.
- A rotation-equivariant convolutional neural network model of primary visual cortex. In International Conference on Learning Representations, 2019. URL https://openreview.net/forum?id=H1fU8iAqKX.
- C. Esteves. Theoretical aspects of group equivariant neural networks, 2020.
- Identifying the Group-Theoretic Structure of Machine-Learned Symmetries. 9 2023a.
- Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles. Mach. Learn. Sci. Tech., 4(2):025027, 2023b. doi: 10.1088/2632-2153/acd989.
- Accelerated Discovery of Machine-Learned Symmetries: Deriving the Exceptional Lie Groups G2, F4 and E6. 7 2023c.
- Discovering Sparse Representations of Lie Groups with Machine Learning. Physics Letters B, 844, 9 2023d. doi: 10.1016/j.physletb.2023.138086.
- Kinematic Variables and Feature Engineering for Particle Phenomenology. 6 2022.
- Neural message passing for quantum chemistry. In D. Precup and Y. W. Teh, editors, Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 1263–1272. PMLR, 06–11 Aug 2017. URL https://proceedings.mlr.press/v70/gilmer17a.html.
- T. N. Kipf and M. Welling. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
- T. N. Kipf and M. Welling. Semi-Supervised Classification with Graph Convolutional Networks. In Proceedings of the 5th International Conference on Learning Representations, ICLR ’17, 2017. URL https://openreview.net/forum?id=SJU4ayYgl.
- Energy flow networks: deep sets for particle jets. Journal of High Energy Physics, 2019(1), jan 2019. doi: 10.1007/jhep01(2019)121. URL https://doi.org/10.1007%2Fjhep01%282019%29121.
- L. Lim and B. J. Nelson. What is an equivariant neural network? CoRR, abs/2205.07362, 2022. doi: 10.48550/arXiv.2205.07362. URL https://doi.org/10.48550/arXiv.2205.07362.
- Invariant and equivariant graph networks. In International Conference on Learning Representations, 2019. URL https://openreview.net/forum?id=Syx72jC9tm.
- Equivariant quantum graph circuits, 2022.
- Exploiting symmetry in variational quantum machine learning. PRX Quantum, 4(1), mar 2023. doi: 10.1103/prxquantum.4.010328. URL https://doi.org/10.1103%2Fprxquantum.4.010328.
- V. Mikuni and F. Canelli. Abcnet: an attention-based method for particle tagging. The European Physical Journal Plus, 135(6):463, 2020. doi: 10.1140/epjp/s13360-020-00497-3. URL https://doi.org/10.1140/epjp/s13360-020-00497-3.
- V. Mikuni and F. Canelli. Point cloud transformers applied to collider physics. Machine Learning: Science and Technology, 2(3):035027, jul 2021. doi: 10.1088/2632-2153/ac07f6. URL https://doi.org/10.1088%2F2632-2153%2Fac07f6.
- Do graph neural networks learn traditional jet substructure? In 36th Conference on Neural Information Processing Systems, 11 2022.
- Equivariant graph neural networks for charged particle tracking, 2023.
- Theory for equivariant quantum neural networks. ArXiv, abs/2210.08566, 2022. URL https://api.semanticscholar.org/CorpusID:252917789.
- Entangling Quantum Generative Adversarial Networks. Phys. Rev. Lett., 128(22):220505, 2022. doi: 10.1103/PhysRevLett.128.220505.
- E. Rodrigues and H. Schreiner. scikit-hep/particle: Version 0.23.0, July 2023. URL https://doi.org/10.5281/zenodo.8112280.
- Oracle-preserving latent flows. Symmetry, 15(7), 2023. ISSN 2073-8994. doi: 10.3390/sym15071352. URL https://www.mdpi.com/2073-8994/15/7/1352.
- E(n) equivariant graph neural networks. ArXiv, abs/2102.09844, 2021. URL https://api.semanticscholar.org/CorpusID:231979049.
- Theoretical guarantees for permutation-equivariant quantum neural networks, 2022.
- Graph neural networks in particle physics. Machine Learning: Science and Technology, 2(2):021001, Dec 2020. doi: 10.1088/2632-2153/abbf9a. URL https://dx.doi.org/10.1088/2632-2153/abbf9a.
- The dawn of quantum natural language processing. ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8612–8616, 2021. URL https://api.semanticscholar.org/CorpusID:238744248.
- Equivariant quantum circuits for learning on weighted graphs. npj Quantum Information, 9(1):47, 2023. doi: 10.1038/s41534-023-00710-y. URL https://doi.org/10.1038/s41534-023-00710-y.
- The general theory of permutation equivarant neural networks and higher order graph variational encoders, 2020.
- P. Veličković. Everything is connected: Graph neural networks. Current Opinion in Structural Biology, 79:102538, 2023. ISSN 0959-440X. doi: https://doi.org/10.1016/j.sbi.2023.102538. URL https://www.sciencedirect.com/science/article/pii/S0959440X2300012X.
- Graph attention networks. In International Conference on Learning Representations, 2018. URL https://openreview.net/forum?id=rJXMpikCZ.
- Quantum graph neural networks. ArXiv, abs/1909.12264, 2019. URL https://api.semanticscholar.org/CorpusID:202889158.
- Harmonic networks: Deep translation and rotation equivariance. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 7168–7177, Los Alamitos, CA, USA, jul 2017. IEEE Computer Society. doi: 10.1109/CVPR.2017.758. URL https://doi.ieeecomputersociety.org/10.1109/CVPR.2017.758.
- Sncqa: A hardware-efficient equivariant quantum convolutional circuit architecture, 2023.
- Graph neural networks: A review of methods and applications. AI Open, 1:57–81, 2020. ISSN 2666-6510. doi: https://doi.org/10.1016/j.aiopen.2021.01.001. URL https://www.sciencedirect.com/science/article/pii/S2666651021000012.