Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

DPHGNN: A Dual Perspective Hypergraph Neural Networks (2405.16616v1)

Published 26 May 2024 in cs.LG and cs.SI

Abstract: Message passing on hypergraphs has been a standard framework for learning higher-order correlations between hypernodes. Recently-proposed hypergraph neural networks (HGNNs) can be categorized into spatial and spectral methods based on their design choices. In this work, we analyze the impact of change in hypergraph topology on the suboptimal performance of HGNNs and propose DPHGNN, a novel dual-perspective HGNN that introduces equivariant operator learning to capture lower-order semantics by inducing topology-aware spatial and spectral inductive biases. DPHGNN employs a unified framework to dynamically fuse lower-order explicit feature representations from the underlying graph into the super-imposed hypergraph structure. We benchmark DPHGNN over eight benchmark hypergraph datasets for the semi-supervised hypernode classification task and obtain superior performance compared to seven state-of-the-art baselines. We also provide a theoretical framework and a synthetic hypergraph isomorphism test to express the power of spatial HGNNs and quantify the expressivity of DPHGNN beyond the Generalized Weisfeiler Leman (1-GWL) test. Finally, DPHGNN was deployed by our partner e-commerce company for the Return-to-Origin (RTO) prediction task, which shows ~7% higher macro F1-Score than the best baseline.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. Structured streaming: A declarative api for real-time applications in apache spark. In Proceedings of the 2018 International Conference on Management of Data. 601–613.
  2. HyperSAGE: Generalizing Inductive Representation Learning on Hypergraphs. CoRR abs/2010.04558 (2020). http://dblp.uni-trier.de/db/journals/corr/corr2010.html#abs-2010-04558
  3. Hypergraph Convolution and Hypergraph Attention. CoRR abs/1901.08150 (2019). http://dblp.uni-trier.de/db/journals/corr/corr1901.html#abs-1901-08150
  4. Hypergraph Attention Isomorphism Network by Learning Line Graph Expansion. In 2020 IEEE International Conference on Big Data (Big Data). 669–678. https://doi.org/10.1109/BigData50022.2020.9378335
  5. Alain Bretto. 2013. Hypergraph Theory. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-00080-0
  6. Jan Böker. 2019. Color Refinement, Homomorphisms, and Hypergraphs.. In WG (Lecture Notes in Computer Science, Vol. 11789), Ignasi Sau and Dimitrios M. Thilikos (Eds.). Springer, 338–350. http://dblp.uni-trier.de/db/conf/wg/wg2019.html#Boker19
  7. Preventing Over-Smoothing for Hypergraph Neural Networks. arXiv:2203.17159 [cs.LG]
  8. You are AllSet: A Multiset Function Framework for Hypergraph Neural Networks. In International Conference on Learning Representations. https://openreview.net/forum?id=hpBTIv2uy_E
  9. On inductive–transductive learning with graph neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 2 (2021), 758–769.
  10. HNHN: Hypergraph Networks with Hyperedge Neurons. ArXiv abs/2006.12278 (2020). https://api.semanticscholar.org/CorpusID:219965680
  11. Graph neural networks for social recommendation. In The world wide web conference. 417–426.
  12. Hypergraph Neural Networks.. In AAAI. AAAI Press, 3558–3565. http://dblp.uni-trier.de/db/conf/aaai/aaai2019.html#FengYZJG19
  13. HGNN+: General Hypergraph Neural Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 45 (2022), 3181–3199. https://api.semanticscholar.org/CorpusID:249644940
  14. Hypergraph Learning: Methods and Practices. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 5 (2022), 2548–2566. https://doi.org/10.1109/TPAMI.2020.3039374
  15. Quantum experiments and hypergraphs: Multiphoton sources for quantum interference, quantum computation, and quantum entanglement. Physical Review A 101, 3 (mar 2020). https://doi.org/10.1103/physreva.101.033816
  16. Inductive Representation Learning on Large Graphs. In Advances in Neural Information Processing Systems. 11.
  17. Jing Huang and Jie Yang. 2021. UniGNN: a Unified Framework for Graph and Hypergraph Neural Networks. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, Zhi-Hua Zhou (Ed.). ijcai.org, 2563–2569. https://doi.org/10.24963/ijcai.2021/353
  18. Ningyuan Teresa Huang and Soledad Villar. 2021. A short tutorial on the weisfeiler-lehman test and its variants. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8533–8537.
  19. Dual channel hypergraph collaborative filtering. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. 2020–2029.
  20. Thomas N. Kipf and Max Welling. 2016. Semi-Supervised Classification with Graph Convolutional Networks. http://arxiv.org/abs/1609.02907 cite arxiv:1609.02907Comment: Published as a conference paper at ICLR 2017.
  21. Kafka: A distributed messaging system for log processing. In Proceedings of the NetDB, Vol. 11. Athens, Greece, 1–7.
  22. Graph neural networks-based multilabel classification of citation network. In Asian Conference on Intelligent Information and Database Systems. Springer, 128–140.
  23. Rashmee Lahon. 2022. Return to Origin- Why it Happens, Its Impact, and How to Solve it? https://razorpay.com/blog/return-to-origin-challenges-and-how-to-solve-it
  24. Deeper insights into graph convolutional networks for semi-supervised learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 32.
  25. Survey of Graph Neural Networks and Applications. Wireless Communications and Mobile Computing (2022). https://api.semanticscholar.org/CorpusID:251192566
  26. Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation.. In IJCAI, Christian Bessiere (Ed.). ijcai.org, 782–788. http://dblp.uni-trier.de/db/conf/ijcai/ijcai2020.html#LiuLZFCLZX20 Scheduled for July 2020, Yokohama, Japan, postponed due to the Corona pandemic..
  27. Provably powerful graph networks. Advances in neural information processing systems 32 (2019).
  28. Weisfeiler and Leman go sparse: Towards scalable higher-order graph embeddings. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 21824–21840. https://proceedings.neurips.cc/paper/2020/file/f81dee42585b3814de199b2e88757f5c-Paper.pdf
  29. Random walks and Laplacians on hypergraphs: When do they match? arXiv:2106.11663 [math.SP]
  30. Hypergraph automorphisms. arXiv preprint arXiv:2010.01049 (2020).
  31. Raffaella Mulas and Dong Zhang. 2021. Spectral theory of Laplace operators on oriented hypergraphs. Discrete Mathematics 344, 6 (jun 2021), 112372. https://doi.org/10.1016/j.disc.2021.112372
  32. Understanding over-squashing and bottlenecks on graphs via curvature. arXiv:2111.14522 [stat.ML]
  33. Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).
  34. Graph Attention Networks. ArXiv abs/1710.10903 (2018).
  35. Heterogeneous edge embedding for friend recommendation. In Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II 41. Springer, 172–179.
  36. How Powerful are Graph Neural Networks?. In ICLR. OpenReview.net. http://dblp.uni-trier.de/db/conf/iclr/iclr2019.html#XuHLJ19
  37. Representation Learning on Graphs with Jumping Knowledge Networks.. In ICML (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, 5449–5458. http://dblp.uni-trier.de/db/conf/icml/icml2018.html#XuLTSKJ18
  38. Naganand Yadati. 2020. Neural Message Passing for Multi-Relational Ordered and Recursive Hypergraphs. In Advances in Neural Information Processing Systems (NeurIPS) 33. Curran Associates, Inc.
  39. Hypergcn: A new method for training graph convolutional networks on hypergraphs. Advances in neural information processing systems 32 (2019).
  40. Cross-attention spectral–spatial network for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), 1–14.
  41. Jonathan S. Yedidia. 2011. Message-Passing Algorithms for Inference and Optimization. Journal of Statistical Physics 145 (2011), 860–890. https://api.semanticscholar.org/CorpusID:120991239
  42. Graph Neural Networks: A Review of Methods and Applications. ArXiv abs/1812.08434 (2018). https://api.semanticscholar.org/CorpusID:56517517
  43. Multilevel spectral hypergraph partitioning with arbitrary vertex sizes. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 18, 9 (1999), 1389–1399. https://doi.org/10.1109/43.784130
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com