Balanced Multi-Relational Graph Clustering (2407.16863v1)
Abstract: Multi-relational graph clustering has demonstrated remarkable success in uncovering underlying patterns in complex networks. Representative methods manage to align different views motivated by advances in contrastive learning. Our empirical study finds the pervasive presence of imbalance in real-world graphs, which is in principle contradictory to the motivation of alignment. In this paper, we first propose a novel metric, the Aggregation Class Distance, to empirically quantify structural disparities among different graphs. To address the challenge of view imbalance, we propose Balanced Multi-Relational Graph Clustering (BMGC), comprising unsupervised dominant view mining and dual signals guided representation learning. It dynamically mines the dominant view throughout the training process, synergistically improving clustering performance with representation learning. Theoretical analysis ensures the effectiveness of dominant view mining. Extensive experiments and in-depth analysis on real-world and synthetic datasets showcase that BMGC achieves state-of-the-art performance, underscoring its superiority in addressing the view imbalance inherent in multi-relational graphs. The source code and datasets are available at https://github.com/zxlearningdeep/BMGC.
- Emmanuel Abbe. 2018. Community detection and stochastic block models: recent developments. Journal of Machine Learning Research 18, 177 (2018), 1–86.
- Effects of Graph Convolutions in Multi-layer Networks. In The Eleventh International Conference on Learning Representations.
- Sudhanshu Chanpuriya and Cameron Musco. 2022. Simplified graph convolution with heterophily. Advances in Neural Information Processing Systems 35 (2022), 27184–27197.
- Adaptive Universal Generalized PageRank Graph Neural Network. In International Conference on Learning Representations.
- One2multi graph autoencoder for multi-view graph clustering. In proceedings of the web conference 2020. 3070–3076.
- PMR: Prototypical Modal Rebalance for Multimodal Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 20029–20038.
- Magnn: Metapath aggregated graph neural network for heterogeneous graph embedding. In Proceedings of The Web Conference 2020. 2331–2341.
- Trusted multi-view classification with dynamic evidential fusion. IEEE transactions on pattern analysis and machine intelligence 45, 2 (2022), 2551–2566.
- Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In proceedings of the 25th international conference on world wide web. 507–517.
- What makes multi-modal learning better than single (provably). Advances in Neural Information Processing Systems 34 (2021), 10944–10956.
- Hdmi: High-order deep multiplex infomax. In Proceedings of the Web Conference 2021. 2414–2424.
- Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. arXiv preprint arXiv:1611.07308 (2016).
- Multi-view attributed graph clustering. IEEE Transactions on knowledge and data engineering 35, 2 (2023), 1872–1880.
- Dual label-guided graph refinement for multi-view graph clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 8791–8798.
- Multilayer graph contrastive clustering network. Information Sciences 613 (2022), 256–267.
- Late fusion incomplete multi-view clustering. IEEE transactions on pattern analysis and machine intelligence 41, 10 (2018), 2410–2423.
- Deep graph clustering via dual correlation reduction. In Proceedings of the AAAI conference on artificial intelligence, Vol. 36. 7603–7611.
- Relation structure-aware heterogeneous information network embedding. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 4456–4463.
- Revisiting heterophily for graph neural networks. Advances in neural information processing systems 35 (2022), 1362–1375.
- Multiplex Graph Representation Learning Via Dual Correlation Reduction. IEEE Transactions on Knowledge and Data Engineering (2023).
- Disentangled multiplex graph representation learning. In International Conference on Machine Learning. PMLR, 24983–25005.
- Erlin Pan and Zhao Kang. 2021. Multi-view contrastive graph clustering. Advances in neural information processing systems 34 (2021), 2148–2159.
- Erlin Pan and Zhao Kang. 2023a. Beyond homophily: Reconstructing structure for graph-agnostic clustering. In International Conference on Machine Learning. PMLR, 26868–26877.
- Erlin Pan and Zhao Kang. 2023b. High-order multi-view clustering for generic data. Information Fusion 100 (2023), 101947.
- Unsupervised attributed multiplex network embedding. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 5371–5378.
- Unsupervised Multiplex Graph Learning with Complementary and Consistent Information. In Proceedings of the 31st ACM International Conference on Multimedia. 454–462.
- Balanced multimodal learning via on-the-fly gradient modulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8238–8247.
- Upper Bounding Barlow Twins: A Novel Filter for Multi-Relational Clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38. 14660–14668.
- An attention-based collaboration framework for multi-view network representation learning. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1767–1776.
- Semi-Supervised Embedding of Attributed Multiplex Networks. In Proceedings of the ACM Web Conference 2023. 578–587.
- Deep fusion clustering network. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 9978–9987.
- Deep Graph Infomax. In International Conference on Learning Representations.
- Microsoft academic graph: When experts are not enough. Quantitative Science Studies 1, 1 (2020), 396–413.
- What makes training multi-modal classification networks hard?. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 12695–12705.
- Heterogeneous graph attention network. In The world wide web conference. 2022–2032.
- Heterogeneous graph contrastive multi-view learning. In Proceedings of the 2023 SIAM International Conference on Data Mining (SDM). SIAM, 136–144.
- Simplifying graph convolutional networks. In International conference on machine learning. PMLR, 6861–6871.
- Graph neural networks for natural language processing: A survey. Foundations and Trends® in Machine Learning 16, 2 (2023), 119–328.
- Flexible multi-view unsupervised graph embedding. IEEE Transactions on Image Processing 30 (2021), 4143–4156.
- Flexible multi-view dimensionality co-reduction. IEEE Transactions on Image Processing 26, 2 (2016), 648–659.
- Network schema preserving heterogeneous information network embedding. In International joint conference on artificial intelligence (IJCAI).
- Graph neural networks with heterophily. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35. 11168–11176.