Knowledge Graph Self-Supervised Rationalization for Recommendation (2307.02759v1)
Abstract: In this paper, we introduce a new self-supervised rationalization method, called KGRec, for knowledge-aware recommender systems. To effectively identify informative knowledge connections, we propose an attentive knowledge rationalization mechanism that generates rational scores for knowledge triplets. With these scores, KGRec integrates generative and contrastive self-supervised tasks for recommendation through rational masking. To highlight rationales in the knowledge graph, we design a novel generative task in the form of masking-reconstructing. By masking important knowledge with high rational scores, KGRec is trained to rebuild and highlight useful knowledge connections that serve as rationales. To further rationalize the effect of collaborative interactions on knowledge graph learning, we introduce a contrastive learning task that aligns signals from knowledge and user-item interaction views. To ensure noise-resistant contrasting, potential noisy edges in both graphs judged by the rational scores are masked. Extensive experiments on three real-world datasets demonstrate that KGRec outperforms state-of-the-art methods. We also provide the implementation codes for our approach at https://github.com/HKUDS/KGRec.
- Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017).
- Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences. In The Web Conference (WWW). 151–161.
- Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In International Conference on Research and Development in Information Retrieval (SIGIR). 335–344.
- Masked Autoencoders As Spatiotemporal Learners. arXiv preprint arXiv:2205.09113 (2022).
- Michael Gutmann and Aapo Hyvärinen. 2010. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In International Conference on Artificial Intelligence and Statistics (AISTATS). 297–304.
- Masked autoencoders are scalable vision learners. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 16000–16009.
- Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In International Conference on Research and Development in Information Retrieval (SIGIR). 355–364.
- Lightgcn: Simplifying and powering graph convolution network for recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 639–648.
- Neural collaborative filtering. In The Web Conference (WWW). 173–182.
- Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In International Conference on Knowledge Discovery & Data Mining (KDD). 1531–1540.
- Heterogeneous graph transformer. In The Web Conference (WWW). 2704–2710.
- Stochastic client selection for federated learning with volatile clients. IEEE Internet of Things Journal (2022).
- Categorical Reparametrization with Gumble-Softmax. In International Conference on Learning Representations (ICLR).
- Supervised contrastive learning. (2020), 18661–18673.
- Rating-based collaborative filtering: algorithms and evaluation. Social information access: Systems and technologies (2018), 344–390.
- Graph Transformer for Recommendation. arXiv preprint arXiv:2306.02330 (2023).
- Federated optimization in heterogeneous networks. Proceedings of Machine Learning and Systems 2 (2020), 429–450.
- Scaling Language-Image Pre-training via Masking. arXiv preprint arXiv:2212.00794 (2022).
- Variational autoencoders for collaborative filtering. In The Web Conference (WWW). 689–698.
- Learning entity and relation embeddings for knowledge graph completion. In AAAI Conference on Artificial Intelligence (AAAI).
- K-bert: Enabling language representation with knowledge graph. In AAAI Conference on Artificial Intelligence (AAAI). 2901–2908.
- BPR: Bayesian personalized ranking from implicit feedback. In International Conference on Uncertainty in Artificial Intelligence (UAI). 452–461.
- Baoxu Shi and Tim Weninger. 2018. Open-world knowledge graph completion. In AAAI Conference on Artificial Intelligence (AAAI).
- BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In International Conference on Information and Knowledge Management (CIKM). 1441–1450.
- RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. In International Conference on Learning Representations (ICLR).
- Joint knowledge pruning and recurrent graph convolution for news recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 51–60.
- DKN: Deep knowledge-aware network for news recommendation. In The Web Conference (WWW). 1835–1844.
- Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In International Conference on Knowledge Discovery & Data Mining (KDD). 968–977.
- Multi-task feature learning for knowledge graph enhanced recommendation. In ACM Web Conference (WWW). 2000–2010.
- Knowledge graph convolutional networks for recommender systems. In The Web Conference (WWW). 3307–3313.
- Swift and Sure: Hardness-aware Contrastive Learning for Low-dimensional Knowledge Graph Embeddings. In The Web Conference (WWW). 838–849.
- Tongzhou Wang and Phillip Isola. 2020. Understanding contrastive representation learning through alignment and uniformity on the hypersphere. In International Conference on Machine Learning (ICML). 9929–9939.
- Kgat: Knowledge graph attention network for recommendation. In International Conference on Knowledge Discovery & Data Mining (KDD). 950–958.
- Neural graph collaborative filtering. In International Conference on Research and Development in Information Retrieval (SIGIR). 165–174.
- Learning intents behind interactions with knowledge graph for recommendation. In The Web Conference (WWW). 878–887.
- Explainable reasoning over knowledge graphs for recommendation. In AAAI Conference on Artificial Intelligence (AAAI), Vol. 33. 5329–5336.
- Knowledge graph embedding by translating on hyperplanes. In AAAI Conference on Artificial Intelligence (AAAI).
- Multi-Modal Self-Supervised Learning for Recommendation. In The Web Conference (WWW). 790–800.
- Self-supervised graph learning for recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 726–735.
- Automated Self-Supervised Learning for Recommendation. In ACM Web Conference (WWW). 992–1002.
- Graph-less Collaborative Filtering. In ACM Web Conference (WWW). 17–27.
- TransA: An adaptive approach for knowledge graph embedding. arXiv preprint arXiv:1509.05490 (2015).
- Debiased Contrastive Learning for Sequential Recommendation. In The Web Conference (WWW). 1063–1073.
- Knowledge Graph Contrastive Learning for Recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 1434–1443.
- Self-supervised learning for large-scale item recommendations. In International Conference on Information & Knowledge Management (CIKM). 4321–4330.
- Self-supervised multi-channel hypergraph convolutional network for social recommendation. In The Web Conference (WWW). 413–424.
- Are graph augmentations necessary? simple graph contrastive learning for recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 1294–1303.
- Personalized entity recommendation: A heterogeneous information network approach. In International Conference on Web Search and Data Mining (WSDM). 283–292.
- Collaborative knowledge base embedding for recommender systems. In International Conference on Knowledge Discovery & Data Mining (KDD). 353–362.
- Kb4rec: A data set for linking knowledge bases with recommender systems. Data Intelligence 1, 2 (2019), 121–136.
- S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In International Conference on Information & Knowledge Management (CIKM). 1893–1902.
- Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System. In International Conference on Research and Development in Information Retrieval (SIGIR).
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.