FedRKG: A Privacy-preserving Federated Recommendation Framework via Knowledge Graph Enhancement (2401.11089v1)
Abstract: Federated Learning (FL) has emerged as a promising approach for preserving data privacy in recommendation systems by training models locally. Recently, Graph Neural Networks (GNN) have gained popularity in recommendation tasks due to their ability to capture high-order interactions between users and items. However, privacy concerns prevent the global sharing of the entire user-item graph. To address this limitation, some methods create pseudo-interacted items or users in the graph to compensate for missing information for each client. Unfortunately, these methods introduce random noise and raise privacy concerns. In this paper, we propose FedRKG, a novel federated recommendation system, where a global knowledge graph (KG) is constructed and maintained on the server using publicly available item information, enabling higher-order user-item interactions. On the client side, a relation-aware GNN model leverages diverse KG relationships. To protect local interaction items and obscure gradients, we employ pseudo-labeling and Local Differential Privacy (LDP). Extensive experiments conducted on three real-world datasets demonstrate the competitive performance of our approach compared to centralized algorithms while ensuring privacy preservation. Moreover, FedRKG achieves an average accuracy improvement of 4% compared to existing federated learning baselines.
- Kgat: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, pages 950–958, 2019.
- A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering, 34(8):3549–3568, 2020.
- Graph neural networks: A review of methods and applications. AI Open, 1:57–81, 2020.
- Graph neural networks in recommender systems: a survey. ACM Computing Surveys, 55(5):1–37, 2022.
- Paul Voigt and Axel Von dem Bussche. The EU general data protection regulation (GDPR). A Practical Guide, 1st Ed., Cham: Springer International Publishing, 10(3152676):10–5555, 2017.
- Secure federated matrix factorization. IEEE Intelligent Systems, 36(5):11–20, 2020.
- FedGNN: Federated graph neural network for privacy-preserving recommendation. arXiv preprint arXiv:2102.04925, 2021.
- Federated social recommendation with graph neural network. ACM Transactions on Intelligent Systems and Technology, 13(4):1–24, 2022.
- Ckan: collaborative knowledge-aware attentive network for recommender systems. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR, pages 219–228, 2020.
- Multi-modal knowledge graphs for recommender systems. In Proceedings of the 29th ACM International Conference on Information & Knowledge Managemen, CIKM, pages 1405–1414, 2020.
- Knowledge graph convolutional networks for recommender systems. In Proceedings of the World Wide Web Conference, WWW, pages 3307–3313, 2019.
- Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, pages 968–977, 2019.
- Personalized edge intelligence via federated self-knowledge distillation. IEEE Transactions on Parallel and Distributed Systems, 34(2):567–580, 2023.
- Subgraph federated learning with missing neighbor generation. In Proceedings of the Annual Conference on Neural Information Processing Systems, NeurIPS, volume 34, pages 6671–6682, 2021.
- Differentially private federated knowledge graphs embedding. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, CIKM, pages 1416–1425, 2021.
- Federated collaborative filtering for privacy-preserving personalized recommendation system. arXiv preprint arXiv:1901.09888, 2019.
- Temporal graph cube. IEEE Transactions on Knowledge and Data Engineering, pages 1–15, 2023.
- Geometric deep learning: progress, applications and challenges. Science China Information Sciences, 65(2):126101, 2022.
- FedBERT: When federated learning meets pre-training. ACM Transactions on Intelligent Systems and Technology, 13(4):1–26, 2022.
- The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems, 5(4):19:1–19:19, 2016.
- Improving recommendation lists through topic diversification. In Proceedings of the World Wide Web Conference, WWW, pages 22–32, 2005.
- Second workshop on information heterogeneity and fusion in recommender systems (HetRec2011). In Proceedings of the 2011 ACM Conference on Recommender Systems, RecSys, pages 387–388, 2011.
- Yehuda Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, pages 426–434, 2008.
- Steffen Rendle. Factorization machines with libfm. ACM Transactions on Intelligent Systems and Technology, 3(3):1–22, 2012.
- Personalized entity recommendation: A heterogeneous information network approach. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining, WSDM, pages 283–292, 2014.
- Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, pages 353–362, 2016.
- Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM, pages 417–426, 2018.
- Dezhong Yao (36 papers)
- Tongtong Liu (15 papers)
- Qi Cao (57 papers)
- Hai Jin (83 papers)