When Federated Recommendation Meets Cold-Start Problem: Separating Item Attributes and User Interactions (2305.12650v2)
Abstract: Federated recommendation system usually trains a global model on the server without direct access to users' private data on their own devices. However, this separation of the recommendation model and users' private data poses a challenge in providing quality service, particularly when it comes to new items, namely cold-start recommendations in federated settings. This paper introduces a novel method called Item-aligned Federated Aggregation (IFedRec) to address this challenge. It is the first research work in federated recommendation to specifically study the cold-start scenario. The proposed method learns two sets of item representations by leveraging item attributes and interaction records simultaneously. Additionally, an item representation alignment mechanism is designed to align two item representations and learn the meta attribute network at the server within a federated learning framework. Experiments on four benchmark datasets demonstrate IFedRec's superior performance for cold-start scenarios. Furthermore, we also verify IFedRec owns good robustness when the system faces limited client participation and noise injection, which brings promising practical application potential in privacy-protection enhanced federated recommendation systems. The implementation code is available
- Recsys challenge 2017: Offline and online evaluation. In Proceedings of the eleventh acm conference on recommender systems. 372–373.
- A survey on homomorphic encryption schemes: Theory and implementation. ACM Computing Surveys (Csur) 51, 4 (2018), 1–35.
- Federated collaborative filtering for privacy-preserving personalized recommendation system. arXiv preprint arXiv:1901.09888 (2019).
- HRS-CE: A hybrid framework to integrate content embeddings in recommender systems for cold start items. Journal of computational science 29 (2018), 9–18.
- Secure federated matrix factorization. IEEE Intelligent Systems 36, 5 (2020), 11–20.
- Generative adversarial framework for cold-start item recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2565–2571.
- Guaranteeing local differential privacy on ultra-low-power systems. In 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA). IEEE, 561–574.
- Federated matrix factorization for privacy-preserving recommender systems. Applied Soft Computing 111 (2021), 107700.
- Federated multi-view matrix factorization for personalized recommendations. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part II. Springer, 324–347.
- Deeply fusing reviews and contents for cold start users in cross-domain recommendation systems. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 94–101.
- Ruining He and Julian McAuley. 2016. VBPR: visual bayesian personalized ranking from implicit feedback. In Proceedings of the AAAI conference on artificial intelligence, Vol. 30.
- Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173–182.
- ReFRS: Resource-efficient federated recommender system for dynamic and diversified user preferences. ACM Transactions on Information Systems 41, 3 (2023), 1–30.
- Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.
- Melu: Meta-learned user preference estimator for cold-start recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1073–1082.
- Learning to collaborate in decentralized learning of personalized models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 9766–9775.
- Federated Recommendation with Additive Personalization. arXiv preprint arXiv:2301.09109 (2023).
- Zhuoran Liu and Martha Larson. 2021. Adversarial item promotion: Vulnerabilities at the core of top-n recommenders that use images to address cold start. In Proceedings of the Web Conference 2021. 3590–3602.
- Federated social recommendation with graph neural network. ACM Transactions on Intelligent Systems and Technology (TIST) 13, 4 (2022), 1–24.
- Multi-center federated learning: clients clustering for better personalization. World Wide Web 26, 1 (2023), 481–500.
- Structured Federated Learning through Clustered Additive Modeling. In Thirty-seventh Conference on Neural Information Processing Systems.
- Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics. PMLR, 1273–1282.
- Fedfast: Going beyond average for faster training of federated recommender systems. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1234–1242.
- Automatic differentiation in pytorch. (2017).
- Vasileios Perifanis and Pavlos S Efraimidis. 2022. Federated neural collaborative filtering. Knowledge-Based Systems 242 (2022), 108441.
- Semi-decentralized Federated Ego Graph Learning for Recommendation. arXiv preprint arXiv:2302.10900 (2023).
- Federated reconstruction: Partially local federated learning. Advances in Neural Information Processing Systems 34 (2021), 11220–11232.
- Federated learning on non-iid graphs via structural knowledge sharing. In Proceedings of the AAAI conference on artificial intelligence, Vol. 37. 9953–9961.
- Paul Voigt and Axel Von dem Bussche. 2017. The eu general data protection regulation (gdpr). A Practical Guide, 1st Ed., Cham: Springer International Publishing 10, 3152676 (2017), 10–5555.
- Dropoutnet: Addressing cold start in recommender systems. Advances in neural information processing systems 30 (2017).
- Content-based neighbor models for cold start in recommender systems. In Proceedings of the Recommender Systems Challenge 2017. 1–6.
- Federated against the cold: A trust-based federated learning approach to counter the cold start problem in recommendation systems. Information Sciences 601 (2022), 189–206.
- Chong Wang and David M Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. 448–456.
- Fast-adapting and privacy-preserving federated recommender system. The VLDB Journal (2021), 1–20.
- Deep & cross network for ad click predictions. In Proceedings of the ADKDD’17. 1–7.
- Collaborative filtering and deep learning based recommendation system for cold start items. Expert Systems with Applications 69 (2017), 29–39.
- Contrastive learning for cold-start recommendation. In Proceedings of the 29th ACM International Conference on Multimedia. 5382–5390.
- A federated graph neural network framework for privacy-preserving personalization. Nature Communications 13, 1 (2022), 3091.
- Peng Yan and Guodong Long. 2023. Personalization Disentanglement for Federated Learning. arXiv preprint arXiv:2306.03570 (2023).
- Interaction-level membership inference attack against federated recommender systems. arXiv preprint arXiv:2301.10964 (2023).
- Federated unlearning for on-device recommendation. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. 393–401.
- Graph-guided Personalization for Federated Recommendation. arXiv preprint arXiv:2305.07866 (2023).
- Dual Personalization on Federated Recommendation. arXiv preprint arXiv:2301.08143 (2023).
- Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Comput. Surv. 52, 1, Article 5 (feb 2019), 38 pages. https://doi.org/10.1145/3285029
- Pipattack: Poisoning federated recommender systems for manipulating item promotion. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1415–1423.
- Contrastive Collaborative Filtering for Cold-Start Item Recommendation. In Proceedings of the ACM Web Conference 2023, WWW 2023, Austin, TX, USA, 30 April 2023 - 4 May 2023, Ying Ding, Jie Tang, Juan F. Sequeda, Lora Aroyo, Carlos Castillo, and Geert-Jan Houben (Eds.). ACM, 928–937. https://doi.org/10.1145/3543507.3583286
- Recommendation for new users and new items via randomized training and mixture-of-experts transformation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1121–1130.
- Chunxu Zhang (20 papers)
- Guodong Long (115 papers)
- Tianyi Zhou (172 papers)
- Zijian Zhang (125 papers)
- Peng Yan (88 papers)
- Bo Yang (427 papers)