Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Does Knowledge Graph Really Matter for Recommender Systems? (2404.03164v1)

Published 4 Apr 2024 in cs.IR, cs.AI, and cs.LG

Abstract: Recommender systems (RSs) are designed to provide personalized recommendations to users. Recently, knowledge graphs (KGs) have been widely introduced in RSs to improve recommendation accuracy. In this study, however, we demonstrate that RSs do not necessarily perform worse even if the KG is downgraded to the user-item interaction graph only (or removed). We propose an evaluation framework KG4RecEval to systematically evaluate how much a KG contributes to the recommendation accuracy of a KG-based RS, using our defined metric KGER (KG utilization efficiency in recommendation). We consider the scenarios where knowledge in a KG gets completely removed, randomly distorted and decreased, and also where recommendations are for cold-start users. Our extensive experiments on four commonly used datasets and a number of state-of-the-art KG-based RSs reveal that: to remove, randomly distort or decrease knowledge does not necessarily decrease recommendation accuracy, even for cold-start users. These findings inspire us to rethink how to better utilize knowledge from existing KGs, whereby we discuss and provide insights into what characteristics of datasets and KG-based RSs may help improve KG utilization efficiency.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE transactions on knowledge and data engineering 17, 6 (2005), 734–749.
  2. Learning heterogeneous knowledge base embeddings for explainable recommendation. Algorithms 11, 9 (2018), 137.
  3. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In International conference on machine learning. PMLR, 115–123.
  4. A collaborative filtering approach to mitigate the new user cold start problem. Knowledge-based systems 26 (2012), 225–238.
  5. A new collaborative filtering metric that improves the behavior of recommender systems. Knowledge-Based Systems 23, 6 (2010), 520–528.
  6. Robin Burke. 2002. Hybrid recommender systems: Survey and experiments. User modeling and user-adapted interaction 12 (2002), 331–370.
  7. 2nd Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec 2011). In Proceedings of the 5th ACM conference on Recommender systems (Chicago, IL, USA) (RecSys 2011). ACM, New York, NY, USA. https://grouplens.org/datasets/hetrec-2011/
  8. Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences. In The world wide web conference. 151–161.
  9. NEWER: A system for NEuro-fuzzy WEb Recommendation. Applied Soft Computing 11, 1 (2011), 793–806.
  10. An effective recommendation method for cold start new users using trust and distrust networks. Information Sciences 224 (2013), 19–36.
  11. Mukund Deshpande and George Karypis. 2004. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems (TOIS) 22, 1 (2004), 143–177.
  12. Lisa Ehrlinger and Wolfram Wöß. 2016. Towards a definition of knowledge graphs. SEMANTiCS (Posters, Demos, SuCCESS) 48, 1-4 (2016), 2.
  13. Stunning Doodle: a Tool for Joint Visualization and Analysis of Knowledge Graphs and Graph Embeddings. In European Semantic Web Conference. Springer, 370–386.
  14. Deep learning on knowledge graph for recommender system: A survey. arXiv preprint arXiv:2004.00387 (2020).
  15. A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3549–3568.
  16. F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. https://grouplens.org/datasets/movielens/. Acm transactions on interactive intelligent systems (tiis) 5, 4 (2015), 1–19.
  17. Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 1531–1540.
  18. Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS) 20, 4 (2002), 422–446.
  19. A review of content-based and context-based recommendation systems. International Journal of Emerging Technologies in Learning (iJET) 16, 3 (2021), 274–306.
  20. Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 426–434.
  21. Gromov-wasserstein guided representation learning for cross-domain recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 1199–1208.
  22. Huizhi Liang and Thanet Markchom. 2022. TNE: A general time-aware network representation learning framework for temporal applications. Knowledge-Based Systems 240 (2022), 108050.
  23. Trends in content-based recommendation: Preface to the special issue on Recommender systems based on rich item descriptions. User Modeling and User-Adapted Interaction 29 (2019), 239–249.
  24. Jointly learning explainable rules for recommendation with knowledge graph. In The world wide web conference. 1210–1221.
  25. A novel deep multi-criteria collaborative filtering model for recommendation system. Knowledge-Based Systems 187 (2020), 104811.
  26. Justifying recommendations using distantly-labeled reviews and fine-grained aspects. https://cseweb.ucsd.edu/~jmcauley/datasets/amazon_v2/. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). 188–197.
  27. Predictors of user perceptions of web recommender systems: How the basis for generating experience and search product recommendations affects user responses. International Journal of Human-Computer Studies 68, 8 (2010), 472–482.
  28. Rgrecsys: A toolkit for robustness evaluation of recommender systems. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1597–1600.
  29. Thamizhiniyan Pugazhenthi and Huizhi Liang. 2022. Improving Conversational Recommender Systems via Knowledge Graph-based Semantic Fusion with Historical Interaction Data. In 2022 IEEE International Conference on Big Data (Big Data). IEEE, 4303–4312.
  30. BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012).
  31. Explaining link prediction systems based on knowledge graph embeddings. In Proceedings of the 2022 International Conference on Management of Data. 2062–2075.
  32. Deepjyoti Roy and Mala Dutta. 2022. A systematic review and research perspective on recommender systems. Journal of Big Data 9, 1 (2022), 59.
  33. Xiaoyuan Su and Taghi M Khoshgoftaar. 2009. A survey of collaborative filtering techniques. Advances in artificial intelligence 2009 (2009).
  34. Ellen M Voorhees et al. 1999. The trec-8 question answering track report.. In Trec, Vol. 99. 77–82.
  35. Setrank: A setwise bayesian approach for collaborative ranking from implicit feedback. In Proceedings of the aaai conference on artificial intelligence, Vol. 34. 6127–6136.
  36. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM international conference on information and knowledge management. 417–426.
  37. Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 968–977.
  38. Knowledge graph convolutional networks for recommender systems. In The world wide web conference. 3307–3313.
  39. Kgat: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 950–958.
  40. Learning intents behind interactions with knowledge graph for recommendation. In Proceedings of the web conference 2021. 878–887.
  41. Learning intents behind interactions with knowledge graph for recommendation. In Proceedings of the Web Conference 2021. 878–887.
  42. Poisoning attacks against knowledge graph-based recommendation systems using deep reinforcement learning. Neural Computing and Applications (2022), 1–19.
  43. Recent Advances in RecBole: Extensions with more Practical Considerations.
  44. Knowledge graph contrastive learning for recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1434–1443.
  45. Recommendation in heterogeneous information networks with implicit user feedback. In Proceedings of the 7th ACM conference on Recommender systems. 347–350.
  46. Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 353–362.
  47. Data poisoning attack against knowledge graph embedding. arXiv preprint arXiv:1904.12052 (2019).
  48. Alleviating new user cold-start in user-based collaborative filtering via bipartite network. IEEE Transactions on Computational Social Systems 7, 3 (2020), 672–685.
  49. KB4Rec: A Data Set for Linking Knowledge Bases with Recommender Systems. Data Intelligence 1, 2 (2019), 121–136. https://doi.org/10.1162/dint_a_00008
  50. RecBole 2.0: Towards a More Up-to-Date Recommendation Library. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 4722–4726.
  51. RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms. In CIKM. ACM, 4653–4664.
  52. Cai-Nicolas Ziegler. 2004. Book-Crossing Dataset. http://www2.informatik.uni-freiburg.de/~cziegler/BX/
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Haonan Zhang (51 papers)
  2. Dongxia Wang (18 papers)
  3. Zhu Sun (32 papers)
  4. Yanhui Li (12 papers)
  5. Youcheng Sun (40 papers)
  6. Huizhi Liang (14 papers)
  7. Wenhai Wang (123 papers)