Papers
Topics
Authors
Recent
Search
2000 character limit reached

Neural Causal Graph Collaborative Filtering

Published 10 Jul 2023 in cs.IR | (2307.04384v2)

Abstract: Graph collaborative filtering (GCF) has gained considerable attention in recommendation systems by leveraging graph learning techniques to enhance collaborative filtering (CF). One classical approach in GCF is to learn user and item embeddings with Graph Convolutional Network (GCN) and utilize these embeddings for CF models. However, existing GCN-based methods are insufficient in generating satisfactory embeddings for CF models. This is because they fail to model complex node dependencies and variable relation dependencies from a given graph, making the learned embeddings fragile to uncover the root causes of user interests. In this work, we propose to integrate causal modeling with the learning process of GCN-based GCF models, leveraging causality-aware graph embeddings to capture complex causal relations in recommendations. We complete the task by 1) Causal Graph conceptualization, 2) Neural Causal Model parameterization and 3) Variational inference for Neural Causal Model. Our Neural Causal Model, called Neural Causal Graph Collaborative Filtering (NCGCF), enables causal modeling for GCN-based GCF to facilitate accurate recommendations. Extensive experiments show that NCGCF provides precise recommendations that align with user preferences. We release our code and processed datasets at https://github.com/Chrystalii/CNGCF.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. J. B. Schafer, D. Frankowski, J. Herlocker, and S. Sen, “Collaborative filtering recommender systems,” in The adaptive web.   Springer, 2007, pp. 291–324.
  2. F. Xia, K. Sun, S. Yu, A. Aziz, L. Wan, S. Pan, and H. Liu, “Graph learning: A survey,” IEEE Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 109–127, 2021.
  3. S. Wang, L. Hu, Y. Wang, X. He, Q. Z. Sheng, M. A. Orgun, L. Cao, F. Ricci, and P. S. Yu, “Graph learning based recommender systems: A review,” arXiv preprint arXiv:2105.06339, 2021.
  4. S. Chen and Y. Peng, “Matrix factorization for recommendation with explicit and implicit feedback,” Knowledge-Based Systems, vol. 158, pp. 109–117, 2018.
  5. X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua, “Neural collaborative filtering,” in Proceedings of the 26th international conference on world wide web, 2017, pp. 173–182.
  6. W. L. Hamilton, “Graph representation learning,” Synthesis Lectures on Artifical Intelligence and Machine Learning, vol. 14, no. 3, pp. 1–159, 2020.
  7. X. Wang, X. He, M. Wang, F. Feng, and T.-S. Chua, “Neural graph collaborative filtering,” in Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval, 2019, pp. 165–174.
  8. J. Sun, Z. Cheng, S. Zuberi, F. Pérez, and M. Volkovs, “Hgcf: Hyperbolic graph convolution networks for collaborative filtering,” in Proceedings of the Web Conference 2021, 2021, pp. 593–601.
  9. R. v. d. Berg, T. N. Kipf, and M. Welling, “Graph convolutional matrix completion,” arXiv preprint arXiv:1706.02263, 2017.
  10. X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, “Lightgcn: Simplifying and powering graph convolution network for recommendation,” in Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020, pp. 639–648.
  11. Y. Yan, M. Hashemi, K. Swersky, Y. Yang, and D. Koutra, “Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks,” in 2022 IEEE International Conference on Data Mining (ICDM).   IEEE, 2022, pp. 1287–1292.
  12. X. Wang, Q. Li, D. Yu, and G. Xu, “Off-policy learning over heterogeneous information for recommendation,” ser. WWW ’22.   New York, NY, USA: Association for Computing Machinery, 2022, p. 2348–2359. [Online]. Available: https://doi.org/10.1145/3485447.3512072
  13. S. Xu, Y. Ge, Y. Li, Z. Fu, X. Chen, and Y. Zhang, “Causal collaborative filtering,” in Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, 2023, pp. 235–245.
  14. Y. Zheng, C. Gao, X. Li, X. He, Y. Li, and D. Jin, “Disentangling user interest and conformity for recommendation with causal embedding,” in Proceedings of the Web Conference 2021, 2021, pp. 2980–2991.
  15. X. Wang, Q. Li, D. Yu, P. Cui, Z. Wang, and G. Xu, “Causal disentanglement for semantics-aware intent learning in recommendation,” IEEE Transactions on Knowledge and Data Engineering, 2022.
  16. E. Bareinboim, J. D. Correa, D. Ibeling, and T. Icard, “On pearl’s hierarchy and the foundations of causal inference,” in Probabilistic and Causal Inference: The Works of Judea Pearl, 2022, pp. 507–556.
  17. K. Xia, K.-Z. Lee, Y. Bengio, and E. Bareinboim, “The causal-neural connection: Expressiveness, learnability, and inference,” Advances in Neural Information Processing Systems, vol. 34, pp. 10 823–10 836, 2021.
  18. J. Pearl et al., “Models, reasoning and inference,” Cambridge, UK: CambridgeUniversityPress, vol. 19, no. 2, 2000.
  19. A. Mnih and R. R. Salakhutdinov, “Probabilistic matrix factorization,” Advances in neural information processing systems, vol. 20, 2007.
  20. D. Agarwal and B.-C. Chen, “Regression-based latent factor models,” in Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, 2009, pp. 19–28.
  21. Y. Wang, D. Liang, L. Charlin, and D. M. Blei, “The deconfounded recommender: A causal inference approach to recommendation,” arXiv preprint arXiv:1808.06581, 2018.
  22. S. Bhadani, “Biases in recommendation system,” in Proceedings of the 15th ACM Conference on Recommender Systems, 2021, pp. 855–859.
  23. X. Wang, H. Jin, A. Zhang, X. He, T. Xu, and T.-S. Chua, “Disentangled graph collaborative filtering,” in Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, 2020, pp. 1001–1010.
  24. Q. Li, X. Wang, Z. Wang, and G. Xu, “Be causal: De-biasing social network confounding in recommendation,” ACM Transactions on Knowledge Discovery from Data (TKDD), 2022.
  25. T. N. Kipf and M. Welling, “Variational graph auto-encoders,” arXiv preprint arXiv:1611.07308, 2016.
  26. M. Yin and M. Zhou, “Semi-implicit variational inference,” in International Conference on Machine Learning.   PMLR, 2018, pp. 5660–5669.
  27. A. Hasanzadeh, E. Hajiramezanali, K. Narayanan, N. Duffield, M. Zhou, and X. Qian, “Semi-implicit graph variational auto-encoders,” Advances in neural information processing systems, vol. 32, 2019.
  28. C. Zhang, J. Bütepage, H. Kjellström, and S. Mandt, “Advances in variational inference,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 8, pp. 2008–2026, 2019.
  29. B. Altaf, U. Akujuobi, L. Yu, and X. Zhang, “Dataset recommendation via variational graph autoencoder,” in 2019 IEEE International Conference on Data Mining (ICDM).   IEEE, 2019, pp. 11–20.
  30. K. Xu, C. Li, Y. Tian, T. Sonobe, K.-i. Kawarabayashi, and S. Jegelka, “Representation learning on graphs with jumping knowledge networks,” in International Conference on Machine Learning.   PMLR, 2018, pp. 5453–5462.
  31. Y. Koren, “Factorization meets the neighborhood: a multifaceted collaborative filtering model,” in Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, 2008, pp. 426–434.
  32. Y. Koren, S. Rendle, and R. Bell, “Advances in collaborative filtering,” Recommender systems handbook, pp. 91–142, 2022.
  33. X. Wang, Q. Li, D. Yu, Z. Wang, H. Chen, and G. Xu, “Mgpolicy: Meta graph enhanced off-policy learning for recommendations,” in Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022, pp. 1369–1378.
  34. K. Xiong, W. Ye, X. Chen, Y. Zhang, W. X. Zhao, B. Hu, Z. Zhang, and J. Zhou, “Counterfactual review-based recommendation,” in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 2231–2240.
  35. C. Zhang, K. Zhang, and Y. Li, “A causal view on robustness of neural networks,” Advances in Neural Information Processing Systems, vol. 33, pp. 289–301, 2020.
  36. D. Liang, R. G. Krishnan, M. D. Hoffman, and T. Jebara, “Variational autoencoders for collaborative filtering,” in Proceedings of the 2018 world wide web conference, 2018, pp. 689–698.
  37. D. A. Van Dyk and X.-L. Meng, “The art of data augmentation,” Journal of Computational and Graphical Statistics, vol. 10, no. 1, pp. 1–50, 2001.
  38. O. Barkan and N. Koenigstein, “Item2vec: neural item embedding for collaborative filtering,” in 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).   IEEE, 2016, pp. 1–6.
  39. R. He and J. McAuley, “Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering,” in proceedings of the 25th international conference on world wide web, 2016, pp. 507–517.
  40. T. U. Haque, N. N. Saber, and F. M. Shah, “Sentiment analysis on large scale amazon product reviews,” in 2018 IEEE international conference on innovative research and development (ICIRD).   IEEE, 2018, pp. 1–6.
  41. J. Tang, H. Gao, and H. Liu, “mTrust: Discerning multi-faceted trust in a connected world,” in Proceedings of the fifth ACM international conference on Web search and data mining.   ACM, 2012, pp. 93–102.
  42. S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme, “Bpr: Bayesian personalized ranking from implicit feedback,” arXiv preprint arXiv:1205.2618, 2012.
  43. J. Zhang, X. Chen, and W. X. Zhao, “Causally attentive collaborative filtering,” in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 3622–3626.
  44. T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” arXiv preprint arXiv:1609.02907, 2016.
  45. W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” Advances in neural information processing systems, vol. 30, 2017.
  46. R. Ying, R. He, K. Chen, P. Eksombatchai, W. L. Hamilton, and J. Leskovec, “Graph convolutional neural networks for web-scale recommender systems,” in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 2018, pp. 974–983.
  47. L. Xia, C. Huang, Y. Xu, J. Zhao, D. Yin, and J. Huang, “Hypergraph contrastive collaborative filtering,” in Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval, 2022, pp. 70–79.
  48. D. Lee, S. Kang, H. Ju, C. Park, and H. Yu, “Bootstrapping user and item representations for one-class collaborative filtering,” in Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021, pp. 317–326.
  49. Y. Zhang, F. Feng, X. He, T. Wei, C. Song, G. Ling, and Y. Zhang, “Causal intervention for leveraging popularity bias in recommendation,” arXiv preprint arXiv:2105.06067, 2021.
  50. W. Wang, X. Lin, F. Feng, X. He, M. Lin, and T.-S. Chua, “Causal representation learning for out-of-distribution recommendation,” in Proceedings of the ACM Web Conference 2022, 2022, pp. 3562–3571.
Citations (2)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up