Adaptive spectral graph wavelets for collaborative filtering (2312.03167v1)
Abstract: Collaborative filtering is a popular approach in recommender systems, whose objective is to provide personalized item suggestions to potential users based on their purchase or browsing history. However, personalized recommendations require considerable amount of behavioral data on users, which is usually unavailable for new users, giving rise to the cold-start problem. To help alleviate this challenging problem, we introduce a spectral graph wavelet collaborative filtering framework for implicit feedback data, where users, items and their interactions are represented as a bipartite graph. Specifically, we first propose an adaptive transfer function by leveraging a power transform with the goal of stabilizing the variance of graph frequencies in the spectral domain. Then, we design a deep recommendation model for efficient learning of low-dimensional embeddings of users and items using spectral graph wavelets in an end-to-end fashion. In addition to capturing the graph's local and global structures, our approach yields localization of graph signals in both spatial and spectral domains, and hence not only learns discriminative representations of users and items, but also promotes the recommendation quality. The effectiveness of our proposed model is demonstrated through extensive experiments on real-world benchmark datasets, achieving better recommendation performance compared with strong baseline methods.
- S. Boutemedjet and D. Ziou, “A graphical model for context-aware visual content recommendation,” IEEE Transactions on Multimedia, vol. 10, no. 1, pp. 52–62, 2008.
- J. Konstan, B. Miller, D. Maltz, J. Herlocker, L. Gordon, and J. Riedl, “Grouplens: Applying collaborative filtering to usenet news,” Communications of the ACM, vol. 40, no. 3, pp. 77–87, 1997.
- Y. Hu, Y. Koren, and C. Volinsky, “Collaborative filtering for implicit feedback datasets,” in Proc. IEEE International Conference on Data Mining, pp. 263–272, 2008.
- Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” IEEE Computer, vol. 42, no. 8, pp. 30–37, 2009.
- S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme, “BPR: Bayesian personalized ranking from implicit feedback,” in Proc. Conference on Uncertainty in Artificial Intelligence, pp. 452–461, 2009.
- Y. Koren, “Factorization meets the neighborhood: a multifaceted collaborative filtering model,” in Proc. ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 426–434, 2020.
- Y. Koren, “Factor in the neighbors: Scalable and accurate collaborative filtering,” ACM Transactions on Knowledge Discovery from Data, vol. 4, no. 1, 2010.
- X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua, “Neural collaborative filtering,” in Proc. International Conference on World Wide Web, pp. 173–182, 2017.
- L. Zheng, C.-T. Lu, F. Jiang, J. Zhang, and P. S. Yu, “Spectral collaborative filtering,” in Proc. ACM Conference on Recommender Systems, 2018.
- X. Wang, X. He, M. Wang, F. Feng, and T.-S. Chua, “Neural graph collaborative filtering,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 165–174, 2019.
- D. Liang, R. G. Krishnan, M. D. Hoffman, and T. Jebara, “Variational autoencoders for collaborative filtering,” in Proc. International Conference on World Wide Web, pp. 689–698, 2018.
- X. Wang, H. Jin, A. Zhang, X. He, T. Xu, and T.-S. Chua, “Disentangled graph collaborative filtering,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1001–1010, 2020.
- J. Chang, C. Gao, X. He, Y. Li, and D. Jin, “Bundle recommendation with graph convolutional networks,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1673–1676, 2020.
- Z. Li, Q. Xu, Y. Jiang, K. Ma, X. Cao, and Q. Huang, “Neural collaborative preference learning with pairwise comparisons,” IEEE Transactions on Multimedia, pp. 1–13, 2020.
- J. Jin, J. Qin, Y. Fang, K. Du, W. Zhang, Y. Yu, Z. Zhang, and A. J. Smola, “An efficient neighborhood-based interaction model for recommendation on heterogeneous graph,” in Proc. ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 75–84, 2020.
- L. Chen, L. Wu, R. Hong, K. Zhang, and M. Wang, “Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach,” in AAAI Conference on Artificial Intelligence, pp. 27–34, 2020.
- Z. Li, Q. Xu, Y. Jiang, K. Ma, X. Cao, and Q. Huang, “Neural collaborative preference learning with pairwise comparisons,” IEEE Transactions on Multimedia, 2020.
- S. Sedhain, A. K. Menon, S. Sanner, and L. Xie, “AutoRec: Autoencoders meet collaborative filtering,” in Proc. International Conference on World Wide Web, pp. 111–112, 2015.
- H. Wang, N. Wang, and D.-Y. Yeung, “Collaborative deep learning for recommender systems,” in Proc. ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1235–1244, 2015.
- B. Hui, L. Zhang, X. Zhou, X. Wen, and Y. Nian, “Personalized recommendation system based on knowledge embedding and historical behavior,” Applied Intelligence, vol. 52, pp. 954–966, 2022.
- T. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in International Conference on Learning Representations, pp. 1–14, 2017.
- H. Zhang and J. McAuley, “Stacked mixed-order graph convolutional networks for collaborative filtering,” in Proc. SIAM International Conference on Data Mining, pp. 73–81, 2020.
- X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, “LightGCN: Simplifying and powering graph convolution network for recommendationg,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639–648, 2020.
- J. Yu, H. Yin, X. Xia, T. Chen, L. Cui, and Q. V. H. Nguyen, “Are graph augmentations necessary? simple graph contrastive learning for recommendation,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1294–1303, 2022.
- L. Xia, C. Huang, Y. Xu, J. Zhao, D. Yin, and J. Huang, “Hypergraph contrastive collaborative filtering,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 70–79, 2022.
- Z. Liu, L. Meng, F. Jiang, J. Zhang, and P. S. Yu, “Deoscillated adaptive graph collaborative filtering,” in Proceedings of Machine Learning Research, pp. 248–257, 2022.
- Y. Song, H. Ye, M. Li, and F. Cao, “Deep multi-graph neural networks with attention fusion for recommendation,” Expert Systems with Applications, vol. 191, pp. 954–966, 2022.
- S. Qian, D. Xue, H. Zhang, Q. Fang, and C. Xu, “Dual adversarial graph neural networks for multi-label cross-modal retrieval,” in Proc. AAAI Conference on Artificial Intelligence, pp. 2440–2448, 2021.
- S. Qian, D. Xue, Q. Fang, and C. Xu, “Deep multi-graph neural networks with attention fusion for recommendation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, pp. 4794–4811, 2023.
- W. Fan, Y. Ma, Q. Li, Y. He, E. Zhao, J. Tang, and D. Yin, “Graph neural networks for social recommendatiog,” in Proc. International Conference on World Wide Web, pp. 417–426, 2019.
- J. Wu, X. Wang, F. Feng, X. He, L. Chen, J. Lian, and X. Xie, “Hypergraph contrastive collaborative filtering,” in Proc. International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 726–735, 2021.
- M. Defferrard, X. Bresson, and P. Vandergheynst, “Convolutional neural networks on graphs with fast localized spectral filtering,” in Advances in Neural Information Processing, pp. 3844–3852, 2016.
- F. Wu, A. H. Souza, T. Zhang, C. Fifty, T. Yu, and K. Q. Weinberger, “Simplifying graph convolutional networks,” in Proc. International Conference on Machine Learning, pp. 6861–6871, 2019.
- C. Godsil and G. Royle, Algebraic Graph Theory. Springer-Verlag New York, 2001.
- H. Krim and A. Ben Hamza, Geometric Methods in Signal and Image Analysis. Cambridge University Press, 2015.
- D. Hammond, P. Vandergheynst, and R. Gribonval, “Wavelets on graphs via spectral graph theory,” Applied and Computational Harmonic Analysis, vol. 30, no. 2, pp. 129–150, 2011.
- C. Li and A. Ben Hamza, “A multiresolution descriptor for deformable 3D shape retrieval,” The Visual Computer, vol. 29, pp. 513–524, 2013.
- C. Donnat, M. Zitnik, D. Hallac, and J. Leskovec, “Learning structural node embeddings via diffusion wavelets,” in Proc. ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1320–1329, 2018.
- B. Xu, H. Shen, Q. Cao, Y. Qiu, and X. Cheng, “Graph wavelet neural network,” in International Conference on Learning Representations, 2019.
- I. Yeo and R. Johnson, “A new family of power transformations to improve normality or symmetry,” Biometrika, vol. 87, pp. 954–959, 2000.
- F. Harper and J. Konstan, “The MovieLens datasets: History and context,” ACM Transactions on Interactive Intelligent Systems, vol. 5, no. 4, pp. 1–19, 2015.
- J. Ni, J. Li, and J. McAuley, “Justifying recommendations using distantly-labeled reviews and fined-grained aspects,” in Proc. EMNLP-IJCNLP, pp. 188–197, 2019.
- K. Järvelin and J. Kekäläinen, “Cumulated gain-based evaluation of IR techniques,” ACM Transactions on Information Systems, vol. 20, no. 4, pp. 422–446, 2002.
- F. Xue, X. He, X. Wang, J. Xu, K. Liu, and R. Hong, “Deep item-based collaborative filtering for top-n recommendation,” ACM Transactions on Information Systems, vol. 37, no. 3, pp. 1–25, 2019.
- X. He, X. Du, X. Wang, F. Tian, J. Tang, and T.-S. Chua, “Outer product-based neural collaborative filtering,” in Proc. International Joint Conference on Artificial Intelligence, pp. 2227–2233, 2018.
- D.-K. Chae, J.-S. Kang, S.-W. Kim, and J.-T. Lee, “CFGAN: A generic collaborative filtering framework based on generative adversarial networks,” in Proc. ACM international Conference on Information and Knowledge Management, pp. 137–146, 2018.
- R. v. d. Berg, T. N. Kipf, and M. Welling, “Graph convolutional matrix completion,” in Proc. ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2018.