Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Graph Signal Diffusion Model for Collaborative Filtering (2311.08744v3)

Published 15 Nov 2023 in cs.IR and cs.LG

Abstract: Collaborative filtering is a critical technique in recommender systems. It has been increasingly viewed as a conditional generative task for user feedback data, where newly developed diffusion model shows great potential. However, existing studies on diffusion model lack effective solutions for modeling implicit feedback. Particularly, the standard isotropic diffusion process overlooks correlation between items, misaligned with the graphical structure of the interaction space. Meanwhile, Gaussian noise destroys personalized information in a user's interaction vector, causing difficulty in its reconstruction. In this paper, we adapt standard diffusion model and propose a novel Graph Signal Diffusion Model for Collaborative Filtering (named GiffCF). To better represent the correlated distribution of user-item interactions, we define a generalized diffusion process using heat equation on the item-item similarity graph. Our forward process smooths interaction signals with an advanced family of graph filters, introducing the graph adjacency as beneficial prior knowledge for recommendation. Our reverse process iteratively refines and sharpens latent signals in a noise-free manner, where the updates are conditioned on the user's history and computed from a carefully designed two-stage denoiser, leading to high-quality reconstruction. Finally, through extensive experiments, we show that GiffCF effectively leverages the advantages of both diffusion model and graph signal processing, and achieves state-of-the-art performance on three benchmark datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Structured Denoising Diffusion Models in Discrete State-Spaces. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 17981–17993.
  2. James Baglama and Lothar Reichel. 2005. Augmented Implicitly Restarted Lanczos Bidiagonalization Methods. SIAM Journal on Scientific Computing 27, 1 (Jan. 2005), 19–42. https://doi.org/10.1137/04060593X
  3. Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise. Advances in Neural Information Processing Systems 36 (Dec. 2023), 41259–41282.
  4. CFGAN: A Generic Collaborative Filtering Framework Based on Generative Adversarial Networks. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM ’18). Association for Computing Machinery, New York, NY, USA, 137–146. https://doi.org/10.1145/3269206.3271743
  5. Blurring-Sharpening Process Models for Collaborative Filtering. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’23). Association for Computing Machinery, New York, NY, USA, 1096–1106. https://doi.org/10.1145/3539618.3591645
  6. Fan R. K. Chung. [n. d.]. Spectral Graph Theory. American Mathematical Soc.
  7. Soft Diffusion: Score Matching for General Corruptions. https://doi.org/10.48550/arXiv.2209.05442 arXiv:2209.05442 [cs]
  8. Sequential Recommendation with Diffusion Models. https://doi.org/10.48550/arXiv.2304.04541 arXiv:2304.04541 [cs]
  9. Graph Trend Filtering Networks for Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’22). Association for Computing Machinery, New York, NY, USA, 112–121. https://doi.org/10.1145/3477495.3531985
  10. Revisiting Neighborhood-based Link Prediction for Collaborative Filtering. In Companion Proceedings of the Web Conference 2022 (WWW ’22). Association for Computing Machinery, New York, NY, USA, 1009–1018. https://doi.org/10.1145/3487553.3524712
  11. TriRank: Review-aware Explainable Recommendation by Modeling Aspects. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM ’15). Association for Computing Machinery, New York, NY, USA, 1661–1670. https://doi.org/10.1145/2806416.2806504
  12. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’20). Association for Computing Machinery, New York, NY, USA, 639–648. https://doi.org/10.1145/3397271.3401063
  13. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web (WWW ’17). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 173–182. https://doi.org/10.1145/3038912.3052569
  14. Denoising Diffusion Probabilistic Models. In Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc., 6840–6851.
  15. Emiel Hoogeboom and Tim Salimans. 2022. Blurring Diffusion Models. In The Eleventh International Conference on Learning Representations.
  16. Collaborative Filtering for Implicit Feedback Datasets. In 2008 Eighth IEEE International Conference on Data Mining. 263–272. https://doi.org/10.1109/ICDM.2008.22
  17. Variational Diffusion Models. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 21696–21707.
  18. Diederik P. Kingma and Jimmy Ba. 2017. Adam: A Method for Stochastic Optimization. https://doi.org/10.48550/arXiv.1412.6980 arXiv:1412.6980 [cs]
  19. Matrix Factorization Techniques for Recommender Systems. Computer 42, 8 (Aug. 2009), 30–37. https://doi.org/10.1109/MC.2009.263
  20. DiffuRec: A Diffusion Model for Sequential Recommendation. ACM Transactions on Information Systems 42, 3 (Dec. 2023), 66:1–66:28. https://doi.org/10.1145/3631116
  21. Variational Autoencoders for Collaborative Filtering. In Proceedings of the 2018 World Wide Web Conference (WWW ’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 689–698. https://doi.org/10.1145/3178876.3186150
  22. Discrete Conditional Diffusion for Reranking in Recommendation. https://doi.org/10.48550/arXiv.2308.06982 arXiv:2308.06982 [cs]
  23. Diffusion Augmentation for Sequential Recommendation. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23). Association for Computing Machinery, New York, NY, USA, 1576–1586. https://doi.org/10.1145/3583780.3615134
  24. Conditional Diffusion Probabilistic Model for Speech Enhancement. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 7402–7406. https://doi.org/10.1109/ICASSP43922.2022.9746901
  25. Learning Disentangled Representations for Recommendation. In Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, Inc.
  26. Cameron Musco and Christopher Musco. 2015. Randomized Block Krylov Methods for Stronger and Faster Approximate Singular Value Decomposition. In Advances in Neural Information Processing Systems, Vol. 28. Curran Associates, Inc.
  27. M. E. J. Newman. 2001. Clustering and Preferential Attachment in Growing Networks. Physical Review E 64, 2 (July 2001), 025102. https://doi.org/10.1103/PhysRevE.64.025102
  28. BPR: Bayesian Personalized Ranking from Implicit Feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI ’09). AUAI Press, Arlington, Virginia, USA, 452–461.
  29. Generative Modelling with Inverse Heat Dissipation. In The Eleventh International Conference on Learning Representations.
  30. High-Resolution Image Synthesis With Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10684–10695.
  31. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, Nassir Navab, Joachim Hornegger, William M. Wells, and Alejandro F. Frangi (Eds.). Springer International Publishing, Cham, 234–241. https://doi.org/10.1007/978-3-319-24574-4_28
  32. A Survey on Oversmoothing in Graph Neural Networks. https://doi.org/10.48550/arXiv.2303.10993 arXiv:2303.10993 [cs]
  33. How Powerful Is Graph Convolution for Recommendation?. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM ’21). Association for Computing Machinery, New York, NY, USA, 1619–1629. https://doi.org/10.1145/3459637.3482264
  34. Deep Unsupervised Learning Using Nonequilibrium Thermodynamics. In Proceedings of the 32nd International Conference on Machine Learning. PMLR, 2256–2265.
  35. Denoising Diffusion Implicit Models. In International Conference on Learning Representations.
  36. CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 24804–24816.
  37. Recommendation via Collaborative Diffusion Generative Model. In Knowledge Science, Engineering and Management, Gerard Memmi, Baijian Yang, Linghe Kong, Tianwei Zhang, and Meikang Qiu (Eds.). Springer International Publishing, Cham, 593–605. https://doi.org/10.1007/978-3-031-10989-8_47
  38. Variable Interval Time Sequence Modeling for Career Trajectory Prediction: Deep Collaborative Perspective. In Proceedings of the Web Conference 2021 (WWW ’21). Association for Computing Machinery, New York, NY, USA, 612–623. https://doi.org/10.1145/3442381.3449959
  39. Personalized and Explainable Employee Training Course Recommendations: A Bayesian Variational Approach. ACM Transactions on Information Systems 40, 4 (Dec. 2021), 70:1–70:32. https://doi.org/10.1145/3490476
  40. SetRank: A Setwise Bayesian Approach for Collaborative Ranking in Recommender System. ACM Transactions on Information Systems 42, 2 (Nov. 2023), 56:1–56:32. https://doi.org/10.1145/3626194
  41. GraphGAN: Graph Representation Learning With Generative Adversarial Nets. Proceedings of the AAAI Conference on Artificial Intelligence 32, 1 (April 2018). https://doi.org/10.1609/aaai.v32i1.11872
  42. IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’17). Association for Computing Machinery, New York, NY, USA, 515–524. https://doi.org/10.1145/3077136.3080786
  43. Diffusion Recommender Model. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’23). Association for Computing Machinery, New York, NY, USA, 832–841. https://doi.org/10.1145/3539618.3591663
  44. Neural Graph Collaborative Filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). Association for Computing Machinery, New York, NY, USA, 165–174. https://doi.org/10.1145/3331184.3331267
  45. Conditional Denoising Diffusion for Sequential Recommendation. https://doi.org/10.48550/arXiv.2304.11433 arXiv:2304.11433 [cs]
  46. Collaborative Denoising Auto-Encoders for Top-N Recommender Systems. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM ’16). Association for Computing Machinery, New York, NY, USA, 153–162. https://doi.org/10.1145/2835776.2835837
  47. Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion. In Thirty-Seventh Conference on Neural Information Processing Systems.
Citations (4)

Summary

We haven't generated a summary for this paper yet.