Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

SimpleX: A Simple and Strong Baseline for Collaborative Filtering (2109.12613v3)

Published 26 Sep 2021 in cs.IR and cs.AI

Abstract: Collaborative filtering (CF) is a widely studied research topic in recommender systems. The learning of a CF model generally depends on three major components, namely interaction encoder, loss function, and negative sampling. While many existing studies focus on the design of more powerful interaction encoders, the impacts of loss functions and negative sampling ratios have not yet been well explored. In this work, we show that the choice of loss function as well as negative sampling ratio is equivalently important. More specifically, we propose the cosine contrastive loss (CCL) and further incorporate it to a simple unified CF model, dubbed SimpleX. Extensive experiments have been conducted on 11 benchmark datasets and compared with 29 existing CF models in total. Surprisingly, the results show that, under our CCL loss and a large negative sampling ratio, SimpleX can surpass most sophisticated state-of-the-art models by a large margin (e.g., max 48.5% improvement in NDCG@20 over LightGCN). We believe that SimpleX could not only serve as a simple strong baseline to foster future research on CF, but also shed light on the potential research direction towards improving loss function and negative sampling. Our source code will be available at https://reczoo.github.io/SimpleX.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Graph Convolutional Matrix Completion. In KDD’18 Deep Learning Day.
  2. Efficient Neural Matrix Factorization without Sampling for Recommendation. ACM Transactions on Information Systems (TOIS) 38, 2 (2020), 1–28.
  3. Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 335–344.
  4. Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI). 27–34.
  5. Deep Neural Networks for YouTube Recommendations. In Proceedings of the 10th ACM conference on Recommender Systems (RecSys). 191–198.
  6. Reinforced Negative Sampling for Recommendation with Exposure Data. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI). 2230–2236.
  7. Collaborative Memory Network for Recommendation Systems. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR). 515–524.
  8. Dimensionality Reduction by Learning an Invariant Mapping. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). 1735–1742.
  9. Inductive Representation Learning on Large Graphs. In Advances in Neural Information Processing Systems (NeurIPS). 1024–1034.
  10. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval (SIGIR). 639–648.
  11. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web (WWW). 173–182.
  12. Collaborative Metric Learning. In Proceedings of the 26th International Conference on World Wide Web (WWW). 193–201.
  13. Collaborative Filtering for Implicit Feedback Datasets. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM). 263–272.
  14. Dual Channel Hypergraph Collaborative Filtering. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD). 2020–2029.
  15. Matrix Factorization Techniques for Recommender Systems. Computer 42, 8 (2009), 30–37.
  16. Variational Autoencoders for Collaborative Filtering. In Proceedings of the 2018 World Wide Web Conference (WWW). 689–698.
  17. Disentangled Graph Convolutional Networks. In International Conference on Machine Learning (ICML). 4212–4221.
  18. Learning Disentangled Representations for Recommendation. In Advances in Neural Information Processing Systems (NeurIPS). 5711–5722.
  19. A Deep Recurrent Collaborative Filtering Framework for Venue Recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM). 1429–1438.
  20. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems (NeurIPS). 3111–3119.
  21. Xia Ning and George Karypis. 2011. SLIM: Sparse Linear Methods for Top-N Recommender Systems. In IEEE 11th International Conference on Data Mining (ICDM). 497–506.
  22. BPR: Bayesian Personalized Ranking from Implicit Feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI). 452–461.
  23. RecVAE: A New Variational Autoencoder for Top-N Recommendations with Implicit Feedback. In The Thirteenth ACM International Conference on Web Search and Data Mining (WSDM). 528–536.
  24. Brent Smith and Greg Linden. 2017. Two Decades of Recommender Systems at Amazon.com. IEEE Internet Comput. 21, 3 (2017), 12–18.
  25. NGAT4Rec: Neighbor-Aware Graph Attention Network For Recommendation. arXiv preprint arXiv:2010.12256 (2020).
  26. Harald Steck. 2019. Embarrassingly Shallow Autoencoders for Sparse Data. In The World Wide Web Conference (WWW). 3251–3257.
  27. Xiaoyuan Su and Taghi M. Khoshgoftaar. 2009. A Survey of Collaborative Filtering Techniques. Adv. Artif. Intell. 2009 (2009), 421425:1–421425:19.
  28. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM). 1441–1450.
  29. A Framework for Recommending Accurate and Diverse Items Using Bayesian Graph Convolutional Neural Networks. In Proceedings of ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD). 2030–2039.
  30. Neighbor Interaction Aware Graph Convolution Networks for Recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1289–1298.
  31. Graph Attention Networks. In International Conference on Learning Representations (ICLR).
  32. Neural Graph Collaborative Filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 165–174.
  33. Disentangled Graph Collaborative Filtering. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1001–1010.
  34. NPA: Neural News Recommendation with Personalized Attention. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD). 2576–2584.
  35. Self-supervised Graph Learning for Recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 726–735.
  36. Mixed Negative Sampling for Learning Two-tower Neural Networks in Recommendations. In Companion Proceedings of the Web Conference (WWW). 441–447.
  37. HOP-Rec: High-order Proximity for Implicit Recommendation. In Proceedings of the 12th ACM Conference on Recommender Systems (RecSys). 140–144.
  38. Adaptive Semantic-Visual Tree for Hierarchical Embeddings. In Proceedings of the 27th ACM International Conference on Multimedia (MM). 2097–2105.
  39. Graph Convolutional Neural Networks for Web-scale Recommender Systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD). 974–983.
  40. Wenhui Yu and Zheng Qin. 2020a. Graph Convolutional Network for Recommendation with Low-pass Collaborative Filters. In International Conference on Machine Learning (ICML). 10936–10945.
  41. Wenhui Yu and Zheng Qin. 2020b. Sampler Design for Implicit Feedback Data by Noisy-label Robust Learning. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 861–870.
Citations (135)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now