Papers
Topics
Authors
Recent
Search
2000 character limit reached

Neural Click Models for Recommender Systems

Published 30 Sep 2024 in cs.IR and cs.LG | (2409.20055v1)

Abstract: We develop and evaluate neural architectures to model the user behavior in recommender systems (RS) inspired by click models for Web search but going beyond standard click models. Proposed architectures include recurrent networks, Transformer-based models that alleviate the quadratic complexity of self-attention, adversarial and hierarchical architectures. Our models outperform baselines on the ContentWise and RL4RS datasets and can be used in RS simulators to model user response for RS evaluation and pretraining.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. Reinforcement learning based recommender systems: A survey. CoRR abs/2101.06286 (2021). arXiv:2101.06286 https://arxiv.org/abs/2101.06286
  2. Fast algorithms for mining association rules. In Proc. 20th int. conf. very large data bases, VLDB, Vol. 1215. Santiago, Chile, 487–499.
  3. RecGAN: Recurrent Generative Adversarial Networks for Recommendation Systems. In Proceedings of the 12th ACM Conference on Recommender Systems (Vancouver, British Columbia, Canada) (RecSys ’18). Association for Computing Machinery, New York, NY, USA, 372–376. https://doi.org/10.1145/3240323.3240383
  4. Creating Synthetic Datasets for Collaborative Filtering Recommender Systems using Generative Adversarial Networks. arXiv preprint arXiv:2303.01297 (2023).
  5. A neural click model for web search. In Proceedings of the 25th International Conference on World Wide Web. 531–541.
  6. A click sequence model for web search. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 45–54.
  7. Rating Augmentation with Generative Adversarial Networks towards Accurate Collaborative Filtering. In The World Wide Web Conference (San Francisco, CA, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 2616–2622. https://doi.org/10.1145/3308558.3313413
  8. CFGAN: A Generic Collaborative Filtering Framework Based on Generative Adversarial Networks. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (Torino, Italy) (CIKM ’18). Association for Computing Machinery, New York, NY, USA, 137–146. https://doi.org/10.1145/3269206.3271743
  9. Olivier Chapelle and Ya Zhang. 2009. A dynamic bayesian network click model for web search ranking. In Proceedings of the 18th international conference on World wide web. 1–10.
  10. A context-aware click model for web search. In Proceedings of the 13th International Conference on Web Search and Data Mining. 88–96.
  11. Top-K Off-Policy Correction for a REINFORCE Recommender System. CoRR abs/1812.02353 (2018). arXiv:1812.02353 http://arxiv.org/abs/1812.02353
  12. Deep reinforcement learning in recommender systems: A survey and new perspectives. Knowledge-Based Systems 264 (2023), 110335. https://doi.org/10.1016/j.knosys.2023.110335
  13. Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Alessandro Moschitti, Bo Pang, and Walter Daelemans (Eds.). Association for Computational Linguistics, Doha, Qatar, 1724–1734. https://doi.org/10.3115/v1/D14-1179
  14. Click models for web search. Springer Nature.
  15. An adversarial imitation click model for information retrieval. In Proceedings of the Web Conference 2021. 1809–1820.
  16. SARDINE: A Simulator for Automated Recommendation in Dynamic and Interactive Environments. arXiv:2311.16586 [cs.IR]
  17. Towards Trajectory-Based Recommendations in Museums: Evaluation of Strategies Using Mixed Synthetic and Real Data. In EUSPN/ICTH. https://api.semanticscholar.org/CorpusID:1812507
  18. Context-Aware Recommendations Using Mobile P2P. In Proceedings of the 15th International Conference on Advances in Mobile Computing & Multimedia (Salzburg, Austria) (MoMM2017). Association for Computing Machinery, New York, NY, USA, 82–91. https://doi.org/10.1145/3151848.3151856
  19. Mukund Deshpande and George Karypis. 2004. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems (TOIS) 22, 1 (2004), 143–177.
  20. Generative Adversarial Networks for Spatio-Temporal Data: A Survey. ACM Trans. Intell. Syst. Technol. 13, 2, Article 22 (feb 2022), 25 pages. https://doi.org/10.1145/3474838
  21. Horizon: Facebook’s Open Source Applied Reinforcement Learning Platform. arXiv preprint arXiv:1811.00260 (2018).
  22. Efficient multiple-click models in web search. In Proceedings of the second acm international conference on web search and data mining. 124–131.
  23. IPGAN: Generating Informative Item Pairs by Adversarial Sampling. IEEE Transactions on Neural Networks and Learning Systems 33, 2 (2022), 694–706. https://doi.org/10.1109/TNNLS.2020.3028572
  24. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
  25. Simple and realistic data generation. In Very Large Data Bases Conference. https://api.semanticscholar.org/CorpusID:14579195
  26. Keeping dataset biases out of the simulation: A debiased simulator for reinforcement learning based recommender systems. In Proceedings of the 14th ACM Conference on Recommender Systems. 190–199.
  27. A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning. IEEE Transactions on Pattern Analysis & Machine Intelligence 45, 02 (feb 2023), 1353–1371. https://doi.org/10.1109/TPAMI.2022.3157042
  28. RecSim: A Configurable Simulation Platform for Recommender Systems. CoRR abs/1909.04847 (2019). arXiv:1909.04847 http://arxiv.org/abs/1909.04847
  29. SLATEQ: A Tractable Decomposition for Reinforcement Learning with Recommendation Sets. In Proceedings of the 28th International Joint Conference on Artificial Intelligence (Macao, China) (IJCAI’19). AAAI Press, 2592–2599.
  30. A Review of the Role of Sensors in Mobile Context-Aware Recommendation Systems. International Journal of Distributed Sensor Networks 11, 11 (2015), 489264. https://doi.org/10.1155/2015/489264
  31. Categorical Reparameterization with Gumbel-Softmax. In International Conference on Learning Representations. https://openreview.net/forum?id=rkE3y85ee
  32. Olivier Jeunen and Bart Goethals. 2021. Lessons Learned from Winning the RecoGym Challenge. https://olivierjeunen.github.io/recogym/.
  33. Matrix Factorization Techniques for Recommender Systems. IEEE Computer 42, 8 (2009), 30–37.
  34. A graph-enhanced click model for web search. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. 1259–1268.
  35. A Survey on Reinforcement Learning for Recommender Systems. CoRR abs/2109.10665 (2021). arXiv:2109.10665 https://arxiv.org/abs/2109.10665
  36. A Semi-Synthetic Dataset Generation Framework for Causal Inference in Recommender Systems. arXiv preprint arXiv:2202.11351 (2022).
  37. Unsupervised learning with non-ignorable missing data. In International Workshop on Artificial Intelligence and Statistics. PMLR, 222–229.
  38. ContentWise Impressions. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. ACM. https://doi.org/10.1145/3340531.3412774
  39. Accordion: a trainable simulator for long-term interactive systems. In Proceedings of the 15th ACM Conference on Recommender Systems. 102–113.
  40. RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystems. CoRR abs/2103.08057 (2021). arXiv:2103.08057 https://arxiv.org/abs/2103.08057
  41. Recurrent Models of Visual Attention. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (Montreal, Canada) (NIPS’14). MIT Press, Cambridge, MA, USA, 2204–2212.
  42. All you need is ratings: A clustering approach to synthetic rating datasets generation. arXiv preprint arXiv:1909.00687 (2019).
  43. Data Synthesis Based on Generative Adversarial Networks. Proc. VLDB Endow. 11, 10 (jun 2018), 1071–1083. https://doi.org/10.14778/3231751.3231757
  44. Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (Seattle, Washington) (UAI’01). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 437–444.
  45. DataGenCARS: A generator of synthetic data for the evaluation of context-aware recommendation systems. Pervasive and Mobile Computing 38 (10 2016). https://doi.org/10.1016/j.pmcj.2016.09.020
  46. RecoGym: A Reinforcement Learning Environment for the problem of Product Recommendation in Online Advertising. CoRR abs/1808.00720 (2018). arXiv:1808.00720 http://arxiv.org/abs/1808.00720
  47. High-Resolution Image Synthesis With Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10684–10695.
  48. Virtual-taobao: Virtualizing real-world online retail environment for reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4902–4909.
  49. APL: Adversarial Pairwise Learning for Recommender Systems. Expert Syst. Appl. 118, C (mar 2019), 573–584. https://doi.org/10.1016/j.eswa.2018.10.024
  50. Sequence to Sequence Learning with Neural Networks. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (Montreal, Canada) (NIPS’14). MIT Press, Cambridge, MA, USA, 3104–3112.
  51. Jonathan Traupman and Robert Wilensky. 2004. Collaborative quality filtering: Establishing consensus or recovering ground truth?. In International Workshop on Knowledge Discovery on the Web. Springer, 73–86.
  52. Karen Tso and Lars Schmidt-Thieme. 2006a. Empirical Analysis of Attribute-Aware Recommender System Algorithms Using Synthetic Data. Journal of Computers 1 (07 2006). https://doi.org/10.4304/jcp.1.4.18-29
  53. Karen H. L. Tso and Lars Schmidt-Thieme. 2006b. Empirical Analysis of Attribute-Aware Recommendation Algorithms with Variable Synthetic Data. In Data Science and Classification, Vladimir Batagelj, Hans-Hermann Bock, Anuška Ferligoj, and Aleš Žiberna (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 271–278.
  54. RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender System. arXiv:2110.11073 [cs.IR]
  55. Enhancing Collaborative Filtering with Generative Augmentation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (Anchorage, AK, USA) (KDD ’19). Association for Computing Machinery, New York, NY, USA, 548–556. https://doi.org/10.1145/3292500.3330873
  56. A Minimax Game for Generative and Discriminative Sample Models for Recommendation. In Advances in Knowledge Discovery and Data Mining: 23rd Pacific-Asia Conference, PAKDD 2019, Macau, China, April 14-17, 2019, Proceedings, Part II (Macau, China). Springer-Verlag, Berlin, Heidelberg, 420–431. https://doi.org/10.1007/978-3-030-16145-3_33
  57. Modeling Tabular Data Using Conditional GAN. Curran Associates Inc., Red Hook, NY, USA.
  58. Measuring Recommender System Effects with Simulated Users. CoRR abs/2101.04526 (2021). arXiv:2101.04526 https://arxiv.org/abs/2101.04526
  59. Causal Intervention for Leveraging Popularity Bias in Recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, Canada) (SIGIR ’21). Association for Computing Machinery, New York, NY, USA, 11–20. https://doi.org/10.1145/3404835.3462875
  60. PLASTIC: Prioritize Long and Short-term Information in Top-n Recommendation using Adversarial Training. 3676–3682. https://doi.org/10.24963/ijcai.2018/511
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up