Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Ada-Retrieval: An Adaptive Multi-Round Retrieval Paradigm for Sequential Recommendations (2401.06633v2)

Published 12 Jan 2024 in cs.IR and cs.AI

Abstract: Retrieval models aim at selecting a small set of item candidates which match the preference of a given user. They play a vital role in large-scale recommender systems since subsequent models such as rankers highly depend on the quality of item candidates. However, most existing retrieval models employ a single-round inference paradigm, which may not adequately capture the dynamic nature of user preferences and stuck in one area in the item space. In this paper, we propose Ada-Retrieval, an adaptive multi-round retrieval paradigm for recommender systems that iteratively refines user representations to better capture potential candidates in the full item space. Ada-Retrieval comprises two key modules: the item representation adapter and the user representation adapter, designed to inject context information into items' and users' representations. The framework maintains a model-agnostic design, allowing seamless integration with various backbone models such as RNNs or Transformers. We perform experiments on three widely used public datasets, incorporating five powerful sequential recommenders as backbone models. Our results demonstrate that Ada-Retrieval significantly enhances the performance of various base models, with consistent improvements observed across different datasets. Our code and data are publicly available at: https://github.com/ll0ruc/Ada-Retrieval.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Layer normalization. arXiv preprint arXiv:1607.06450.
  2. Controllable multi-interest framework for recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2942–2951.
  3. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259.
  4. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems, 191–198.
  5. An attentional recurrent neural network for personalized next location recommendation. In Proceedings of the AAAI Conference on artificial intelligence, volume 34, 83–90.
  6. Adversarial feature translation for multi-domain recommendation. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2964–2973.
  7. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778.
  8. Fusing similarity models with markov chains for sparse sequential recommendation. In 2016 IEEE 16th international conference on data mining (ICDM), 191–200. IEEE.
  9. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939.
  10. Self-attentive sequential recommendation. In 2018 IEEE international conference on data mining (ICDM), 197–206. IEEE.
  11. On sampled metrics for item recommendation. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, 1748–1757.
  12. Lewandowski, D. 2008. The retrieval effectiveness of web search engines: considering results descriptions. Journal of documentation, 64(6): 915–937.
  13. Multi-interest network with dynamic routing for recommendation at Tmall. In Proceedings of the 28th ACM international conference on information and knowledge management, 2615–2623.
  14. Neural attentive session-based recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 1419–1428.
  15. Time interval aware self-attention for sequential recommendation. In Proceedings of the 13th international conference on web search and data mining, 322–330.
  16. Image-based recommendations on styles and substitutes. In Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, 43–52.
  17. Rendle, S. 2010. Factorization machines. In 2010 IEEE International conference on data mining, 995–1000. IEEE.
  18. Sherstinsky, A. 2020. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D: Nonlinear Phenomena, 404: 132306.
  19. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, 15(1): 1929–1958.
  20. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM international conference on information and knowledge management, 1441–1450.
  21. Dynamic memory based attention network for sequential recommendation. In Proceedings of the AAAI conference on artificial intelligence, volume 35, 4384–4392.
  22. Sparse-interest network for sequential recommendation. In Proceedings of the 14th ACM international conference on web search and data mining, 598–606.
  23. Personalized top-n sequential recommendation via convolutional sequence embedding. In Proceedings of the eleventh ACM international conference on web search and data mining, 565–573.
  24. Session-based recommendation with graph neural networks. In Proceedings of the AAAI conference on artificial intelligence, volume 33, 346–353.
  25. Improving accuracy and diversity in matching of recommendation with diversified preference network. IEEE Transactions on Big Data, 8(4): 955–967.
  26. Internal and Contextual Attention Network for Cold-start Multi-channel Matching in Recommendation. In IJCAI, 2732–2738.
  27. Contrastive learning for sequential recommendation. In 2022 IEEE 38th international conference on data engineering (ICDE), 1259–1273. IEEE.
  28. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 974–983.
  29. A simple convolutional generative network for next item recommendation. In Proceedings of the twelfth ACM international conference on web search and data mining, 582–590.
  30. Mining search engine query logs for query recommendation. In Proceedings of the 15th international conference on World Wide Web, 1039–1040.
  31. S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In Proceedings of the 29th ACM international conference on information & knowledge management, 1893–1902.
  32. Filter-enhanced MLP is all you need for sequential recommendation. In Proceedings of the ACM web conference 2022, 2388–2399.
  33. Joint optimization of tree-based index and deep model for recommender systems. Advances in Neural Information Processing Systems, 32.
  34. Learning tree-based deep model for recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 1079–1088.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Lei Li (1293 papers)
  2. Jianxun Lian (39 papers)
  3. Xiao Zhou (84 papers)
  4. Xing Xie (220 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - ll0ruc/Ada-Retrieval (6 stars)