Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-Tower Multi-Interest Recommendation with User Representation Repel (2403.05122v2)

Published 8 Mar 2024 in cs.IR and cs.LG

Abstract: In the era of information overload, the value of recommender systems has been profoundly recognized in academia and industry alike. Multi-interest sequential recommendation, in particular, is a subfield that has been receiving increasing attention in recent years. By generating multiple-user representations, multi-interest learning models demonstrate superior expressiveness than single-user representation models, both theoretically and empirically. Despite major advancements in the field, three major issues continue to plague the performance and adoptability of multi-interest learning methods, the difference between training and deployment objectives, the inability to access item information, and the difficulty of industrial adoption due to its single-tower architecture. We address these challenges by proposing a novel multi-tower multi-interest framework with user representation repel. Experimental results across multiple large-scale industrial datasets proved the effectiveness and generalizability of our proposed framework.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Session-based Recommendations with Recurrent Neural Networks, March 2016. arXiv:1511.06939 [cs].
  2. Self-Attentive Sequential Recommendation. In 2018 IEEE International Conference on Data Mining (ICDM), pages 197–206, November 2018. ISSN: 2374-8486.
  3. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pages 974–983, 2018.
  4. Multi-Interest Network with Dynamic Routing for Recommendation at Tmall, April 2019. Issue: arXiv:1904.08030 arXiv:1904.08030 [cs, stat].
  5. Controllable Multi-Interest Framework for Recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD ’20, pages 2942–2951, New York, NY, USA, August 2020. Association for Computing Machinery.
  6. Dynamic routing between capsules. Advances in neural information processing systems, 30, 2017.
  7. Exploring periodicity and interactivity in multi-interest framework for sequential recommendation. arXiv preprint arXiv:2106.04415, 2021.
  8. User-Aware Multi-Interest Learning for Candidate Matching in Recommenders. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’22, pages 1326–1335, New York, NY, USA, July 2022. Association for Computing Machinery.
  9. Rethinking Multi-Interest Learning for Candidate Matching in Recommender Systems, July 2023. arXiv:2302.14532 [cs].
  10. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems, pages 191–198, 2016.
  11. On using very large target vocabulary for neural machine translation. arXiv preprint arXiv:1412.2007, 2014.
  12. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM international conference on Conference on information & knowledge management - CIKM ’13, pages 2333–2338, San Francisco, California, USA, 2013. ACM Press.
  13. The Netflix Recommender System: Algorithms, Business Value, and Innovation. ACM Transactions on Management Information Systems, 6(4):1–19, January 2016.
  14. SDM: Sequential Deep Matching Model for Online Large-scale Recommender System. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pages 2635–2643, Beijing China, November 2019. ACM.
  15. FISM: factored item similarity models for top-N recommender systems. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 659–667, Chicago Illinois USA, August 2013. ACM.
  16. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web, pages 285–295, Hong Kong Hong Kong, April 2001. ACM.
  17. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web, pages 173–182, 2017.
  18. Path-based Deep Network for Candidate Item Matching in Recommenders. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1493–1502, Virtual Event Canada, July 2021. ACM.
  19. Joint optimization of tree-based index and deep model for recommender systems. Advances in Neural Information Processing Systems, 32, 2019.
  20. Learning Tree-based Deep Model for Recommender Systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1079–1088, London United Kingdom, July 2018. ACM.
  21. Factorizing personalized markov chains for next-basket recommendation. In Proceedings of the 19th international conference on World wide web, pages 811–820, 2010.
  22. Learning hierarchical representation model for nextbasket recommendation. In Proceedings of the 38th International ACM SIGIR conference on Research and Development in Information Retrieval, pages 403–412, 2015.
  23. A Dynamic Recurrent Model for Next Basket Recommendation. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pages 729–732, Pisa Italy, July 2016. ACM.
  24. Fusing similarity models with markov chains for sparse sequential recommendation. In 2016 IEEE 16th international conference on data mining (ICDM), pages 191–200. IEEE, 2016.
  25. Translation-based Recommendation. In Proceedings of the Eleventh ACM Conference on Recommender Systems, pages 161–169, Como Italy, August 2017. ACM.
  26. Sequential Recommendation with User Memory Networks. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pages 108–116, Marina Del Rey CA USA, February 2018. ACM.
  27. Self-attentive sequential recommendation. In 2018 IEEE international conference on data mining (ICDM), pages 197–206. IEEE, 2018.
  28. Deep Interest Network for Click-Through Rate Prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1059–1068, London United Kingdom, July 2018. ACM.
  29. Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation. In Proceedings of the ACM Web Conference 2022, pages 2216–2226, Virtual Event, Lyon France, April 2022. ACM.
  30. Deep Metric Learning: A Survey. Symmetry, 11(9):1066, September 2019. Number: 9 Publisher: Multidisciplinary Digital Publishing Institute.
  31. Deep Metric Learning: a (Long) Survey.
  32. Metric Learning for Session-based Recommendations, January 2021. arXiv:2101.02655 [cs].
  33. A Simple Framework for Contrastive Learning of Visual Representations, June 2020. arXiv:2002.05709 [cs, stat].
  34. Collaborative deep metric learning for video understanding. In Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pages 481–490, 2018.
  35. Beyond triplet loss: a deep quadruplet network for person re-identification, April 2017. arXiv:1704.01719 [cs].
  36. Deep Metric Learning via Lifted Structured Feature Embedding. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4004–4012, Las Vegas, NV, USA, June 2016. IEEE.
  37. Kihyuk Sohn. Improved Deep Metric Learning with Multi-class N-pair Loss Objective. In Advances in Neural Information Processing Systems, volume 29. Curran Associates, Inc., 2016.
  38. Metric learning with adaptive density discrimination, 2016.
  39. Deep Metric Learning via Facility Location. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2206–2214, Honolulu, HI, July 2017. IEEE.
  40. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  41. Que2Search: Fast and Accurate Query and Document Understanding for Search at Facebook. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 3376–3384, Virtual Event Singapore, August 2021. ACM.
  42. Deep metric learning: A survey. Symmetry, 11(9):1066, 2019. Publisher: MDPI.
  43. Image-based recommendations on styles and substitutes. In Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pages 43–52, 2015.
  44. Friendship and mobility: user movement in location-based social networks. In Knowledge Discovery and Data Mining, 2011.
  45. Retailrocket recommender system dataset, 2022.
  46. The movielens datasets: History and context. ACM Trans. Interact. Intell. Syst., 5(4), dec 2015.
  47. PRAJIT DATTA. Movielens 100k dataset, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets