Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Personalized Behavior-Aware Transformer for Multi-Behavior Sequential Recommendation (2402.14473v1)

Published 22 Feb 2024 in cs.IR and cs.AI

Abstract: Sequential Recommendation (SR) captures users' dynamic preferences by modeling how users transit among items. However, SR models that utilize only single type of behavior interaction data encounter performance degradation when the sequences are short. To tackle this problem, we focus on Multi-Behavior Sequential Recommendation (MBSR) in this paper, which aims to leverage time-evolving heterogeneous behavioral dependencies for better exploring users' potential intents on the target behavior. Solving MBSR is challenging. On the one hand, users exhibit diverse multi-behavior patterns due to personal characteristics. On the other hand, there exists comprehensive co-influence between behavior correlations and item collaborations, the intensity of which is deeply affected by temporal factors. To tackle these challenges, we propose a Personalized Behavior-Aware Transformer framework (PBAT) for MBSR problem, which models personalized patterns and multifaceted sequential collaborations in a novel way to boost recommendation performance. First, PBAT develops a personalized behavior pattern generator in the representation layer, which extracts dynamic and discriminative behavior patterns for sequential learning. Second, PBAT reforms the self-attention layer with a behavior-aware collaboration extractor, which introduces a fused behavior-aware attention mechanism for incorporating both behavioral and temporal impacts into collaborative transitions. We conduct experiments on three benchmark datasets and the results demonstrate the effectiveness and interpretability of our framework. Our implementation code is released at https://github.com/TiliaceaeSU/PBAT.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Graph heterogeneous multi-relational recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 3958–3966.
  2. Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 19–26.
  3. Curriculum disentangled recommendation with noisy multi-feedback. Advances in Neural Information Processing Systems 34 (2021), 26924–26936.
  4. Philippe Clement and Wolfgang Desch. 2008. An elementary proof of the triangle inequality for the Wasserstein metric. Proc. Amer. Math. Soc. 136, 1 (2008), 333–339.
  5. Paul S Dwyer. 1958. Generalizations of a Gaussian theorem. The Annals of Mathematical Statistics 29, 1 (1958), 106–117.
  6. Sequential Recommendation via Stochastic Self-Attention. In Proceedings of the ACM Web Conference 2022. 2036–2047.
  7. Neural multi-task recommendation from multi-behavior data. In 2019 IEEE 35th international conference on data engineering (ICDE). IEEE, 1554–1557.
  8. Deep multifaceted transformers for multi-objective ranking in large-scale e-commerce recommender systems. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2493–2500.
  9. Buying or browsing?: Predicting real-time purchasing intent using attention-based deep network with multiple behavior. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1984–1992.
  10. Balázs Hidasi and Alexandros Karatzoglou. 2018. Recurrent neural networks with top-k gains for session-based recommendations. In Proceedings of the 27th ACM international conference on information and knowledge management. 843–852.
  11. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
  12. Multi-behavior recommendation with graph convolutional networks. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 659–668.
  13. Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE Int’l Conf. on Data Mining (ICDM). IEEE, 197–206.
  14. Sliced Wasserstein auto-encoders. In International Conference on Learning Representations.
  15. Multi-relational matrix factorization using bayesian personalized ranking for social network data. In Proceedings of the fifth ACM international conference on Web search and data mining. 173–182.
  16. Coarse-to-Fine Sparse Sequential Recommendation. arXiv preprint arXiv:2204.01839 (2022).
  17. Learning from history and present: Next-item recommendation via discriminatively exploiting user behaviors. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1734–1743.
  18. Dual contrastive network for sequential recommendation. In Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval. 2686–2691.
  19. Joint Internal Multi-Interest Exploration and External Domain Alignment for Cross Domain Sequential Recommendation. In Proceedings of the ACM Web Conference 2023. 383–394.
  20. VAE++ Variational AutoEncoder for Heterogeneous One-Class Collaborative Filtering. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 666–674.
  21. Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In Proceedings of the 43rd international ACM SIGIR conference on research and development in Information Retrieval. 1091–1100.
  22. Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation. In 2021 IEEE International Conference on Data Mining (ICDM). IEEE, 519–528.
  23. Factorizing personalized markov chains for next-basket recommendation. In Proceedings of the 19th international conference on World wide web. 811–820.
  24. Ajit P Singh and Geoffrey J Gordon. 2008. Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 650–658.
  25. Enhancing Hierarchy-Aware Graph Networks with Deep Dual Clustering for Session-based Recommendation. In Proceedings of the ACM Web Conference 2023. 165–176.
  26. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM international conference on information and knowledge management. 1441–1450.
  27. Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In Proceedings of the eleventh ACM international conference on web search and data mining. 565–573.
  28. Attentive sequential models of latent intent for next item recommendation. In Proceedings of The Web Conference 2020. 2528–2534.
  29. Next-item recommendation with sequential hypergraphs. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval. 1101–1110.
  30. Beyond clicks: Modeling multi-relational item graph for session-based target behavior prediction. In Proceedings of The Web Conference 2020. 3056–3062.
  31. Neural graph collaborative filtering. In Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval. 165–174.
  32. Contrastive meta learning with behavior multiplicity for recommendation. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1120–1128.
  33. Recurrent recommender networks. In Proceedings of the tenth ACM international conference on web search and data mining. 495–503.
  34. SSE-PT: Sequential recommendation via personalized transformer. In Fourteenth ACM Conference on Recommender Systems. 328–337.
  35. Session-based recommendation with graph neural networks. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 346–353.
  36. Multiplex behavioral relation learning for recommendation via memory augmented transformer network. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2397–2406.
  37. Graph meta network for multi-behavior recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 757–766.
  38. Contrastive learning for sequential recommendation. arXiv preprint arXiv:2010.14395 (2020).
  39. Deep Matrix Factorization Models for Recommender Systems.. In IJCAI, Vol. 17. Melbourne, Australia, 3203–3209.
  40. Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation. In 2021 IEEE International Conference on Data Mining (ICDM). IEEE, 787–796.
  41. Multi-behavior hypergraph-enhanced transformer for sequential recommendation. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2263–2274.
  42. Graph neural network based model for multi-behavior session-based recommendation. GeoInformatica 26, 2 (2022), 429–447.
  43. Multi-Behavior Sequential Transformer Recommender. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1642–1652.
  44. Multiplex graph neural networks for multi-behavior recommendation. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2313–2316.
  45. Improving user topic interest profiles by behavior factorization. In Proceedings of the 24th International Conference on World Wide Web. 1406–1416.
  46. Deep Distribution Network: Addressing the Data Sparsity Issue for Top-N Recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1081–1084.
  47. DDGHM: dual dynamic graph with hybrid metric training for cross-domain sequential recommendation. In Proceedings of the 30th ACM International Conference on Multimedia. 471–481.
  48. Dgtn: Dual-channel graph transition network for session-based recommendation. In 2020 International Conference on Data Mining Workshops (ICDMW). IEEE, 236–242.
  49. Micro behaviors: A new perspective in e-commerce recommender systems. In Proceedings of the eleventh ACM international conference on web search and data mining. 727–735.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Jiajie Su (5 papers)
  2. Chaochao Chen (87 papers)
  3. Zibin Lin (2 papers)
  4. Xi Li (198 papers)
  5. Weiming Liu (31 papers)
  6. Xiaolin Zheng (52 papers)
Citations (13)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now