BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendation (2402.12733v1)
Abstract: In real recommendation scenarios, users often have different types of behaviors, such as clicking and buying. Existing research methods show that it is possible to capture the heterogeneous interests of users through different types of behaviors. However, most multi-behavior approaches have limitations in learning the relationship between different behaviors. In this paper, we propose a novel multilayer perceptron (MLP)-based heterogeneous sequential recommendation method, namely behavior-aware multilayer perceptron (BMLP). Specifically, it has two main modules, including a heterogeneous interest perception (HIP) module, which models behaviors at multiple granularities through behavior types and transition relationships, and a purchase intent perception (PIP) module, which adaptively fuses subsequences of auxiliary behaviors to capture users' purchase intent. Compared with mainstream sequence models, MLP is competitive in terms of accuracy and has unique advantages in simplicity and efficiency. Extensive experiments show that BMLP achieves significant improvement over state-of-the-art algorithms on four public datasets. In addition, its pure MLP architecture leads to a linear time complexity.
- Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939, 2015.
- Personalizing session-based recommendations with hierarchical recurrent neural networks. In Proceedings of the 11th ACM Conference on Recommender Systems, pages 130–137, 2017.
- Jiaxi Tang and Ke Wang. Personalized top-N sequential recommendation via convolutional sequence embedding. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining, pages 565–573, 2018.
- A simple convolutional generative network for next item recommendation. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining, pages 582–590, 2019.
- Self-attentive sequential recommendation. In Proceedings of 2018 IEEE International Conference on Data Mining, pages 197–206, 2018.
- Deep session interest network for click-through rate prediction. arXiv preprint arXiv:1905.06482, 2019.
- Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pages 1441–1450, 2019.
- Session-based recommendation with graph neural networks. In Proceedings of the 33th AAAI Conference on Artificial Intelligence, number 01, pages 346–353, 2019.
- Memory augmented graph neural networks for sequential recommendation. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, number 04, pages 5045–5052, 2020.
- Graph contextualized self-attention network for session-based recommendation. In Proceedings of the 29th International Joint Conference on Artificial Intelligence, pages 3940–3946, 2019.
- Heterogeneous global graph neural networks for personalized session-based recommendation. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining, pages 775–783, 2022.
- Graph meta network for multi-behavior recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 757–766, 2021.
- Multi-behavior recommendation with graph convolutional networks. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 659–668, 2020.
- VAE++: Variational autoencoder for heterogeneous cne-class collaborative filtering. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining, pages 666–674, 2022.
- Micro behaviors: A new perspective in e-commerce recommender systems. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining, pages 727–735, 2018.
- Learning from history and present: Next-item recommendation via discriminatively exploiting user behaviors. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 1734–1743, 2018.
- Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Transactions on Knowledge and Data Engineering, 29(6):1254–1267, 2017.
- Deep multifaceted transformers for multi-objective ranking in large-scale e-commerce recommender systems. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management, pages 2493–2500, 2020.
- Beyond clicks: Modeling multi-relational item graph for session-based target behavior prediction. In Proceedings of The Web Conference 2020, pages 3056–3062, 2020.
- SDM: Sequential deep matching model for online large-scale recommender system. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pages 2635–2643, 2019.
- Factorizing personalized markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web, pages 811–820, 2010.
- Fusing similarity models with markov chains for sparse sequential recommendation. In Proceedings of 2016 IEEE International Conference on Data Mining, pages 191–200, 2016.
- Translation-based recommendation. In Proceedings of the 11th ACM Conference on Recommender Systems, pages 161–169, 2017.
- Improving user topic interest profiles by behavior factorization. In Proceedings of the 24th International Conference on World Wide Web, pages 1406–1416, 2015.
- TransRec++: Translation-based sequential recommendation with heterogeneous feedback. Frontiers of Computer Science, 16(2):1–3, 2022.
- MLP-Mixer: An all-mlp architecture for vision. Advances in Neural Information Processing Systems, 34, 2021.
- Moi-mixer: Improving mlp-mixer with multi order interactions in sequential recommendation. arXiv preprint arXiv:2108.07505, 2021.
- Filter-enhanced mlp is all you need for sequential recommendation. In Proceedings of the International Conference on World Wide Web, pages 2388–2399, 2022.
- Mlp4rec: A pure mlp architecture for sequential recommendations. arXiv preprint arXiv:2204.11510, 2022.
- Convolutional lstm network: A machine learning approach for precipitation nowcasting. Advances in Neural Information Processing Systems, 28:802–810, 2015.
- Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1091–1100, 2020.