Exploring Popularity Bias in Session-based Recommendation (2312.07855v1)
Abstract: Existing work has revealed that large-scale offline evaluation of recommender systems for user-item interactions is prone to bias caused by the deployed system itself, as a form of closed loop feedback. Many adopt the \textit{propensity} concept to analyze or mitigate this empirical issue. In this work, we extend the analysis to session-based setup and adapted propensity calculation to the unique characteristics of session-based recommendation tasks. Our experiments incorporate neural models and KNN-based models, and cover both the music and the e-commerce domain. We study the distributions of propensity and different stratification techniques on different datasets and find that propensity-related traits are actually dataset-specific. We then leverage the effect of stratification and achieve promising results compared to the original models.
- Balázs Hidasi and Alexandros Karatzoglou. 2018. Recurrent neural networks with top-k gains for session-based recommendations. In Proceedings of the 27th ACM international conference on information and knowledge management, pages 843–852.
- Session-based recommendations with recurrent neural networks.
- The simpson’s paradox in the offline evaluation of recommendation systems.
- Session-based item recommendation in e-commerce: on short-term intents, reminders, trends and discounts. User Modeling and User-Adapted Interaction, 27:351–392.
- Neural attentive session-based recommendation.
- Malte Ludewig and Dietmar Jannach. 2018. Evaluation of session-based recommendation algorithms. CoRR, abs/1803.09587.
- Empirical analysis of session-based recommendation algorithms. User Modeling and User-Adapted Interaction, 31(1):149–181.
- Recommendations as treatments: Debiasing learning and evaluation.
- Harald Steck. 2011. Item popularity and recommendation accuracy. In Proceedings of the Fifth ACM Conference on Recommender Systems, RecSys ’11, page 125–132, New York, NY, USA. Association for Computing Machinery.
- GACE: Learning Graph-Based Cross-Page Ads Embedding for Click-Through Rate Prediction. In Neural Information Processing, pages 429–443, Singapore. Springer Nature Singapore.
- Session-based recommendation with graph neural networks. Proceedings of the AAAI Conference on Artificial Intelligence, 33:346–353.
- Unbiased offline recommender evaluation for missing-not-at-random implicit feedback. Proceedings of the 12th ACM Conference on Recommender Systems.