Producers Equilibria and Dynamics in Engagement-Driven Recommender Systems (2401.16641v2)
Abstract: Online platforms such as YouTube or Instagram heavily rely on recommender systems to decide what content to show to which users. Producers often aim to produce content that is likely to be shown to users and have the users engage. To do so, producers try to align their content with the preferences of their targeted user base. In this work, we explore the equilibrium behavior of producers who are interested in maximizing user engagement. We study two variants of the content-serving rule for the platform's recommender system, and provide a structural characterization of producer behavior at equilibrium: namely, each producer chooses to focus on a single embedded feature. We further show that specialization, defined as different producers optimizing for different types of content, naturally arises from the competition among producers trying to maximize user engagement. We provide a heuristic for computing equilibria of our engagement game, and evaluate it experimentally. We highlight how i) the performance and convergence of our heuristic, ii) the level of producer specialization, and iii) the producer and user utilities at equilibrium are affected by the choice of content-serving rule and provide guidance on how to set the content-serving rule to use in engagement games.
- A game theoretic analysis of the adversarial retrieval setting. Journal of Artificial Intelligence Research, 60:1127–1164, 2017.
- A game-theoretic approach to recommendation systems with strategic content providers. Advances in Neural Information Processing Systems, 31, 2018.
- From recommendation systems to facility location games. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 1772–1779, 2019a.
- Convergence of learning dynamics in information retrieval games. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 1780–1787, 2019b.
- Content provider dynamics and coordination in recommendation ecosystems. Advances in Neural Information Processing Systems, 33:18931–18941, 2020.
- Top-k off-policy correction for a reinforce recommender system. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pages 456–464, 2019.
- Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems, pages 191–198, 2016.
- Cristos Goodrow. On youtube’s recommendation system, Sep 2021. URL https://blog.youtube/inside-youtube/on-youtubes-recommendation-system/.
- The movielens datasets: History and context. 5(4), dec 2015. ISSN 2160-6455. doi: 10.1145/2827872. URL https://doi.org/10.1145/2827872.
- Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web, pages 173–182, 2017.
- Modeling content creator incentives on algorithm-curated platforms. In The Eleventh International Conference on Learning Representations, 2022.
- Incentivizing high-quality content in online recommender systems. arXiv preprint arXiv:2306.07479, 2023.
- Nicolas Hug. Surprise: A python library for recommender systems. Journal of Open Source Software, 5(52):2174, 2020. doi: 10.21105/joss.02174. URL https://doi.org/10.21105/joss.02174.
- Clickbait vs. quality: How engagement-based optimization shapes the content landscape in online platforms. arXiv preprint arXiv:2401.09804, 2024.
- Instagram. Instagram ranking explained, May 2023. URL https://about.instagram.com/blog/announcements/instagram-ranking-explained/.
- Supply-side equilibria in recommender systems. arXiv preprint arXiv:2206.13489, 2022.
- Matrix factorization techniques for recommender systems. Computer, 42(8):30–37, 2009.
- Worst-case equilibria. In Annual symposium on theoretical aspects of computer science, pages 404–413. Springer, 1999.
- Algorithms for non-negative matrix factorization. Advances in neural information processing systems, 13, 2000.
- A contextual-bandit approach to personalized news article recommendation. In Proceedings of the 19th international conference on World wide web, pages 661–670, 2010.
- Recommender systems. Physics reports, 519(1):1–49, 2012.
- An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Transactions on Industrial Informatics, 10(2):1273–1284, 2014.
- Zachary Mack. How streaming affects the lengths of songs, May 2019. URL https://www.theverge.com/2019/5/28/18642978/music-streaming-spotify-song-length-distribution-production-switched-on-pop-vergecast-interview.
- Five points for anger, one for a ‘like’: How facebook’s formula fostered rage and misinformation. The Washington Post, 26, 2021.
- Choosing the right weights: Balancing value, strategy, and noise in recommender systems, 2023.
- John Nash. Non-cooperative games. Annals of mathematics, pages 286–295, 1951.
- Amanda Perelli. The creator economy is a $250 billion industry and it’s here to stay — businessinsider.com. https://www.businessinsider.com/creator-economy-250-billion-market-and-here-to-stay-2023-11?utm_source=copy-link&utm_medium=referral&utm_content=topbar, 2023.
- Digital content creation: An analysis of the impact of recommendation systems. Available at SSRN 4311562, 2022.
- Information retrieval meets game theory: The ranking competition between documents’ authors. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 465–474, 2017.
- Stigler Committee. Final report: Stigler committee on digital platforms. available at https://www.chicagobooth.edu/-/media/research/stigler/pdfs/digital-platforms---committee-report---stigler-center.pdf,, September 2019.
- TikTok. How tiktok recommends videos #foryou, Jun 2020. URL https://newsroom.tiktok.com/en-us/how-tiktok-recommends-videos-for-you.
- Nonnegative matrix factorization: A comprehensive review. IEEE Transactions on knowledge and data engineering, 25(6):1336–1353, 2012.
- How bad is top-k𝑘kitalic_k recommendation under competing content creators? arXiv preprint arXiv:2302.01971, 2023a.
- Rethinking incentives in recommender systems: Are monotone rewards always beneficial? arXiv preprint arXiv:2306.07893, 2023b.
- Sampling-Bias-Corrected Neural Modeling for Large Corpus Item Recommendations, 2019.
- Krishna Acharya (7 papers)
- Varun Vangala (1 paper)
- Jingyan Wang (13 papers)
- Juba Ziani (36 papers)