Modeling Content Creator Incentives on Algorithm-Curated Platforms (2206.13102v2)
Abstract: Content creators compete for user attention. Their reach crucially depends on algorithmic choices made by developers on online platforms. To maximize exposure, many creators adapt strategically, as evidenced by examples like the sprawling search engine optimization industry. This begets competition for the finite user attention pool. We formalize these dynamics in what we call an exposure game, a model of incentives induced by algorithms, including modern factorization and (deep) two-tower architectures. We prove that seemingly innocuous algorithmic choices, e.g., non-negative vs. unconstrained factorization, significantly affect the existence and character of (Nash) equilibria in exposure games. We proffer use of creator behavior models, like exposure games, for an (ex-ante) pre-deployment audit. Such an audit can identify misalignment between desirable and incentivized content, and thus complement post-hoc measures like content filtering and moderation. To this end, we propose tools for numerically finding equilibria in exposure games, and illustrate results of an audit on the MovieLens and LastFM datasets. Among else, we find that the strategically produced content exhibits strong dependence between algorithmic exploration and content diversity, and between model expressivity and bias towards gender-based user and creator groups.
- Deep learning of constrained autoencoders for enhanced understanding of data. IEEE TNNLS, 2017.
- The mechanics of n-player differentiable games. In ICML, 2018.
- A game theoretic analysis of the adversarial retrieval setting. Journal of Artificial Intelligence Research, 2017.
- A game-theoretic approach to recommendation systems with strategic content providers. In NeurIPS, 2018.
- From recommendation systems to facility location games. In AAAI, 2019a.
- Convergence of learning dynamics in information retrieval games. In AAAI, 2019b.
- Content provider dynamics and coordination in recommendation ecosystems. In NeurIPS, 2020.
- Learning processes, mixed equilibria and dynamical systems arising from repeated games. Games and Economic Behavior, 1997.
- The million song dataset. In ISMIR, 2011.
- Fairness in recommendation ranking through pairwise comparisons. In ACM SIGKDD, 2019.
- Ethics of the attention economy: The problem of social media addiction. Business Ethics Quarterly, 2021.
- Latent dirichlet allocation. JMLR, 2003.
- Nicolas Boumal. An Introduction to Optimization on Smooth Manifolds. Cambridge University Press, 2022.
- JAX: composable transformations of Python+NumPy programs, 2018.
- Regulating algorithmic filtering on social media. NeurIPS, 2021.
- Boltzmann exploration done right. NeurIPS, 2017.
- Algorithms for implicit hitting set problems. In Proceedings of the twenty-second annual ACM-SIAM symposium on Discrete Algorithms, pp. 614–629. SIAM, 2011.
- Top-k off-policy correction for a REINFORCE recommender system. In ACM WSDM, 2019.
- Statistics and social network of youtube videos. In IWQoS, 2008.
- Niraj Chokshi. YouTube filtering draws ire of gay and transgender creators. https://www.nytimes.com/2017/03/20/technology/youtube-lgbt-videos.html, 2017. Accessed: 2022-05-16.
- Deep neural networks for YouTube recommendations. In ACM RecSys, 2016.
- An experimental comparison of click position-bias models. In ACM WSDM, pp. 87–94, 2008.
- Quantifying availability and discovery in recommender systems via stochastic reachability. In ICML, 2021.
- Algorithms. McGraw-Hill, 2008.
- Gerard Debreu. A social equilibrium existence theorem. Proceedings of the National Academy of Sciences, 1952.
- Andrew Dennis. Penguin 4.0: Necessary and positive improvement. https://searchengineland.com/penguin-4-0-necessary-positive-improvement-261359, 2016. Accessed: 2022-05-13.
- Online certification of preference-based fairness for personalized recommender systems. arXiv, 2021.
- Robert Dorfman. Application of the simplex method to a game theory problem. In Activity Analysis of Production and Allocation-Proceedings of a Conference, pp. 348–358. Wiley, Chapman & Hall New York, London, 1951.
- Ky Fan. Fixed-point and minimax theorems in locally convex topological linear spaces. Proceedings of the National Academy of Sciences, 1952.
- Megan Farokhmanesh. YouTube is still restricting and demonetizing LGBT videos and adding anti-LGBT ads to some. https://www.theverge.com/2018/6/4/17424472/youtube-lgbt-demonetization-ads-algorithm, 2018. Accessed: 2022-05-16.
- Learning mixed equilibria. Games and Economic Behavior, 1993.
- Irving L Glicksberg. A further generalization of the Kakutani fixed point theorem, with application to Nash equilibrium points. Proceedings of the American Mathematical Society, 1952.
- Danny Goodwin. A complete guide to the Google Panda update: 2011-21. https://www.searchenginejournal.com/google-algorithm-history/panda-update, 2021. Accessed: 2022-05-13.
- A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Science, 2019.
- Barriers to academic data science research in the new realm of algorithmic behaviour modification by digital platforms. Nature Machine Intelligence, 2022.
- A counterfactual framework for seller-side a/b testing on marketplaces. In ACM SIGIR, 2020.
- Facebook tried to make its platform a healthier place. It got angrier instead. https://www.wsj.com/articles/facebook-algorithm-change-zuckerberg-11631654215, 2021. Accessed: 2022-05-04.
- Strategic classification. In ACM ITCS, 2016.
- Youtube, the great radicalizer? auditing and mitigating ideological biases in youtube recommendations. arXiv, 2022.
- The MovieLens datasets: History and context. ACM TIIS, 2015.
- Array programming with NumPy. Nature, 2020.
- Focusing on the long-term: It’s good for users and business. In ACM CIKM, 2015.
- Harold Hotelling. Stability in competition. The Economic Journal, 1929.
- The disparate effects of strategic manipulation. In FAccT, 2019.
- Learning deep structured semantic models for web search using clickthrough data. In ACM CIKM, 2013.
- Nicolas Hug. Surprise: A Python library for recommender systems. Journal of Open Source Software, 2020.
- John D Hunter. Matplotlib: A 2D graphics environment. Computing in Science & Engineering, 2007.
- Algorithmic amplification of politics on Twitter. Proceedings of the National Academy of Sciences, 2022.
- Alternative microfoundations for strategic classification. In ICML, 2021.
- Supply-side equilibria in recommender systems. arXiv, 2022.
- Learning dynamics in games with stochastic perturbations. Games and Economic Behavior, 1995.
- How do classifiers induce agents to invest effort strategically? ACM TEAC, 2020.
- Jupyter notebooks - a publishing format for reproducible computational workflows. In Positioning and Power in Academic Publishing: Players, Agents and Agendas, 2016.
- Will Knight. Elon Musk’s plan to open source the Twitter algorithm won’t solve anything. https://www.wired.com/story/twitter-open-algorithm-problem/, 2022. Accessed: 2022-05-16.
- Matrix factorization techniques for recommender systems. Computer, 2009.
- Do offline metrics predict online performance in recommender systems? arXiv, 2020.
- Bandit Algorithms. Cambridge University Press, 2020.
- Learning the parts of objects by non-negative matrix factorization. Nature, 1999.
- A contextual-bandit approach to personalized news article recommendation. In TheWebConf, 2010.
- The disparate equilibria of algorithmic decision making when individuals invest rationally. In FAccT, 2020.
- Strategic ranking. In ICAS, 2022.
- T-RECS: A simulation tool to study the societal impact of recommender systems. arXiv, 2021.
- Contrast effects in consumer judgments: Changes in mental representations or in the anchoring of rating scales? Journal of Consumer Research, 1991.
- Chris Marentis. A complete guide to the essentials of post-Hummingbird SEO. https://searchengineland.com/adapting-googles-2013-algorithm-shake-ups-navigate-win-todays-seo-188427, 2014. Accessed: 2022-05-13.
- On finding local Nash equilibria (and only local Nash equilibria) in zero-sum games. arXiv, 2019.
- Recommender systems and their ethical challenges. AI & Society, 2020.
- The social cost of strategic classification. In FAccT, 2019.
- Optimizing long-term social welfare in recommender systems: A constrained matching approach. In ICML, 2020.
- Probabilistic matrix factorization. Advances in Neural Information Processing Systems, 20, 2007.
- A/b testing for recommender systems in a two-sided marketplace. NeurIPS, 2021.
- John F Nash Jr. Equilibrium points in n-person games. Proceedings of the national academy of sciences, 36(1):48–49, 1950.
- Institutional polymorphism: Diversification of content and monetization strategies on youtube. Television & New Media, 2022.
- The pandas development team. pandas-dev/pandas: Pandas, February 2020. URL https://doi.org/10.5281/zenodo.3509134.
- Comparative study of Google search engine optimization algorithms: Panda, Penguin and Hummingbird. In I2CT, 2021.
- Performative prediction. In ICML, 2020.
- Approximate mechanism design without money. ACM TEAC, 2013.
- Information retrieval meets game theory: The ranking competition between documents’ authors. In ACM SIGIR, 2017.
- On the characterization of local Nash equilibria in continuous games. IEEE TACON, 2016.
- Towards platform observability. Internet Policy Review, 2020.
- Julian A Rodriguez. LGBTQ incorporated: YouTube and the management of diversity. Journal of Homosexuality, 2022.
- The new trend for search engine optimization, tools and techniques. IJEECS, 2020.
- Exploring artist gender bias in music recommendation. arXiv, 2020.
- Leo K Simon. Games with discontinuous payoffs. The Review of Economic Studies, 1987.
- Nash convergence of gradient dynamics in general-sum games. In UAI, 2000.
- The role of transparency in recommender systems. In CHI Extended Abstracts on Human Factors in Computing Systems, 2002.
- Fairness and transparency in recommendation: The users’ perspective. In ACM UMAP, 2021.
- Overlapping experiment infrastructure: More, better, faster experimentation. In ACM CIKM, 2010.
- Guido van Rossum and Fred L Drake. Python 3 Reference Manual. CreateSpace, 2009.
- Practical compositional fairness: Understanding fairness in multi-component recommender systems. In ACM WSDM, 2021.
- James Williams. Stand out of our light: freedom and resistance in the attention economy. Cambridge University Press, 2018.
- From infrastructure to culture: A/B testing challenges in large scale social networks. In ACM CIKM, 2015.
- Sampling-bias-corrected neural modeling for large corpus item recommendations. In ACM RecSys, 2019.
- Towards content provider aware recommender systems: A simulation study on the interplay between user and provider utilities. In TheWebConf, 2021.