Towards Efficient Pareto-optimal Utility-Fairness between Groups in Repeated Rankings (2402.14305v1)
Abstract: In this paper, we tackle the problem of computing a sequence of rankings with the guarantee of the Pareto-optimal balance between (1) maximizing the utility of the consumers and (2) minimizing unfairness between producers of the items. Such a multi-objective optimization problem is typically solved using a combination of a scalarization method and linear programming on bi-stochastic matrices, representing the distribution of possible rankings of items. However, the above-mentioned approach relies on Birkhoff-von Neumann (BvN) decomposition, of which the computational complexity is $\mathcal{O}(n5)$ with $n$ being the number of items, making it impractical for large-scale systems. To address this drawback, we introduce a novel approach to the above problem by using the Expohedron - a permutahedron whose points represent all achievable exposures of items. On the Expohedron, we profile the Pareto curve which captures the trade-off between group fairness and user utility by identifying a finite number of Pareto optimal solutions. We further propose an efficient method by relaxing our optimization problem on the Expohedron's circumscribed $n$-sphere, which significantly improve the running time. Moreover, the approximate Pareto curve is asymptotically close to the real Pareto optimal curve as the number of substantial solutions increases. Our methods are applicable with different ranking merits that are non-decreasing functions of item relevance. The effectiveness of our methods are validated through experiments on both synthetic and real-world datasets.
- A rewriting system for convex optimization problems. Journal of Control and Decision 5, 1 (2018), 42–60.
- Chapter 2. In Mathematical Methods for Physicists (Third Edition) (third edition ed.), George B. Arfken, Hans J. Weber, and Frank E. Harris (Eds.). Academic Press, Orlando, 102–111. https://doi.org/10.1016/B978-0-12-384654-9.00002-5
- Saima Aysha and Shrimali Tarun. 2022. A Pareto Dominance Approach to Multi-criteria Recommender System Using PSO Algorithm. In International Conference on Innovative Computing and Communications, Ashish Khanna, Deepak Gupta, Siddhartha Bhattacharyya, Aboul Ella Hassanien, Sameer Anand, and Ajay Jaiswal (Eds.). Springer Singapore, Singapore, 737–755.
- Overview of the TREC 2020 Fair Ranking Track. arXiv:2108.05135 [cs.IR]
- Equity of Attention. In The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM. https://doi.org/10.1145/3209978.3210063
- Richard L. Bishop. 2013. Riemannian Geometry. arXiv:1303.5390 [math.DG]
- V. J. Bowman. 1972. Permutation Polyhedra. SIAM J. Appl. Math. 22, 4 (1972), 580–589. https://doi.org/10.1137/0122054 arXiv:https://doi.org/10.1137/0122054
- Constantin Carathéodory. 1907. Über den Variabilitätsbereich der Koeffizienten von Potenzreihen, die gegebene Werte nicht annehmen. Math. Ann. 64 (1907), 95–115. https://api.semanticscholar.org/CorpusID:116695038
- Aleksandr Chuklin and Ilya Markov. 2015. Click Models for Web Search Authors ’ version *. https://api.semanticscholar.org/CorpusID:12961209
- Click Models for Web Search. Vol. 7. 1–115 pages. https://doi.org/10.2200/S00654ED1V01Y201507ICR043
- Geir Dahl. 2010. Majorization permutahedra and (0,1)-matrices. Linear Algebra Appl. 432, 12 (2010), 3265–3271. https://doi.org/10.1016/j.laa.2010.01.024
- Evaluating Stochastic Rankings with Expected Exposure. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM ’20). ACM. https://doi.org/10.1145/3340531.3411962
- Online Certification of Preference-Based Fairness for Personalized Recommender Systems. Proceedings of the AAAI Conference on Artificial Intelligence 36, 6 (Jun. 2022), 6532–6540. https://doi.org/10.1609/aaai.v36i6.20606
- Fanny Dufossé and Bora Uçar. 2016. Notes on Birkhoff–von Neumann decomposition of doubly stochastic matrices. Linear Algebra Appl. 497 (2016), 108–115. https://doi.org/10.1016/j.laa.2016.02.023
- Popcorn: Human-in-the-Loop Popularity Debiasing in Conversational Recommender Systems. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management (Virtual Event, Queensland, Australia) (CIKM ’21). Association for Computing Machinery, New York, NY, USA, 494–503. https://doi.org/10.1145/3459637.3482461
- Towards Long-term Fairness in Recommendation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining (WSDM ’21). ACM. https://doi.org/10.1145/3437963.3441824
- Toward Pareto Efficient Fairness-Utility Trade-off in Recommendation through Reinforcement Learning. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (WSDM ’22). ACM. https://doi.org/10.1145/3488560.3498487
- Fairness-Aware Ranking in Search Recommendation Systems with Application to LinkedIn Talent Search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM. https://doi.org/10.1145/3292500.3330691
- Tohru Gotoh. 1994. GEODESIC HYPERSPHERES IN COMPLEX PROJECTIVE SPACE. Tsukuba Journal of Mathematics 18, 1 (1994), 207–215. http://www.jstor.org/stable/43685888
- P. J. Hilton. 1964. Topology. By John G. Hocking and Gail S. Young. Pp. 382. 74s. 1961. (Addison-Wesley). The Mathematical Gazette 48, 363 (1964), 122–123. https://doi.org/10.2307/3614368
- Jeff Horen. 1985. Linear programming, by Katta G. Murty, John Wiley and Sons, New York, 1983, 482 pp. Networks 15, 2 (1985), 273–274. http://dblp.uni-trier.de/db/journals/networks/networks15.html#Horen85
- Tibor Illés and Tamás Terlaky. 2002. Pivot versus interior point methods: Pros and cons. European Journal of Operational Research 140, 2 (2002), 170–190. https://doi.org/10.1016/S0377-2217(02)00061-9
- Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated Gain-Based Evaluation of IR Techniques. ACM Trans. Inf. Syst. 20, 4 (oct 2002), 422–446. https://doi.org/10.1145/582415.582418
- Pareto-based Multi-Objective Recommender System with Forgetting Curve. ArXiv abs/2312.16868 (2023). https://api.semanticscholar.org/CorpusID:266573337
- Introducing the Expohedron for Efficient Pareto-optimal Fairness-Utility Amortizations in Repeated Rankings. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. ACM. https://doi.org/10.1145/3488560.3498490
- Inequalities: Theory of Majorization and Its Applications. https://api.semanticscholar.org/CorpusID:37387169
- Alistair Moffat and Justin Zobel. 2008. Rank-Biased Precision for Measurement of Retrieval Effectiveness. ACM Trans. Inf. Syst. 27, 1, Article 2 (dec 2008), 27 pages. https://doi.org/10.1145/1416950.1416952
- The Unfairness of Popularity Bias in Book Recommendation. In International Workshop on Algorithmic Bias in Search and Recommendation. https://api.semanticscholar.org/CorpusID:247158125
- Yu. E. Nesterov and M. J. Todd. 1997. Self-Scaled Barriers and Interior-Point Methods for Convex Programming. Mathematics of Operations Research 22, 1 (1997), 1–42. https://doi.org/10.1287/moor.22.1.1 arXiv:https://doi.org/10.1287/moor.22.1.1
- Vincenzo Paparella. 2022. Pursuing Optimal Trade-Off Solutions in Multi-Objective Recommender Systems. Proceedings of the 16th ACM Conference on Recommender Systems (2022). https://api.semanticscholar.org/CorpusID:252216518
- Vilfredo Pareto. 2014. Manual of Political Economy: A Critical and Variorum Edition. Number 9780199607952 in OUP Catalogue. Oxford University Press. https://ideas.repec.org/b/oxp/obooks/9780199607952.html
- Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 Datasets. CoRR abs/1306.2597 (2013). http://arxiv.org/abs/1306.2597
- Capuchin: Causal Database Repair for Algorithmic Fairness. arXiv:1902.08283 [cs.DB]
- A Unified Optimization Toolbox for Solving Popularity Bias, Fairness, and Diversity in Recommender Systems. In Proceedings of the 1st Workshop on Multi-Objective Recommender Systems (MORS 2021) co-located with 15th ACM Conference on Recommender Systems (RecSys 2021), Amsterdam, The Netherlands, September 25, 2021 (CEUR Workshop Proceedings, Vol. 2959), Himan Abdollahpouri, Mehdi Elahi, Masoud Mansoury, Shaghayegh Sahebi, Zahra Nazari, Allison Chaney, and Babak Loni (Eds.). CEUR-WS.org. http://ceur-ws.org/Vol-2959/paper5.pdf
- Ashudeep Singh and Thorsten Joachims. 2018. Fairness of Exposure in Rankings. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM. https://doi.org/10.1145/3219819.3220088
- John P. Snyder. 2012. Map Projections: A Working Manual. https://api.semanticscholar.org/CorpusID:60447053
- Optimizing Rankings for Recommendation in Matching Markets. arXiv:2106.01941 [cs.IR]
- Geomstats team. [n. d.]. https://geomstats.github.io/. https://geomstats.github.io/
- Thibaut Thonet and Jean-Michel Renders. 2020. Multi-Grouping Robust Fair Ranking. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, China) (SIGIR ’20). Association for Computing Machinery, New York, NY, USA, 2077–2080. https://doi.org/10.1145/3397271.3401292
- Lequn Wang and Thorsten Joachims. 2021. User Fairness, Item Fairness, and Diversity for Rankings in Two-Sided Markets. In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR ’21). ACM. https://doi.org/10.1145/3471158.3472260
- DCN V2: Improved Deep and Cross Network and Practical Lessons for Web-scale Learning to Rank Systems. Proceedings of the Web Conference 2021 (2020). https://api.semanticscholar.org/CorpusID:224845398
- Fairness Constraints: A Flexible Approach for Fair Classification. J. Mach. Learn. Res. 20, 1 (jan 2019), 2737–2778.
- George Zerveas. 2022. Mitigating Bias in Search Results Through Contextual Document Reranking and Neutrality Regularization. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (2022). https://api.semanticscholar.org/CorpusID:248837769