Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Efficient Pareto-optimal Utility-Fairness between Groups in Repeated Rankings (2402.14305v1)

Published 22 Feb 2024 in cs.IR and cs.LG

Abstract: In this paper, we tackle the problem of computing a sequence of rankings with the guarantee of the Pareto-optimal balance between (1) maximizing the utility of the consumers and (2) minimizing unfairness between producers of the items. Such a multi-objective optimization problem is typically solved using a combination of a scalarization method and linear programming on bi-stochastic matrices, representing the distribution of possible rankings of items. However, the above-mentioned approach relies on Birkhoff-von Neumann (BvN) decomposition, of which the computational complexity is $\mathcal{O}(n5)$ with $n$ being the number of items, making it impractical for large-scale systems. To address this drawback, we introduce a novel approach to the above problem by using the Expohedron - a permutahedron whose points represent all achievable exposures of items. On the Expohedron, we profile the Pareto curve which captures the trade-off between group fairness and user utility by identifying a finite number of Pareto optimal solutions. We further propose an efficient method by relaxing our optimization problem on the Expohedron's circumscribed $n$-sphere, which significantly improve the running time. Moreover, the approximate Pareto curve is asymptotically close to the real Pareto optimal curve as the number of substantial solutions increases. Our methods are applicable with different ranking merits that are non-decreasing functions of item relevance. The effectiveness of our methods are validated through experiments on both synthetic and real-world datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. A rewriting system for convex optimization problems. Journal of Control and Decision 5, 1 (2018), 42–60.
  2. Chapter 2. In Mathematical Methods for Physicists (Third Edition) (third edition ed.), George B. Arfken, Hans J. Weber, and Frank E. Harris (Eds.). Academic Press, Orlando, 102–111. https://doi.org/10.1016/B978-0-12-384654-9.00002-5
  3. Saima Aysha and Shrimali Tarun. 2022. A Pareto Dominance Approach to Multi-criteria Recommender System Using PSO Algorithm. In International Conference on Innovative Computing and Communications, Ashish Khanna, Deepak Gupta, Siddhartha Bhattacharyya, Aboul Ella Hassanien, Sameer Anand, and Ajay Jaiswal (Eds.). Springer Singapore, Singapore, 737–755.
  4. Overview of the TREC 2020 Fair Ranking Track. arXiv:2108.05135 [cs.IR]
  5. Equity of Attention. In The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM. https://doi.org/10.1145/3209978.3210063
  6. Richard L. Bishop. 2013. Riemannian Geometry. arXiv:1303.5390 [math.DG]
  7. V. J. Bowman. 1972. Permutation Polyhedra. SIAM J. Appl. Math. 22, 4 (1972), 580–589. https://doi.org/10.1137/0122054 arXiv:https://doi.org/10.1137/0122054
  8. Constantin Carathéodory. 1907. Über den Variabilitätsbereich der Koeffizienten von Potenzreihen, die gegebene Werte nicht annehmen. Math. Ann. 64 (1907), 95–115. https://api.semanticscholar.org/CorpusID:116695038
  9. Aleksandr Chuklin and Ilya Markov. 2015. Click Models for Web Search Authors ’ version *. https://api.semanticscholar.org/CorpusID:12961209
  10. Click Models for Web Search. Vol. 7. 1–115 pages. https://doi.org/10.2200/S00654ED1V01Y201507ICR043
  11. Geir Dahl. 2010. Majorization permutahedra and (0,1)-matrices. Linear Algebra Appl. 432, 12 (2010), 3265–3271. https://doi.org/10.1016/j.laa.2010.01.024
  12. Evaluating Stochastic Rankings with Expected Exposure. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM ’20). ACM. https://doi.org/10.1145/3340531.3411962
  13. Online Certification of Preference-Based Fairness for Personalized Recommender Systems. Proceedings of the AAAI Conference on Artificial Intelligence 36, 6 (Jun. 2022), 6532–6540. https://doi.org/10.1609/aaai.v36i6.20606
  14. Fanny Dufossé and Bora Uçar. 2016. Notes on Birkhoff–von Neumann decomposition of doubly stochastic matrices. Linear Algebra Appl. 497 (2016), 108–115. https://doi.org/10.1016/j.laa.2016.02.023
  15. Popcorn: Human-in-the-Loop Popularity Debiasing in Conversational Recommender Systems. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management (Virtual Event, Queensland, Australia) (CIKM ’21). Association for Computing Machinery, New York, NY, USA, 494–503. https://doi.org/10.1145/3459637.3482461
  16. Towards Long-term Fairness in Recommendation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining (WSDM ’21). ACM. https://doi.org/10.1145/3437963.3441824
  17. Toward Pareto Efficient Fairness-Utility Trade-off in Recommendation through Reinforcement Learning. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (WSDM ’22). ACM. https://doi.org/10.1145/3488560.3498487
  18. Fairness-Aware Ranking in Search Recommendation Systems with Application to LinkedIn Talent Search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM. https://doi.org/10.1145/3292500.3330691
  19. Tohru Gotoh. 1994. GEODESIC HYPERSPHERES IN COMPLEX PROJECTIVE SPACE. Tsukuba Journal of Mathematics 18, 1 (1994), 207–215. http://www.jstor.org/stable/43685888
  20. P. J. Hilton. 1964. Topology. By John G. Hocking and Gail S. Young. Pp. 382. 74s. 1961. (Addison-Wesley). The Mathematical Gazette 48, 363 (1964), 122–123. https://doi.org/10.2307/3614368
  21. Jeff Horen. 1985. Linear programming, by Katta G. Murty, John Wiley and Sons, New York, 1983, 482 pp. Networks 15, 2 (1985), 273–274. http://dblp.uni-trier.de/db/journals/networks/networks15.html#Horen85
  22. Tibor Illés and Tamás Terlaky. 2002. Pivot versus interior point methods: Pros and cons. European Journal of Operational Research 140, 2 (2002), 170–190. https://doi.org/10.1016/S0377-2217(02)00061-9
  23. Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated Gain-Based Evaluation of IR Techniques. ACM Trans. Inf. Syst. 20, 4 (oct 2002), 422–446. https://doi.org/10.1145/582415.582418
  24. Pareto-based Multi-Objective Recommender System with Forgetting Curve. ArXiv abs/2312.16868 (2023). https://api.semanticscholar.org/CorpusID:266573337
  25. Introducing the Expohedron for Efficient Pareto-optimal Fairness-Utility Amortizations in Repeated Rankings. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. ACM. https://doi.org/10.1145/3488560.3498490
  26. Inequalities: Theory of Majorization and Its Applications. https://api.semanticscholar.org/CorpusID:37387169
  27. Alistair Moffat and Justin Zobel. 2008. Rank-Biased Precision for Measurement of Retrieval Effectiveness. ACM Trans. Inf. Syst. 27, 1, Article 2 (dec 2008), 27 pages. https://doi.org/10.1145/1416950.1416952
  28. The Unfairness of Popularity Bias in Book Recommendation. In International Workshop on Algorithmic Bias in Search and Recommendation. https://api.semanticscholar.org/CorpusID:247158125
  29. Yu. E. Nesterov and M. J. Todd. 1997. Self-Scaled Barriers and Interior-Point Methods for Convex Programming. Mathematics of Operations Research 22, 1 (1997), 1–42. https://doi.org/10.1287/moor.22.1.1 arXiv:https://doi.org/10.1287/moor.22.1.1
  30. Vincenzo Paparella. 2022. Pursuing Optimal Trade-Off Solutions in Multi-Objective Recommender Systems. Proceedings of the 16th ACM Conference on Recommender Systems (2022). https://api.semanticscholar.org/CorpusID:252216518
  31. Vilfredo Pareto. 2014. Manual of Political Economy: A Critical and Variorum Edition. Number 9780199607952 in OUP Catalogue. Oxford University Press. https://ideas.repec.org/b/oxp/obooks/9780199607952.html
  32. Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 Datasets. CoRR abs/1306.2597 (2013). http://arxiv.org/abs/1306.2597
  33. Capuchin: Causal Database Repair for Algorithmic Fairness. arXiv:1902.08283 [cs.DB]
  34. A Unified Optimization Toolbox for Solving Popularity Bias, Fairness, and Diversity in Recommender Systems. In Proceedings of the 1st Workshop on Multi-Objective Recommender Systems (MORS 2021) co-located with 15th ACM Conference on Recommender Systems (RecSys 2021), Amsterdam, The Netherlands, September 25, 2021 (CEUR Workshop Proceedings, Vol. 2959), Himan Abdollahpouri, Mehdi Elahi, Masoud Mansoury, Shaghayegh Sahebi, Zahra Nazari, Allison Chaney, and Babak Loni (Eds.). CEUR-WS.org. http://ceur-ws.org/Vol-2959/paper5.pdf
  35. Ashudeep Singh and Thorsten Joachims. 2018. Fairness of Exposure in Rankings. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM. https://doi.org/10.1145/3219819.3220088
  36. John P. Snyder. 2012. Map Projections: A Working Manual. https://api.semanticscholar.org/CorpusID:60447053
  37. Optimizing Rankings for Recommendation in Matching Markets. arXiv:2106.01941 [cs.IR]
  38. Geomstats team. [n. d.]. https://geomstats.github.io/. https://geomstats.github.io/
  39. Thibaut Thonet and Jean-Michel Renders. 2020. Multi-Grouping Robust Fair Ranking. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, China) (SIGIR ’20). Association for Computing Machinery, New York, NY, USA, 2077–2080. https://doi.org/10.1145/3397271.3401292
  40. Lequn Wang and Thorsten Joachims. 2021. User Fairness, Item Fairness, and Diversity for Rankings in Two-Sided Markets. In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR ’21). ACM. https://doi.org/10.1145/3471158.3472260
  41. DCN V2: Improved Deep and Cross Network and Practical Lessons for Web-scale Learning to Rank Systems. Proceedings of the Web Conference 2021 (2020). https://api.semanticscholar.org/CorpusID:224845398
  42. Fairness Constraints: A Flexible Approach for Fair Classification. J. Mach. Learn. Res. 20, 1 (jan 2019), 2737–2778.
  43. George Zerveas. 2022. Mitigating Bias in Search Results Through Contextual Document Reranking and Neutrality Regularization. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (2022). https://api.semanticscholar.org/CorpusID:248837769

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets