Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
38 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Neutrality Fallacy: When Algorithmic Fairness Interventions are (Not) Positive Action (2404.12143v1)

Published 18 Apr 2024 in cs.AI and cs.CY

Abstract: Various metrics and interventions have been developed to identify and mitigate unfair outputs of machine learning systems. While individuals and organizations have an obligation to avoid discrimination, the use of fairness-aware machine learning interventions has also been described as amounting to 'algorithmic positive action' under European Union (EU) non-discrimination law. As the Court of Justice of the European Union has been strict when it comes to assessing the lawfulness of positive action, this would impose a significant legal burden on those wishing to implement fair-ml interventions. In this paper, we propose that algorithmic fairness interventions often should be interpreted as a means to prevent discrimination, rather than a measure of positive action. Specifically, we suggest that this category mistake can often be attributed to neutrality fallacies: faulty assumptions regarding the neutrality of fairness-aware algorithmic decision-making. Our findings raise the question of whether a negative obligation to refrain from discrimination is sufficient in the context of algorithmic decision-making. Consequently, we suggest moving away from a duty to 'not do harm' towards a positive obligation to actively 'do no harm' as a more adequate framework for algorithmic decision-making and fair ml-interventions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. Jeremias Adams-Prassl. 2022. Regulating algorithms at work: Lessons for a ‘European approach to artificial intelligence’. European Labour Law Journal 13, 1 (2022), 30–50.
  2. Directly discriminatory algorithms. The Modern Law Review 86, 1 (2023), 144–175.
  3. Algorithmic profiling of job seekers in Austria: how austerity politics are made effective. Frontiers in Big Data (2020), 5.
  4. Louise Amoore. 2020. Cloud ethics: Algorithms and the attributes of ourselves and others. Duke University Press.
  5. Jack M Balkin and Reva B Siegel. 2003. The American civil rights tradition: Anticlassification or antisubordination. Issues in Legal Scholarship 2, 1 (2003).
  6. Jason R Bent. 2019. Is algorithmic affirmative action legal. Georgetown Law 108 (2019), 803.
  7. Less Discriminatory Algorithms. Georgetown Law Journal 113, 1 (2024).
  8. Eugenia Caracciolo di Torella. 2022. Directive 2004/113/EC on Gender Equality in Goods and Services – In search of the potential of a forgotten Directive. Publications Office of the European Union, Luxembourg.
  9. Case 157/15. 2017. Opinion of AG Kokott in Samira Achbita and Centrum voor gelijkheid van kansen en voor racismebestrijding v G4S Secure Solutions NV. EU:C:2016:382.
  10. Case 158/97. 2000. Georg Badeck and Others. EU:C:2000:163.
  11. Case 170/84. 1986. Bilka - Kaufhaus GmbH v Karin Weber von Hartz. EU:C:1986:204.
  12. Case 236/09. 2011. Association Belge des Consommateurs Test-Achats ASBL and Others v Conseil des ministres. EU:C:2011:100.
  13. Case 236/98. 2000. Jämställdhetsombudsmannen v Örebro läns landsting. EU:C:2000:173.
  14. Case 312/86. 1988. Commission v France. EU:C:1988:485.
  15. Case 366/99. 2001. Joseph Griesmar v Ministre de l’Economie, des Finances et de l’Industrie and Ministre de la Fonction publique, de la Réforme de l’Etat et de la Décentralisation. EU:C:2001:648.
  16. Case 400/93. 1995. Specialarbejderforbundet i Danmark v Dansk Industri, formerly Industriens Arbejdsgivere, acting for Royal Copenhagen A/S. EU:C:1995:155.
  17. Case 407/98. 2000. Katarina Abrahamsson and Leif Anderson v Elisabet Fogelqvist. EU:C:2000:367.
  18. Case 409/95. 1997. Hellmut Marschall v Land Nordrhein‐Westfalen. EU:C:1997:533.
  19. Case 450/93. 1995. Eckhard Kalanke v Freie Hansestadt Bremen. EU:C:1995:322.
  20. College voor de Rechten van de Mens. 2023. Breeze Social B.V. discrimineert niet, als zij maatregelen neemt die voorkomen dat haar algoritme gebruikers met een niet-Nederlandse afkomst of donkere huidskleur benadeelt. https://oordelen.mensenrechten.nl/oordeel/2023-82 Oordeelnummer 2023-82.
  21. Council of European Union. 1976. Council Directive 76/207/EEC of 9 February 1976 on the implementation of the principle of equal treatment for men and women as regards access to employment, vocational training and promotion, and working conditions. Official Journal L 39 (1976), 40–42.
  22. Council of European Union. 2000a. Council Directive 2000/78/EC of 27 November 2000 establishing a general framework for equal treatment in employment and occupation. Official Journal L 303 (2000), 16–22.
  23. Council of European Union. 2000b. Racial Equality Directive. Council Directive 2000/43/EC of 29 June 2000 implementing the principle of equal treatment between persons irrespective of racial or ethnic origin. Official Journal L 180 (2000), 22–26.
  24. Council of European Union. 2006. Directive 2006/54/EC of the European Parliament and of the Council of 5 July 2006 on the implementation of the principle of equal opportunities and equal treatment of men and women in matters of employment and occupation. Official Journal L 204 (2006), 23––36.
  25. Council of European Union. 2012. Treaty on the Functioning of the European Union. Official Journal C 326 (2012), 1–390.
  26. Council of European Union. 2022. Directive (EU) 2022/2381 of the European Parliament and of the Councilmen as of 23 November 2022 on improving the gender balance among directors of listed companies and related measures. Official Journal L 315 (2022), 44–59.
  27. Simone Cusack and Lisa Pusey. 2013. CEDAW and the Rights to Non-Discrimination and Equality. Melb. J. Int’l L. 14 (2013), 54.
  28. Benjamin Davies and Thomas Douglas. 2022. Learning to Discriminate. Sentencing and Artificial Intelligence (2022), 97.
  29. Mark De Vos. 2007. Beyond formal equality: Positive action under Directives 2000/43/EC and 2000/78/EC. Office for Official Publications of the European Communities.
  30. Batya Friedman and Helen Nissenbaum. 1996. Bias in computer systems. ACM Transactions on information systems (TOIS) 14, 3 (1996), 330–347.
  31. Counterfactual Prediction Under Outcome Measurement Error. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1584–1598.
  32. Ground (less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 688–704.
  33. Philipp Hacker. 2018. Teaching fairness to artificial intelligence: Existing and novel strategies against algorithmic discrimination under EU law. Common Market Law Review 55, Issue 4 (Aug. 2018), 1143–1185. https://doi.org/10.54648/cola2018095
  34. Towards a critical race methodology in algorithmic fairness. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 501–512.
  35. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 (2016).
  36. Deborah Hellman. 2020. Measuring algorithmic fairness. Virginia Law Review 106, 4 (2020), 811–866.
  37. Deborah Hellman. 2023. Big data and compounding injustice. Journal of Moral Philosophy 1, aop (2023), 1–22.
  38. Daniel E Ho and Alice Xiang. 2020. Affirmative algorithms: The legal grounds for fairness as awareness. The University of Chicago Law Review Online (2020), 134.
  39. Discrimination for the Sake of Fairness: Fairness by Design and Its Legal Framework. Available at SSRN 3773766 (2021).
  40. Fairness by awareness? On the inclusion of protected features in algorithmic decisions. Computer Law & Security Review 44 (2022), 105658. https://doi.org/10.1016/j.clsr.2022.105658
  41. Abigail Z Jacobs and Hanna Wallach. 2021. Measurement and fairness. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 375–385.
  42. Faisal Kamiran and Toon Calders. 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1 (2012), 1–33.
  43. Decision theory for discrimination-aware classification. In 2012 IEEE 12th international conference on data mining. IEEE, 924–929.
  44. Pauline T. Kim. 2022. Race-Aware Algorithms: Fairness, nondiscrimination, and affirmative action. California Law Review 110 (2022), 1539–1596.
  45. Ethnic Minority Status, Age-at-Immigration and Psychosis Risk in Rural Environments: Evidence From the SEPEA Study. Schizophrenia Bulletin 43, 6 (May 2017), 1251–1261. https://doi.org/10.1093/schbul/sbx010
  46. The Misuse of AUC: What High Impact Risk Assessment Gets Wrong. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1570–1583.
  47. Angela HEM Maas and Yolande EA Appelman. 2010. Gender differences in coronary heart disease. Netherlands Heart Journal 18 (2010), 598–603.
  48. Christopher McCrudden. 2019. Gender-based positive action in employment in Europe: a comparative analysis of legal and policy approaches in the EU and EEA. Available at SSRN 3524238 (2019).
  49. Jan-Laurin Müller. 2023. Fairness in Machine Learning as ‘Algorithmic Positive Action’. In EWAF’23: European Workshop on Algorithmic Fairness.
  50. Tobias Nowak. 2022. Dutch positive action measures in higher education in the light of EU law. Maastricht Journal of European and Comparative Law 29, 4 (2022), 468–482.
  51. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (Oct. 2019), 447–453. https://doi.org/10.1126/science.aax2342
  52. Peter N Salib. 2022. Big Data Affirmative Action. Northwestern University Law Review 117 (2022), 821.
  53. Overbooked and overlooked: machine learning and racial bias in medical appointment scheduling. Manufacturing & Service Operations Management 24, 6 (2022), 2825–2842.
  54. Anette Scoppetta and Arthur Buckenleib. 2018. Tackling long-term unemployment through risk profiling and outreach. Eur. Comm.–ESF Transnatl. Coop 6 (2018), 1–28.
  55. Bias preservation in machine learning: the legality of fairness metrics under EU non-discrimination law. W. Va. L. Rev. 123 (2020), 735.
  56. Does the End Justify the Means? On the Moral Justification of Fairness-Aware Machine Learning. arXiv preprint arXiv:2202.08536 (2022).
  57. Look and You Will Find It: Fairness-Aware Data Collection through Active Learning. In IAL@ PKDD/ECML. 74–88.
  58. Algorithmic Unfairness through the Lens of EU Non-Discrimination Law: Or Why the Law is not a Decision Tree. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 805–816.
  59. Malwina Anna Wójcik. 2023. Assessing the Legality of Using the Category of Race and Ethnicity in Clinical Algorithms - the EU Anti-discrimination Law Perspective. In EWAF’23: European Workshop on Algorithmic Fairness.
  60. Raphaële Xenidis. 2022. Algorithmic neutrality vs neutralising discriminatory algorithms: for a paradigm shift in EU anti-discrimination law. Lavoro e diritto 36, 4 (2022), 765–771.
  61. Raphaële Xenidis and Hélène Masse-Dessen. 2018. Positive action in practice: some dos and don’ts in the field of EU gender equality law. European Equality Law Review 2 (2018), 36–62.
  62. Raphaële Xenidis and Linda Senden. 2019. EU non-discrimination law in the era of artificial intelligence: Mapping the challenges of algorithmic discrimination. General Principles of EU law and the EU Digital Order (2019), 151–182.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Hilde Weerts (6 papers)
  2. Raphaële Xenidis (2 papers)
  3. Fabien Tarissan (7 papers)
  4. Henrik Palmer Olsen (2 papers)
  5. Mykola Pechenizkiy (118 papers)
Citations (1)
X Twitter Logo Streamline Icon: https://streamlinehq.com