Learning Social Fairness Preferences from Non-Expert Stakeholder Opinions in Kidney Placement (2404.03800v1)
Abstract: Modern kidney placement incorporates several intelligent recommendation systems which exhibit social discrimination due to biases inherited from training data. Although initial attempts were made in the literature to study algorithmic fairness in kidney placement, these methods replace true outcomes with surgeons' decisions due to the long delays involved in recording such outcomes reliably. However, the replacement of true outcomes with surgeons' decisions disregards expert stakeholders' biases as well as social opinions of other stakeholders who do not possess medical expertise. This paper alleviates the latter concern and designs a novel fairness feedback survey to evaluate an acceptance rate predictor (ARP) that predicts a kidney's acceptance rate in a given kidney-match pair. The survey is launched on Prolific, a crowdsourcing platform, and public opinions are collected from 85 anonymous crowd participants. A novel social fairness preference learning algorithm is proposed based on minimizing social feedback regret computed using a novel logit-based fairness feedback model. The proposed model and learning algorithm are both validated using simulation experiments as well as Prolific data. Public preferences towards group fairness notions in the context of kidney placement have been estimated and discussed in detail. The specific ARP tested in the Prolific survey has been deemed fair by the participants.
- Identifying AI Opportunities in Donor Kidney Acceptance: Incremental Hierarchical Systems Engineering Approach. In 2022 IEEE International Systems Conference (SysCon), pages 1–8. IEEE, 2022.
- Predicting Kidney Discard using Machine Learning. Transplantation, 105(9):2054, 2021.
- Fairness in criminal justice risk assessments: The state of the art. Sociological Methods & Research, 50(1):3–44, 2018.
- U.S. Census Bureau. ACS Demographic and Housing Estimates. U.S. Census Bureau. URL https://data.census.gov/table/ACSDP5Y2021.DP05?g=010XX00US&y=2021&d=ACS5-YearEstimatesDataProfiles.
- Fairness in machine learning: A survey. arXiv preprint arXiv:2010.04053, 2020.
- Reconsidering Donor Race in Predicting Allograft and Patient Survival among Kidney Transplant Recipients. Kidney360, 2(11):1831, 2021.
- Alexandra Chouldechova. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data, 5(2):153–163, 2017.
- The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810, 2018.
- Algorithmic decision making and the cost of fairness. In Proceedings of the 23rd acm sigkdd international conference on knowledge discovery and data mining, pages 797–806, 2017.
- Fairness Through Awareness. In Proceedings of the 3rd innovations in theoretical computer science conference, pages 214–226. ACM, 2012.
- Benjamin Eidelson. Kidney allocation and the limits of the age discrimination act. Yale LJ, 122:1635, 2012.
- The Kidney Allocation System. Surgical Clinics, 93(6):1395–1406, 2013.
- Human perceptions of fairness in algorithmic decision making: A case study of criminal risk prediction. In Proceedings of the 2018 World Wide Web Conference, pages 903–912, 2018.
- Equality of Opportunity in Supervised Learning. In D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems 29, pages 3315–3323. Curran Associates, Inc., 2016.
- An empirical study on the perceived fairness of realistic, imperfect machine learning models. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pages 392–402, 2020.
- Applicants’ fairness perceptions of algorithm-driven hiring procedures. Journal of Business Ethics, pages 1–26, 2023.
- Optn/srtr 2021 annual data report: kidney. American Journal of Transplantation, 23(2):S21–S120, 2023.
- Pediatric transplantation. American Journal of Transplantation, 4:54–71, 2004.
- An Experiment on the Impact of Predictive Analytics on Kidney Offer Acceptance Decisions. American Journal of Transplantation, 23:957–965, 2023.
- A survey on bias and fairness in machine learning. ACM Computing Surveys (CSUR), 54(6):1–35, 2021.
- Algorithmic fairness. arXiv preprint arXiv:2001.09784, 2020.
- Learning optimal fair scoring systems for multi-class classification. In ICTAI 2022-The 34th IEEE International Conference on Tools with Artificial Intelligence, 2022.
- Mathematical notions vs. human perception of fairness: A descriptive approach to fairness for machine learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 2459–2468, 2019.