An ExplainableFair Framework for Prediction of Substance Use Disorder Treatment Completion (2404.03833v1)
Abstract: Fairness of machine learning models in healthcare has drawn increasing attention from clinicians, researchers, and even at the highest level of government. On the other hand, the importance of developing and deploying interpretable or explainable models has been demonstrated, and is essential to increasing the trustworthiness and likelihood of adoption of these models. The objective of this study was to develop and implement a framework for addressing both these issues - fairness and explainability. We propose an explainable fairness framework, first developing a model with optimized performance, and then using an in-processing approach to mitigate model biases relative to the sensitive attributes of race and sex. We then explore and visualize explanations of the model changes that lead to the fairness enhancement process through exploring the changes in importance of features. Our resulting-fairness enhanced models retain high sensitivity with improved fairness and explanations of the fairness-enhancement that may provide helpful insights for healthcare providers to guide clinical decision-making and resource allocation.
- “Health Equity in Healthy People 2030 - Healthy People 2030 | health.gov.” [Online]. Available: https://health.gov/healthypeople/priority-areas/health-equity-healthy-people-2030
- R. K. Wadhera and I. J. Dahabreh, “The US Health Equity Crisis—An Economic Case for a Moral Imperative?” JAMA, vol. 329, no. 19, pp. 1647–1649, May 2023. [Online]. Available: https://doi.org/10.1001/jama.2023.4018
- C. C. Yang, “Explainable Artificial Intelligence for Predictive Modeling in Healthcare,” Journal of Healthcare Informatics Research, vol. 6, no. 2, p. 228, Jun. 2022, publisher: Springer. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8832418/
- A. K. Menon and R. C. Williamson, “The cost of fairness in binary classification,” in Proceedings of the 1st Conference on Fairness, Accountability and Transparency. PMLR, Jan. 2018, pp. 107–118, iSSN: 2640-3498. [Online]. Available: https://proceedings.mlr.press/v81/menon18a.html
- E. Pierson, “Accuracy and Equity in Clinical Risk Prediction,” New England Journal of Medicine, vol. 390, no. 2, pp. 100–102, Jan. 2024, publisher: Massachusetts Medical Society _eprint: https://doi.org/10.1056/NEJMp2311050. [Online]. Available: https://doi.org/10.1056/NEJMp2311050
- J. Angwin, J. Larson, S. Mattu, and L. Kirchner, “Machine Bias.” [Online]. Available: https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
- A. Chouldechova, “Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments,” Big Data, vol. 5, no. 2, pp. 153–163, Jun. 2017, arXiv: 1703.00056 Publisher: Mary Ann Liebert Inc.
- Z. Obermeyer, B. Powers, C. Vogeli, and S. Mullainathan, “Dissecting racial bias in an algorithm used to manage the health of populations,” Science (New York, N.Y.), vol. 366, no. 6464, pp. 447–453, Oct. 2019.
- L. Acion, D. Kelmansky, M. v. d. Laan, E. Sahker, D. Jones, and S. Arndt, “Use of a machine learning framework to predict substance use disorder treatment success,” PLOS ONE, vol. 12, no. 4, p. e0175383, Apr. 2017, publisher: Public Library of Science. [Online]. Available: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0175383
- M. Nasir, N. S. Summerfield, A. Oztekin, M. Knight, L. K. Ackerson, and S. Carreiro, “Machine learning–based outcome prediction and novel hypotheses generation for substance use disorder treatment,” Journal of the American Medical Informatics Association : JAMIA, vol. 28, no. 6, pp. 1216–1224, Feb. 2021. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8661425/
- O. S. Liang, “Developing Clinical Prediction Models for Post-treatment Substance Use Relapse with Explainable Artificial Intelligence,” Ph.D. dissertation, Drexel University, 2021, book Title: Developing Clinical Prediction Models for Post-treatment Substance Use Relapse with Explainable Artificial Intelligence.
- D. Morel, K. C. Yu, A. Liu-Ferrara, A. J. Caceres-Suriel, S. G. Kurtz, and Y. P. Tabak, “Predicting hospital readmission in patients with mental or substance use disorders: A machine learning approach,” International Journal of Medical Informatics, vol. 139, p. 104136, Jul. 2020.
- M. M. Lucas, C.-H. Chang, and C. C. Yang, “Resampling for Mitigating Bias in Predictive Model for Substance Use Disorder Treatment Completion,” in 2023 IEEE 11th International Conference on Healthcare Informatics (ICHI). Houston, TX, USA: IEEE, Jun. 2023, pp. 709–711. [Online]. Available: https://ieeexplore.ieee.org/document/10337249/
- R. Zemel, Y. Wu, K. Swersky, T. Pitassi, and C. Dwork, “Learning Fair Representations,” in Proceedings of the 30th International Conference on Machine Learning. PMLR, May 2013, pp. 325–333, iSSN: 1938-7228. [Online]. Available: https://proceedings.mlr.press/v28/zemel13.html
- B. H. Zhang, B. Lemoine, and M. Mitchell, “Mitigating Unwanted Biases with Adversarial Learning,” Jan. 2018, arXiv:1801.07593 [cs]. [Online]. Available: http://arxiv.org/abs/1801.07593
- T. Adel, I. Valera, Z. Ghahramani, and A. Weller, “One-network adversarial fairness,” in Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, ser. AAAI’19/IAAI’19/EAAI’19. Honolulu, Hawaii, USA: AAAI Press, Jan. 2019, pp. 2412–2420. [Online]. Available: https://dl.acm.org/doi/10.1609/aaai.v33i01.33012412
- T. Kamishima, S. Akaho, H. Asoh, and J. Sakuma, “Fairness-Aware Classifier with Prejudice Remover Regularizer,” in Machine Learning and Knowledge Discovery in Databases. Springer, Berlin, Heidelberg, 2012, pp. 35–50. [Online]. Available: https://link.springer.com/chapter/10.1007/978-3-642-33486-3_3
- A. Agarwal, A. Beygelzimer, M. Dudik, J. Langford, and H. Wallach, “A Reductions Approach to Fair Classification,” in Proceedings of the 35th International Conference on Machine Learning. PMLR, Jul. 2018, pp. 60–69, iSSN: 2640-3498. [Online]. Available: https://proceedings.mlr.press/v80/agarwal18a.html
- Y. Roh, K. Lee, S. E. Whang, and C. Suh, “FAIRBATCH: BATCH SELECTION FOR MODEL FAIRNESS,” 2021.
- A. Shen, X. Han, T. Cohn, T. Baldwin, and L. Frermann, “Optimising Equal Opportunity Fairness in Model Training,” in Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Seattle, United States: Association for Computational Linguistics, Jul. 2022, pp. 4073–4084. [Online]. Available: https://aclanthology.org/2022.naacl-main.299
- A. Angerschmid, K. Theuermann, A. Holzinger, F. Chen, and J. Zhou, “Effects of Fairness and Explanation on Trust in Ethical AI,” in Machine Learning and Knowledge Extraction, ser. Lecture Notes in Computer Science, A. Holzinger, P. Kieseberg, A. M. Tjoa, and E. Weippl, Eds. Cham: Springer International Publishing, 2022, pp. 51–67.
- C. Combi, J. C. Facelli, P. Haddawy, J. H. Holmes, S. Koch, H. Liu, J. Meyer, M. Peleg, G. Pozzi, G. Stiglic, P. Veltri, and C. C. Yang, “The IHI Rochester Report 2022 on Healthcare Informatics Research: Resuming After the CoViD-19,” Journal of Healthcare Informatics Research, vol. 7, no. 2, pp. 169–202, Jun. 2023. [Online]. Available: https://link.springer.com/10.1007/s41666-023-00126-5
- J. Zhou, F. Chen, and A. Holzinger, “Towards Explainability for AI Fairness,” in xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, ser. Lecture Notes in Computer Science, A. Holzinger, R. Goebel, R. Fong, T. Moon, K.-R. Müller, and W. Samek, Eds. Cham: Springer International Publishing, 2022, pp. 375–386. [Online]. Available: https://doi.org/10.1007/978-3-031-04083-2_18
- S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, ser. NIPS’17. Red Hook, NY, USA: Curran Associates Inc., Dec. 2017, pp. 4768–4777.
- I. Unal, “Defining an Optimal Cut-Point Value in ROC Analysis: An Alternative Approach,” Computational and Mathematical Methods in Medicine, vol. 2017, p. 3762651, 2017. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5470053/
- N. J. Perkins and E. F. Schisterman, “The Inconsistency of “Optimal” Cut-points Using Two ROC Based Criteria.” American journal of epidemiology, vol. 163, no. 7, pp. 670–675, Apr. 2006. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1444894/
- M. Hardt, E. Price, and N. Srebro, “Equality of opportunity in supervised learning,” in Proceedings of the 30th International Conference on Neural Information Processing Systems, ser. NIPS’16. Red Hook, NY, USA: Curran Associates Inc., Dec. 2016, pp. 3323–3331.
- S. Reif, L. Braude, D. R. Lyman, R. H. Dougherty, A. S. Daniels, S. S. Ghose, O. Salim, and M. E. Delphin-Rittmon, “Peer Recovery Support for Individuals With Substance Use Disorders: Assessing the Evidence,” Psychiatric Services, vol. 65, no. 7, pp. 853–861, Jul. 2014, publisher: American Psychiatric Publishing. [Online]. Available: https://ps.psychiatryonline.org/doi/10.1176/appi.ps.201400047
- M. Leamy, V. Bird, C. L. Boutillier, J. Williams, and M. Slade, “Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis,” The British Journal of Psychiatry, vol. 199, no. 6, pp. 445–452, Dec. 2011.
- D. Best, J. Irving, B. Collinson, C. Andersson, and M. Edwards, “Recovery Networks and Community Connections: Identifying Connection Needs and Community Linkage Opportunities in Early Recovery Populations,” Alcoholism Treatment Quarterly, vol. 35, no. 1, pp. 2–15, Jan. 2017, publisher: Taylor & Francis _eprint: https://doi.org/10.1080/07347324.2016.1256718. [Online]. Available: https://doi.org/10.1080/07347324.2016.1256718
- C. for Behavioral Health Statistics and Quality, “Racial/Ethnic Differences in Substance Use, Substance Use Disorders, and Substance Use Treatment Utilization Among People Aged 12 or Older (2015-2019) | CBHSQ Data,” 2021. [Online]. Available: https://www.samhsa.gov/data/report/racialethnic-differences-substance-use
- O. T. Hall, A. Jordan, J. Teater, K. Dixon-Shambley, M. E. McKiever, M. Baek, S. Garcia, K. M. Rood, and D. A. Fielin, “Experiences of racial discrimination in the medical setting and associations with medical mistrust and expectations of care among black patients seeking addiction treatment,” Journal of Substance Abuse Treatment, vol. 133, Feb. 2022, publisher: Elsevier. [Online]. Available: https://www.jsatjournal.com/article/S0740-5472(21)00277-4/abstract
- E. Sahker, G. Pro, M. Sakata, and T. A. Furukawa, “Substance use improvement depends on Race/Ethnicity: Outpatient treatment disparities observed in a large US national sample,” Drug and Alcohol Dependence, vol. 213, p. 108087, Aug. 2020. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0376871620302520
- E. F. Wagner and J. A. Baldwin, “Recovery in Special Emphasis Populations,” Alcohol Research : Current Reviews, vol. 40, no. 3, p. 05, Dec. 2020. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7721369/
- C. K. Marino, “To belong, contribute, and hope: first stage development of a measure of social recovery,” Journal of Mental Health, vol. 24, no. 2, pp. 68–72, Mar. 2015, publisher: Routledge _eprint: https://doi.org/10.3109/09638237.2014.954696. [Online]. Available: https://doi.org/10.3109/09638237.2014.954696
- D. Pessach and E. Shmueli, “A Review on Fairness in Machine Learning,” ACM Computing Surveys, vol. 55, no. 3, pp. 1–44, Mar. 2023. [Online]. Available: https://dl.acm.org/doi/10.1145/3494672
- F. C. G. Polubriaginof, P. Ryan, H. Salmasian, A. W. Shapiro, A. Perotte, M. M. Safford, G. Hripcsak, S. Smith, N. P. Tatonetti, and D. K. Vawdrey, “Challenges with quality of race and ethnicity data in observational databases,” Journal of the American Medical Informatics Association: JAMIA, vol. 26, no. 8-9, pp. 730–736, Aug. 2019.