Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Evolutionary Multi-Objective Optimisation for Fairness-Aware Self Adjusting Memory Classifiers in Data Streams (2404.12076v1)

Published 18 Apr 2024 in cs.AI and cs.NE

Abstract: This paper introduces a novel approach, evolutionary multi-objective optimisation for fairness-aware self-adjusting memory classifiers, designed to enhance fairness in machine learning algorithms applied to data stream classification. With the growing concern over discrimination in algorithmic decision-making, particularly in dynamic data stream environments, there is a need for methods that ensure fair treatment of individuals across sensitive attributes like race or gender. The proposed approach addresses this challenge by integrating the strengths of the self-adjusting memory K-Nearest-Neighbour algorithm with evolutionary multi-objective optimisation. This combination allows the new approach to efficiently manage concept drift in streaming data and leverage the flexibility of evolutionary multi-objective optimisation to maximise accuracy and minimise discrimination simultaneously. We demonstrate the effectiveness of the proposed approach through extensive experiments on various datasets, comparing its performance against several baseline methods in terms of accuracy and fairness metrics. Our results show that the proposed approach maintains competitive accuracy and significantly reduces discrimination, highlighting its potential as a robust solution for fairness-aware data stream classification. Further analyses also confirm the effectiveness of the strategies to trigger evolutionary multi-objective optimisation and adapt classifiers in the proposed approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Salp chain-based optimization of support vector machines and feature weighting for medical diagnostic information systems. Evolutionary machine learning techniques: algorithms and applications, pages 11–34, 2020.
  2. Particle swarm optimization-based feature weighting for improving intelligent phishing website detection. IEEE Access, 8:116766–116780, 2020.
  3. jmetalpy: A python framework for multi-objective optimization with metaheuristics. Swarm and Evolutionary Computation, 51:100598, 2019. ISSN 2210-6502.
  4. Learning from time-changing data with adaptive windowing. In Proceedings of the 2007 SIAM international conference on data mining, pages 443–448. SIAM, 2007.
  5. Three naive bayes approaches for discrimination-free classification. Data mining and knowledge discovery, 21:277–292, 2010.
  6. Building classifiers with independency constraints. In 2009 IEEE International Conference on Data Mining Workshops, pages 13–18.
  7. Mitigating racial and ethnic bias and advancing health equity in clinical algorithms: A scoping review: Scoping review examines racial and ethnic bias in clinical algorithms. Health Affairs, 42(10):1359–1368, 2023.
  8. Kalyanmoy Deb. Multi-objective optimisation using evolutionary algorithms: an introduction. In Multi-objective evolutionary optimisation for product design and manufacturing, pages 3–34. Springer, London, 2011.
  9. Data-driven prediction in dynamical systems: recent developments. Philosophical Transactions of the Royal Society A, 380(2229):20210213, 2022.
  10. Adaptive random forests for evolving data stream classification. Machine Learning, 106(9):1469–1495, 2017.
  11. Machine learning for streaming data: state of the art, challenges, and opportunities. ACM SIGKDD Explorations Newsletter, 21(2):6–22, 2019.
  12. Equality of opportunity in supervised learning. Advances in neural information processing systems, 29, 2016.
  13. Postwar us business cycles: an empirical investigation. Journal of Money, credit, and Banking, pages 1–16, 1997.
  14. Evaluation and mitigation of racial bias in clinical machine learning models: scoping review. JMIR Medical Informatics, 10(5):e36388, 2022.
  15. Mining time-changing data streams. In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, pages 97–106, 2001.
  16. -online fairness-aware learning under class imbalance. In International Conference on Discovery Science, pages 159–174. Springer, 2020.
  17. Fairness-enhancing interventions in stream classification. In International Conference on Database and Expert Systems Applications, pages 261–276, 2019.
  18. Machine learning models for stock prediction using real-time streaming data. In International Conference on Biologically Inspired Techniques in Many-Criteria Decision Making, pages 101–108. Springer, 2020.
  19. Classifying without discriminating. In The 2nd international conference on computer, control and communication, pages 1–6, 2009.
  20. Ensemble learning for data stream analysis: A survey. Information Fusion, 37:132–156, 2017.
  21. A survey on datasets for fairness-aware machine learning. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, page e1452, 2022.
  22. Accuracy and fairness trade-offs in machine learning: A stochastic multi-objective approach. Computational Management Science, 19(3):513–537, 2022.
  23. Knn classifier with self-adjusting memory for heterogeneous concept drift. In 2016 IEEE 16th International Conference on data mining (ICDM), pages 291–300.
  24. A survey of swarm intelligence for dynamic optimization: Algorithms and applications. Swarm and Evolutionary Computation, 33:1–17, 2017.
  25. A survey on bias and fairness in machine learning. ACM computing surveys (CSUR), 54(6):1–35, 2021.
  26. Shikha Mehta et al. Concept drift in streaming data classification: algorithms, platforms and issues. Procedia computer science, 122:804–811, 2017.
  27. Smpso: A new pso-based metaheuristic for multi-objective optimization. In 2009 IEEE Symposium on computational intelligence in multi-criteria decision-making (MCDM), pages 66–73. IEEE, 2009.
  28. Feature weighting methods: A review. Expert Systems with Applications, 184:115424, 2021.
  29. Addressing fairness in classification with a model-agnostic multi-objective algorithm. In Uncertainty in artificial intelligence, pages 600–609. PMLR, 2021.
  30. System for analyzing crime news by mining live data streams with preserving data privacy. In Sentimental Analysis and Deep Learning: Proceedings of ICSADL 2021, pages 799–811. Springer, 2022.
  31. Swarm intelligence techniques in recommender systems-a review of recent research. Swarm and Evolutionary Computation, 48:201–219, 2019.
  32. A review on fairness in machine learning. ACM Computing Surveys (CSUR), 55(3):1–44, 2022.
  33. Fairness aware swarm-based machine learning for data streams. In Australasian Joint Conference on Artificial Intelligence, pages 205–219. Springer, 2022.
  34. Fairness optimisation with multi-objective swarms for explainable classifiers on data streams. Complex & Intelligent Systems, pages 1–14, 2024.
  35. Fairness optimisation with multi-objective swarms for explainable classifiers on data streams. accepted, January 2024.
  36. Fair feature subset selection using multiobjective genetic algorithm. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, pages 360–363, 2022.
  37. Mining concept-drifting data streams using ensemble classifiers. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 226–235, 2003.
  38. Dynamic extreme learning machine for data stream classification. Neurocomputing, 238:433–449, 2017.
  39. De2: dynamic ensemble of ensembles for learning nonstationary data. Neurocomputing, 165:14–22, 2015.
  40. A simple unlearning framework for online learning under concept drifts. In Advances in Knowledge Discovery and Data Mining: 20th Pacific-Asia Conference, PAKDD 2016, Auckland, New Zealand, April 19-22, 2016, Proceedings, Part I 20, pages 115–126. Springer, 2016.
  41. Towards fairness-aware multi-objective optimization. arXiv preprint arXiv:2207.12138, 2022.
  42. Fairer machine learning through multi-objective evolutionary learning. In International conference on artificial neural networks, pages 111–123. Springer, 2021.
  43. Mitigating unfairness via evolutionary multi-objective ensemble learning. IEEE Transactions on Evolutionary Computation, 2022.
  44. Feat: A fairness-enhancing and concept-adapting decision tree classifier. In International Conference on Discovery Science, pages 175–189, 2020.
  45. FAHT: An adaptive fairness-aware decision tree classifier. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), pages 1480–1486, 2019.
  46. Flexible and adaptive fairness-aware learning in non-stationary data streams. In 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), pages 399–406.
  47. A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Transactions on Evolutionary Computation, 19(6):761–776, 2014.
  48. Multiobjective evolutionary algorithms: A survey of the state of the art. Swarm and evolutionary computation, 1(1):32–49, 2011.
  49. Indrė Žliobaitė. Measuring discrimination in algorithmic decision making. Data Mining and Knowledge Discovery, 31(4):1060–1089, 2017.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Pivithuru Thejan Amarasinghe (2 papers)
  2. Diem Pham (1 paper)
  3. Binh Tran (9 papers)
  4. Su Nguyen (6 papers)
  5. Yuan Sun (117 papers)
  6. Damminda Alahakoon (8 papers)

Summary

We haven't generated a summary for this paper yet.