Papers
Topics
Authors
Recent
Search
2000 character limit reached

Learning Performance Maximizing Ensembles with Explainability Guarantees

Published 20 Dec 2023 in stat.ML and cs.LG | (2312.12715v2)

Abstract: In this paper we propose a method for the optimal allocation of observations between an intrinsically explainable glass box model and a black box model. An optimal allocation being defined as one which, for any given explainability level (i.e. the proportion of observations for which the explainable model is the prediction function), maximizes the performance of the ensemble on the underlying task, and maximizes performance of the explainable model on the observations allocated to it, subject to the maximal ensemble performance condition. The proposed method is shown to produce such explainability optimal allocations on a benchmark suite of tabular datasets across a variety of explainable and black box model types. These learned allocations are found to consistently maintain ensemble performance at very high explainability levels (explaining $74\%$ of observations on average), and in some cases even outperforming both the component explainable and black box models while improving explainability.

Authors (2)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. Neural additive models: Interpretable machine learning with neural nets. Advances in neural information processing systems, 34: 4699–4711.
  2. Learning Hybrid Interpretable Models: Theory, Taxonomy, and Methods. arXiv preprint arXiv:2303.04437.
  3. Validation of clinical classification schemes for predicting stroke: results from the National Registry of Atrial Fibrillation. Jama, 285(22): 2864–2870.
  4. An adaptive ensemble machine learning model for intrusion detection. Ieee Access, 7: 82512–82521.
  5. Explaining the explainer: A first theoretical analysis of LIME. In International conference on artificial intelligence and statistics, 1287–1296. PMLR.
  6. Why do tree-based models still outperform deep learning on typical tabular data? Advances in Neural Information Processing Systems, 35: 507–520.
  7. A review of explainable deep learning cancer detection models in medical imaging. Applied Sciences, 11(10): 4573.
  8. Inoue, H. 2019. Adaptive ensemble prediction for deep neural networks based on confidence level. In The 22nd International Conference on Artificial Intelligence and Statistics, 1284–1293. PMLR.
  9. LassoNet: Neural Networks with Feature Sparsity. In Banerjee, A.; and Fukumizu, K., eds., Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, volume 130 of Proceedings of Machine Learning Research, 10–18. PMLR.
  10. Explainable ai: A review of machine learning interpretability methods. Entropy, 23(1): 18.
  11. A unified approach to interpreting model predictions. Advances in neural information processing systems, 30.
  12. Adaptive classification for prediction under a budget. Advances in neural information processing systems, 30.
  13. From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai. ACM Computing Surveys.
  14. Interpretable companions for black-box models. In International conference on artificial intelligence and statistics, 2444–2454. PMLR.
  15. ” Why should i trust you?” Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 1135–1144.
  16. Rudin, C. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature machine intelligence, 1(5): 206–215.
  17. Protopshare: Prototype sharing for interpretable image classification and similarity discovery. arXiv preprint arXiv:2011.14340.
  18. Explainable Artificial Intelligence for Tabular Data: A Survey. IEEE Access, 9: 135392–135422.
  19. Trading interpretability for accuracy: Oblique treed sparse additive models. In Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 1245–1254.
  20. Local supervised learning through space partitioning. Advances in Neural Information Processing Systems, 25.
  21. Wang, T. 2019. Gaining free or low-cost interpretability with interpretable partial substitute. In International Conference on Machine Learning, 6505–6514. PMLR.
  22. Hybrid predictive models: When an interpretable model collaborates with a black-box model. The Journal of Machine Learning Research, 22(1): 6085–6122.
  23. Wide residual networks. arXiv preprint arXiv:1605.07146.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up