A Framework for Data-Driven Explainability in Mathematical Optimization (2308.08309v2)
Abstract: Advancements in mathematical programming have made it possible to efficiently tackle large-scale real-world problems that were deemed intractable just a few decades ago. However, provably optimal solutions may not be accepted due to the perception of optimization software as a black box. Although well understood by scientists, this lacks easy accessibility for practitioners. Hence, we advocate for introducing the explainability of a solution as another evaluation criterion, next to its objective value, which enables us to find trade-off solutions between these two criteria. Explainability is attained by comparing against (not necessarily optimal) solutions that were implemented in similar situations in the past. Thus, solutions are preferred that exhibit similar features. Although we prove that already in simple cases the explainable model is NP-hard, we characterize relevant polynomially solvable cases such as the explainable shortest path problem. Our numerical experiments on both artificial as well as real-world road networks show the resulting Pareto front. It turns out that the cost of enforcing explainability can be very small.
- Synchronization and Diversity of Solutions. Proceedings of the AAAI Conference on Artificial Intelligence, 37(10): 11516–11524.
- On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one, 10(7): e0130140.
- Mathematical Optimization Modelling for Group Counterfactual Explanations. Technical report, IMUS, Sevilla, Spain.
- Algorithms and uncertainty sets for data-driven robust shortest path problems. European Journal of Operational Research, 274(2): 671–686.
- Towards an argumentation-based approach to explainable planning. In ICAPS 2019 Workshop XAIP Program Chairs.
- Explainable interactive evolutionary multiobjective optimization. Available at SSRN 3792994.
- Schedule Explainer: An Argumentation-Supported Tool for Interactive Explanations in Makespan Scheduling. In International Workshop on Explainable, Transparent Autonomous Agents and Multi-Agent Systems, 243–259. Springer.
- Argumentation for Explainable Scheduling. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01): 2752–2759.
- Explainable k-means and k-medians clustering. In Proceedings of the 37th International Conference on Machine Learning, Vienna, Austria, 12–18.
- Explainable artificial intelligence: A survey. In 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 0210–0215.
- Explainable dynamic programming. Journal of Functional Programming, 31.
- Explainable Data-Driven Optimization: From Context to Decision and Back Again. arXiv:2301.10074.
- The directed subgraph homeomorphism problem. Theoretical Computer Science, 10(2): 111–121.
- Computers and intractability. W. H. Freeman.
- A framework for inherently interpretable optimization models. European Journal of Operational Research, 310(3): 1312–1324.
- The Price of Explainability for Clustering. arXiv preprint arXiv:2304.09743.
- Gurobi Optimization, LLC. 2023. Gurobi Optimizer Reference Manual.
- Solving Explainability Queries with Quantification: The Case of Feature Relevancy. Proceedings of the AAAI Conference on Artificial Intelligence, 37(4): 3996–4006.
- The LRP Toolbox for Artificial Neural Networks. Journal of Machine Learning Research, 17(114): 1–5.
- A survey of data-driven and knowledge-aware explainable ai. IEEE Transactions on Knowledge and Data Engineering, 34(1): 29–49.
- Fairness over time in dynamic resource allocation with an application in healthcare. Mathematical Programming, 111–121.
- Delivering Trustworthy AI through Formal XAI. Proceedings of the AAAI Conference on Artificial Intelligence, 36(11): 12342–12350.
- Integer programming formulation of traveling salesman problems. Journal of the ACM (JACM), 7(4): 326–329.
- Miller, T. 2021. Contrastive explanation: A structural-model approach. The Knowledge Engineering Review, 36.
- Towards explainable interactive multiobjective optimization: R-XIMO. Autonomous Agents and Multi-Agent Systems, 36(2): 43.
- Argument-based plan explanation. In Knowledge Engineering Tools and Techniques for AI Planning, 173–188. Springer.
- Rudin, C. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5): 206–215.
- Towards Explainable Artificial Intelligence. In Samek, W.; Montavon, G.; Vedaldi, A.; Hansen, L. K.; and Müller, K.-R., eds., Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, 5–22. Cham: Springer International Publishing.
- Toward explainable multi-objective probabilistic planning. In 2018 IEEE/ACM 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS), 19–25. IEEE.
- Fairness and Explainability: Bridging the Gap Towards Fair Model Explanations. Proceedings of the AAAI Conference on Artificial Intelligence, 37(9): 11363–11371.