Best practices for leveraging usability studies in XAI

Determine effective methodologies for leveraging usability studies within the wider context of explainable artificial intelligence to evaluate and improve the interpretability and accessibility of explanations, including approaches such as standardized question banks and assessments of different query and modality types.

Background

The paper discusses the need to rigorously assess explanation quality and usability, especially for visualization methods and human-centered evaluation in XAI. While EC-based techniques can generate and assess explanations, a key gap remains in how to systematically use usability studies to measure whether users can interpret and trust explanations.

In this context, the authors note that the broader XAI community has proposed directions such as question banks and evaluating query/modality types, and they emphasize that these approaches can be adapted for EC to make explanations more accessible and useful to decision-makers.