Quantitative effects of explainability modalities on user perceptions
Determine how different forms of explainability in AI systems quantitatively shape user perceptions.
References
Most prior studies are qualitative or theoretical, leaving open questions about how different forms of explainability quantitatively shape user perceptions.
Recognition alone leaves open how users evaluated the explanation.
Their clinical usefulness has not been assessed with practitioners. Whether the justifications improve a stockperson's decisions or their confidence in the system is an empirical question that requires a user study we have not carried out. We regard the lack of a user study as the most important gap between the present work and a validated claim of trustworthiness.
Which the over-trust branch should prefer is a question the present study cannot answer: establishing it requires distinguishing the effect of an explanation from that of a correction in the interaction logs, and that this is the obstacle rather than an insufficient number of events is itself part of what the instantiation shows.
Whether a separate device also changes what people notice is a question for a user study, which we have not run.