Characterize the appropriate design of participant feedback in automated officiating

Determine how much algorithmic feedback participants in challenge-based automated officiating systems should receive, in what form, and at what point during play, in order to shape participant understanding and behavior appropriately.

Background

Challenge-based ABS provides only sparse feedback because an automated ruling becomes visible when a player elects to challenge a call. The paper contrasts this limited feedback stream with full automated ball-strike systems, where every pitch produces an automated ruling that teams may use for calibration.

The authors identify an unresolved Sports HCI design question concerning the amount, format, and timing of algorithmic feedback. Answering it would help determine how automated officiating systems should expose information to umpires and players while accounting for calibration, strategic behavior, and the selective nature of review.

References

This raises a broader Sports HCI design question: how much algorithmic feedback should participants receive, in what form, and at what point in play?

— When the Strike Zone Becomes Algorithmic: Umpire Judgment and Player Challenge Decisions under AI Review  (2609.25525 - Lee et al., 22 Sep 2026) in Section 7.1, “Real-Time Feedback and Player Calibration”