Decision-theoretic integration of clarification value and cost for long-horizon agents
Develop a decision-theoretic framework that integrates the value of information obtained from clarifying questions with the costs of user interaction—specifically interruption, latency, and trust costs—to optimally determine when a long-horizon workflow agent should ask for clarification versus proceed autonomously.
References
Toward this goal, we study the value of information and the cost of corresponding questions separately, with their integration into a decision-theoretic framework left for future work.
This paper focuses on single-turn clarification; extending CLAIM to multi-turn interaction requires explicit dialogue-state tracking, history-dependent uncertainty estimation, and planning over future turns, which we leave for future work.
A workflow can therefore be technically valid while no longer representing exactly what the user asked for. The present release should consequently be viewed as an inspectable, validation-gated route for constructing a bounded class of collider-simulation workflows requiring expert approval, not as an autonomous replacement for scientific judgement or an operating-system sandbox. The most important next step is to make the interaction with the user more reliable when the request is incomplete or inconsistent, particularly through explicit clarification and stronger preservation of scientific intent. Within this scope, the results support combining LLMs with deterministic grounding and workflow construction, while also showing that reliable preservation of scientific intent remains the principal unresolved boundary.
Pedagogical correspondence is partly interpretive, however, so when and what educators should confirm remains an empirical question rather than a fixed checkpoint schedule.
In particular, it remains unclear whether an agent actually recovers formulation-critical missing requirements and whether it knows when enough information has been obtained to proceed.