Expanding Agent Autonomy While Preserving Production Reliability

Develop systematic approaches to relax constraints on AI agent execution environments and autonomy in production deployments while preserving safety guarantees and production-level reliability, including clear pathways to incrementally increase agent freedom without degrading correctness or trustworthiness.

Background

The paper finds that reliability is the dominant development challenge for deployed agents, leading practitioners to tightly constrain agent autonomy, operate in restricted environments, and rely on human oversight. Production agents typically execute few autonomous steps and follow structured workflows to maintain controllability and correctness.

Within this context, the authors highlight a gap: although constrained designs enable current deployments, the field lacks systematic methods to expand agent autonomy without sacrificing reliability and safety. They explicitly flag this as an open question that must be addressed to advance agent capabilities in real-world settings.

References

An open question remains: how can future agents expand autonomy while maintaining production-level reliability? The field has not established clear pathways for systematically relaxing these constraints while preserving safety guarantees.

— Measuring Agents in Production (2512.04123 - Pan et al., 2 Dec 2025) in Discussion, Subsection: Reliability Through Constrained Deployment