Adaptability of LLM-Based Agents to Root Cause Analysis
Determine whether large language model-based agents can be effectively adapted to perform root cause analysis (RCA) of production incidents in cloud software systems.
References
Therefore, while LLM agents offer exceptional abilities that go far beyond prior approaches, it is unclear whether they can be effectively adapted to the RCA task.
A separately preregistered Direct-LLM arm did not complete held-out execution and is therefore documented in Appendix B and excluded from performance comparisons; as a result, this study does not establish that retrieval is necessary, only that retrieval architecture matters greatly among the arms that completed.
The observer does not attempt novelty prediction (its Layer~1 is, by construction, a regression engine; whether Layer~2 generalizes is an open measurement, \S\ref{sec:fn44}); it does not read components (4{,}000+ unit tests own those); it does not act on its verdicts (read-only; a human decides).