Balancing risk-model scope and granularity

Determine how AI risk models should balance comprehensive coverage of the potential risk universe against sufficiently fine-grained representation of causal pathways within individual risk scenarios.

Background

Frontier-AI risk landscapes contain many possible scenarios, while detailed causal models require substantial data and structural assumptions. Broad models may omit important pathways and underestimate aggregate risk, whereas highly granular models may become difficult to parameterize and overly sensitive to weak evidence. The paper identifies the appropriate balance between coverage and detail as a fundamental unresolved design problem.

References

An open question in AI risk modeling, and risk modeling more broadly, is how to balance scope and granularity.

Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling  (2609.03178 - Jackson et al., 2 Sep 2026) in Section 4.2, “Model Scope and Granularity”