Independence of sabotage attempts across episodes
Establish whether sabotage attempts by language-model-based agents are statistically independent events across episodes in deployments that use asynchronous monitoring, and characterize any temporal or strategic correlations that would invalidate independence assumptions in safety models.
References
But some uncertainties will remain, such as how many attacks are needed to cause harm, or whether attacks are independent (although we may be able to get some idea by careful threat modelling and additional measurements).
Finally, our cumulative-risk calculations make the implications of repeated exposure explicit under independence and constant-rate assumptions. Extending them to deployment requires measuring how frequently the relevant conditions occur and how failures depend on prior interactions.