Distribution shifts from sim2real gaps and controller–abstraction coupling

Address distribution shifts in statistical verification and control caused by (i) simulation-to-reality gaps and (ii) couplings between controllers and statistical abstractions that induce dependence and shift between calibration and deployment data; develop methods to quantify, compensate for, or guarantee safety under such shifts.

Background

Conformal prediction relies on exchangeability between calibration and test data. In practice, calibration often comes from simulators, leading to sim2real gaps, and control policies may affect the data used to build abstractions, creating couplings that break independence.

The authors emphasize dealing with these shifts as core open problems to enable reliable formal verification and control in realistic deployments.

References

Some of the open problems here, as already discussed in this article, are to deal with distribution shifts caused by: (1) sim2real gaps that arise in practice, and (2) couplings between the controllers and statistical abstractions and hence in dealing with distribution shifts.

— Formal Verification and Control with Conformal Prediction  (2409.00536 - Lindemann et al., 2024) in Section 7, Open Problems and Future Directions

By \cref{def:scope} a certificate holds over one mission distribution and one set of model versions. Nothing here says how fast it decays as a deployment drifts, which is the quantity an operator actually needs to know when deciding how often to recertify.

— Agent Behavioral Contracts II: Certifying Compositional Reliability Without Assuming Independence  (2608.12895 - Bhardwaj et al., 13 Aug 2026) in Section 7, “Future Work,” paragraph “Certificate decay”; see also Section 6, “Limitations”

The evaluation is in simulation. The sim-to-real gap for language-model control of this kind has not been quantified in any published study, and is not addressed here.

— Large reasoning models for abnormal situation management in safety-critical industrial processes  (2608.19819 - Alhazmi, 20 Aug 2026) in Discussion, paragraph beginning “Several limitations bound these claims.”
  1. Or architect for it. Where the sampling process is under your control, exchangeability can be manufactured, at a price paid in coordination or adaptivity. Quantifying that price across settings is open.
— The Exceedance Design Effect: Effective Sample Size for Thresholds under Clustering  (2608.21262 - Noonan, 21 Aug 2026) in Section 8, item 8, p. 29