Dice Question Streamline Icon: https://streamlinehq.com

Distribution shifts from sim2real gaps and controller–abstraction coupling

Address distribution shifts in statistical verification and control caused by (i) simulation-to-reality gaps and (ii) couplings between controllers and statistical abstractions that induce dependence and shift between calibration and deployment data; develop methods to quantify, compensate for, or guarantee safety under such shifts.

Information Square Streamline Icon: https://streamlinehq.com

Background

Conformal prediction relies on exchangeability between calibration and test data. In practice, calibration often comes from simulators, leading to sim2real gaps, and control policies may affect the data used to build abstractions, creating couplings that break independence.

The authors emphasize dealing with these shifts as core open problems to enable reliable formal verification and control in realistic deployments.

References

Some of the open problems here, as already discussed in this article, are to deal with distribution shifts caused by: (1) sim2real gaps that arise in practice, and (2) couplings between the controllers and statistical abstractions and hence in dealing with distribution shifts.

Formal Verification and Control with Conformal Prediction (2409.00536 - Lindemann et al., 31 Aug 2024) in Section 7, Open Problems and Future Directions