Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Bayesian Formal Synthesis of Unknown Systems via Robust Simulation Relations (2304.07428v2)

Published 14 Apr 2023 in eess.SY, cs.LO, and cs.SY

Abstract: This paper addresses the problem of data-driven computation of controllers that are correct by design for safety-critical systems and can provably satisfy (complex) functional requirements. With a focus on continuous-space stochastic systems with parametric uncertainty, we propose a two-stage approach that decomposes the problem into a learning stage and a robust formal controller synthesis stage. The first stage utilizes available Bayesian regression results to compute robust credible sets for the true parameters of the system. For the second stage, we introduce methods for systems subject to both stochastic and parametric uncertainties. We provide simulation relations for enabling correct-by-design control refinement that are founded on coupling uncertainties of stochastic systems via sub-probability measures. The presented relations are essential for constructing abstract models that are related to not only one model but to a set of parameterized models. The results are demonstrated on three case studies, including a nonlinear and a high-dimensional system.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Formal control synthesis for stochastic neural network dynamic models. IEEE Control Systems Letters, 6:2858–2863, 2022.
  2. Data-driven controller synthesis via finite abstractions with formal guarantees. IEEE Control Systems Letters, 7:3453–3458, 2023.
  3. C. W. Axelrod. Managing the risks of cyber-physical systems. In LISAT 2013. IEEE, 2013.
  4. Probabilities are not enough: Formal controller synthesis for stochastic dynamical models with epistemic uncertainty. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 14701–14710, 2023.
  5. C. Baier and J.-P. Katoen. Principles of Model Checking. MIT Press, 2008.
  6. Formal methods for discrete-time dynamical systems, volume 15. Springer, 2017.
  7. C. M. Bishop. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer-Verlag, Berlin, Heidelberg, 2006.
  8. V. I. Bogachev. Measure theory. Springer Science & Business Media, 2007.
  9. V. S. Borkar. Probability theory: An advanced course. Springer Science & Business Media, 2012.
  10. Efficient learning of hyperrectangular invariant sets using Gaussian processes. IEEE Open Journal of Control Systems, 1:223–236, 2022.
  11. N. Cauchi and A. Abate. Benchmarks for cyber-physical systems: A modular model library for building automation systems. IFAC-PapersOnLine, 51(16):49–54, 2018.
  12. V. Chew. Confidence, prediction, and tolerance regions for the multivariate normal distribution. Journal of the American Statistical Association, 61(315):605–617, 1966.
  13. Robust control barrier functions for nonlinear control systems with uncertainty: A duality-based approach. In 2022 IEEE 61st Conference on Decision and Control (CDC), pages 174–179. IEEE, 2022.
  14. Practical and rigorous uncertainty bounds for Gaussian process regression. In AAAI, 2021.
  15. Linear temporal logic and linear dynamic logic on finite traces. IJCAI International Joint Conference on Artificial Intelligence, pages 854–860, 2013.
  16. A. Girard and G. J. Pappas. Hierarchical control system design using approximate simulation. Automatica, 45(2):566–571, 2009.
  17. A. Girard and G. J. Pappas. Approximate bisimulation: A bridge between computer science and control theory. European Journal of Control, 17(5-6):568–578, 2011.
  18. Temporal logic control of POMDPs via label-based stochastic simulation relations. IFAC-PapersOnLine, 51(16):271–276, 2018.
  19. S. Haesaert and S. Soudjani. Robust dynamic programming for temporal logic control of stochastic systems. IEEE Transactions on Automatic Control, 2020.
  20. Verification of general Markov decision processes by approximate similarity relations and policy refinement. SIAM Journal on Control and Optimization, 55(4):2333–2367, 2017.
  21. Data-driven and model-based verification via Bayesian identification and reachability analysis. Automatica, 79:115–126, 2017.
  22. Towards manipulation planning with temporal logic specifications. In 2015 IEEE International Conference on Robotics and Automation (ICRA), pages 346–352. IEEE, 2015.
  23. Mona: Monadic second-order logic in practice. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 1019, pages 89–110. Springer Verlag, 1995.
  24. Safety verification of unknown dynamical systems via Gaussian process regression. In 2020 59th IEEE Conference on Decision and Control (CDC), pages 860–866, 2020.
  25. Control barrier functions for unknown nonlinear systems using Gaussian processes. In 2020 59th IEEE Conference on Decision and Control (CDC), pages 3699–3704. IEEE, 2020.
  26. E. T. Jaynes and O. Kempthorne. Confidence Intervals vs Bayesian Intervals, pages 175–257. Springer Netherlands, Dordrecht, 1976.
  27. Safe learning for uncertainty-aware planning via interval MDP abstraction. IEEE Control Systems Letters, 6:2641–2646, 2022.
  28. Data-driven abstraction-based control synthesis. Nonlinear Analysis: Hybrid Systems, 52:101467, 2024.
  29. K. J. Keesman. System identification: An introduction, volume 2. Springer, 2011.
  30. Wiener’s polynomial chaos for the analysis and control of nonlinear dynamical systems with probabilistic uncertainties [historical perspectives]. IEEE Control Systems Magazine, 33(5):58–67, 2013.
  31. O. Kupferman and M. Y. Vardi. Model checking of safety properties. Formal Methods in System Design, 19(3):291–314, 2001.
  32. Automated verification and synthesis of stochastic hybrid systems: A survey. Automatica, 146:110617, 2022.
  33. T. Lew and M. Pavone. Sampling-based reachability analysis: A random set theory approach with adversarial sampling. In Conference on Robot Learning, pages 2055–2070. PMLR, 2021.
  34. Risk of stochastic systems for temporal logic specifications. ACM Transactions on Embedded Computing Systems, 22(3):1–31, 2023.
  35. Unmatched control barrier functions: Certainty equivalence adaptive safety. In 2023 American Control Conference (ACC), pages 3662–3668. IEEE, 2023.
  36. Efficient data-driven abstraction of monotone systems with disturbances. IFAC-PapersOnLine, 54(5):49–54, 2021.
  37. O. Maler and D. Nickovic. Monitoring temporal properties of continuous signals. In International Symposium on Formal Techniques in Real-Time and Fault-Tolerant Systems, pages 152–166. Springer, 2004.
  38. G. Pan and T. Faulwasser. Distributionally robust uncertainty quantification via data-driven stochastic optimal control. IEEE Control Systems Letters, 7:3036–3041, 2023.
  39. Part-X: A family of stochastic algorithms for search-based test generation with probabilistic guarantees. IEEE Transactions on Automation Science and Engineering, 2023.
  40. A framework for worst-case and stochastic safety verification using barrier certificates. IEEE Transactions on Automatic Control, 52(8):1415–1428, 2007.
  41. Statistical verification using surrogate models and conformal inference and a comparison with risk-aware verification. ACM Transactions on Cyber-Physical Systems, 2024.
  42. Gaussian Processes for Machine Learning, volume 1. Springer, 2006.
  43. Promises of deep kernel learning for control synthesis. IEEE Control Systems Letters, 2023.
  44. Distributionally robust optimal and safe control of stochastic systems via kernel conditional mean embedding. In 2023 62nd IEEE Conference on Decision and Control (CDC), pages 2016–2021, 2023.
  45. Data-driven verification and synthesis of stochastic systems via barrier certificates. Automatica, 159:111323, 2024.
  46. Correct-by-design control of parametric stochastic systems. In 2022 IEEE 61st Conference on Decision and Control (CDC), pages 5580–5587, 2022.
  47. Verifying the unknown: Correct-by-design control synthesis for networks of stochastic uncertain systems. In 2023 62nd IEEE Conference on Decision and Control (CDC), pages 7035–7042, 2023.
  48. Bayesian polynomial chaos.
  49. Reinforcement Learning: An Introduction. A Bradford Book, Cambridge, MA, USA, 2018.
  50. P. Tabuada. Verification and Control of Hybrid Systems: A Symbolic Approach. Springer, 2009.
  51. Data-driven chance constrained control using kernel distribution embeddings. In Learning for Dynamics and Control Conference, pages 790–802. PMLR, 2022.
  52. P. M. Van Den Hof and R. J. Schrama. Identification and control–closed-loop issues. Automatica, 31(12):1751–1770, 1995.
  53. SySCoRe: Synthesis via stochastic coupling relations. In Proceedings of the 26th ACM International Conference on Hybrid Systems: Computation and Control, pages 1–11, 2023.
  54. Similarity quantification for linear stochastic systems: A coupling compensator approach. Automatica, 144:110476, 2022.
  55. LTLf synthesis on probabilistic systems. In Electronic Proceedings in Theoretical Computer Science, EPTCS, volume 326, pages 166–181, 2020.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now