Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Data-Driven Distributionally Robust Safety Verification Using Barrier Certificates and Conditional Mean Embeddings (2403.10497v1)

Published 15 Mar 2024 in eess.SY, cs.LG, and cs.SY

Abstract: Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches. To design systems with rigorous guarantees, many approaches still rely on exact models of the underlying systems. Since this assumption can rarely be met in practice, models have to be inferred from measurement data or are bypassed completely. Whilst former usually requires the model structure to be known a-priori and immense amounts of data to be available, latter gives rise to a plethora of restrictive mathematical assumptions about the unknown dynamics. In a pursuit of developing scalable formal verification algorithms without shifting the problem to unrealistic assumptions, we employ the concept of barrier certificates, which can guarantee safety of the system, and learn the certificate directly from a compact set of system trajectories. We use conditional mean embeddings to embed data from the system into a reproducing kernel Hilbert space (RKHS) and construct an RKHS ambiguity set that can be inflated to robustify the result w.r.t. a set of plausible transition kernels. We show how to solve the resulting program efficiently using sum-of-squares optimization and a Gaussian process envelope. Our approach lifts the need for restrictive assumptions on the system dynamics and uncertainty, and suggests an improvement in the sample complexity of verifying the safety of a system on a tested case study compared to a state-of-the-art approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. C. Baier and J.-P. Katoen. Principles of Model Checking. MIT Press, 2008.
  2. Formal methods for discrete-time dynamical systems, volume 15. Springer, 2017.
  3. A. Berlinet and C. Thomas-Agnan. Reproducing Kernel Hilbert Spaces in Probability and Statistics. Kluwer Academic, Boston, 2004.
  4. V. I. Bogachev. Measure theory. Springer Science & Business Media, 2007.
  5. J. A. Chekan and C. Langbort. Safety-aware learning-based control of systems with uncertainty dependent constraints. In 2023 American Control Conference (ACC), pages 1264–1270, 2023.
  6. Robust control barrier functions for nonlinear control systems with uncertainty: A duality-based approach. In Proceedings of the IEEE Conference on Decision and Control, volume 2022-Decem, pages 174–179, aug 2022.
  7. H. Dette and A. A. Zhigljavsky. Reproducing kernel Hilbert spaces, polynomials, and the classical moment problem. SIAM-ASA Journal on Uncertainty Quantification, 9(4):1589–1614, 2021.
  8. Distributionally robust strategy synthesis for switched stochastic systems. In Proceedings of the 26th ACM International Conference on Hybrid Systems: Computation and Control, pages 1–10, 2023.
  9. A kernel two-sample test. Journal of Machine Learning Research, 13(25):723–773, 2012.
  10. Safety verification of unknown dynamical systems via Gaussian process regression. In 2020 59th IEEE Conference on Decision and Control (CDC), pages 860–866. IEEE, 2020.
  11. Control barrier functions for unknown nonlinear systems using Gaussian processes. In Proceedings of the IEEE Conference on Decision and Control, volume 2020-Decem, pages 3699–3704, oct 2020.
  12. Formal synthesis of stochastic systems via control barrier certificates. IEEE Transactions on Automatic Control, 66(7):3097–3110, 2021.
  13. Gaussian processes and kernel methods: A review on connections and equivalences. arXiv:1807.02582, 2018.
  14. Data-driven abstraction-based control synthesis. Nonlinear Analysis: Hybrid Systems, 52:101467, 2024.
  15. M. Kazemi and S. Soudjani. Formal policy synthesis for continuous-state systems via reinforcement learning. In Integrated Formal Methods: 16th International Conference, IFM 2020, Lugano, Switzerland, November 16–20, 2020, Proceedings 16, pages 3–21. Springer, 2020.
  16. A rigorous theory of conditional mean embeddings. SIAM Journal on Mathematics of Data Science, 2(3):583–606, 2020.
  17. H. J. Kushner and Kushner. Stochastic stability and control, volume 33. Academic press New York, 1967.
  18. Formal controller synthesis for continuous-space MDPs via model-free reinforcement learning. In 2020 ACM/IEEE 11th International Conference on Cyber-Physical Systems (ICCPS), pages 98–107, 2020.
  19. Automated verification and synthesis of stochastic hybrid systems: A survey. Automatica, 146:110617, 2022.
  20. Optimal rates for regularized conditional mean embedding learning. Advances in Neural Information Processing Systems, 35:4433–4445, 2022.
  21. Learning hybrid control barrier functions from data. In Conference on Robot Learning, pages 1351–1370. PMLR, 2021.
  22. Unmatched control barrier functions: Certainty equivalence adaptive safety. In 2023 American Control Conference (ACC), pages 3662–3668, 2023.
  23. Data-driven models of monotone systems. IEEE Transactions on Automatic Control, 2023.
  24. H. Q. Minh. Some properties of Gaussian reproducing kernel Hilbert spaces and their implications for function approximation and learning theory. Constructive Approximation, 32(2):307–338, dec 2010.
  25. Maximum mean discrepancy distributionally robust nonlinear chance-constrained optimization with finite-sample guarantee. In 2022 IEEE 61st Conference on Decision and Control (CDC), pages 5660–5667, 2022.
  26. SOSTOOLS: Sum of squares optimization toolbox for MATLAB. http://arxiv.org/abs/1310.4716, 2013. Available from http://www.eng.ox.ac.uk/control/sostools.
  27. J. Park and K. Muandet. A measure-theoretic approach to kernel conditional mean embeddings. In Advances in Neural Information Processing Systems, volume 2020-Decem, pages 21247–21259, 2020.
  28. P. A. Parrilo. Semidefinite programming relaxations for semialgebraic problems. Mathematical Programming, Series B, 96(2):293–320, may 2003.
  29. S. Prajna. Barrier certificates for nonlinear model validation. Automatica, 42(1):117–126, 2006.
  30. R. Rajamani. Vehicle dynamics and control. Springer Science & Business Media, 2011.
  31. Gaussian Processes for Machine Learning. The MIT Press, 11 2005.
  32. Distributionally robust optimal and safe control of stochastic systems via kernel conditional mean embedding. In 2023 62nd IEEE Conference on Decision and Control (CDC), pages 2016–2021, 2023.
  33. Data-driven verification and synthesis of stochastic systems via barrier certificates. Automatica, 159:111323, 2024.
  34. B. Schölkopf and A. J. Smola. Learning with kernels: Support vector machines, regularization, optimization, and beyond. MIT press, 2002.
  35. Bayesian formal synthesis of unknown systems via robust simulation relations. arXiv:2304.07428, 2023.
  36. A Hilbert space embedding for distributions. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 4754 LNAI, pages 13–31, 2007.
  37. Hilbert space embeddings of conditional distributions with applications to dynamical systems. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML ’09, page 961–968, New York, NY, USA, 2009. Association for Computing Machinery.
  38. I. Steinwart and A. Christmann. Support Vector Machines. Information Science and Statistics. Springer New York, New York, NY, 2008.
  39. Multi-objective compositions for collision-free connectivity maintenance in teams of mobile robots. In 2016 IEEE 55th Conference on Decision and Control, CDC 2016, pages 2659–2664, aug 2016.
  40. Safe learning of quadrotor dynamics using barrier certificates. In Proceedings - IEEE International Conference on Robotics and Automation, pages 2460–2465, oct 2018.
  41. Formal synthesis of controllers for safety-critical autonomous systems: Developments and challenges. arXiv:2402.13075, 2024.
  42. Formal verification of unknown stochastic systems via non-parametric estimation. International Conference on Artificial Intelligence and Statistics (AISTATS), 2024.
Citations (4)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets