Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Framework for Safe Probabilistic Invariance Verification of Stochastic Dynamical Systems (2404.09007v2)

Published 13 Apr 2024 in eess.SY and cs.SY

Abstract: Ensuring safety through set invariance has proven to be a valuable method in various robotics and control applications. This paper introduces a comprehensive framework for the safe probabilistic invariance verification of both discrete- and continuous-time stochastic dynamical systems over an infinite time horizon. The objective is to ascertain the lower and upper bounds of liveness probabilities for a given safe set and set of initial states. The liveness probability signifies the likelihood of the system remaining within the safe set indefinitely, starting from a state in the initial set. To address this problem, we propose optimizations for verifying safe probabilistic invariance in discrete-time and continuous-time stochastic dynamical systems. These optimizations are constructed via either using the Doob's nonnegative supermartingale inequality-based method or relaxing the equations described in [30,32], which can precisely characterize the probability of reaching a target set while avoiding unsafe states. Finally, we demonstrate the effectiveness of these optimizations through several examples using semi-definite programming tools.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Approximate model checking of stochastic hybrid systems. European Journal of Control, 16(6):624–641, 2010.
  2. Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems. Automatica, 44(11):2724–2734, 2008.
  3. k-inductive barrier certificates for stochastic systems. In 25th ACM International Conference on Hybrid Systems: Computation and Control, pages 1–11, 2022.
  4. M. ApS. Mosek optimization toolbox for matlab. User’s Guide and Reference Manual, Version, 4, 2019.
  5. A. Chakarov and S. Sankaranarayanan. Probabilistic program analysis with martingales. In Computer Aided Verification: 25th International Conference, CAV 2013, Saint Petersburg, Russia, July 13-19, 2013. Proceedings 25, pages 511–526. Springer, 2013.
  6. Stochastic satisfiability modulo theory: A novel technique for the analysis of probabilistic hybrid systems. In Hybrid Systems: Computation and Control: 11th International Workshop, HSCC 2008, St. Louis, MO, USA, April 22-24, 2008. Proceedings 11, pages 172–186. Springer, 2008.
  7. Computing probabilistic controlled invariant sets. IEEE Transactions on Automatic Control, 66(7):3138–3151, 2020.
  8. On a correspondence between probabilistic and robust invariant sets for linear systems. In 2018 European Control Conference (ECC), pages 1642–1647. IEEE, 2018.
  9. Temporal logic verification of stochastic systems using barrier certificates. In International Symposium on Automated Technology for Verification and Analysis, pages 177–193. Springer, 2018.
  10. Probabilistic set invariance and ultimate boundedness. Automatica, 48(10):2670–2676, 2012.
  11. Continuous-time probabilistic ultimate bounds and invariant sets: Computation and assignment. Automatica, 71:98–105, 2016.
  12. H. J. Kushner. Stochastic stability and control. Technical report, Brown Univ Providence RI, 1967.
  13. Automated verification and synthesis of stochastic hybrid systems: A survey. Automatica, 146:110617, 2022.
  14. Y. Nishimura and K. Hoshino. Control barrier functions for stochastic systems with quantitative evaluation of probability. arXiv preprint arXiv:2209.08728, 2022.
  15. B. Oksendal. Stochastic differential equations: an introduction with applications. Springer Science & Business Media, 2013.
  16. Stochastic safety verification using barrier certificates. In 2004 43rd IEEE conference on decision and control (CDC)(IEEE Cat. No. 04CH37601), volume 1, pages 929–934. IEEE, 2004.
  17. A framework for worst-case and stochastic safety verification using barrier certificates. IEEE Transactions on Automatic Control, 52(8):1415–1428, 2007.
  18. S. Prajna and A. Rantzer. Convex programs for temporal verification of nonlinear dynamical systems. SIAM Journal on Control and Optimization, 46(3):999–1021, 2007.
  19. Invariant approximations of the minimal robust positively invariant set. IEEE Transactions on Automatic Control, 50(3):406–410, 2005.
  20. Verification and control for finite-time safety of stochastic systems via barrier functions. In 2019 IEEE conference on control technology and applications (CCTA), pages 712–717. IEEE, 2019.
  21. A barrier function approach to finite-time stochastic system verification and control. Automatica, 125:109439, 2021.
  22. J. Steinhardt and R. Tedrake. Finite-time regional verification of stochastic non-linear systems. The International Journal of Robotics Research, 31(7):901–923, 2012.
  23. W. Tan and A. Packard. Stability region analysis using polynomial and composite polynomial lyapunov functions and sum-of-squares programming. IEEE Transactions on Automatic Control, 53(2):565–571, 2008.
  24. I. Tkachev and A. Abate. On infinite-horizon probabilistic properties and stochastic bisimulation functions. In 2011 50th IEEE Conference on Decision and Control and European Control Conference, pages 526–531. IEEE, 2011.
  25. I. Tkachev and A. Abate. Characterization and computation of infinite-horizon specifications over markov processes. Theoretical Computer Science, 515:1–18, 2014.
  26. J. Ville. Etude critique de la notion de collectif. 1939.
  27. Safety-critical control of stochastic systems using stochastic control barrier functions. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 5924–5931. IEEE, 2021.
  28. B. Xue. A new framework for bounding reachability probabilities of continuous-time stochastic systems. arXiv preprint arXiv:2312.15843, 2023.
  29. Reach-avoid analysis for stochastic discrete-time systems. In 2021 American Control Conference (ACC), pages 4879–4885. IEEE, 2021.
  30. B. Xue and N. Zhan. Robust invariant sets computation for discrete-time perturbed nonlinear systems. IEEE Transactions on Automatic Control, 67(2):1053–1060, 2021.
  31. Reach-avoid analysis for polynomial stochastic differential equations. IEEE Transactions on Automatic Control, 2023.
  32. Safe probabilistic invariance verification for stochastic discrete-time dynamical systems. In 2023 62nd IEEE Conference on Decision and Control (CDC), pages 5175–5181.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now