Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A New Framework for Bounding Reachability Probabilities of Continuous-time Stochastic Systems (2312.15843v1)

Published 26 Dec 2023 in eess.SY and cs.SY

Abstract: This manuscript presents an innovative framework for constructing barrier functions to bound reachability probabilities for continuous-time stochastic systems described by stochastic differential equations (SDEs). The reachability probabilities considered in this paper encompass two aspects: the probability of reaching a set of specified states within a predefined finite time horizon, and the probability of reaching a set of specified states at a particular time instant. The barrier functions presented in this manuscript are developed either by relaxing a parabolic partial differential equation that characterizes the exact reachability probability or by applying the Gr\"onwall's inequality. In comparison to the prevailing construction method, which relies on Doob's non-negative supermartingale inequality (or Ville's inequality), the proposed barrier functions provide stronger alternatives, complement existing methods, or fill gaps.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. Stochastic reachability as an exit problem. In 2009 17th Mediterranean Conference on Control and Automation, pages 1026–1031. IEEE, 2009.
  2. JL Doob. Jean ville, étude critique de la notion de collectif. 1939.
  3. The stochastic reach-avoid problem and set characterization for diffusions. Automatica, 70:43–56, 2016.
  4. Unbounded-time safety verification of stochastic differential dynamics. In International Conference on Computer Aided Verification, pages 327–348. Springer, 2020.
  5. Stochastic satisfiability modulo theory: A novel technique for the analysis of probabilistic hybrid systems. In International Workshop on Hybrid Systems: Computation and Control, pages 172–186. Springer, 2008.
  6. Pedestrian route-choice and activity scheduling theory and models. Transportation Research Part B: Methodological, 38(2):169–190, 2004.
  7. Stochastic differential equations. Springer, 1992.
  8. Computational methods for verification of stochastic hybrid systems. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 38(2):385–396, 2008.
  9. Harold Joseph Kushner. Stochastic stability and control, volume 33. Academic press New York, 1967.
  10. Automated verification and synthesis of stochastic hybrid systems: A survey. Automatica, 146:110617, 2022.
  11. Lyapunov-like conditions for tight exit probability bounds through comparison theorems for sdes. In 2020 American Control Conference (ACC), pages 5175–5181. IEEE, 2020.
  12. Pablo A Parrilo. Semidefinite programming relaxations for semialgebraic problems. Mathematical programming, 96:293–320, 2003.
  13. Stochastic safety verification using barrier certificates. In 2004 43rd IEEE conference on decision and control (CDC)(IEEE Cat. No. 04CH37601), volume 1, pages 929–934. IEEE, 2004.
  14. A framework for worst-case and stochastic safety verification using barrier certificates. IEEE Transactions on Automatic Control, 52(8):1415–1428, 2007.
  15. A barrier function approach to finite-time stochastic system verification and control. Automatica, 125:109439, 2021.
  16. Finite-time regional verification of stochastic non-linear systems. The International Journal of Robotics Research, 31(7):901–923, 2012.
  17. Safety-critical control of stochastic systems using stochastic control barrier functions. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 5924–5931. IEEE, 2021.
  18. Long-term stability analysis of power systems with wind power based on stochastic differential equations: Model development and foundations. IEEE Transactions on Sustainable Energy, 6(4):1534–1542, 2015.
  19. Bai Xue. Reachability verification for stochastic discrete-time dynamical systems. arXiv preprint arXiv:2302.09843, 2023.
  20. Bai Xue. Safe exit controllers synthesis for continuous-time stochastic systems. arXiv preprint arXiv:2310.05088, 2023.
  21. Inner-approximating reachable sets for polynomial systems with time-varying uncertainties. IEEE Transactions on Automatic Control, 65(4):1468–1483, 2019.
  22. Reach-avoid analysis for stochastic discrete-time systems. In 2021 American Control Conference (ACC), pages 4879–4885. IEEE, 2021.
  23. Reach-avoid analysis for polynomial stochastic differential equations. IEEE Transactions on Automatic Control, 2023.
Citations (3)

Summary

We haven't generated a summary for this paper yet.