A New Framework for Bounding Reachability Probabilities of Continuous-time Stochastic Systems (2312.15843v1)
Abstract: This manuscript presents an innovative framework for constructing barrier functions to bound reachability probabilities for continuous-time stochastic systems described by stochastic differential equations (SDEs). The reachability probabilities considered in this paper encompass two aspects: the probability of reaching a set of specified states within a predefined finite time horizon, and the probability of reaching a set of specified states at a particular time instant. The barrier functions presented in this manuscript are developed either by relaxing a parabolic partial differential equation that characterizes the exact reachability probability or by applying the Gr\"onwall's inequality. In comparison to the prevailing construction method, which relies on Doob's non-negative supermartingale inequality (or Ville's inequality), the proposed barrier functions provide stronger alternatives, complement existing methods, or fill gaps.
- Stochastic reachability as an exit problem. In 2009 17th Mediterranean Conference on Control and Automation, pages 1026–1031. IEEE, 2009.
- JL Doob. Jean ville, étude critique de la notion de collectif. 1939.
- The stochastic reach-avoid problem and set characterization for diffusions. Automatica, 70:43–56, 2016.
- Unbounded-time safety verification of stochastic differential dynamics. In International Conference on Computer Aided Verification, pages 327–348. Springer, 2020.
- Stochastic satisfiability modulo theory: A novel technique for the analysis of probabilistic hybrid systems. In International Workshop on Hybrid Systems: Computation and Control, pages 172–186. Springer, 2008.
- Pedestrian route-choice and activity scheduling theory and models. Transportation Research Part B: Methodological, 38(2):169–190, 2004.
- Stochastic differential equations. Springer, 1992.
- Computational methods for verification of stochastic hybrid systems. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 38(2):385–396, 2008.
- Harold Joseph Kushner. Stochastic stability and control, volume 33. Academic press New York, 1967.
- Automated verification and synthesis of stochastic hybrid systems: A survey. Automatica, 146:110617, 2022.
- Lyapunov-like conditions for tight exit probability bounds through comparison theorems for sdes. In 2020 American Control Conference (ACC), pages 5175–5181. IEEE, 2020.
- Pablo A Parrilo. Semidefinite programming relaxations for semialgebraic problems. Mathematical programming, 96:293–320, 2003.
- Stochastic safety verification using barrier certificates. In 2004 43rd IEEE conference on decision and control (CDC)(IEEE Cat. No. 04CH37601), volume 1, pages 929–934. IEEE, 2004.
- A framework for worst-case and stochastic safety verification using barrier certificates. IEEE Transactions on Automatic Control, 52(8):1415–1428, 2007.
- A barrier function approach to finite-time stochastic system verification and control. Automatica, 125:109439, 2021.
- Finite-time regional verification of stochastic non-linear systems. The International Journal of Robotics Research, 31(7):901–923, 2012.
- Safety-critical control of stochastic systems using stochastic control barrier functions. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 5924–5931. IEEE, 2021.
- Long-term stability analysis of power systems with wind power based on stochastic differential equations: Model development and foundations. IEEE Transactions on Sustainable Energy, 6(4):1534–1542, 2015.
- Bai Xue. Reachability verification for stochastic discrete-time dynamical systems. arXiv preprint arXiv:2302.09843, 2023.
- Bai Xue. Safe exit controllers synthesis for continuous-time stochastic systems. arXiv preprint arXiv:2310.05088, 2023.
- Inner-approximating reachable sets for polynomial systems with time-varying uncertainties. IEEE Transactions on Automatic Control, 65(4):1468–1483, 2019.
- Reach-avoid analysis for stochastic discrete-time systems. In 2021 American Control Conference (ACC), pages 4879–4885. IEEE, 2021.
- Reach-avoid analysis for polynomial stochastic differential equations. IEEE Transactions on Automatic Control, 2023.