Bounding Stochastic Safety: Leveraging Freedman's Inequality with Discrete-Time Control Barrier Functions (2403.05745v5)
Abstract: When deployed in the real world, safe control methods must be robust to unstructured uncertainties such as modeling error and external disturbances. Typical robust safety methods achieve their guarantees by always assuming that the worst-case disturbance will occur. In contrast, this paper utilizes Freedman's inequality in the context of discrete-time control barrier functions (DTCBFs) and c-martingales to provide stronger (less conservative) safety guarantees for stochastic systems. Our approach accounts for the underlying disturbance distribution instead of relying exclusively on its worst-case bound and does not require the barrier function to be upper-bounded, which makes the resulting safety probability bounds more directly useful for intuitive safety constraints such as signed distance. We compare our results with existing safety guarantees, such as input-to-state safety (ISSf) and martingale results that rely on Ville's inequality. When the assumptions for all methods hold, we provide a range of parameters for which our guarantee is stronger. Finally, we present simulation examples, including a bipedal walking robot, that demonstrate the utility and tightness of our safety guarantee.
- A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada, “Control Barrier Function Based Quadratic Programs for Safety Critical Systems,” IEEE Transactions on Automatic Control, vol. 62, pp. 3861–3876, Aug. 2017.
- S. Kolathaya and A. D. Ames, “Input-to-State Safety With Control Barrier Functions,” IEEE Control Systems Letters, vol. 3, Jan. 2019.
- S. Bansal, M. Chen, S. Herbert, and C. J. Tomlin, “Hamilton-jacobi reachability: A brief overview and recent advances,” in 2017 IEEE 56th Annual Conference on Decision and Control (CDC), 2017.
- Cambridge University Press, 2017.
- Code Code Repository for this work:. https://github.com/rkcosner/freedman.git.
- A. Abate, M. Prandini, J. Lygeros, and S. Sastry, “Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems,” Automatica, vol. 44, 2008.
- M. Fränzle, E. M. Hahn, H. Hermanns, N. Wolovick, and L. Zhang, “Measurability and safety verification for stochastic hybrid systems,” pp. 43–52, 2011. 14th international conference on Hybrid systems: computation and control.
- M. P. Chapman, R. Bonalli, K. M. Smith, I. Yang, M. Pavone, and C. J. Tomlin, “Risk-sensitive safety analysis using conditional value-at-risk,” IEEE Transactions on Automatic Control, vol. 67, 2021.
- L. Lindemann, N. Matni, and G. J. Pappas, “Stl robustness risk over discrete-time stochastic processes,” in 2021 60th IEEE Conference on Decision and Control (CDC), pp. 1329–1335, IEEE, 2021.
- J. Steinhardt and R. Tedrake, “Finite-time regional verification of stochastic non-linear systems,” The International Journal of Robotics Research, vol. 31, pp. 901–923, June 2012.
- C. Santoyo, M. Dutreix, and S. Coogan, “A barrier function approach to finite-time stochastic system verification and control,” Automatica, vol. 125, p. 109439, Mar. 2021.
- O. So, A. Clark, and C. Fan, “Almost-sure safety guarantees of stochastic zero-control barrier functions do not hold,” 2023. arXiv:2312.02430.
- M. Black, G. Fainekos, B. Hoxha, D. Prokhorov, and D. Panagou, “Safety under uncertainty: Tight bounds with risk-aware control barrier functions,” in IEEE International Conference on Robotics and Automation (ICRA), 2023.
- H. Kushner, “Stochastic Stability and Control.,” 1967. Academic Press.
- S. Prajna, A. Jadbabaie, and G. J. Pappas, “Stochastic safety verification using barrier certificates,” in 2004 43rd IEEE conference on decision and control (CDC), vol. 1, pp. 929–934, IEEE, 2004.
- R. Cosner, P. Culbertson, A. Taylor, and A. Ames, “Robust Safety under Stochastic Uncertainty with Discrete-Time Control Barrier Functions,” in Proceedings of Robotics: Science and Systems, 2023.
- C. Santoyo, M. Dutreix, and S. Coogan, “Verification and control for finite-time safety of stochastic systems via barrier functions,” in IEEE Conference on Control Technology and Applications (CCTA), 2019.
- F. B. Mathiesen, L. Romao, S. C. Calvert, A. Abate, and L. Laurenti, “Inner approximations of stochastic programs for data-driven stochastic barrier function design,” in 2023 62nd IEEE Conference on Decision and Control (CDC), pp. 3073–3080, 2023.
- R. K. Cosner, I. Sadalski, J. K. Woo, P. Culbertson, and A. D. Ames, “Generative modeling of residuals for real-time risk-sensitive safety with discrete-time control barrier functions,” May 2023.
- J. Ville, “Etude critique de la notion de collectif,” 1939.
- D. A. Freedman, “On tail probabilities for martingales,” the Annals of Probability, pp. 100–118, 1975.
- O. Khatib, “Real-time obstacle avoidance for manipulators and mobile robots,” The international journal of robotics research, 1986.
- A. Agrawal and K. Sreenath, “Discrete Control Barrier Functions for Safety-Critical Control of Discrete Systems with Application to Bipedal Robot Navigation,” in Robotics: Science and Systems XIII, July 2017.
- J. Breeden, K. Garg, and D. Panagou, “Control Barrier Functions in Sampled-Data Systems,” IEEE Control Systems Letters, vol. 6, pp. 367–372, 2022. Conference Name: IEEE Control Systems Letters.
- J. Zeng, B. Zhang, and K. Sreenath, “Safety-Critical Model Predictive Control with Discrete-Time Control Barrier Function,” in 2021 American Control Conference (ACC), pp. 3882–3889, IEEE, May 2021.
- M. Ahmadi, A. Singletary, J. W. Burdick, and A. D. Ames, “Safe Policy Synthesis in Multi-Agent POMDPs via Discrete-Time Barrier Functions,” in 2019 IEEE Conference on Decision and Control (CDC).
- P. Culbertson, R. K. Cosner, M. Tucker, and A. D. Ames, “Input-to-State Stability in Probability,” 2023. IEEE Conference on Decision and Control (CDC).
- G. Grimmett and D. Stirzaker, Probability and Random Processes. Oxford University Press, July 2020.
- X. Fan, I. Grama, and Q. Liu, “Hoeffding’s inequality for supermartingales,” Stochastic Processes and their Applications, 2012.
- Extended version of this paper: https://arxiv.org/pdf/2403.05745.pdf.
- X. Xiong and A. Ames, “3-d underactuated bipedal walking via h-lip based gait synthesis and stepping stabilization,” IEEE Transactions on Robotics, vol. 38, no. 4, pp. 2405–2425, 2022.
- R. Freeman, “Global internal stabilizability does not imply global external stabilizability for small sensor disturbances,” IEEE Transactions on Automatic Control, vol. 40, pp. 2119–2122, Dec. 1995. Conference Name: IEEE Transactions on Automatic Control.
- J. Tropp, “Freedman’s inequality for matrix martingales,” Electronic Communications in Probability, vol. 16, no. none, pp. 262 – 270, 2011.
- T. Popoviciu, “Sur les équations algébriques ayant toutes leurs racines réelles,” Mathematica, vol. 9, no. 129-145, p. 20, 1935.