Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Generating Formal Safety Assurances for High-Dimensional Reachability (2209.12336v3)

Published 25 Sep 2022 in cs.RO, cs.AI, cs.LG, cs.SY, and eess.SY

Abstract: Providing formal safety and performance guarantees for autonomous systems is becoming increasingly important. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification tool for providing these guarantees, since it can handle general nonlinear system dynamics, bounded adversarial system disturbances, and state and input constraints. However, it involves solving a PDE, whose computational and memory complexity scales exponentially with respect to the state dimensionality, making its direct use on large-scale systems intractable. A recently proposed method called DeepReach overcomes this challenge by leveraging a sinusoidal neural PDE solver for high-dimensional reachability problems, whose computational requirements scale with the complexity of the underlying reachable tube rather than the state space dimension. Unfortunately, neural networks can make errors and thus the computed solution may not be safe, which falls short of achieving our overarching goal to provide formal safety assurances. In this work, we propose a method to compute an error bound for the DeepReach solution. This error bound can then be used for reachable tube correction, resulting in a safe approximation of the true reachable tube. We also propose a scenario-based optimization approach to compute a probabilistic bound on this error correction for general nonlinear dynamical systems. We demonstrate the efficacy of the proposed approach in obtaining probabilistically safe reachable tubes for high-dimensional rocket-landing and multi-vehicle collision-avoidance problems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. J. Lygeros, “On reachability and minimum cost optimal control,” Automatica, vol. 40, no. 6, pp. 917–927, 2004.
  2. I. Mitchell, A. Bayen, and C. J. Tomlin, “A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games,” IEEE Transactions on Automatic Control (TAC), vol. 50, no. 7, pp. 947–957, 2005.
  3. S. Bansal, M. Chen, S. Herbert, and C. J. Tomlin, “Hamilton-Jacobi Reachability: A brief overview and recent advances,” in IEEE Conference on Decision and Control (CDC), 2017.
  4. M. R. Greenstreet and I. Mitchell, “Integrating projections,” in Hybrid Systems: Computation and Control, T. A. Henzinger and S. Sastry, Eds.   Berlin, Heidelberg: Springer Berlin Heidelberg, 1998, pp. 159–174.
  5. G. Frehse, C. Le Guernic, A. Donzé, S. Cotton, R. Ray, O. Lebeltel, R. Ripado, A. Girard, T. Dang, and O. Maler, “SpaceEx: Scalable verification of hybrid systems,” in International Conference Computer Aided Verification, 2011.
  6. A. B. Kurzhanski and P. Varaiya, “Ellipsoidal techniques for reachability analysis: internal approximation,” Systems & Control Letters, 2000.
  7. A. Kurzhanski and P. Varaiya, “On ellipsoidal techniques for reachability analysis. part ii: Internal approximations box-valued constraints,” Optimization Methods and Software, vol. 17, pp. 207–237, 01 2002.
  8. J. N. Maidens, S. Kaynama, I. M. Mitchell, M. M. Oishi, and G. A. Dumont, “Lagrangian methods for approximating the viability kernel in high-dimensional systems,” Automatica, 2013.
  9. A. Girard, “Reachability of uncertain linear systems using zonotopes,” in International Workshop on Hybrid Systems: Computation and Control, 2005, pp. 291–305.
  10. M. Althoff, O. Stursberg, and M. Buss, “Computing reachable sets of hybrid systems using a combination of zonotopes and polytopes,” Nonlinear analysis: hybrid systems, vol. 4, no. 2, pp. 233–249, 2010.
  11. S. Bak, H.-D. Tran, and T. T. Johnson, “Numerical verification of affine systems with up to a billion dimensions,” in International Conference on Hybrid Systems: Computation and Control, 2019, pp. 23–32.
  12. P. Nilsson and N. Ozay, “Synthesis of separable controlled invariant sets for modular local control design,” in American Control Conference, 2016, pp. 5656–5663.
  13. A. Majumdar, R. Vasudevan, M. M. Tobenkin, and R. Tedrake, “Convex optimization of nonlinear feedback controllers via occupation measures,” The International Journal of Robotics Research, vol. 33, no. 9, pp. 1209–1230, 2014. [Online]. Available: https://doi.org/10.1177/0278364914528059
  14. A. Majumdar and R. Tedrake, “Funnel libraries for real-time robust feedback motion planning,” The International Journal of Robotics Research, vol. 36, no. 8, pp. 947–982, 2017.
  15. T. Dreossi, T. Dang, and C. Piazza, “Parallelotope bundles for polynomial reachability,” in International Conference on Hybrid Systems: Computation and Control, 2016.
  16. D. Henrion and M. Korda, “Convex computation of the region of attraction of polynomial control systems,” IEEE Transactions on Automatic Control, vol. 59, no. 2, pp. 297–312, 2014.
  17. S. Coogan and M. Arcak, “Efficient finite abstraction of mixed monotone systems,” in Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control, 2015, pp. 58–67.
  18. Y. T. Chow, J. Darbon, S. Osher, and W. Yin, “Algorithm for overcoming the curse of dimensionality for time-dependent non-convex hamilton–jacobi equations arising from optimal control and differential games problems,” Journal of Scientific Computing, vol. 73, no. 2-3, pp. 617–643, 2017.
  19. S. Bansal and C. J. Tomlin, “DeepReach: A deep learning approach to high-dimensional reachability,” in IEEE International Conference on Robotics and Automation (ICRA), 2021.
  20. V. Rubies-Royo, D. Fridovich-Keil, S. Herbert, and C. J. Tomlin, “A classification-based approach for approximate reachability,” in International Conference on Robotics and Automation.   IEEE, 2019, pp. 7697–7704.
  21. J. F. Fisac, N. F. Lugovoy, V. Rubies-Royo, S. Ghosh, and C. J. Tomlin, “Bridging Hamilton-Jacobi Safety Analysis and Reinforcement Learning,” International Conference on Robotics and Automation, 2019.
  22. B. Djeridane and J. Lygeros, “Neural approximation of pde solutions: An application to reachability computations,” in Conference on Decision and Control, 2006, pp. 3034–3039.
  23. K. Niarchos and J. Lygeros, “A neural approximation to continuous time reachability computations,” in Conference on Decision and Control, 2006, pp. 6313–6318.
  24. J. Darbon, G. P. Langlois, and T. Meng, “Overcoming the curse of dimensionality for some hamilton–jacobi partial differential equations via neural network architectures,” Research in the Mathematical Sciences, vol. 7, no. 3, pp. 1–50, 2020.
  25. D. Onken, L. Nurbekyan, X. Li, S. W. Fung, S. Osher, and L. Ruthotto, “A neural network approach for high-dimensional optimal control applied to multiagent path finding,” IEEE Transactions on Control Systems Technology, 2022.
  26. S. Ghosh, S. Bansal, A. Sangiovanni-Vincentelli, S. A. Seshia, and C. Tomlin, “A new simulation metric to determine safe environments and controllers for systems with unknown dynamics,” in Proceedings of the 22nd ACM International Conference on Hybrid Systems: Computation and Control, 2019, pp. 185–196.
  27. M. C. Campi and S. Garatti, “A sampling-and-discarding approach to chance-constrained optimization: feasibility and optimality,” Journal of Optimization Theory and Applications, 2011.
  28. G. C. Calafiore and M. C. Campi, “The scenario approach to robust control design,” IEEE Transactions on Automatic Control, 2006.
  29. M. C. Campi, S. Garatti, and M. Prandini, “The scenario approach for systems and control design,” Annual Reviews in Control, 2009.
  30. A. Lin and S. Bansal, “Generating formal safety assurances for high-dimensional reachability,” arXiv preprint arXiv:2209.12336, 2022.
Citations (16)

Summary

We haven't generated a summary for this paper yet.