Harmonic Control Lyapunov Barrier Functions for Constrained Optimal Control with Reach-Avoid Specifications (2310.02869v2)
Abstract: This paper introduces harmonic control Lyapunov barrier functions (harmonic CLBF) that aid in constrained control problems such as reach-avoid problems. Harmonic CLBFs exploit the maximum principle that harmonic functions satisfy to encode the properties of control Lyapunov barrier functions (CLBFs). As a result, they can be initiated at the start of an experiment rather than trained based on sample trajectories. The control inputs are selected to maximize the inner product of the system dynamics with the steepest descent direction of the harmonic CLBF. Numerical results are presented with four different systems under different reach-avoid environments. Harmonic CLBFs show a significantly low risk of entering unsafe regions and a high probability of entering the goal region.
- Dario Amodei Alex Ray, Joshua Achiam. Benchmarking safe exploration in deep reinforcement learning. OpenAI, 2019.
- Harmonic function theory, volume 137. Springer Science & Business Media, 2013.
- Reinforcement learning for safety-critical control under model uncertainty, using control lyapunov functions and control barrier functions. arXiv preprint arXiv:2004.07584, 2020.
- Path planning using laplace’s equation. In Proceedings., IEEE International Conference on Robotics and Automation, pages 2102–2106. IEEE, 1990.
- Safe nonlinear control using robust neural lyapunov-barrier functions. In 5th Annual Conference on Robot Learning, 2021.
- Reinforcement learning for safe robot control using control Lyapunov barrier functions, 2023.
- Escaping from saddle points — online stochastic gradient for tensor decomposition, 2015.
- Elliptic Partial Differential Equations of Second Order, Second Edition. Springer-Verlag, 1983.
- Towards a framework for realizable safety critical control through active set invariance. In 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS), pages 98–106. IEEE, 2018.
- Emergence of locomotion behaviours in rich environments. arXiv preprint arXiv:1707.02286, 2017.
- Ching-An Cheng Hoai-An Nguyen. Provable reset-free reinforcement learning by no-regret reduction. International Conference on Machine Learning, 2023.
- Real-time obstacle avoidance using harmonic potential functions. IEEE Transactions on Robotics and Automation, June 1992.
- Gradient descent converges to minimizers, 2016.
- A. Logg and G. N. Wells. Dolfin: Automated finite element computing. ACM Transactions on Mathematical Software 37, 2010.
- Modern Robotics: Mechanics, Planning, and Control. Cambridge University Press, 2017.
- Smooth converse lyapunov-barrier theorems for asymptotic stability with safety constraints and reach-avoid-stay specifications. Automatica, 144:110478, 2022.
- Maximum Principles in Differential Equations. Springer, 1984.
- S. Kawamura S. Akishita and K. Hayashi. Laplace potential for moving obstacle avoidance and approach of a mobile robot. In I990 Japan-USA Symposium on Flexible Automation, A Pacific Rim Conference, 1990.
- Reinforcement learning: An introduction. MIT press, 2018.
- A Yanushauskas. The zeros of the gradient and the hessian of an harmonic function. Siberian Mathematical Journal, 10(3):497–501, 1969.
- Safe-control-gym: A unified benchmark suite for safe learning-based control and reinforcement learning in robotics. IEEE Robotics and Automation Letters, 7(4):11142–11149, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.