Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Stability-informed Bayesian Optimization for MPC Cost Function Learning (2404.12187v1)

Published 18 Apr 2024 in eess.SY, cs.LG, and cs.SY

Abstract: Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while considering closed-loop stability. We employ constrained Bayesian optimization to learn a model predictive controller's (MPC) cost function parametrized as a feedforward neural network, optimizing closed-loop behavior as well as minimizing model-plant mismatch. Doing so offers a high degree of freedom and, thus, the opportunity for efficient and global optimization towards the desired and optimal closed-loop behavior. We extend this framework by stability constraints on the learned controller parameters, exploiting the optimal value function of the underlying MPC as a Lyapunov candidate. The effectiveness of the proposed approach is underlined in simulations, highlighting its performance and safety capabilities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (17)
  1. A painless deterministic policy gradient method for learning-based MPC. In European Control Conference, 1–7.
  2. Safe learning of regions of attraction for uncertain, nonlinear systems with Gaussian processes. In Conference on Decision and Control, 4661–4666.
  3. Neural Lyapunov control. In Advances in Neural Information Processing Systems, volume 32.
  4. An introduction to nonlinear model predictive control. In 21st Benelux meeting on systems and control, volume 11, 119–141. Veldhoven.
  5. Garnett, R. (2023). Bayesian Optimization. Cambridge University Press.
  6. Gevers, M. (1993). Towards a joint design of identification and control? In Essays on Control: Perspectives in the Theory and its Applications, 111–151. Springer.
  7. Cautious model predictive control using Gaussian process regression. IEEE Transactions on Control Systems Technology, 28(6), 2736–2743.
  8. Reinforcement learning for MPC: Fundamentals and current challenges. In IFAC-PapersOnLine, volume 56, 5773–5780.
  9. Krishnamoorthy, D. (2023). On tuning parameterized control policies online for safety-critical systems – Applied to biomedical systems. In IFAC-PapersOnLine, volume 56, 5781–5786.
  10. Online learning-based model predictive control with Gaussian process models and stability guarantees. International Journal of Robust and Nonlinear Control, 31(18), 8785–8812.
  11. Performance-oriented model learning for control via multi-objective Bayesian optimization. Computers & Chemical Engineering, 162, 107770.
  12. A tutorial on derivative-free policy learning methods for interpretable controller representations. In American Control Conference, 1295–1306.
  13. Performance-oriented model learning for data-driven MPC design. IEEE Control Systems Letters, 3(3), 577–582.
  14. Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA.
  15. Model Predictive Control: Theory, Computation, and Design. Nob Hill Publishing, Madison, Wisconsin, 2nd edition.
  16. Convex neural network-based cost modifications for learning model predictive control. IEEE Open Journal of Control Systems, 1, 366–379.
  17. Safe reinforcement learning using robust MPC. IEEE Transactions on Automatic Control, 66(8), 3638–3652.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com