Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Efficient model predictive control for nonlinear systems modelled by deep neural networks (2405.10372v1)

Published 16 May 2024 in eess.SY, cs.LG, cs.SY, and math.OC

Abstract: This paper presents a model predictive control (MPC) for dynamic systems whose nonlinearity and uncertainty are modelled by deep neural networks (NNs), under input and state constraints. Since the NN output contains a high-order complex nonlinearity of the system state and control input, the MPC problem is nonlinear and challenging to solve for real-time control. This paper proposes two types of methods for solving the MPC problem: the mixed integer programming (MIP) method which produces an exact solution to the nonlinear MPC, and linear relaxation (LR) methods which generally give suboptimal solutions but are much computationally cheaper. Extensive numerical simulation for an inverted pendulum system modelled by ReLU NNs of various sizes is used to demonstrate and compare performance of the MIP and LR methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Optimal control: linear quadratic methods. Courier Corporation.
  2. Askari, I. et al. (2022). Sampling-based nonlinear MPC of neural network dynamics with application to autonomous vehicle motion planning. In Proc. ACC (pp. 2084–2090). IEEE.
  3. Nonlinear mpc design for incrementally iss systems with application to gru networks. Automatica, 159, 111381.
  4. An incremental input-to-state stability condition for a class of recurrent neural networks. IEEE Trans. Autom. Control, 69, 2221–2236.
  5. D’Errico, J. (2023). fminsearchbnd, fminsearchcon. URL: https://www.mathworks.com/matlab central/fileexchange/8277-fminsearchbnd-fmin searchcon accessed: 2023-02-28.
  6. Gurobi Optimization, LLC (2023). Gurobi Optimizer Reference Manual. URL: https://www.gurobi.com.
  7. Efficient neural network verification via adaptive refinement and adversarial search. In Proc. ECAI20 (pp. 2513–2520). IOS Press.
  8. Stability and feasibility of neural network-based controllers via output range analysis. In Proc. IEEE Conf. Decis. Control (pp. 4947–4954). IEEE.
  9. Open-and closed-loop neural network verification using polynomial zonotopes. arXiv preprint arXiv:2207.02715, .
  10. Theory and computation of disturbance invariant sets for discrete-time linear systems. Mathematical Problems in Engineering, 4, 317–367.
  11. Robust model predictive control using tubes. Automatica, 40, 125–133.
  12. Ławryńczuk, M. (2010). Suboptimal nonlinear predictive control based on multivariable neural hammerstein models. Appl. Intell., 32, 173–192.
  13. Löfberg, J. (2004). YALMIP: A toolbox for modeling and optimization in MATLAB. In Proc. CACSD. volume 3.
  14. Machine learning in control systems: An overview of the state of the art. In Proc. Innov. Appl. Artif. Intell. Conf. (pp. 250–265). Springer.
  15. An iterative LQR controller for off-road and on-road vehicles using a neural network dynamics model. In Proc. IEEE IV (pp. 1740–1745). IEEE.
  16. Nonlinear internal model control strategy for neural network models. Comput. Chem. Eng., 16, 1039–1057.
  17. Dynamic state feedback controller and observer design for dynamic artificial neural network models. Automatica, 146, 110622.
  18. Patan, K. (2018). Two stage neural network modelling for robust model predictive control. ISA Trans., 72, 56–65.
  19. Model predictive control: theory, computation, and design volume 2. Nob Hill Publishing Madison, WI.
  20. Ren, Y. M. et al. (2022). A tutorial review of neural network modeling approaches for model predictive control. Comput. Chem. Eng., (p. 107956).
  21. Model predictive control with learned vehicle dynamics for autonomous vehicle path tracking. IEEE Access, 9, 128233–128249.
  22. Rossiter, J. A. (2003). Model-based predictive control: a practical approach. CRC press.
  23. Neural net based model predictive control. Int. J. Control, 54, 1453–1468.
  24. Salzmann, T. et al. (2023). Real-time neural MPC: Deep learning model predictive control for quadrotors and agile robotic platforms. IEEE Robot. Autom. Lett., 8, 2397–2404.
  25. Implementation of neural network based non-linear predictive control. Neurocomputing, 28, 37–51.
  26. Neural network model predictive motion control applied to automated driving with unknown friction. IEEE Trans. Control Syst. Technol., 30, 1934–1945.
  27. Spielberg, N. A. et al. (2019). Neural network vehicle models for high-performance automated driving. Sci. Robot., 4, eaaw1975.
  28. Tang, Y. et al. (2022). Perception and navigation in autonomous systems in the era of learning: A survey. IEEE Trans. Neural Netw. Learn. Syst., .
  29. Safe control with neural network dynamic models. In Learning for Dynamics and Control Conference (pp. 739–750). PMLR.
  30. Williams, G. et al. (2016). Information theoretic MPC using neural network dynamics. In Proc. NeurIPS.
  31. Jordan neural network for modelling and predictive control of dynamic systems. In Proc. MMAR (pp. 145–150). IEEE.
  32. Model predictive control of nonlinear systems with unmodeled dynamics based on feedforward and recurrent neural networks. IEEE Trans. Industr. Inform., 8, 746–756.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now