Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Approximate Dynamic Programming based Model Predictive Control of Nonlinear systems (2312.05952v1)

Published 10 Dec 2023 in eess.SY, cs.SY, and math.OC

Abstract: This paper studies the optimal control problem for discrete-time nonlinear systems and an approximate dynamic programming-based Model Predictive Control (MPC) scheme is proposed for minimizing a quadratic performance measure. In the proposed approach, the value function is approximated as a quadratic function for which the parametric matrix is computed using a switched system approximate of the nonlinear system. The approach is modified further using a multi-stage scheme to improve the control accuracy and an extension to incorporate state constraints. The MPC scheme is validated experimentally on a multi-tank system which is modeled as a third-order nonlinear system. The experimental results show the proposed MPC scheme results in significantly lesser online computation compared to the Nonlinear MPC scheme.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. K. Basil, C. Mark, “Model Predictive Control- Classical, Robust and Stochastic”, Springer, 2015.
  2. J. M. Lee and J. H. Lee, “Approximate dynamic programming-based approaches for input–output data-driven control of nonlinear processes”, Automatica, vol. 41, pp. 1281-1288, 2005.
  3. F. Lewis and D. Liu, “Reinforcement Learning and Approximate Dynamic Programming for Feedback Control”, John Wiley and Sons, 2012.
  4. P. Rokhforoz, H Kebriaei, and M. Ahmadabadi,“Large scale dynamic system optimization using dual decomposition method with approximate dynamic programming,” Systems and Control Letters, vol. 150, pp. 550-565, 2021.
  5. A. Keyser, H. Vansompel, and G. Crevecoeuri,“Real-Time Energy-Efficient Actuation of Induction Motor Drives Using Approximate Dynamic Programming,” IEEE Transactions on Industrial Electronics, vol. 68, 2021.
  6. J. M. Lee and J. H. Lee, “Approximate Dynamic Programming Strategies and Their Applicability for Process Control: A Review and Future Directions”, International Journal of Control, Automation, and Systems, vol. 3, pp. 263-278, 2004.
  7. L. Dong, J. Yan, X. Yuan, H. He, and C. Sun, “Functional Nonlinear Model Predictive Control Based on Adaptive Dynamic Programming”, IEEE Transactions On Cybernetics, vol. 49, pp. 23-35, 2019.
  8. N. Zhang, B. Leibowicz, and G. Hanasusanto, “Optimal Residential Battery Storage Operations Using Robust Data-Driven Dynamic Programming”, IEEE Transactions on Smart Grid, vol. 11, pp. 1771-1780, 2020.
  9. M. Park, K. Kalyanam, S. Darbha, P. Khargonekar, M. Pachter, and P. Chandler, “Optimal Residential Battery Storage Operations Using Robust Data-Driven Dynamic Programming”, IEEE Transactions on Automation Science and Engineering, vol. 13, pp. 564-578, 2016.
  10. T. Sun and X. Sun, “Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines”, IEEE Transactions on Industrial Informatics", vol. 17, pp. 367-376, 2021.
  11. B. Luo, D. Liu, T. Huang, and J. Liu, “Tracking Control Based on Adaptive Dynamic Programming With Multistep Policy Evaluation”, IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 49, pp. 2155-2165, 2019.
  12. X. Xu, C. Lian, L. Zuo, and H. He, “Kernel-Based Approximate Dynamic Programming for Real-Time Online Learning Control: An Experimental Study”, IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 22, pp. 146-156, 2014.
  13. H. Zhang, H. Su, K. Zhang, and Y. Luo, “Event-Triggered Adaptive Dynamic Programming for Non-Zero-Sum Games of Unknown Nonlinear Systems via Generalized Fuzzy Hyperbolic Models”, IEEE Transactions on Fuzzy Systems, vol. 27, pp. 2202-2214, 2019.
  14. D. Bertsekas, “Dynamic Programming and Optimal Control”, IEEE Transactions on Fuzzy Systems, Athena Scientific, 2005.
  15. D. Bertsekas, “Dynamic Programming and Optimal Control, Vol II: Approximate Dynamic Programming”, Athena Scientific, 2012.
  16. L. Grune and J. Pannek “Nonlinear Model Predictive Control Theory and Algorithms”, Springer, 2011.
  17. J. Liu, D. Pena, and P. Christofides, “Distributed Model Predictive Control of Nonlinear Process Systems”, AIChE Journal, vol. 55, pp. 1171-1184, 2009.
  18. M. Maiworm, D. Limon, and R. Findeisen, “Online learning-based model predictive control with Gaussian process models and stability guarantees”, International Journal of Robust and Nonlinear Control, vol. 31, pp. 8785-8812, 2020.
  19. M. Augustine and D. Patil, “A Practically Stabilizing Model Predictive Control Scheme for Switched Affine Systems,” IEEE Control System Letters, vol. 7, pp. 625-630, Sep. 2022.
  20. M. Augustine and D. Patil, “A Computationally efficient LQR based Model Predictive Control Scheme for Discrete-time Switched Linear Systems,”, 60t⁢hsuperscript60𝑡ℎ60^{th}60 start_POSTSUPERSCRIPT italic_t italic_h end_POSTSUPERSCRIPT IEEE Conference on Decision and Control, Texas, USA, Dec. 2021
  21. Inteco, “Multi-Tank User Manual,” Inteco Ltd, Krakow, 2003.
  22. W. Zhang, J. Hu and A. Abate,“Infinite-Horizon Switched LQR Problems in Discrete Time: A Suboptimal Algorithm With Performance Analysis,” IEEE Transactions on Automatic Control, vol. 57, no. 7, pp. 1815-1821, Jul. 2012.
  23. T. Geyer, G. Papafotiou, and M. Morari,“Hybrid model predictive control of the step-down dc-dc converter,” IEEE Transactions on Control Systems Technology, vol. 16, pp. 1112-1124, Nov. 2008.
  24. A. Forootani, R. Iervolino, M. Tipaldi, and J. Neilson,“Approximate Dynamic Programming for Stochastic Resource Allocation Problems,” IEEE/CAA Journal of Automatica Sinica, vol. 7, pp. 975-990, 2020.
  25. P. Beuchat, J. Warrington, and J. Lygeros,“Point Wise Maximum Approach to Approximate Dynamic Programming,” IEEE Transactions on Automatic Control, vol. 67, pp. 251-266, 2022.
  26. K. Chacko, S. Janardhanan, and I. Kar,“Computationally Efficient Nonlinear MPC for Discrete System with Disturbances,” International Journal of Control, Automation and Systems, vol. 15, 2022.
  27. K. Chacko, S. Janardhanan, and I. Kar,“Efficient Nonlinear Model Predictive Control for Discrete System with Disturbances,” Int. Conf. on Control, Automation, Robotics and Vision, Singapore, 2018.
  28. S. Huang, Z. Hu, G. Cao, G Jing, and Y. Liu,“Input-Constrained-Nonlinear-Dynamic-Model-Based Predictive Position Control of Planar Motors,” IEEE Transactions on Industrial Electronics, vol. 68, pp. 50-60, 2021.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now