A Tutorial on Gaussian Process Learning-based Model Predictive Control (2404.03689v1)
Abstract: This tutorial provides a systematic introduction to Gaussian process learning-based model predictive control (GP-MPC), an advanced approach integrating Gaussian process (GP) with model predictive control (MPC) for enhanced control in complex systems. It begins with GP regression fundamentals, illustrating how it enriches MPC with enhanced predictive accuracy and robust handling of uncertainties. A central contribution of this tutorial is the first detailed, systematic mathematical formulation of GP-MPC in literature, focusing on deriving the approximation of means and variances propagation for GP multi-step predictions. Practical applications in robotics control, such as path-following for mobile robots in challenging terrains and mixed-vehicle platooning, are discussed to demonstrate the real-world effectiveness and adaptability of GP-MPC. This tutorial aims to make GP-MPC accessible to researchers and practitioners, enriching the learning-based control field with in-depth theoretical and practical insights and fostering further innovations in complex system control.
- L. Brunke, M. Greeff, A. W. Hall, Z. Yuan, S. Zhou, J. Panerati, and A. P. Schoellig, “Safe learning in robotics: From learning-based control to safe reinforcement learning,” Annual Review of Control, Robotics, and Autonomous Systems, vol. 5, pp. 411–444, 2022.
- L. Hewing, K. P. Wabersich, M. Menner, and M. N. Zeilinger, “Learning-based model predictive control: Toward safe learning in control,” Annual Review of Control, Robotics, and Autonomous Systems, vol. 3, pp. 269–296, 2020.
- J. Wang, M. T. Fader, and J. A. Marshall, “Learning-based model predictive control for improved mobile robot path following using Gaussian processes and feedback linearization,” Journal of Field Robotics, vol. 40, pp. 1014–1033, 2023.
- X. Wang, Y. Jin, S. Schmitt, and M. Olhofer, “Recent advances in Bayesian optimization,” ACM Computing Surveys, vol. 55, no. 13s, pp. 1–36, 2023.
- J. Wang, “An intuitive tutorial to Gaussian process regression,” Computing in Science & Engineering, vol. 25, no. 4, pp. 4–11, 2023.
- Y. He and Y. Zhao, “Adaptive robust control of uncertain Euler–Lagrange systems using Gaussian processes,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- A. Khalid, Z. Mushtaq, S. Arif, K. Zeb, M. A. Khan, and S. Bakshi, “Control schemes for quadrotor UAV: Taxonomy and survey,” ACM Computing Surveys, vol. 56, no. 5, pp. 1–32, 2023.
- V. Deshpande and Y. Zhang, “Fault-tolerant model predictive control of a fixed-wing UAV with actuator fault estimation,” Guidance, Navigation and Control, vol. 1, no. 04, p. 2140006, 2021.
- T. Chevet, C. Vlad, C. S. Maniu, and Y. Zhang, “Decentralized MPC for UAVs formation deployment and reconfiguration with multiple outgoing agents,” Journal of Intelligent & Robotic Systems, vol. 97, no. 1, pp. 155–170, 2020.
- J. Wang, Z. Jiang, and Y. V. Pant, “Improving safety in mixed traffic: A learning-based model predictive control for autonomous and human-driven vehicle platooning,” Knowledge-Based Systems, vol. 293, p. 111673, 2024.
- M. Liu, G. Chowdhary, B. C. Da Silva, S.-Y. Liu, and J. P. How, “Gaussian processes for learning and control: A tutorial with examples,” IEEE Control Systems Magazine, vol. 38, no. 5, pp. 53–86, 2018.
- D. Duvenaud, “Automatic model construction with Gaussian processes,” Ph.D. dissertation, University of Cambridge, 2014.
- L. Hewing, J. Kabzan, and M. N. Zeilinger, “Cautious model predictive control using Gaussian process regression,” IEEE Transactions on Control Systems Technology, vol. 28, no. 6, pp. 2736–2743, 2019.
- J. Wang, Y. V. Pant, and Z. Jiang, “Learning-based modeling of human-autonomous vehicle interaction for improved safety in mixed-vehicle platooning control,” Transportation Research Part C: Emerging Technologies, 2024.
- H. Liu, Y.-S. Ong, X. Shen, and J. Cai, “When Gaussian process meets big data: A review of scalable GPs,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 11, pp. 4405–4423, 2020.
- L. Hewing, A. Liniger, and M. N. Zeilinger, “Cautious NMPC with Gaussian process dynamics for autonomous miniature race cars,” in 2018 European Control Conference (ECC). IEEE, 2018, pp. 1341–1348.
- E. Snelson and Z. Ghahramani, “Sparse Gaussian processes using pseudo-inputs,” Advances in Neural Information Processing Systems, vol. 18, 2005.
- J. Quinonero-Candela, A. Girard, and C. E. Rasmussen, “Prediction at an uncertain input for Gaussian processes and relevance vector machines-application to multiple-step ahead time-series forecasting,” Technical University of Denmark, DTU: Informatics and Mathematical Modelling, Tech. Rep., 2003.
- H.-A. Langåker, “Cautious MPC-based control with machine learning,” Master’s thesis, Norwegian University of Science and Technology, 2018.
- C. J. Ostafew, A. P. Schoellig, T. D. Barfoot, and J. Collier, “Learning-based nonlinear model predictive control to improve vision-based mobile robot path tracking,” Journal of Field Robotics, vol. 33, no. 1, pp. 133–152, 2016.
- I. Sadeghzadeh, M. Abdolhosseini, and Y. Zhang, “Payload drop application using an unmanned quadrotor helicopter based on gain-scheduled PID and model predictive control,” Unmanned Systems, vol. 2, no. 01, pp. 39–52, 2014.
- M. Abdolhosseini, Y. M. Zhang, and C. A. Rabbath, “An efficient model predictive control scheme for an unmanned quadrotor helicopter,” Journal of Intelligent & Robotic Systems, vol. 70, pp. 27–38, 2013.
- J. Wang, Y. V. Pant, L. Zhao, M. Antkiewicz, and K. Czarnecki, “Enhancing safety in mixed traffic: Learning-based modeling and efficient control of autonomous and human-driven vehicles,” IEEE Transactions on Intelligent Transportation Systems, 2024.
- A. Coppola, D. G. Lui, A. Petrillo, and S. Santini, “Eco-driving control architecture for platoons of uncertain heterogeneous nonlinear connected autonomous electric vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 12, pp. 24 220–24 234, 2022.
- A. Girard, C. Rasmussen, and R. Murray-Smith, “Gaussian process priors with uncertainty inputs: multiple-step-ahead prediction,” Technical Report TR-2002–119, Dept. of Computer Science, 2002.
- A. Girard, C. Rasmussen, J. Q. Candela, and R. Murray-Smith, “Gaussian process priors with uncertain inputs application to multiple-step ahead time series forecasting,” Advances in Neural Information Processing Systems, vol. 15, 2002.
- K. B. Petersen and M. S. Pedersen, “The matrix cookbook,” 2012, version 20121115. [Online]. Available: http://www2.compute.dtu.dk/pubdb/pubs/3274-full.html