Lane-Keeping Control of Autonomous Vehicles Through a Soft-Constrained Iterative LQR (2311.16900v2)
Abstract: The accurate prediction of smooth steering inputs is crucial for automotive applications because control actions with jitter might cause the vehicle system to become unstable. To address this problem in automobile lane-keeping control without the use of additional smoothing algorithms, we developed a novel soft-constrained iterative linear quadratic regulator (soft-CILQR) algorithm by integrating CILQR algorithm and a model predictive control (MPC) constraint relaxation method. We incorporated slack variables into the state and control barrier functions of the soft-CILQR solver to soften the constraints in the optimization process such that control input stabilization can be achieved in a computationally simple manner. Two types of automotive lane-keeping experiments (numerical simulations and experiments involving challenging vision-based maneuvers) were conducted with a linear system dynamics model to test the performance of the proposed soft-CILQR algorithm, and its performance was compared with that of the CILQR algorithm. In the numerical simulations, the soft-CILQR and CILQR solvers managed to drive the system toward the reference state asymptotically; however, the soft-CILQR solver obtained smooth steering input trajectories more easily than did the CILQR solver under conditions involving additive disturbances. The results of the vision-based experiments in which an ego vehicle drove in perturbed TORCS environments with various road friction settings were consistent with those of the numerical tests. The proposed soft-CILQR algorithm achieved an average runtime of 2.55 ms and is thus applicable for real-time autonomous driving scenarios.
- C. Chen, A. Seff, A. Kornhauser, and J. Xiao, “DeepDriving: Learning affordance for direct perception in autonomous driving,” in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 2722-2730.
- D. Li, D. Zhao, Q. Zhang, and Y. Chen, “Reinforcement learning and deep learning based lateral control for autonomous driving,” IEEE Comput. Intell. Mag. vol. 14, no. 2, pp. 83-98, May 2019.
- Y. Wu, S. Liao, X. Liu, Z. Li and R. Lu, “Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 7, pp. 3680-3690, July 2023.
- J. Wang, H. Sun and C. Zhu, “Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach,” IEEE Trans. Veh. Technol., vol. 72, no. 9, pp. 11213-11226, Sept 2023.
- A. Savitzky and M. J. Golay, “Smoothing and differentiation of data by simplified least squares procedures,” Anal. Chem., vol. 36, no. 8, pp. 1627–1639, 1964.
- S. Mata, A. Zubizarreta and C. Pinto, “Robust Tube-Based Model Predictive Control for Lateral Path Tracking,” IEEE Trans. Intell. Veh., vol. 4, no. 4, pp. 569-577, Dec 2019.
- E. Chisari, A. Liniger, A. Rupenyan, L. Van Gool and J. Lygeros, “Learning from Simulation, Racing in Reality,” in IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 8046-8052.
- T. Kim, G. Park, K. Kwak, J. Bae and W. Lee, “Smooth Model Predictive Path Integral Control Without Smoothing,” IEEE Robot. Autom. Lett., vol. 7, no. 4, pp. 10406-10413, Oct 2022.
- A. Zheng and M. Morari, “Stability of model predictive control with mixed constraints,” IEEE Trans. Autom. Control, vol. 40, no. 10, pp. 1818-1823, Oct 1995.
- J. B. Rawlings, “Tutorial overview of model predictive control,” IEEE Control Systems Magazine, vol. 20, no. 3, pp. 38-52, June 2000.
- M. Askari, M. Moghavvemi, H. A. F. Almurib and A. M. A. Haidar, “Stability of Soft-Constrained Finite Horizon Model Predictive Control,” IEEE Trans. Ind. Appl., vol. 53, no. 6, pp. 5883-5892, 2017.
- K. P. Wabersich, R. Krishnadas and M. N. Zeilinger, “A Soft Constrained MPC Formulation Enabling Learning From Trajectories With Constraint Violations,” IEEE Control Syst. Lett., vol. 6, pp. 980-985, 2022.
- S. V. Raković, S. Zhang, H. Sun and Y. Xia, “Model Predictive Control for Linear Systems Under Relaxed Constraints,” IEEE Trans. Autom. Control, vol. 68, no. 1, pp. 369-376, Jan 2023.
- A. G. Wills and W. P. Heath, “Barrier function based model predictive control,” Automatica, vol. 40, pp. 1415-1422, 2004.
- C. Feller and C. Ebenbauer, “Relaxed Logarithmic Barrier Function Based Model Predictive Control of Linear Systems,” IEEE Trans. Autom. Control, vol. 62, no. 3, pp. 1223-1238, March 2017.
- J. Chen, W. Zhan and M. Tomizuka, “Constrained iterative LQR for on-road autonomous driving motion planning,” in IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), 2017, pp. 1-7.
- J. Chen, W. Zhan and M. Tomizuka, “Autonomous Driving Motion Planning With Constrained Iterative LQR,” IEEE Trans. Intell. Veh., vol. 4, no. 2, pp. 244-254, June 2019.
- Y. Shimizu, W. Zhan, L. Sun, J. Chen, S. Kato, and M. Tomizuka, “Motion planning for autonomous driving with extended constrained iterative lqr,” in Dynamic Systems and Control Conference, American Society of Mechanical Engineers, 2020, pp. V001T12A001.
- W. Li and E. Todorov, “Iterative linear quadratic regulator design for nonlinear biological movement systems,” in Proc. 1st Int. Conf. Inform. Control Autom. Robot., 2004, pp. 222–229.
- E. Todorov and W. Li, “A generalized iterative LQG method for locally optimal feedback control of constrained nonlinear stochastic systems,” in Proc. Amer. Control Conf., 2005, pp. 300–306.
- B. Wymann, C. Dimitrakakis, A. Sumner, E. Espié, C. Guionneau, and R. Coulom, “Torcs: the open racing car simulator,” Tech. Rep., 2013.
- K. Lee, S. Jeon, H. Kim and D. Kum, “Optimal Path Tracking Control of Autonomous Vehicle: Adaptive Full-State Linear Quadratic Gaussian (LQG) Control,” IEEE Access, vol. 7, pp. 109120-109133, 2019.
- C. Feller and C. Ebenbauer, “Continuous-time linear MPC algorithms based on relaxed logarithmic barrier functions,” in Proc. 19th IFAC World Congr., Cape Town, South Africa, 2014, pp. 2481–2488.
- Y. Tassa, T. Erez and E. Todorov, “Synthesis and stabilization of complex behaviors through online trajectory optimization,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2012, pp. 4906-4913.
- Y. Tassa, N. Mansard and E. Todorov, “Control-limited differential dynamic programming,” in IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 1168-1175.
- J. Hauser and A. Saccon, “A Barrier Function Method for the Optimization of Trajectory Functionals with Constraints,” in Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, USA, 2006, pp. 864-869.
- C. Feller and C. Ebenbauer, “A stabilizing iteration scheme for model predictive control based on relaxed barrier functions,” Automatica, vol. 80, pp. 328-339, June 2017.
- D.-H. Lee, “Efficient Perception, Planning, and Control Algorithms for Vision-Based Automated Vehicles”, 2022, arXiv:2209.07042. [Online]. Available: https://arxiv.org/abs/2209.07042
- O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer, 2015, pp. 234-241.
- C. V. Samak, T. V. Samak, and S. Kandhasamy, “Control Strategies for Autonomous Vehicles,” 2021, arXiv:2011.08729. [Online]. Available: https://arxiv.org/abs/2011.08729