Towards Efficient MPPI Trajectory Generation with Unscented Guidance: U-MPPI Control Strategy (2306.12369v3)
Abstract: The classical Model Predictive Path Integral (MPPI) control framework, while effective in many applications, lacks reliable safety features due to its reliance on a risk-neutral trajectory evaluation technique, which can present challenges for safety-critical applications such as autonomous driving. Furthermore, when the majority of MPPI sampled trajectories concentrate in high-cost regions, it may generate an infeasible control sequence. To address this challenge, we propose the U-MPPI control strategy, a novel methodology that can effectively manage system uncertainties while integrating a more efficient trajectory sampling strategy. The core concept is to leverage the Unscented Transform (UT) to propagate not only the mean but also the covariance of the system dynamics, going beyond the traditional MPPI method. As a result, it introduces a novel and more efficient trajectory sampling strategy, significantly enhancing state-space exploration and ultimately reducing the risk of being trapped in local minima. Furthermore, by leveraging the uncertainty information provided by UT, we incorporate a risk-sensitive cost function that explicitly accounts for risk or uncertainty throughout the trajectory evaluation process, resulting in a more resilient control system capable of handling uncertain conditions. By conducting extensive simulations of 2D aggressive autonomous navigation in both known and unknown cluttered environments, we verify the efficiency and robustness of our proposed U-MPPI control strategy compared to the baseline MPPI. We further validate the practicality of U-MPPI through real-world demonstrations in unknown cluttered environments, showcasing its superior ability to incorporate both the UT and local costmap into the optimization problem without introducing additional complexity.
- H. Kurniawati, Y. Du, D. Hsu, and W. S. Lee, “Motion planning under uncertainty for robotic tasks with long time horizons,” The International Journal of Robotics Research, vol. 30, no. 3, pp. 308–323, 2011.
- A. Bemporad and M. Morari, “Robust model predictive control: A survey,” in Robustness in identification and control. Springer, 2007, pp. 207–226.
- A. Mesbah, “Stochastic model predictive control: An overview and perspectives for future research,” IEEE Control Systems Magazine, vol. 36, no. 6, pp. 30–44, 2016.
- N. E. Du Toit and J. W. Burdick, “Probabilistic collision checking with chance constraints,” IEEE Transactions on Robotics, vol. 27, no. 4, pp. 809–815, 2011.
- L. Hewing and M. N. Zeilinger, “Stochastic model predictive control for linear systems using probabilistic reachable sets,” in 2018 IEEE Conference on Decision and Control (CDC). IEEE, 2018, pp. 5182–5188.
- S. A. Sajadi-Alamdari, H. Voos, and M. Darouach, “Risk-averse stochastic nonlinear model predictive control for real-time safety-critical systems,” IFAC-PapersOnLine, vol. 50, no. 1, pp. 5991–5997, 2017.
- X. Yang and J. Maciejowski, “Risk-sensitive model predictive control with gaussian process models,” IFAC-PapersOnLine, vol. 48, no. 28, pp. 374–379, 2015.
- E. Hyeon, Y. Kim, and A. G. Stefanopoulou, “Fast risk-sensitive model predictive control for systems with time-series forecasting uncertainties,” in 2020 59th IEEE Conference on Decision and Control (CDC). IEEE, 2020, pp. 2515–2520.
- M. Schuurmans, A. Katriniok, H. E. Tseng, and P. Patrinos, “Learning-based risk-averse model predictive control for adaptive cruise control with stochastic driver models,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 15 128–15 133, 2020.
- I. S. Mohamed, G. Allibert, and P. Martinet, “Model predictive path integral control framework for partially observable navigation: A quadrotor case study,” in 16th Int. Conf. on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, China, Dec. 2020, pp. 196–203.
- G. Williams, A. Aldrich, and E. A. Theodorou, “Model predictive path integral control: From theory to parallel computation,” Journal of Guidance, Control, and Dynamics, vol. 40, no. 2, pp. 344–357, 2017.
- I. S. Mohamed, G. Allibert, and P. Martinet, “Sampling-based MPC for constrained vision based control,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2021, pp. 3753–3758.
- J. Pravitra, K. A. Ackerman, C. Cao, N. Hovakimyan, and E. A. Theodorou, “ℒ1subscriptℒ1\mathcal{L}_{1}caligraphic_L start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT-adaptive MPPI architecture for robust and agile control of multirotors,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2020, pp. 7661–7666.
- I. S. Mohamed, “MPPI-VS: Sampling-based model predictive control strategy for constrained image-based and position-based visual servoing,” arXiv preprint arXiv:2104.04925, 2021.
- J. Yin, Z. Zhang, E. Theodorou, and P. Tsiotras, “Trajectory distribution control for model predictive path integral control using covariance steering,” in IEEE Int. Conf. on Robotics and Automation (ICRA), 2022, pp. 1478–1484.
- I. S. Mohamed, K. Yin, and L. Liu, “Autonomous navigation of AGVs in unknown cluttered environments: log-MPPI control strategy,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10 240–10 247, 2022.
- G. Williams, B. Goldfain, P. Drews, K. Saigol, J. M. Rehg, and E. A. Theodorou, “Robust sampling based model predictive control with sparse objective information,” in Robotics: Science and Systems, Pittsburgh, Pennsylvania, USA, 2018, pp. 42––51.
- J. Yin, Z. Zhang, and P. Tsiotras, “Risk-aware model predictive path integral control using conditional value-at-risk,” arXiv preprint arXiv:2209.12842, 2022.
- I. M. Ross, R. J. Proulx, and M. Karpenko, “Unscented guidance,” in American Control Conference (ACC). IEEE, 2015, pp. 5605–5610.
- A. Savitzky and M. J. Golay, “Smoothing and differentiation of data by simplified least squares procedures.” Analytical chemistry, vol. 36, no. 8, pp. 1627–1639, 1964.
- S. J. Julier, J. K. Uhlmann, and H. F. Durrant-Whyte, “A new approach for filtering nonlinear systems,” in Proceedings of 1995 American Control Conference-ACC’95, vol. 3. IEEE, 1995, pp. 1628–1632.
- J. Xu, K. Yin, and L. Liu, “Online planning in uncertain and dynamic environment in the presence of multiple mobile vehicles,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020, pp. 2410–2416.
- R. Van Der Merwe, “Sigma-point kalman filters for probabilistic inference in dynamic state-space models,” Ph.D. dissertation, Oregon Health & Science University, 2004.
- S. J. Julier, “The scaled unscented transformation,” in American Control Conference, vol. 6. IEEE, 2002, pp. 4555–4559.
- I. M. Ross, R. J. Proulx, and M. Karpenko, “Unscented optimal control for space flight,” in International Symposium on Space Flight Dynamics (ISSFD), 2014, pp. 1–12.
- N. Ozaki, S. Campagnola, and R. Funase, “Tube stochastic optimal control for nonlinear constrained trajectory optimization problems,” Journal of Guidance, Control, and Dynamics, 2020.
- P. Whittle, “Risk-sensitive linear/quadratic/gaussian control,” Advances in Applied Probability, vol. 13, no. 4, pp. 764–777, 1981.
- G. Williams, P. Drews, B. Goldfain, J. M. Rehg, and E. A. Theodorou, “Information-theoretic model predictive control: Theory and applications to autonomous driving,” IEEE Transactions on Robotics, vol. 34, no. 6, pp. 1603–1622, 2018.
- J. Zhang and S. Singh, “LOAM: Lidar odometry and mapping in real-time.” in Robotics: Science and Systems, vol. 2, no. 9. Berkeley, CA, 2014, pp. 1–9.
- M. Ali and L. Liu, “GP-frontier for local mapless navigation,” in IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 10 047–10 053.