Spline-Interpolated Model Predictive Path Integral Control with Stein Variational Inference for Reactive Navigation (2404.10395v1)
Abstract: This paper presents a reactive navigation method that leverages a Model Predictive Path Integral (MPPI) control enhanced with spline interpolation for the control input sequence and Stein Variational Gradient Descent (SVGD). The MPPI framework addresses a nonlinear optimization problem by determining an optimal sequence of control inputs through a sampling-based approach. The efficacy of MPPI is significantly influenced by the sampling noise. To rapidly identify routes that circumvent large and/or newly detected obstacles, it is essential to employ high levels of sampling noise. However, such high noise levels result in jerky control input sequences, leading to non-smooth trajectories. To mitigate this issue, we propose the integration of spline interpolation within the MPPI process, enabling the generation of smooth control input sequences despite the utilization of substantial sampling noises. Nonetheless, the standard MPPI algorithm struggles in scenarios featuring multiple optimal or near-optimal solutions, such as environments with several viable obstacle avoidance paths, due to its assumption that the distribution over an optimal control input sequence can be closely approximated by a Gaussian distribution. To address this limitation, we extend our method by incorporating SVGD into the MPPI framework with spline interpolation. SVGD, rooted in the optimal transportation algorithm, possesses the unique ability to cluster samples around an optimal solution. Consequently, our approach facilitates robust reactive navigation by swiftly identifying obstacle avoidance paths while maintaining the smoothness of the control input sequences. The efficacy of our proposed method is validated on simulations with a quadrotor, demonstrating superior performance over existing baseline techniques.
- The dynamic window approach to collision avoidance. IEEE Robotics & Automation Magazine, 4(1):23–33, 1997.
- State space sampling of feasible motions for high-performance mobile robot navigation in complex environments. Journal of Field Robotics, 25(6-7):325––345, 2008.
- Chapter 3. the cross-entropy method for optimization. Handbook of StatisticsCEM, 31:35–59, 12 2013.
- Aggressive driving with model predictive path integral control. pages 1433–1440, 2016.
- Information theoretic mpc for model-based reinforcement learning. in IEEE International Conference on Robotics and Automation (ICRA), 2017.
- Information theoretic model predictive control:theory and applications to autonomous driving. IEEE Transactions on Robotics, 34(6):1603–1622, 2018.
- Ali Mesbah. Stochastic model predictive control: An overview and perspectives for future research. IEEE Control Systems Magazine, 36(6):30–44, 2016.
- Stochastic linear model predictive control with chance constraints – a review. Journal of Process Control, 44:53–67, 2016.
- Q. Liu and D. Wang. Stein variational gradient descent: A general purpose bayesian inference algorithm. Neural Information Processing Systems, 2016.
- Smooth model predictive path integral control without smoothing. IEEE Robotics and Automation Letters, 7(4):10406–10413, 2022.
- A model predictive path integral method for fast, proactive, and uncertainty-aware uav planning in cluttered environments. arXiv preprint arXiv:2308.00914, 2023.
- Stein variational model predictive control. 155:1278–1297, 2021.
- Collision-free motion generation based on stochastic optimization and composite signed distance field networks of articulated robot. arXiv preprint arXiv:2306.04130, 2023.
- Constrained covariance steering based Tube-MPPI. In American Control Conference, pages 4197–4202. IEEE, 2022.
- Robust sampling based model predictive control with sparse objective information. In Robotics: Science and Systems, volume 14, page 2018, 2018.
- Trajectory distribution control for model predictive path integral control using covariance steering. In International Conference on Robotics and Automation, pages 1478–1484. IEEE, 2022.
- Learning sampling distributions for model predictive control. In Conference on Robot Learning, pages 1733–1742. PMLR, 2023.
- Model predictive optimized path integral strategies. In International Conference on Robotics and Automation, pages 3182–3188. IEEE, 2023.
- Towards efficient MPPI trajectory generation with unscented guidance: U-MPPI control strategy. arXiv preprint arXiv:2306.12369, 2023.
- Variational inference MPC for Bayesian model-based reinforcement learning. In Conference on robot learning, pages 258–272. PMLR, 2020.
- Variational inference MPC using tsallis divergence. Robotics: Science and Systems, 2021.
- Dual online Stein variational inference for control and dynamics. Robotics: Science and Systems, 2021 (in print).
- Bayesian estimates of equation system parameters: an application of integration by monte carlo. Econometrica: Journal of the Econometric Society, pages 1–19, 1978.
- Measuring sample quality with stein's method. In C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 28. Curran Associates, Inc., 2015.
- Takato Miura (1 paper)
- Naoki Akai (6 papers)
- Kohei Honda (16 papers)
- Susumu Hara (1 paper)