Biased-MPPI: Informing Sampling-Based Model Predictive Control by Fusing Ancillary Controllers (2401.09241v2)
Abstract: Motion planning for autonomous robots in dynamic environments poses numerous challenges due to uncertainties in the robot's dynamics and interaction with other agents. Sampling-based MPC approaches, such as Model Predictive Path Integral (MPPI) control, have shown promise in addressing these complex motion planning problems. However, the performance of MPPI relies heavily on the choice of sampling distribution. Existing literature often uses the previously computed input sequence as the mean of a Gaussian distribution for sampling, leading to potential failures and local minima. In this paper, we propose a novel derivation of MPPI that allows for arbitrary sampling distributions to enhance efficiency, robustness, and convergence while alleviating the problem of local minima. We present an efficient importance sampling scheme that combines classical and learning-based ancillary controllers simultaneously, resulting in more informative sampling and control fusion. Several simulated and real-world demonstrate the validity of our approach.
- H. J. Kappen, “Path integrals and symmetry breaking for optimal control theory,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2005, no. 11, pp. 205–229, Nov. 2005.
- G. Williams, P. Drews, B. Goldfain, J. M. Rehg, and E. A. Theodorou, “Aggressive driving with model predictive path integral control,” in 2016 IEEE International Conference on Robotics and Automation (ICRA), May 2016, pp. 1433–1440.
- G. Williams, A. Aldrich, and E. A. Theodorou, “Model predictive path integral control: From theory to parallel computation,” Journal of Guidance, Control, and Dynamics, vol. 40, no. 2, pp. 344–357, Feb. 2017.
- G. Williams, N. Wagener, B. Goldfain, P. Drews, J. M. Rehg, B. Boots, and E. A. Theodorou, “Information theoretic MPC for model-based reinforcement learning,” in Proceedings - IEEE International Conference on Robotics and Automation, 2017, pp. 1714–1721.
- G. Williams, P. Drews, B. Goldfain, J. M. Rehg, and I. A. Theodorou, “Information-Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving,” IEEE Transactions on Robotics, vol. 34, no. 6, pp. 1603–1622, Dec. 2018.
- D. Pérez-Morales and V. Fremont, “Information-Theoretic Sensor-Based Predictive Control for Autonomous Vehicle Navigation: A Proof of Concept,” in 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Sep. 2021, pp. 879–884.
- G. Williams, B. Goldfain, P. Drews, J. M. Rehg, and E. A. Theodorou, “Best Response Model Predictive Control for Agile Interactions Between Autonomous Ground Vehicles,” in 2018 IEEE International Conference on Robotics and Automation (ICRA). Brisbane, QLD: IEEE, May 2018, pp. 2403–2410.
- I. S. Mohamed, G. Allibert, and P. Martinet, “Model Predictive Path Integral Control Framework for Partially Observable Navigation: A Quadrotor Case Study,” in 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), Dec. 2020, pp. 196–203.
- J. Pravitra, E. A. Theodorou, and E. N. Johnson, “Flying complex maneuvers with model predictive path integral control,” in AIAA Scitech 2021 Forum. American Institute of Aeronautics and Astronautics Inc, AIAA, 2021, pp. 1–12.
- J. Pravitra, K. A. Ackerman, C. Cao, N. Hovakimyan, and E. A. Theodorou, “L1-Adaptive MPPI Architecture for Robust and Agile Control of Multirotors,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2020, pp. 7661–7666.
- V. Gómez, S. Thijssen, A. Symington, S. Hailes, and H. J. Kappen, “Real-time stochastic optimal control for multi-agent quadrotor systems,” in Proceedings International Conference on Automated Planning and Scheduling, ICAPS, vol. 2016, Mar. 2016, pp. 468–476.
- N. Wan, A. Gahlawat, N. Hovakimyan, E. A. Theodorou, and P. G. Voulgaris, “Cooperative Path Integral Control for Stochastic Multi-Agent Systems,” in 2021 American Control Conference (ACC), May 2021, pp. 1262–1267.
- L. Streichenberg, E. Trevisan, J. J. Chung, R. Siegwart, and J. Alonso-Mora, “Multi-Agent Path Integral Control for Interaction-Aware Motion Planning in Urban Canals,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 1379–1385.
- M. Bhardwaj, B. Sundaralingam, A. Mousavian, N. D. Ratliff, D. Fox, F. Ramos, and B. Boots, “STORM: An Integrated Framework for Fast Joint-Space Model-Predictive Control for Reactive Manipulation,” in 5th Annual Conference on Robot Learning, Jun. 2021.
- I. Abraham, A. Handa, N. Ratliff, K. Lowrey, T. D. Murphey, and D. Fox, “Model-Based Generalization Under Parameter Uncertainty Using Path Integral Control,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 2864–2871, Apr. 2020.
- E. Arruda, M. J. Mathew, M. Kopicki, M. Mistry, M. Azad, and J. L. Wyatt, “Uncertainty averse pushing with model predictive path integral control,” in 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), Nov. 2017, pp. 497–502.
- L. Cong, M. Grner, P. Ruppel, H. Liang, N. Hendrich, and J. Zhang, “Self-Adapting Recurrent Models for Object Pushing from Learning in Simulation,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2020, pp. 5304–5310.
- J. Carius, R. Ranftl, F. Farshidian, and M. Hutter, “Constrained stochastic optimal control with learned importance sampling: A path integral approach,” The International Journal of Robotics Research, p. 02783649211047890, Oct. 2021.
- T. Howell, N. Gileadi, S. Tunyasuvunakool, K. Zakka, T. Erez, and Y. Tassa, “Predictive Sampling: Real-time Behaviour Synthesis with MuJoCo,” Dec. 2022. [Online]. Available: http://arxiv.org/abs/2212.00541
- C. Pezzato, C. Salmi, M. Spahn, E. Trevisan, J. Alonso-Mora, and C. H. Corbato, “Sampling-based Model Predictive Control Leveraging Parallelizable Physics Simulations,” Jul. 2023. [Online]. Available: http://arxiv.org/abs/2307.09105
- G. Williams, B. Goldfain, P. Drews, K. Saigol, J. Rehg, and E. Theodorou, “Robust Sampling Based Model Predictive Control with Sparse Objective Information,” in Robotics: Science and Systems XIV. Robotics: Science and Systems Foundation, Jun. 2018.
- T. Mensink, J. Verbeek, and B. Kappen, “EP for efficient stochastic control with obstacles,” in Frontiers in Artificial Intelligence and Applications, vol. 215. IOS Press, Aug. 2010, pp. 675–680.
- M. Okada and T. Taniguchi, “Acceleration of Gradient-Based Path Integral Method for Efficient Optimal and Inverse Optimal Control,” in 2018 IEEE International Conference on Robotics and Automation (ICRA), May 2018, pp. 3013–3020.
- D. M. Asmar, R. Senanayake, S. Manuel, and M. J. Kochenderfer, “Model Predictive Optimized Path Integral Strategies,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 3182–3188.
- I. S. Mohamed, K. Yin, and L. Liu, “Autonomous Navigation of AGVs in Unknown Cluttered Environments: Log-MPPI Control Strategy,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10 240–10 247, Oct. 2022.
- R. Kusumoto, L. Palmieri, M. Spies, A. Csiszar, and K. O. Arras, “Informed Information Theoretic Model Predictive Control,” in 2019 International Conference on Robotics and Automation (ICRA), May 2019, pp. 2047–2053.
- T. Power and D. Berenson, “Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projection,” in Robotics: Science and Systems XVIII, vol. 18, Jun. 2022.
- I. M. Balci, E. Bakolas, B. Vlahov, and E. A. Theodorou, “Constrained Covariance Steering Based Tube-MPPI,” in 2022 American Control Conference (ACC), Jun. 2022, pp. 4197–4202.
- J. Yin, Z. Zhang, E. Theodorou, and P. Tsiotras, “Trajectory Distribution Control for Model Predictive Path Integral Control using Covariance Steering,” in 2022 International Conference on Robotics and Automation (ICRA), May 2022, pp. 1478–1484.
- O. Arslan, E. A. Theodorou, and P. Tsiotras, “Information-theoretic stochastic optimal control via incremental sampling-based algorithms,” in 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Dec. 2014, pp. 1–8.
- M. S. Gandhi, B. Vlahov, J. Gibson, G. Williams, and E. A. Theodorou, “Robust Model Predictive Path Integral Control: Analysis and Performance Guarantees,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 1423–1430, Apr. 2021.
- G. R. Williams, “Model predictive path integral control: Theoretical foundations and applications to autonomous driving,” Ph.D. dissertation, Georgia Institute of Technology, Mar. 2019. [Online]. Available: https://smartech.gatech.edu/handle/1853/62666
- Q. Inc., “QUBE - Servo 2 - Quanser.” [Online]. Available: https://www.quanser.com/products/qube-servo-2/
- I. Tejado, D. Torres, E. Pérez, and B. M. Vinagre, “Physical Modeling based Simulators to Support Teaching in Automatic Control: the Rotatory Pendulum,” in 11th IFAC Symposium on Advances in Control Education ACE 2016, vol. 49, Jan. 2016, pp. 75–80.
- K. J. Åström and K. Furuta, “Swinging up a pendulum by energy control,” Automatica, vol. 36, no. 2, pp. 287–295, Feb. 2000.
- W. Wang, L. A. Mateos, S. Park, P. Leoni, B. Gheneti, F. Duarte, C. Ratti, and D. Rus, “Design. Modeling, and Nonlinear Model Predictive Tracking Control of a Novel Autonomous Surface Vehicle,” in Proceedings - IEEE International Conference on Robotics and Automation, 2018, pp. 6189–6196.
- W. Jansma, E. Trevisan, Á. Serra-Gómez, and J. Alonso-Mora, “Interaction-Aware Sampling-Based MPC with Learned Local Goal Predictions,” Sep. 2023, number: arXiv:2309.14931 arXiv:2309.14931 [cs]. [Online]. Available: http://arxiv.org/abs/2309.14931
- Elia Trevisan (8 papers)
- Javier Alonso-Mora (76 papers)