Integrating Predictive Motion Uncertainties with Distributionally Robust Risk-Aware Control for Safe Robot Navigation in Crowds (2403.05081v1)
Abstract: Ensuring safe navigation in human-populated environments is crucial for autonomous mobile robots. Although recent advances in machine learning offer promising methods to predict human trajectories in crowded areas, it remains unclear how one can safely incorporate these learned models into a control loop due to the uncertain nature of human motion, which can make predictions of these models imprecise. In this work, we address this challenge and introduce a distributionally robust chance-constrained model predictive control (DRCC-MPC) which: (i) adopts a probability of collision as a pre-specified, interpretable risk metric, and (ii) offers robustness against discrepancies between actual human trajectories and their predictions. We consider the risk of collision in the form of a chance constraint, providing an interpretable measure of robot safety. To enable real-time evaluation of chance constraints, we consider conservative approximations of chance constraints in the form of distributionally robust Conditional Value at Risk constraints. The resulting formulation offers computational efficiency as well as robustness with respect to out-of-distribution human motion. With the parallelization of a sampling-based optimization technique, our method operates in real-time, demonstrating successful and safe navigation in a number of case studies with real-world pedestrian data.
- Y. Yuan, X. Weng, Y. Ou, and K. M. Kitani, “Agentformer: Agent-aware transformers for socio-temporal multi-agent forecasting,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9813–9823, 2021.
- S. Ettinger, S. Cheng, B. Caine, C. Liu, H. Zhao, S. Pradhan, Y. Chai, B. Sapp, C. R. Qi, Y. Zhou, et al., “Large scale interactive motion forecasting for autonomous driving: The waymo open motion dataset,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9710–9719, 2021.
- Y. Huang, J. Du, Z. Yang, Z. Zhou, L. Zhang, and H. Chen, “A survey on trajectory-prediction methods for autonomous driving,” IEEE Transactions on Intelligent Vehicles, vol. 7, no. 3, pp. 652–674, 2022.
- K. Mangalam, Y. An, H. Girase, and J. Malik, “From goals, waypoints & paths to long term human trajectory forecasting,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15233–15242, 2021.
- R. Cheng, R. M. Murray, and J. W. Burdick, “Limits of probabilistic safety guarantees when considering human uncertainty,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 3182–3189, IEEE, 2021.
- Z. I. Botev, D. P. Kroese, R. Y. Rubinstein, and P. L’Ecuyer, “The cross-entropy method for optimization,” in Handbook of statistics, vol. 31, pp. 35–59, Elsevier, 2013.
- J. Van den Berg, M. Lin, and D. Manocha, “Reciprocal velocity obstacles for real-time multi-agent navigation,” in 2008 IEEE international conference on robotics and automation, pp. 1928–1935, Ieee, 2008.
- J. Van Den Berg, S. J. Guy, M. Lin, and D. Manocha, “Reciprocal n-body collision avoidance,” in Robotics Research: The 14th International Symposium ISRR, pp. 3–19, Springer, 2011.
- N. Pradhan, T. Burg, and S. Birchfield, “Robot crowd navigation using predictive position fields in the potential function framework,” in Proceedings of the 2011 American control conference, pp. 4628–4633, IEEE, 2011.
- D. Yang, Ü. Özgüner, and K. Redmill, “Social force based microscopic modeling of vehicle-crowd interaction,” in 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 1537–1542, IEEE, 2018.
- D. Yang, Ü. Özgüner, and K. Redmill, “A social force based pedestrian motion model considering multi-pedestrian interaction with a vehicle,” ACM Transactions on Spatial Algorithms and Systems (TSAS), vol. 6, no. 2, pp. 1–27, 2020.
- Z. Williams, J. Chen, and N. Mehr, “Distributed potential ilqr: Scalable game-theoretic trajectory planning for multi-agent interactions,” arXiv preprint arXiv:2303.04842, 2023.
- M. Wang, N. Mehr, A. Gaidon, and M. Schwager, “Game-theoretic planning for risk-aware interactive agents,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6998–7005, IEEE, 2020.
- M. Bhatt, Y. Jia, and N. Mehr, “Efficient constrained multi-agent trajectory optimization using dynamic potential games,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 7303–7310, IEEE, 2023.
- T. Kavuncu, A. Yaraneri, and Negar Mehr, “Potential iLQR: A Potential-Minimizing Controller for Planning Multi-Agent Interactive Trajectories,” in Proceedings of Robotics: Science and Systems (RSS), (Virtual), July 2021.
- Z. Jian, Z. Yan, X. Lei, Z. Lu, B. Lan, X. Wang, and B. Liang, “Dynamic control barrier function-based model predictive control to safety-critical obstacle-avoidance of mobile robot,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 3679–3685, IEEE, 2023.
- W. Luo, W. Sun, and A. Kapoor, “Multi-robot collision avoidance under uncertainty with probabilistic safety barrier certificates,” Advances in Neural Information Processing Systems, vol. 33, pp. 372–383, 2020.
- M. Chen, J. C. Shih, and C. J. Tomlin, “Multi-vehicle collision avoidance via hamilton-jacobi reachability and mixed integer programming,” in 2016 IEEE 55th Conference on Decision and Control (CDC), pp. 1695–1700, IEEE, 2016.
- O. Andersson, M. Wzorek, P. Rudol, and P. Doherty, “Model-predictive control with stochastic collision avoidance using bayesian policy optimization,” in 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4597–4604, IEEE, 2016.
- D. Althoff, M. Althoff, D. Wollherr, and M. Buss, “Probabilistic collision state checker for crowded environments,” in 2010 IEEE international conference on robotics and automation, pp. 1492–1498, IEEE, 2010.
- G. S. Aoude, B. D. Luders, J. M. Joseph, N. Roy, and J. P. How, “Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns,” Autonomous Robots, vol. 35, pp. 51–76, 2013.
- A. Nemirovski and A. Shapiro, “Convex approximations of chance constrained programs,” SIAM Journal on Optimization, vol. 17, no. 4, pp. 969–996, 2007.
- Q. Li, F. Gama, A. Ribeiro, and A. Prorok, “Graph neural networks for decentralized multi-robot path planning,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 11785–11792, IEEE, 2020.
- S. Liu, P. Chang, W. Liang, N. Chakraborty, and K. Driggs-Campbell, “Decentralized structural-rnn for robot crowd navigation with deep reinforcement learning,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 3517–3524, IEEE, 2021.
- C. Chen, Y. Liu, S. Kreiss, and A. Alahi, “Crowd-robot interaction: Crowd-aware robot navigation with attention-based deep reinforcement learning,” in 2019 international conference on robotics and automation (ICRA), pp. 6015–6022, IEEE, 2019.
- S. Liu, P. Chang, Z. Huang, N. Chakraborty, K. Hong, W. Liang, D. L. McPherson, J. Geng, and K. Driggs-Campbell, “Intention aware robot crowd navigation with attention-based interaction graph,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 12015–12021, IEEE, 2023.
- E. Leurent and J. Mercat, “Social attention for autonomous decision-making in dense traffic,” arXiv preprint arXiv:1911.12250, 2019.
- E. Schmerling, K. Leung, W. Vollprecht, and M. Pavone, “Multimodal probabilistic model-based planning for human-robot interaction,” in 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 3399–3406, IEEE, 2018.
- H. Nishimura, B. Ivanovic, A. Gaidon, M. Pavone, and M. Schwager, “Risk-sensitive sequential action control with multi-modal human trajectory forecasting for safe crowd-robot interaction,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 11205–11212, IEEE, 2020.
- H. Rahimian and S. Mehrotra, “Distributionally robust optimization: A review,” arXiv preprint arXiv:1908.05659, 2019.
- M. Schuurmans, P. Sopasakis, and P. Patrinos, “Safe learning-based control of stochastic jump linear systems: a distributionally robust approach,” in 2019 IEEE 58th Conference on Decision and Control (CDC), pp. 6498–6503, IEEE, 2019.
- K. Long, Y. Yi, J. Cortes, and N. Atanasov, “Safe and stable control synthesis for uncertain system models via distributionally robust optimization,” arXiv preprint arXiv:2210.01341, 2022.
- A. Hakobyan and I. Yang, “Wasserstein distributionally robust motion control for collision avoidance using conditional value-at-risk,” IEEE Transactions on Robotics, vol. 38, no. 2, pp. 939–957, 2021.
- A. Sinha, M. O’Kelly, H. Zheng, R. Mangharam, J. Duchi, and R. Tedrake, “Formulazero: Distributionally robust online adaptation via offline population synthesis,” in International Conference on Machine Learning, pp. 8992–9004, PMLR, 2020.
- H. Nishimura, N. Mehr, A. Gaidon, and M. Schwager, “Rat ilqr: A risk auto-tuning controller to optimally account for stochastic model mismatch,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 763–770, 2021.
- B. P. Van Parys, D. Kuhn, P. J. Goulart, and M. Morari, “Distributionally robust control of constrained stochastic systems,” IEEE Transactions on Automatic Control, vol. 61, no. 2, pp. 430–442, 2015.
- S. Zymler, D. Kuhn, and B. Rustem, “Distributionally robust joint chance constraints with second-order moment information.,” Mathematical Programming, vol. 137, 2013.
- B. HomChaudhuri, “Distributionally robust model predictive control for collision avoidance in the presence of stochastic obstacles,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, p. 09596518221122721, 2023.
- V. Renganathan, I. Shames, and T. H. Summers, “Towards integrated perception and motion planning with distributionally robust risk constraints,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 15530–15536, 2020.
- R. Soloperto, J. Köhler, F. Allgöwer, and M. A. Müller, “Collision avoidance for uncertain nonlinear systems with moving obstacles using robust model predictive control,” in 2019 18th European Control Conference (ECC), pp. 811–817, IEEE, 2019.
- P. Bouffard, A. Aswani, and C. Tomlin, “Learning-based model predictive control on a quadrotor: Onboard implementation and experimental results,” in 2012 IEEE International Conference on Robotics and Automation, pp. 279–284, IEEE, 2012.
- Z. Chen, D. Kuhn, and W. Wiesemann, “On approximations of data-driven chance constrained programs over wasserstein balls,” arXiv preprint arXiv:2206.00231, 2022.
- Z. Liu, H. Zhou, B. Chen, S. Zhong, M. Hebert, and D. Zhao, “Constrained model-based reinforcement learning with robust cross-entropy method,” arXiv preprint arXiv:2010.07968, 2020.
- T. Salzmann, B. Ivanovic, P. Chakravarty, and M. Pavone, “Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16, pp. 683–700, Springer, 2020.
- S. Pellegrini, A. Ess, K. Schindler, and L. Van Gool, “You’ll never walk alone: Modeling social behavior for multi-target tracking,” in 2009 IEEE 12th international conference on computer vision, pp. 261–268, IEEE, 2009.
- M. Wang, Z. Wang, S. Paudel, and M. Schwager, “Safe distributed lane change maneuvers for multiple autonomous vehicles using buffered input cells,” in 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 4678–4684, IEEE, 2018.
- A. Majumdar and M. Pavone, “How should a robot assess risk? towards an axiomatic theory of risk in robotics,” in Robotics Research: The 18th International Symposium ISRR, pp. 75–84, Springer, 2020.