Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
120 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Uncertainty-Aware Prediction and Application in Planning for Autonomous Driving: Definitions, Methods, and Comparison (2403.02297v1)

Published 4 Mar 2024 in cs.RO

Abstract: Autonomous driving systems face the formidable challenge of navigating intricate and dynamic environments with uncertainty. This study presents a unified prediction and planning framework that concurrently models short-term aleatoric uncertainty (SAU), long-term aleatoric uncertainty (LAU), and epistemic uncertainty (EU) to predict and establish a robust foundation for planning in dynamic contexts. The framework uses Gaussian mixture models and deep ensemble methods, to concurrently capture and assess SAU, LAU, and EU, where traditional methods do not integrate these uncertainties simultaneously. Additionally, uncertainty-aware planning is introduced, considering various uncertainties. The study's contributions include comparisons of uncertainty estimations, risk modeling, and planning methods in comparison to existing approaches. The proposed methods were rigorously evaluated using the CommonRoad benchmark and settings with limited perception. These experiments illuminated the advantages and roles of different uncertainty factors in autonomous driving processes. In addition, comparative assessments of various uncertainty modeling strategies underscore the benefits of modeling multiple types of uncertainties, thus enhancing planning accuracy and reliability. The proposed framework facilitates the development of methods for UAP and surpasses existing uncertainty-aware risk models, particularly when considering diverse traffic scenarios. Project page: https://swb19.github.io/UAP/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Y. Huang, J. Du, Z. Yang, Z. Zhou, L. Zhang, and H. Chen, “A survey on trajectory-prediction methods for autonomous driving,” IEEE Transactions on Intelligent Vehicles, vol. 7, no. 3, pp. 652–674, 2022.
  2. J. Li, W. Shao, and H. Wang, “Key challenges and chinese solutions for sotif in intelligent connected vehicles,” Engineering, 2023.
  3. A. Kendall and Y. Gal, “What uncertainties do we need in bayesian deep learning for computer vision?” Advances in neural information processing systems, vol. 30, 2017.
  4. H. Cheng, M. Liu, L. Chen, H. Broszio, M. Sester, and M. Y. Yang, “Gatraj: A graph-and attention-based multi-agent trajectory prediction model,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 205, pp. 163–175, 2023.
  5. Y. Chen, B. Ivanovic, and M. Pavone, “Scept: Scene-consistent, policy-based trajectory predictions for planning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17 103–17 112.
  6. W. Zhou, Z. Cao, Y. Xu, N. Deng, X. Liu, K. Jiang, and D. Yang, “Long-tail prediction uncertainty aware trajectory planning for self-driving vehicles,” in 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC).   IEEE, 2022, pp. 1275–1282.
  7. S. Lefèvre, D. Vasquez, and C. Laugier, “A survey on motion prediction and risk assessment for intelligent vehicles,” ROBOMECH journal, vol. 1, no. 1, pp. 1–14, 2014.
  8. W. Shao, J. Li, and H. Wang, “Self-aware trajectory prediction for safe autonomous driving,” in 2023 IEEE Intelligent Vehicles Symposium (IV), 2023, pp. 1–8.
  9. Z. Zhou, L. Ye, J. Wang, K. Wu, and K. Lu, “Hivt: Hierarchical vector transformer for multi-agent motion prediction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 8823–8833.
  10. Z. Sheng, Y. Xu, S. Xue, and D. Li, “Graph-based spatial-temporal convolutional network for vehicle trajectory prediction in autonomous driving,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 10, pp. 17 654–17 665, 2022.
  11. M. Geisslinger, P. Karle, J. Betz, and M. Lienkamp, “Watch-and-learn-net: self-supervised online learning for probabilistic vehicle trajectory prediction,” in 2021 IEEE international conference on systems, man, and cybernetics (SMC).   IEEE, 2021, pp. 869–875.
  12. J. Gao, C. Sun, H. Zhao, Y. Shen, D. Anguelov, C. Li, and C. Schmid, “Vectornet: Encoding hd maps and agent dynamics from vectorized representation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 11 525–11 533.
  13. F.-C. Chou, T.-H. Lin, H. Cui, V. Radosavljevic, T. Nguyen, T.-K. Huang, M. Niedoba, J. Schneider, and N. Djuric, “Predicting motion of vulnerable road users using high-definition maps and efficient convnets,” in 2020 IEEE Intelligent Vehicles Symposium (IV).   IEEE, 2020, pp. 1655–1662.
  14. Y. Ma, X. Zhu, S. Zhang, R. Yang, W. Wang, and D. Manocha, “Trafficpredict: Trajectory prediction for heterogeneous traffic-agents,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 6120–6127.
  15. R. Huang, H. Xue, M. Pagnucco, F. Salim, and Y. Song, “Multimodal trajectory prediction: A survey,” arXiv preprint arXiv:2302.10463, 2023.
  16. Z. Lv, X. Huang, and W. Cao, “An improved gan with transformers for pedestrian trajectory prediction models,” International Journal of Intelligent Systems, vol. 37, no. 8, pp. 4417–4436, 2022.
  17. B. Ivanovic, K. Leung, E. Schmerling, and M. Pavone, “Multimodal deep generative models for trajectory prediction: A conditional variational autoencoder approach,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 295–302, 2020.
  18. H. Zhao, J. Gao, T. Lan, C. Sun, B. Sapp, B. Varadarajan, Y. Shen, Y. Shen, Y. Chai, C. Schmid et al., “Tnt: Target-driven trajectory prediction,” in Conference on Robot Learning.   PMLR, 2021, pp. 895–904.
  19. J. Gu, C. Sun, and H. Zhao, “Densetnt: End-to-end trajectory prediction from dense goal sets,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 15 303–15 312.
  20. F. Zheng, L. Wang, S. Zhou, W. Tang, Z. Niu, N. Zheng, and G. Hua, “Unlimited neighborhood interaction for heterogeneous trajectory prediction,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 13 168–13 177.
  21. J. Gawlikowski, C. R. N. Tassi, M. Ali, J. Lee, M. Humt, J. Feng, A. Kruspe, R. Triebel, P. Jung, R. Roscher et al., “A survey of uncertainty in deep neural networks,” Artificial Intelligence Review, vol. 56, no. Suppl 1, pp. 1513–1589, 2023.
  22. W. Shao, Y. Xu, J. Li, C. Lv, W. Wang, and H. Wang, “How does traffic environment quantitatively affect the autonomous driving prediction?” IEEE Transactions on Intelligent Transportation Systems, pp. 1–16, 2023.
  23. M. Abdar, F. Pourpanah, S. Hussain, D. Rezazadegan, L. Liu, M. Ghavamzadeh, P. Fieguth, X. Cao, A. Khosravi, U. R. Acharya et al., “A review of uncertainty quantification in deep learning: Techniques, applications and challenges,” Information fusion, vol. 76, pp. 243–297, 2021.
  24. Y. Gal and Z. Ghahramani, “Dropout as a bayesian approximation: Representing model uncertainty in deep learning,” in international conference on machine learning.   PMLR, 2016, pp. 1050–1059.
  25. A. Amini, W. Schwarting, A. Soleimany, and D. Rus, “Deep evidential regression,” Advances in Neural Information Processing Systems, vol. 33, pp. 14 927–14 937, 2020.
  26. B. Lakshminarayanan, A. Pritzel, and C. Blundell, “Simple and scalable predictive uncertainty estimation using deep ensembles,” Advances in neural information processing systems, vol. 30, 2017.
  27. Z. Cao, K. Jiang, W. Zhou, S. Xu, H. Peng, and D. Yang, “Continuous improvement of self-driving cars using dynamic confidence-aware reinforcement learning,” Nature Machine Intelligence, vol. 5, no. 2, pp. 145–158, 2023.
  28. Y. Wen, D. Tran, and J. Ba, “Batchensemble: an alternative approach to efficient ensemble and lifelong learning,” arXiv preprint arXiv:2002.06715, 2020.
  29. M. Geisslinger, F. Poszler, and M. Lienkamp, “An ethical trajectory planning algorithm for autonomous vehicles,” Nature Machine Intelligence, vol. 5, no. 2, pp. 137–144, 2023.
  30. J. Xu, W. Shao, Y. Xu, W. Wang, J. Li, and H. Wang, “A risk probability predictor for effective downstream planning tasks,” in 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC).   IEEE, 2023.
  31. S. Khaitan, Q. Lin, and J. M. Dolan, “Safe planning and control under uncertainty for self-driving,” IEEE Transactions on Vehicular Technology, vol. 70, no. 10, pp. 9826–9837, 2021.
  32. J. Hardy and M. Campbell, “Contingency planning over probabilistic hybrid obstacle predictions for autonomous road vehicles,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.   IEEE, 2010, pp. 2237–2242.
  33. W. Xu, J. Pan, J. Wei, and J. M. Dolan, “Motion planning under uncertainty for on-road autonomous driving,” in 2014 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2014, pp. 2507–2512.
  34. A. Cui, S. Casas, A. Sadat, R. Liao, and R. Urtasun, “Lookout: Diverse multi-future prediction and planning for self-driving,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 16 107–16 116.
  35. W. Ding, L. Zhang, J. Chen, and S. Shen, “Epsilon: An efficient planning system for automated vehicles in highly interactive environments,” IEEE Transactions on Robotics, vol. 38, no. 2, pp. 1118–1138, 2021.
  36. T. Li, L. Zhang, S. Liu, and S. Shen, “Marc: Multipolicy and risk-aware contingency planning for autonomous driving,” IEEE Robotics and Automation Letters, 2023.
  37. Y. Chen, P. Karkus, B. Ivanovic, X. Weng, and M. Pavone, “Tree-structured policy planning with learned behavior models,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 7902–7908.
  38. C. Hubmann, J. Schulz, M. Becker, D. Althoff, and C. Stiller, “Automated driving in uncertain environments: Planning with interaction and uncertain maneuver prediction,” IEEE transactions on intelligent vehicles, vol. 3, no. 1, pp. 5–17, 2018.
  39. C.-J. Hoel, K. Wolff, and L. Laine, “Ensemble quantile networks: Uncertainty-aware reinforcement learning with applications in autonomous driving,” IEEE Transactions on Intelligent Transportation Systems, 2023.
  40. K. Yang, X. Tang, S. Qiu, S. Jin, Z. Wei, and H. Wang, “Towards robust decision-making for autonomous driving on highway,” IEEE Transactions on Vehicular Technology, 2023.
  41. X. Tang, K. Yang, H. Wang, J. Wu, Y. Qin, W. Yu, and D. Cao, “Prediction-uncertainty-aware decision-making for autonomous vehicles,” IEEE Transactions on Intelligent Vehicles, vol. 7, no. 4, pp. 849–862, 2022.
  42. K. Yang, B. Li, W. Shao, X. Tang, X. Liu, and H. Wang, “Prediction failure risk-aware decision-making for autonomous vehicles on signalized intersections,” IEEE Transactions on Intelligent Transportation Systems, pp. 1–15, 2023.
  43. W. Zhou, Z. Cao, N. Deng, X. Liu, K. Jiang, and D. Yang, “Dynamically conservative self-driving planner for long-tail cases,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 3, pp. 3476–3488, 2023.
  44. N. Deo, E. Wolff, and O. Beijbom, “Multimodal trajectory prediction conditioned on lane-graph traversals,” in Conference on Robot Learning.   PMLR, 2022, pp. 203–212.
  45. W. Shao, Y. Xu, L. Peng, J. Li, and H. Wang, “Failure detection for motion prediction of autonomous driving: An uncertainty perspective,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 12 721–12 728.
  46. M. Althoff, M. Koschi, and S. Manzinger, “Commonroad: Composable benchmarks for motion planning on roads,” in 2017 IEEE Intelligent Vehicles Symposium (IV).   IEEE, 2017, pp. 719–726.
  47. T. Salzmann, B. Ivanovic, P. Chakravarty, and M. Pavone, “Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16.   Springer, 2020, pp. 683–700.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now