Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture (2404.03789v1)

Published 4 Apr 2024 in cs.CV and cs.AI

Abstract: Safety and robustness are crucial factors in developing trustworthy autonomous vehicles. One essential aspect of addressing these factors is to equip vehicles with the capability to predict future trajectories for all moving objects in the surroundings and quantify prediction uncertainties. In this paper, we propose the Sequential Neural Variational Agent (SeNeVA), a generative model that describes the distribution of future trajectories for a single moving object. Our approach can distinguish Out-of-Distribution data while quantifying uncertainty and achieving competitive performance compared to state-of-the-art methods on the Argoverse 2 and INTERACTION datasets. Specifically, a 0.446 meters minimum Final Displacement Error, a 0.203 meters minimum Average Displacement Error, and a 5.35% Miss Rate are achieved on the INTERACTION test set. Extensive qualitative and quantitative analysis is also provided to evaluate the proposed model. Our open-source code is available at https://github.com/PurdueDigitalTwin/seneva.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Information Fusion, 76:243–297, 2021.
  2. Social lstm: Human trajectory prediction in crowded spaces. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 961–971, 2016.
  3. Multipath: Multiple probabilistic anchor trajectory hypotheses for behavior prediction. In Proceedings of the Conference on Robot Learning, pages 86–99. PMLR, 2020.
  4. Argoverse: 3d tracking and forecasting with rich maps. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8748–8757, 2019.
  5. Forecast-mae: Self-supervised pre-training for motion forecasting with masked autoencoders. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 8679–8689, 2023.
  6. Probabilistic 3d multi-modal, multi-object tracking for autonomous driving. In 2021 IEEE international conference on robotics and automation (ICRA), pages 14227–14233. IEEE, 2021.
  7. Uncertainty-aware short-term motion prediction of traffic actors for autonomous driving. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020.
  8. A review and comparative study on probabilistic object detection in autonomous driving. IEEE Transactions on Intelligent Transportation Systems, 23(8):9961–9980, 2021.
  9. Vectornet: Encoding hd maps and agent dynamics from vectorized representation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  10. GOHOME: Graph-Oriented Heatmap Output for future Motion Estimation. In 2022 International Conference on Robotics and Automation (ICRA), pages 9107–9114, Philadelphia, PA, USA, 2022. IEEE.
  11. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  12. Densetnt: End-to-end trajectory prediction from dense goal sets. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15303–15312, 2021.
  13. Social gan: Socially acceptable trajectories with generative adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2255–2264, 2018.
  14. Probabilistic object detection: Definition and evaluation. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1031–1040, 2020.
  15. Learning non-maximum suppression. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4507–4515, 2017.
  16. Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Driving. In 2022 International Conference on Robotics and Automation (ICRA), pages 2605–2611, Philadelphia, PA, USA, 2022. IEEE.
  17. The trajectron: Probabilistic multi-agent trajectory modeling with dynamic spatiotemporal graphs. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2375–2384, 2019.
  18. Generative modeling of multimodal multi-human behavior. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3088–3095. IEEE, 2018.
  19. Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervision. In 2023 IEEE Intelligent Vehicles Symposium (IV), pages 1–8, Anchorage, AK, USA, 2023. IEEE.
  20. HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encoding, 2022. arXiv:2205.09753 [cs].
  21. Auto-encoding variational bayes, 2022.
  22. On convergence and stability of gans, 2017.
  23. Social-bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks. Advances in Neural Information Processing Systems, 32, 2019.
  24. On Information and Sufficiency. The Annals of Mathematical Statistics, 22(1):79 – 86, 1951.
  25. Simple and scalable predictive uncertainty estimation using deep ensembles. In Advances in Neural Information Processing Systems. Curran Associates, Inc., 2017.
  26. DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2165–2174, Honolulu, HI, 2017. IEEE.
  27. Learning lane graph representations for motion forecasting. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16, pages 541–556. Springer, 2020.
  28. Online prediction of lane change with a hierarchical learning-based approach. In 2022 IEEE International Conference on Robotics and Automation (ICRA), 2022.
  29. Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
  30. Multimodal Motion Prediction with Stacked Transformers. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 7573–7582, Nashville, TN, USA, 2021. IEEE.
  31. Vision-cloud data fusion for adas: A lane change prediction case study. IEEE Transactions on Intelligent Vehicles, 7(2):210–220, 2022.
  32. Towards generalizable and interpretable motion prediction: A deep variational bayes approach, 2024.
  33. Long Short-Term Memory. Long short-term memory. Neural computation, 9(8):1735–1780, 2010.
  34. Analysis of recurrent neural networks for probabilistic modeling of driver behavior. IEEE Transactions on Intelligent Transportation Systems, 18(5):1289–1298, 2016.
  35. Efficient non-maximum suppression. In 18th international conference on pattern recognition (ICPR’06), pages 850–855. IEEE, 2006.
  36. Sophie: An attentive gan for predicting paths compliant to social and physical constraints. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1349–1358, 2019.
  37. Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16, pages 683–700. Springer, 2020.
  38. Multimodal probabilistic model-based planning for human-robot interaction. In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages 3399–3406. IEEE, 2018.
  39. Learning structured output representation using deep conditional generative models. Advances in neural information processing systems, 28, 2015.
  40. Scalability in perception for autonomous driving: Waymo open dataset. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2446–2454, 2020.
  41. Social attention: Modeling attention in human crowds. In 2018 IEEE international Conference on Robotics and Automation (ICRA), pages 4601–4607. IEEE, 2018.
  42. Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(2):283–298, 2008.
  43. Uncertainty quantification and reduction in aircraft trajectory prediction using bayesian-entropy information fusion. Reliability Engineering & System Safety, 212:107650, 2021.
  44. Argoverse 2: Next generation datasets for self-driving perception and forecasting, 2023.
  45. Interaction dataset: An international, adversarial and cooperative motion dataset in interactive driving scenarios with semantic maps, 2019.
  46. Tnt: Target-driven trajectory prediction. In Proceedings of the 2020 Conference on Robot Learning, pages 895–904. PMLR, 2021.
  47. Multi-agent tensor fusion for contextual trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12126–12134, 2019.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets