Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

KI-GAN: Knowledge-Informed Generative Adversarial Networks for Enhanced Multi-Vehicle Trajectory Forecasting at Signalized Intersections (2404.11181v2)

Published 17 Apr 2024 in cs.LG, cs.AI, and cs.RO

Abstract: Reliable prediction of vehicle trajectories at signalized intersections is crucial to urban traffic management and autonomous driving systems. However, it presents unique challenges, due to the complex roadway layout at intersections, involvement of traffic signal controls, and interactions among different types of road users. To address these issues, we present in this paper a novel model called Knowledge-Informed Generative Adversarial Network (KI-GAN), which integrates both traffic signal information and multi-vehicle interactions to predict vehicle trajectories accurately. Additionally, we propose a specialized attention pooling method that accounts for vehicle orientation and proximity at intersections. Based on the SinD dataset, our KI-GAN model is able to achieve an Average Displacement Error (ADE) of 0.05 and a Final Displacement Error (FDE) of 0.12 for a 6-second observation and 6-second prediction cycle. When the prediction window is extended to 9 seconds, the ADE and FDE values are further reduced to 0.11 and 0.26, respectively. These results demonstrate the effectiveness of the proposed KI-GAN model in vehicle trajectory prediction under complex scenarios at signalized intersections, which represents a significant advancement in the target field.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Trajectory prediction for vehicle conflict identification at intersections using sequence-to-sequence recurrent neural networks. arXiv preprint arXiv:2210.08009, 2022.
  2. Rohit Abdelraouf, Amr an d Gupta and Kyungtae Han. Interaction-aware personalized vehicle trajectory prediction using temporal graph neural networks. arXiv preprint arXiv:2308.07439, 2023.
  3. Social lstm: Human trajectory prediction in crowded spaces. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 961–971, 2016.
  4. Florent Altché and Arnaud de La Fortelle. An lstm network for highway trajectory prediction. In 2017 IEEE 20th international conference on intelligent transportation systems (ITSC), pages 353–359. IEEE, 2017.
  5. The ind dataset: A drone dataset of naturalistic road user trajectories at german intersections. In 2020 IEEE Intelligent Vehicles Symposium (IV), pages 1929–1934. IEEE, 2020.
  6. opendd: A large-scale roundabout drone dataset. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pages 1–6. IEEE, 2020.
  7. Real-time vehicle trajectory prediction for traffic conflict detection at unsignalized intersections. Journal of Advanced Transportation, 2021.
  8. Argoverse: 3d tracking and forecasting with rich maps. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8748–8757, 2019.
  9. Distributed stochastic model predictive control for a microscopic interactive traffic model. Electronics, 2023.
  10. The impact of vehicle appearance and vehicle behavior on pedestrian interaction with autonomous vehicles. In Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications adjunct, pages 158–162, 2017.
  11. The traffic signal control problem for intersections: a review. EUROPEAN Transport Research Review, 12(1), 2020.
  12. Atten-gan: Pedestrian trajectory prediction with gan based on attention mechanism. Cognitive Computation, 14(6):2296–2305, 2022.
  13. Mixed-integer linear programming for optimal scheduling of autonomous vehicle intersection crossing. IEEE Transactions on Intelligent Vehicles, 3:287–299, 2018.
  14. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  15. Social gan: Socially acceptable trajectories with generative adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2255–2264, 2018.
  16. Long short-term memory. Neural Computation, 9:1735–1780, 1997.
  17. Effect of signal timing on vehicles’ near misses at intersections. Scientific Reports, 13(1):9065, 2023.
  18. Trajectory prediction of turning vehicles based on intersection geometry and observed velocities. 2018 IEEE Intelligent Vehicles Symposium (IV), pages 511–516, 2018.
  19. Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network. 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pages 399–404, 2017.
  20. Social-bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks. Advances in neural information processing systems, 32, 2019.
  21. The round dataset: A drone dataset of road user trajectories at roundabouts in germany. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pages 1–6. IEEE, 2020.
  22. Deep learning-based multimodal trajectory prediction with traffic light. Applied Sciences, 13(22), 2023.
  23. Personalized trajectory prediction for driving behavior modeling in ramp-merging scenarios. In 2023 Seventh IEEE International Conference on Robotic Computing (IRC), pages 1–4. IEEE, 2023.
  24. Vehicle trajectory prediction using lstms with spatial–temporal attention mechanisms. IEEE Intelligent Transportation Systems Magazine, 14:197–208, 2022.
  25. Multimodal motion prediction with stacked transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7577–7586, 2021.
  26. Multi-agent trajectory prediction with graph attention isomorphism neural network. In 2022 IEEE Intelligent Vehicles Symposium (IV), pages 273–279. IEEE, 2022.
  27. Maneuver-based trajectory prediction for self-driving cars using spatio-temporal convolutional networks. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4888–4895, 2021.
  28. Attention based vehicle trajectory prediction. IEEE Transactions on Intelligent Vehicles, 6(1):175–185, 2020.
  29. Graph and recurrent neural network-based vehicle trajectory prediction for highway driving. 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), pages 1934–1939, 2021.
  30. Multi-agent trajectory prediction with heterogeneous edge-enhanced graph attention network. IEEE Transactions on Intelligent Transportation Systems, 23(7):9554–9567, 2022.
  31. Social-patternn: Socially-aware trajectory prediction guided by motion patterns. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 9859–9864. IEEE, 2022.
  32. Impact of traffic lights on trajectory forecasting of human-driven vehicles near signalized intersections. arXiv: Robotics, 2019.
  33. Data-driven vehicle trajectory prediction. Proceedings of the 2016 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, 2016.
  34. You’ll never walk alone: Modeling social behavior for multi-target tracking. In 2009 IEEE 12th international conference on computer vision, pages 261–268. IEEE, 2009.
  35. Energy-efficient dispatching of battery electric truck fleets with backhauls and time windows. SAE International Journal of Electrified Vehicles, 13(14-13-01-0009), 2023.
  36. Predicting vehicles trajectories in urban scenarios with transformer networks and augmented information. 2021 IEEE Intelligent Vehicles Symposium (IV), pages 1051–1056, 2021.
  37. Fjmp: Factorized joint multi-agent motion prediction over learned directed acyclic interaction graphs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13745–13755, 2023.
  38. Vehicle trajectory prediction at intersections using interaction based generative adversarial networks. 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pages 2318–2323, 2019.
  39. Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16, pages 683–700. Springer, 2020.
  40. Ethical decision making in autonomous vehicles: Challenges and research progress. IEEE Intelligent Transportation Systems Magazine, 14(1):6–17, 2020.
  41. Dilemma zone: A comprehensive study of influential factors and behavior analysis. In 2024 Forum for Innovative Sustainable Transportation Systems (FISTS), pages 1–8. IEEE, 2024.
  42. Sind: A drone dataset at signalized intersection in china. In 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC), pages 2471–2478. IEEE, 2022.
  43. Tpcn: Temporal point cloud networks for motion forecasting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11318–11327, 2021.
  44. Towards a fatality-aware benchmark of probabilistic reaction prediction in highly interactive driving scenarios. 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pages 3274–3280, 2018.
  45. Interaction dataset: An international, adversarial and cooperative motion dataset in interactive driving scenarios with semantic maps. arXiv preprint arXiv:1910.03088, 2019.
  46. D2-tpred: Discontinuous dependency for trajectory prediction under traffic lights. In European Conference on Computer Vision, pages 522–539. Springer, 2022.
  47. A novel generation-adversarial-network-based vehicle trajectory prediction method for intelligent vehicular networks. IEEE Internet of Things Journal, 8:2066–2077, 2021.
  48. An analysis of the brake performance of radar-based adaptive cruise control during ramp merging on simulation software. In 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), pages 1112–1115. IEEE, 2022.
  49. Naturalistic driver intention and path prediction using recurrent neural networks. IEEE Transactions on Intelligent Transportation Systems, 21:1584–1594, 2018.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now