Papers
Topics
Authors
Recent
Search
2000 character limit reached

Bi-Level Control of Weaving Sections in Mixed Traffic Environments with Connected and Automated Vehicles

Published 24 Mar 2024 in eess.SY and cs.SY | (2403.16225v1)

Abstract: Connected and automated vehicles (CAVs) can be beneficial for improving the operation of highway bottlenecks such as weaving sections. This paper proposes a bi-level control approach based on an upper-level deep reinforcement learning controller and a lower-level model predictive controller to coordinate the lane-changings of a mixed fleet of CAVs and human-driven vehicles (HVs) in weaving sections. The upper level represents a roadside controller that collects vehicular information from the entire weaving section and determines the control weights used in the lower-level controller. The lower level is implemented within each CAV, which takes the control weights from the upper-level controller and generates the acceleration and steering angle for individual CAVs based on the local situation. The lower-level controller further incorporates an HV trajectory predictor, which is capable of handling the dynamic topology of vehicles in weaving scenarios with intensive mandatory lane changes. The case study inspired by a real weaving section in Basel, Switzerland, shows that our method consistently outperforms state-of-the-art benchmarks.

Authors (3)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. P. Lertworawanich and L. Elefteriadou, “A methodology for estimating capacity at ramp weaves based on gap acceptance and linear optimization,” Transportation Research Part B: Methodological, vol. 37, no. 5, pp. 459–483, 2003.
  2. D. Chen and S. Ahn, “Capacity-drop at extended bottlenecks: Merge, diverge, and weave,” Transportation Research Part B: Methodological, vol. 108, pp. 1–20, 2018.
  3. G. Tilg, K. Yang, and M. Menendez, “Evaluating the effects of automated vehicle technology on the capacity of freeway weaving sections,” Transportation Research Part C: Emerging Technologies, vol. 96, pp. 3–21, 2018.
  4. B. Wortelen, M. Baumann, and A. Lüdtke, “Dynamic simulation and prediction of drivers’ attention distribution,” Transportation research part F: traffic psychology and behaviour, vol. 21, pp. 278–294, 2013.
  5. N. Kauffmann, F. Winkler, F. Naujoks, and M. Vollrath, ““what makes a cooperative driver?” identifying parameters of implicit and explicit forms of communication in a lane change scenario,” Transportation research part F: traffic psychology and behaviour, vol. 58, pp. 1031–1042, 2018.
  6. M. Cai, Q. Xu, C. Chen, J. Wang, K. Li, J. Wang, and X. Wu, “Formation control with lane preference for connected and automated vehicles in multi-lane scenarios,” Transportation research part C: emerging technologies, vol. 136, p. 103513, 2022.
  7. Y. Wang, L. Wang, J. Guo, I. Papamichail, M. Papageorgiou, F.-Y. Wang, R. Bertini, W. Hua, and Q. Yang, “Ego-efficient lane changes of connected and automated vehicles with impacts on traffic flow,” Transportation research part C: emerging technologies, vol. 138, p. 103478, 2022.
  8. J. Peng, S. Zhang, Y. Zhou, and Z. Li, “An integrated model for autonomous speed and lane change decision-making based on deep reinforcement learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 11, pp. 21 848–21 860, 2022.
  9. J. Zhang, C. Chang, X. Zeng, and L. Li, “Multi-agent drl-based lane change with right-of-way collaboration awareness,” IEEE Transactions on Intelligent Transportation Systems, 2022.
  10. G. Wang, J. Hu, Z. Li, and L. Li, “Harmonious lane changing via deep reinforcement learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 5, pp. 4642–4650, 2021.
  11. M. Tajalli, R. Niroumand, and A. Hajbabaie, “Distributed cooperative trajectory and lane changing optimization of connected automated vehicles: Freeway segments with lane drop,” Transportation Research Part C: Emerging Technologies, vol. 143, p. 103761, 2022.
  12. C. Yang, X. Chen, X. Lin, and M. Li, “Coordinated trajectory planning for lane-changing in the weaving areas of dedicated lanes for connected and automated vehicles,” Available at SSRN 4068717, 2022.
  13. X. Han, R. Xu, X. Xia, A. Sathyan, Y. Guo, P. Bujanović, E. Leslie, M. Goli, and J. Ma, “Strategic and tactical decision-making for cooperative vehicle platooning with organized behavior on multi-lane highways,” Transportation Research Part C: Emerging Technologies, vol. 145, p. 103952, 2022.
  14. E. Amini, A. Omidvar, and L. Elefteriadou, “Optimizing operations at freeway weaves with connected and automated vehicles,” Transportation Research Part C: Emerging Technologies, vol. 126, p. 103072, 2021.
  15. H. Zhang, L. Du, and J. Shen, “Hybrid mpc system for platoon based cooperative lane change control using machine learning aided distributed optimization,” Transportation Research Part B: Methodological, vol. 159, pp. 104–142, 2022.
  16. J. Qiu and L. Du, “cooperative trajectory control for synchronizing the movement of two connected and autonomous vehicles separated in a mixed traffic flow,” Transportation Research Part B: Methodological, vol. 174, p. 102769, 2023.
  17. A. Pareja, G. Domeniconi, J. Chen, T. Ma, T. Suzumura, H. Kanezashi, T. Kaler, T. Schardl, and C. Leiserson, “Evolvegcn: Evolving graph convolutional networks for dynamic graphs,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 04, 2020, pp. 5363–5370.
  18. Z. Gu, Y. Yin, S. E. Li, J. Duan, F. Zhang, S. Zheng, and R. Yang, “Integrated eco-driving automation of intelligent vehicles in multi-lane scenario via model-accelerated reinforcement learning,” Transportation Research Part C: Emerging Technologies, vol. 144, p. 103863, 2022.
  19. D. Li, F. Zhu, T. Chen, Y. D. Wong, C. Zhu, and J. Wu, “Coor-plt: A hierarchical control model for coordinating adaptive platoons of connected and autonomous vehicles at signal-free intersections based on deep reinforcement learning,” Transportation Research Part C: Emerging Technologies, vol. 146, p. 103933, 2023.
  20. X. Gong, S. Liang, B. Wang, and W. Zhang, “Game theory-based decision-making and iterative predictive lateral control for cooperative obstacle avoidance of guided vehicle platoon,” IEEE Transactions on Vehicular Technology, 2023.
  21. J. Liang, Y. Li, G. Yin, L. Xu, Y. Lu, J. Feng, T. Shen, and G. Cai, “A mas-based hierarchical architecture for the cooperation control of connected and automated vehicles,” IEEE Transactions on Vehicular Technology, vol. 72, no. 2, pp. 1559–1573, 2022.
  22. J. Wang, Y. Yan, K. Zhang, Y. Chen, M. Cao, and G. Yin, “Path planning on large curvature roads using driver-vehicle-road system based on the kinematic vehicle model,” IEEE Transactions on Vehicular Technology, vol. 71, no. 1, pp. 311–325, 2021.
  23. E. Soria, F. Schiano, and D. Floreano, “Distributed predictive drone swarms in cluttered environments,” IEEE Robotics and Automation Letters, vol. 7, no. 1, pp. 73–80, 2021.
  24. A. Kesting, M. Treiber, and D. Helbing, “General lane-changing model mobil for car-following models,” Transportation Research Record, vol. 1999, pp. 86 – 94, 2007. [Online]. Available: https://api.semanticscholar.org/CorpusID:39345746
  25. S. Albeaik, A. Bayen, M. T. Chiri, X. Gong, A. Hayat, N. Kardous, A. Keimer, S. T. McQuade, B. Piccoli, and Y. You, “Limitations and improvements of the intelligent driver model (idm),” SIAM Journal on Applied Dynamical Systems, vol. 21, no. 3, pp. 1862–1892, 2022.
  26. X. Jia, P. Wu, L. Chen, Y. Liu, H. Li, and J. Yan, “Hdgt: Heterogeneous driving graph transformer for multi-agent trajectory prediction via scene encoding,” IEEE transactions on pattern analysis and machine intelligence, 2023.
  27. G. Alinezhad Noghre, V. Katariya, A. Danesh Pazho, C. Neff, and H. Tabkhi, “Pishgu: Universal path prediction network architecture for real-time cyber-physical edge systems,” in Proceedings of the ACM/IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2023), 2023, pp. 88–97.
  28. F. Marchetti, F. Becattini, L. Seidenari, and A. D. Bimbo, “Mantra: Memory augmented networks for multiple trajectory prediction,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 7143–7152.
  29. H. Liao, S. Liu, Y. Li, Z. Li, C. Wang, B. Wang, Y. Guan, and C. Xu, “Human observation-inspired trajectory prediction for autonomous driving in mixed-autonomy traffic environments,” arXiv preprint arXiv:2402.04318, 2024.
  30. E. Leurent, “An environment for autonomous driving decision-making,” https://github.com/eleurent/highway-env, 2018.
  31. Y. Xue, X. Zhang, Z. Cui, B. Yu, and K. Gao, “A platoon-based cooperative optimal control for connected autonomous vehicles at highway on-ramps under heavy traffic,” Transportation research part C: emerging technologies, vol. 150, p. 104083, 2023.
  32. R. Wei, S. Zeng, C. Li, A. Garcia, A. D. McDonald, and M. Hong, “A bayesian approach to robust inverse reinforcement learning,” in Conference on Robot Learning.   PMLR, 2023, pp. 2304–2322.
  33. S. Dixit, U. Montanaro, M. Dianati, D. Oxtoby, T. Mizutani, A. Mouzakitis, and S. Fallah, “Trajectory planning for autonomous high-speed overtaking in structured environments using robust mpc,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 6, pp. 2310–2323, 2019.
  34. Q. Zhang, R. Langari, H. E. Tseng, D. Filev, S. Szwabowski, and S. Coskun, “A game theoretic model predictive controller with aggressiveness estimation for mandatory lane change,” IEEE Transactions on Intelligent Vehicles, vol. 5, no. 1, pp. 75–89, 2019.
  35. H. Yang and H. Rakha, “Feedback control speed harmonization algorithm: Methodology and preliminary testing,” Transportation Research Part C: Emerging Technologies, vol. 81, pp. 209–226, 2017.
  36. P. Wu, F. Gao, X. Tang, and K. Li, “An integrated decision and motion planning framework for automated driving on highway,” IEEE Transactions on Vehicular Technology, 2023.
  37. K. Sun, S. Gong, Y. Zhou, Z. Chen, X. Zhao, and X. Wu, “A multi-vehicle cooperative control scheme in mitigating traffic oscillation with smooth tracking-objective switching for a single-vehicle lane change scenario,” Transportation research part C: emerging technologies, vol. 159, p. 104487, 2024.
  38. X. Lin, Y. Wang, J. Olkin, and D. Held, “Softgym: Benchmarking deep reinforcement learning for deformable object manipulation,” in Conference on Robot Learning.   PMLR, 2021, pp. 432–448.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up