Smart Infrastructure: A Research Junction (2307.06177v1)
Abstract: Complex inner-city junctions are among the most critical traffic areas for injury and fatal accidents. The development of highly automated driving (HAD) systems struggles with the complex and hectic everyday life within those areas. Sensor-equipped smart infrastructures, which can communicate and cooperate with vehicles, are essential to enable a holistic scene understanding to resolve occlusions drivers and vehicle perception systems for themselves can not cover. We introduce an intelligent research infrastructure equipped with visual sensor technology, located at a public inner-city junction in Aschaffenburg, Germany. A multiple-view camera system monitors the traffic situation to perceive road users' behavior. Both motorized and non-motorized traffic is considered. The system is used for research in data generation, evaluating new HAD sensors systems, algorithms, and AI training strategies using real-, synthetic- and augmented data. In addition, the junction features a highly accurate digital twin. Real-world data can be taken into the digital twin for simulation purposes and synthetic data generation.
- M. Goldhammer, E. Strigel, D. Meissner, U. Brunsmann, K. Doll, and K. Dietmayer, “Cooperative multi sensor network for traffic safety applications at intersections,” in 2012 15th International IEEE Conference on Intelligent Transportation Systems, pp. 1178–1183, 2012.
- DLR Institute of Transportation Systems, “Aim research intersection: Instrument for traffic detection and behavior assessment for a complex urban intersection,” Journal of large-scale research facilitie, vol. 2, p. A65, 2016.
- “Continental Launches Smart City Mobility and Transportation Hub for Safer and Smarter Cities.” http://https://www.continental.com/en-us/press-/press-releases/smart-city-mobility-205048.
- “AI Data Tooling.” http://www.ki-datatooling.de.
- M. Shokrolah Shirazi and B. Morris, “Looking at intersections: A survey of intersection monitoring, behavior and safety analysis of recent studies,” IEEE Transactions on Intelligent Transportation Systems, vol. PP, pp. 1–21, 08 2016.
- M. Bieshaar, G. Reitberger, S. Zernetsch, B. Sick, E. Fuchs, and K. Doll, “Detecting intentions of vulnerable road users based on collective intelligence,” CoRR, vol. abs/1809.03916, 2018.
- G. Reitberger, S. Zernetsch, M. Bieshaar, B. Sick, K. Doll, and E. Fuchs, “Cooperative tracking of cyclists based on smart devices and infrastructure,” 2018.
- M. Bieshaar, S. Zernetsch, A. Hubert, B. Sick, and K. Doll, “Cooperative starting movement detection of cyclists using convolutional neural networks and a boosted stacking ensemble,” CoRR, vol. abs/1803.03487, 2018.
- S. Zernetsch, H. Reichert, V. Kress, K. Doll, and B. Sick, “Trajectory forecasts with uncertainties of vulnerable road users by means of neural networks,” in 2019 IEEE Intelligent Vehicles Symposium (IV), pp. 810–815, 2019.
- V. Kress, J. Jung, S. Zernetsch, K. Doll, and B. Sick, “Human pose estimation in real traffic scenes,” in 2018 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 518–523, 2018.
- “GIDAS, German in-depth accident study.” https://www.gidas.org.
- European Commission, “European annual accident report 2018,” tech. rep., April 2018.
- ISO/IEC 14496-10, “Coding of Audiovisual Objects-Part 10: Advanced Video Coding/ITU-T Recommendation H.264 Advanced video coding for generic audiovisual services,” 2003.
- Y. Wu, A. Kirillov, F. Massa, W.-Y. Lo, and R. Girshick, “Detectron2.” https://github.com/facebookresearch/detectron2, 2019.
- Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh, “Realtime multi-person 2d pose estimation using part affinity fields,” in CVPR, 2017.
- J. Carreira and A. Zisserman, “Quo vadis, action recognition? a new model and the kinetics dataset,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4724–4733, 2017.
- S. Zernetsch, S. Schreck, V. Kress, K. Doll, and B. Sick, “Image sequence based cyclist action recognition using multi-stream 3d convolution,” in International Conference on Pattern Recognition (ICPR), 2021. (accepted).