Big Data and Deep Learning in Smart Cities: A Comprehensive Dataset for AI-Driven Traffic Accident Detection and Computer Vision Systems (2401.03587v1)
Abstract: In the dynamic urban landscape, where the interplay of vehicles and pedestrians defines the rhythm of life, integrating advanced technology for safety and efficiency is increasingly crucial. This study delves into the application of cutting-edge technological methods in smart cities, focusing on enhancing public safety through improved traffic accident detection. Action recognition plays a pivotal role in interpreting visual data and tracking object motion such as human pose estimation in video sequences. The challenges of action recognition include variability in rapid actions, limited dataset, and environmental factors such as (Weather, Illumination, and Occlusions). In this paper, we present a novel comprehensive dataset for traffic accident detection. This datasets is specifically designed to bolster computer vision and action recognition systems in predicting and detecting road traffic accidents. We integrated datasets from wide variety of data sources, road networks, weather conditions, and regions across the globe. This approach is underpinned by empirical studies, aiming to contribute to the discourse on how technology can enhance the quality of life in densely populated areas. This research aims to bridge existing research gaps by introducing benchmark datasets that leverage state-of-the-art algorithms tailored for traffic accident detection in smart cities. These dataset is expected to advance academic research and also enhance real-time accident detection applications, contributing significantly to the evolution of smart urban environments. Our study marks a pivotal step towards safer, more efficient smart cities, harnessing the power of AI and machine learning to transform urban living.
- P. Neirotti, A. De Marco, A. C. Cagliano, G. Mangano, and F. Scorrano, “Current trends in smart city initiatives: Some stylised facts,” Cities, vol. 38, pp. 25–36, 2014.
- R. Poppe, “A survey on vision-based human action recognition,” Image and vision computing, vol. 28, no. 6, pp. 976–990, 2010.
- K. Soomro and A. R. Zamir, “Action recognition in realistic sports videos,” Advances in Computer Vision and Pattern Recognition, vol. 71, pp. 181–208, 2014.
- H.-B. Zhang, Y.-X. Zhang, B. Zhong, Q. Lei, L. Yang, J.-X. Du, and D.-S. Chen, “A comprehensive survey of vision-based human action recognition methods,” Sensors, vol. 19, no. 5, p. 1005, 2019.
- M. A. R. Ahad, “Motion history images for action recognition and understanding,” 2012.
- V. Adewopo, N. Elsayed, Z. ElSayed, M. Ozer, C. Zekios, A. Abdelgawad, and M. Bayoumi, “Traffic accident detection video dataset for ai-driven computer vision systems in smart city transportation,” 2023.
- A. Caragliu, C. Del Bo, and P. Nijkamp, “Smart cities in europe,” in Creating Smart-er Cities, pp. 65–82, Routledge, 2013.
- Y. Yao, X. Wang, M. Xu, Z. Pu, Y. Wang, E. Atkins, and D. Crandall, “DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
- L. Yu, B. Du, X. Hu, L. Sun, L. Han, and W. Lv, “Deep spatio-temporal graph convolutional network for traffic accident prediction,” Neurocomputing, vol. 423, pp. 135–147, 2021.
- X. Wang, Y. Ma, Y. Wang, W. Jin, X. Wang, J. Tang, C. Jia, and J. Yu, “Traffic Flow Prediction via Spatial Temporal Graph Neural Network,” in The Web Conference 2020 - Proceedings of the World Wide Web Conference, WWW 2020, vol. 11, pp. 1082–1092, Association for Computing Machinery, Inc, apr 2020.
- W. Bao, Q. Yu, and Y. Kong, “Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learning,” in MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia, pp. 2682–2690, Association for Computing Machinery, Inc, aug 2020.
- D. R. Reddy, C. Chella, K. B. Ravi Teja, H. Rose Baby, and P. Kodali, “Autonomous Vehicle Based on Deep Q-Learning and YOLOv3 with Data Augmentation,” in ICCISc 2021 - 2021 International Conference on Communication, Control and Information Sciences, Proceedings, Institute of Electrical and Electronics Engineers Inc., jun 2021.
- D. Fernández-Llorca, M. Biparva, R. Izquierdo-Gonzalo, and J. K. Tsotsos, “Two-Stream Networks for Lane-Change Prediction of Surrounding Vehicles,” in 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020, Institute of Electrical and Electronics Engineers Inc., sep 2020.
- A. Ali, Y. Zhu, and M. Zakarya, “Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction,” Neural Networks, vol. 145, pp. 233–247, 2022.
- J. Wang, Q. Chen, and H. Gong, “STMAG: A spatial-temporal mixed attention graph-based convolution model for multi-data flow safety prediction,” Information Sciences, vol. 525, pp. 16–36, 2020.
- A. A. Alkandari and M. Aljandal, “Theory of dynamic fuzzy logic traffic light integrated system with accident detection and action,” in 2015 2nd International Conference on Computing Technology and Information Management, ICCTIM 2015, pp. 62–68, Institute of Electrical and Electronics Engineers Inc., aug 2015.
- W. Riaz, G. Chenqiang, A. Azeem, Saifullah, J. A. Bux, and A. Ullah, “Traffic Anomaly Prediction System Using Predictive Network,” Remote Sensing, vol. 14, p. 447, jan 2022.
- X. Tang, X. L. Huang, S. Y. Sun, H. Dong, X. Zhang, Y. Gao, and N. Liu, “Intelligent recognition of traffic video based on mixture LDA model,” in Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, vol. 183, pp. 356–363, Springer Verlag, 2017.
- T. Huang, S. Wang, and A. Sharma, “Highway crash detection and risk estimation using deep learning,” Accident Analysis and Prevention, vol. 135, 2020.
- M. Bortnikov, A. Khan, A. M. Khattak, and M. Ahmad, “Accident Recognition via 3D CNNs for Automated Traffic Monitoring in Smart Cities,” in Advances in Intelligent Systems and Computing, vol. 944, pp. 256–264, Springer Verlag, 2020.
- G. Gupta, R. Singh, A. Singh Patel, and M. Ojha, “Accident detection using time-distributed model in videos,” in Advances in Intelligent Systems and Computing, vol. 1184, pp. 214–223, Springer Science and Business Media Deutschland GmbH, 2021.
- Y. Yang, H. Song, S. Sun, W. Zhang, Y. Chen, L. Rakal, and Y. Fang, “A fast and effective video vehicle detection method leveraging feature fusion and proposal temporal link,” in Journal of Real-Time Image Processing, vol. 18, pp. 1261–1274, Springer Science and Business Media Deutschland GmbH, aug 2021.
- E. P. Ijjina, D. Chand, S. Gupta, and K. Goutham, “Computer Vision-based Accident Detection in Traffic Surveillance,” in 2019 10th International Conference on Computing, Communication and Networking Technologies, ICCCNT 2019, Institute of Electrical and Electronics Engineers Inc., jul 2019.
- T. You and B. Han, “Traffic Accident Benchmark for Causality Recognition,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12352 LNCS, pp. 540–556, Springer Science and Business Media Deutschland GmbH, 2020.
- A. Srinivasan, A. Srikanth, H. Indrajit, and V. Narasimhan, “A Novel Approach for Road Accident Detection using DETR Algorithm,” in 2020 International Conference on Intelligent Data Science Technologies and Applications, IDSTA 2020, pp. 75–80, Institute of Electrical and Electronics Engineers Inc., oct 2020.
- Z. Hui, Y. Xie, M. Lu, and J. Fu, “Vision-based real-time traffic accident detection,” in Proceedings of the World Congress on Intelligent Control and Automation (WCICA), vol. 2015-March, pp. 1035–1038, Institute of Electrical and Electronics Engineers Inc., mar 2015.
- L. min Xia, X. jie Hu, and J. Wang, “Anomaly detection in traffic surveillance with sparse topic model,” Journal of Central South University, vol. 25, pp. 2245–2257, oct 2018.
- N. R. Vatti, P. Vatti, R. Vatti, and C. Garde, “Smart Road Accident Detection and communication System,” in Proceedings of the 2018 International Conference on Current Trends towards Converging Technologies, ICCTCT 2018, Institute of Electrical and Electronics Engineers Inc., nov 2018.
- V. Adewopo, N. Elsayed, Z. Elsayed, M. Ozer, A. Abdelgawad, and M. Bayoumi, “Review on action recognition for accident detection in smart city transportation systems,” ArXiv, vol. abs/2208.09588, 2022.
- R. Krajewski, J. Bock, L. Kloeker, and L. Eckstein, “The highd dataset: A drone dataset of naturalistic vehicle trajectories on german highways for validation of highly automated driving systems,” in 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 2118–2125, IEEE, 2018.
- W. Zhan, L. Sun, D. Wang, H. Shi, A. Clausse, M. Naumann, J. Kummerle, H. Konigshof, C. Stiller, A. de La Fortelle, et al., “Interaction dataset: An international, adversarial and cooperative motion dataset in interactive driving scenarios with semantic maps,” arXiv preprint arXiv:1910.03088, 2019.
- J. Colyar and J. Halkias, “Ngsim-us highway 101 dataset,” Federal Highway Administration (FHWA), Tech. Rep. FHWA-HRT-07-030, DC, USA, 2007.
- J. Halkias and J. Colyar, “Ngsim interstate 80 freeway dataset,” US Federal Highway Administration, FHWA-HRT-06-137, Washington, DC, USA, 2006.
- H. Zhao, C. Wang, Y. Lin, F. Guillemard, S. Geronimi, and F. Aioun, “On-road vehicle trajectory collection and scene-based lane change analysis: Part i,” IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 1, pp. 192–205, 2017.
- R. Izquierdo, A. Quintanar, I. Parra, D. Fernández-Llorca, and M. Sotelo, “The prevention dataset: a novel benchmark for prediction of vehicles intentions,” in 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 3114–3121, IEEE, 2019.
- P. Wang, X. Huang, X. Cheng, D. Zhou, Q. Geng, and R. Yang, “The apolloscape open dataset for autonomous driving and its application,” IEEE transactions on pattern analysis and machine intelligence, 2019.
- W. Bao, Q. Yu, and Y. Kong, “Uncertainty-based traffic accident anticipation with spatio-temporal relational learning,” in ACM Multimedia Conference, May 2020.
- V. Adewopo and N. Elsayed, “Smart city transportation: Deep learning ensemble approach for traffic accident detection,” arXiv preprint arXiv:2310.10038, 2023.
- V. Adewopo, N. Elsayed, and K. Anderson, “Baby physical safety monitoring in smart home using action recognition system,” in SoutheastCon 2023, pp. 142–149, IEEE, 2023.
- V. Adewopo, N. Elsayed, Z. Elsayed, M. Ozer, V. Wangia-Anderson, and A. Abdelgawad, “Ai on the road: A comprehensive analysis of traffic accidents and accident detection system in smart cities,” arXiv preprint arXiv:2307.12128, 2023.