Vehicle Detection Performance in Nordic Region (2403.15017v1)
Abstract: This paper addresses the critical challenge of vehicle detection in the harsh winter conditions in the Nordic regions, characterized by heavy snowfall, reduced visibility, and low lighting. Due to their susceptibility to environmental distortions and occlusions, traditional vehicle detection methods have struggled in these adverse conditions. The advanced proposed deep learning architectures brought promise, yet the unique difficulties of detecting vehicles in Nordic winters remain inadequately addressed. This study uses the Nordic Vehicle Dataset (NVD), which has UAV images from northern Sweden, to evaluate the performance of state-of-the-art vehicle detection algorithms under challenging weather conditions. Our methodology includes a comprehensive evaluation of single-stage, two-stage, and transformer-based detectors against the NVD. We propose a series of enhancements tailored to each detection framework, including data augmentation, hyperparameter tuning, transfer learning, and novel strategies designed explicitly for the DETR model. Our findings not only highlight the limitations of current detection systems in the Nordic environment but also offer promising directions for enhancing these algorithms for improved robustness and accuracy in vehicle detection amidst the complexities of winter landscapes. The code and the dataset are available at https://nvd.ltu-ai.dev
- “Dataset: Traffic images captured from UAVs for use in training machine vision algorithms for traffic management” In Data 7.5 Multidisciplinary Digital Publishing Institute, 2022, pp. 53
- “VisDrone-DET2021: The vision meets drone object detection challenge results” In Proceedings of the IEEE/CVF International conference on computer vision, 2021, pp. 2847–2854
- “End-to-end object detection with transformers” In European conference on computer vision, 2020, pp. 213–229 Springer
- “Data augmentation analysis in vehicle detection from aerial videos” In 2020 RIVF International Conference on Computing and Communication Technologies (RIVF), 2020, pp. 1–3 IEEE
- “Efficient maximally stable extremal region (MSER) tracking” In 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06) 1, 2006, pp. 553–560 Ieee
- Pedro Felzenszwalb, David McAllester and Deva Ramanan “A discriminatively trained, multiscale, deformable part model” In 2008 IEEE conference on computer vision and pattern recognition, 2008, pp. 1–8 Ieee
- Andreas Geiger, Philip Lenz and Raquel Urtasun “Are we ready for autonomous driving? the kitti vision benchmark suite” In 2012 IEEE conference on computer vision and pattern recognition, 2012, pp. 3354–3361 IEEE
- “Rich feature hierarchies for accurate object detection and semantic segmentation” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 580–587
- “Fast-D: When non-smoothing color feature meets moving object detection in real-time” In IEEE Access 8 IEEE, 2020, pp. 186756–186772
- “Mobilenets: Efficient convolutional neural networks for mobile vision applications” In arXiv preprint arXiv:1704.04861, 2017
- “Utilising visual attention cues for vehicle detection and tracking” In 2020 25th International Conference on Pattern Recognition (ICPR), 2021, pp. 5535–5542 IEEE
- “3D-DETNet: a single stage video-based vehicle detector” In Third International Workshop on Pattern Recognition 10828, 2018, pp. 60–66 SPIE
- “Feature pyramid networks for object detection” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2117–2125
- “Fast multiclass vehicle detection on aerial images” In IEEE Geoscience and Remote Sensing Letters 12.9 IEEE, 2015, pp. 1938–1942
- “Swin transformer: Hierarchical vision transformer using shifted windows” In Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 10012–10022
- “Bibliometric analysis of one-stage and two-stage object detection” In Libr. Philos. Pract 4910, 2021, pp. 34
- Madhusri Maity, Sriparna Banerjee and Sheli Sinha Chaudhuri “Faster r-cnn and yolo based vehicle detection: A survey” In 2021 5th international conference on computing methodologies and communication (ICCMC), 2021, pp. 1442–1447 IEEE
- “Robust wide-baseline stereo from maximally stable extremal regions” In Image and vision computing 22.10 Elsevier, 2004, pp. 761–767
- Chaochao Meng, Hong Bao and Yan Ma “Vehicle detection: A review” In Journal of Physics: Conference Series 1634.1, 2020, pp. 012107 IOP Publishing
- “Improved faster RCNN based on feature amplification and oversampling data augmentation for oriented vehicle detection in aerial images” In Remote Sensing 12.16 MDPI, 2020, pp. 2558
- “A new DCT-PCM method for license plate number detection in drone images” In Pattern Recognition Letters 148 Elsevier, 2021, pp. 45–53
- “Car plate detection engine based on conventional edge detection technique” In The International Conference on Computer Graphics, Multimedia and Image Processing (CGMIP2014). The Society of Digital Information and Wireless Communication, 2014
- “License Plate Number Detection in Drone Images” In Artificial Intelligence and Applications, 2022
- “Nordic Vehicle Dataset (NVD): Performance of vehicle detectors using newly captured NVD from UAV in different snowy weather conditions.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 5313–5321
- Nama Ezzaalddin Mustafa and Fattah Alizadeh “Unmanned Aerial Vehicle (UAV) Images of Road Vehicles Dataset” In Data in Brief Elsevier, 2024, pp. 110264
- Sankar K Pal, B Uma Shankar and Pabitra Mitra “Granular computing, rough entropy and object extraction” In Pattern recognition letters 26.16 Elsevier, 2005, pp. 2509–2517
- “You only look once: Unified, real-time object detection” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779–788
- “Faster r-cnn: Towards real-time object detection with region proposal networks” In Advances in neural information processing systems 28, 2015
- “Let it snow: On the synthesis of adverse weather image data” In 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), 2021, pp. 3300–3306 IEEE
- Kaustubh V Sakhare, Tanuja Tewari and Vibha Vyas “Review of vehicle detection systems in advanced driver assistant systems” In Archives of Computational Methods in Engineering 27.2 Springer, 2020, pp. 591–610
- “DETR-SPP: a fine-tuned vehicle detection with transformer” In Multimedia Tools and Applications Springer, 2023, pp. 1–22
- Luo-Wei Tsai, Jun-Wei Hsieh and Kuo-Chin Fan “Vehicle detection using normalized color and edge map” In IEEE transactions on Image Processing 16.3 IEEE, 2007, pp. 850–864
- “Attention is all you need” In Advances in neural information processing systems 30, 2017
- “Vistrongerdet: Stronger visual information for object detection in visdrone images” In Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 2820–2829
- Chien-Yao Wang, I-Hau Yeh and Hong-Yuan Mark Liao “YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information” In arXiv preprint arXiv:2402.13616, 2024
- “Soft-weighted-average ensemble vehicle detection method based on single-stage and two-stage deep learning models” In IEEE Transactions on Intelligent Vehicles 6.1 IEEE, 2020, pp. 100–109
- Jie Wang, Sandra Simeonova and Mozhdeh Shahbazi “Orientation-and scale-invariant multi-vehicle detection and tracking from unmanned aerial videos” In Remote Sensing 11.18 MDPI, 2019, pp. 2155
- “Vehicle detection in aerial images” In Photogrammetric Engineering & Remote Sensing 85.4 American Society for PhotogrammetryRemote Sensing, 2019, pp. 297–304
- Alessandro Zamberletti, Ignazio Gallo and Lucia Noce “Augmented text character proposals and convolutional neural networks for text spotting from scene images” In 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), 2015, pp. 196–200 IEEE
- “Revisiting open world object detection” In IEEE Transactions on Circuits and Systems for Video Technology IEEE, 2023
- “Deformable detr: Deformable transformers for end-to-end object detection” In arXiv preprint arXiv:2010.04159, 2020
- Hamam Mokayed (9 papers)
- Rajkumar Saini (19 papers)
- Oluwatosin Adewumi (1 paper)
- Lama Alkhaled (11 papers)
- Bjorn Backe (2 papers)
- Palaiahnakote Shivakumara (5 papers)
- Olle Hagner (2 papers)
- Yan Chai Hum (2 papers)