BoostRad: Enhancing Object Detection by Boosting Radar Reflections (2404.17861v1)
Abstract: Automotive radars have an important role in autonomous driving systems. The main challenge in automotive radar detection is the radar's wide point spread function (PSF) in the angular domain that causes blurriness and clutter in the radar image. Numerous studies suggest employing an 'end-to-end' learning strategy using a Deep Neural Network (DNN) to directly detect objects from radar images. This approach implicitly addresses the PSF's impact on objects of interest. In this paper, we propose an alternative approach, which we term "Boosting Radar Reflections" (BoostRad). In BoostRad, a first DNN is trained to narrow the PSF for all the reflection points in the scene. The output of the first DNN is a boosted reflection image with higher resolution and reduced clutter, resulting in a sharper and cleaner image. Subsequently, a second DNN is employed to detect objects within the boosted reflection image. We develop a novel method for training the boosting DNN that incorporates domain knowledge of radar's PSF characteristics. BoostRad's performance is evaluated using the RADDet and CARRADA datasets, revealing its superiority over reference methods.
- TI mmwave-sdk software development kit (SDK), https://www.ti.com/tool/mmwave-sdk.
- Pointillism: Accurate 3d bounding box estimation with multi-radars. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems, pages 340–353, 2020.
- Code optimization for fast chirp FMCW automotive MIMO radar. IEEE Transactions on Vehicular Technology, 70(8):7582–7593, 2021.
- Super resolution wide aperture automotive radar. IEEE Sensors Journal, 21(16):17846–17858, 2021.
- Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11682–11692, 2020.
- Automotive mimo radar for urban environments. In 2016 IEEE Radar Conference (RadarConf), pages 1–6. IEEE, 2016.
- Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934, 2020.
- nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11621–11631, 2020.
- 2d car detection in radar data with pointnets. In 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pages 61–66. IEEE, 2019.
- Probabilistic oriented object detection in automotive radar. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pages 102–103, 2020.
- CARLA: An open urban driving simulator. In Proceedings of the 1st Annual Conference on Robot Learning, pages 1–16, 2017.
- Radar-based 2d car detection using deep neural networks. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pages 1–8. IEEE, 2020.
- Principles of modern radar. Springer Science & Business Media, 2012.
- Deep multi-modal object detection and semantic segmentation for autonomous driving: Datasets, methods, and challenges. IEEE Transactions on Intelligent Transportation Systems, 22(3):1341–1360, 2020.
- Point cloud segmentation with a high-resolution automotive radar. In AmE 2019-Automotive meets Electronics; 10th GMM-Symposium, pages 1–5. VDE, 2019.
- Cramnet: Camera-radar fusion with ray-constrained cross-attention for robust 3d object detection. In European Conference on Computer Vision, pages 388–405. Springer, 2022.
- Low-level sensor fusion network for 3d vehicle detection using radar range-azimuth heatmap and monocular image. In Proceedings of the Asian Conference on Computer Vision, 2020.
- Yolo-based simultaneous target detection and classification in automotive fmcw radar systems. Sensors, 20(10):2897, 2020.
- Using machine learning to detect ghost images in automotive radar. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pages 1–7. IEEE, 2020.
- Radar and camera early fusion for vehicle detection in advanced driver assistance systems. In Machine Learning for Autonomous Driving Workshop at the 33rd Conference on Neural Information Processing Systems, volume 2, page 7, 2019.
- MATLAB simulations for radar systems design. Chapman and Hall/CRC, 2003.
- aimotive dataset: A multimodal dataset for robust autonomous driving with long-range perception. 2022.
- Automotive radar dataset for deep learning based 3d object detection. In 2019 16th european radar conference (EuRAD), pages 129–132. IEEE, 2019.
- Deep learning based 3d object detection for automotive radar and camera. In 2019 16th European Radar Conference (EuRAD), pages 133–136. IEEE, 2019.
- Graph convolutional networks for 3d object detection on radar data. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3060–3069, 2021.
- Radar-camera sensor fusion for joint object detection and distance estimation in autonomous vehicles. arXiv preprint arXiv:2009.08428, 2020.
- Centerfusion: Center-based radar and camera fusion for 3d object detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1527–1536, 2021.
- Carrada dataset: Camera and automotive radar with range-angle-doppler annotations. In 2020 25th International Conference on Pattern Recognition (ICPR), pages 5068–5075. IEEE, 2021.
- K-radar: 4d radar object detection dataset and benchmark for autonomous driving in various weather conditions. arXiv preprint arXiv:2206.08171, 2022.
- Raw high-definition radar for multi-task learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17021–17030, 2022.
- You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 779–788, 2016.
- Hermann Rohling. Radar cfar thresholding in clutter and multiple target situations. IEEE transactions on aerospace and electronic systems, (4):608–621, 1983.
- U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pages 234–241. Springer, 2015.
- Radar-based road user classification and novelty detection with recurrent neural network ensembles. In 2019 IEEE Intelligent Vehicles Symposium (IV), pages 722–729. IEEE, 2019.
- Radar measurements of two vehicles with three cooperative imaging sensors, 2022.
- Semantic segmentation on radar point clouds. In 2018 21st International Conference on Information Fusion (FUSION), pages 2179–2186. IEEE, 2018.
- Radarscenes: A real-world radar point cloud data set for automotive applications. In 2021 IEEE 24th International Conference on Information Fusion (FUSION), pages 1–8. IEEE, 2021.
- Radiate: A radar dataset for automotive perception in bad weather. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 1–7. IEEE, 2021.
- Combined object detection and tracking on high resolution radar imagery for autonomous driving using deep neural networks and particle filters. In 2020 IEEE Radar Conference (RadarConf20), pages 1–6. IEEE, 2020.
- Fast chirp FMCW radar in automotive applications. In IET International Radar Conference, pages 1–4. IET, 2015.
- Rodnet: Radar object detection using cross-modal supervision. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 504–513, 2021.
- Rodnet: A real-time radar object detection network cross-supervised by camera-radar fused object 3d localization. IEEE Journal of Selected Topics in Signal Processing, 15(4):954–967, 2021.
- Raddet: Range-azimuth-doppler based radar object detection for dynamic road users. In 2021 18th Conference on Robots and Vision (CRV), pages 95–102. IEEE, 2021.
- Object detection and 3d estimation via an fmcw radar using a fully convolutional network. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 4487–4491. IEEE, 2020.