Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Exploiting Polarized Material Cues for Robust Car Detection (2401.02606v1)

Published 5 Jan 2024 in cs.CV

Abstract: Car detection is an important task that serves as a crucial prerequisite for many automated driving functions. The large variations in lighting/weather conditions and vehicle densities of the scenes pose significant challenges to existing car detection algorithms to meet the highly accurate perception demand for safety, due to the unstable/limited color information, which impedes the extraction of meaningful/discriminative features of cars. In this work, we present a novel learning-based car detection method that leverages trichromatic linear polarization as an additional cue to disambiguate such challenging cases. A key observation is that polarization, characteristic of the light wave, can robustly describe intrinsic physical properties of the scene objects in various imaging conditions and is strongly linked to the nature of materials for cars (e.g., metal and glass) and their surrounding environment (e.g., soil and trees), thereby providing reliable and discriminative features for robust car detection in challenging scenes. To exploit polarization cues, we first construct a pixel-aligned RGB-Polarization car detection dataset, which we subsequently employ to train a novel multimodal fusion network. Our car detection network dynamically integrates RGB and polarization features in a request-and-complement manner and can explore the intrinsic material properties of cars across all learning samples. We extensively validate our method and demonstrate that it outperforms state-of-the-art detection methods. Experimental results show that polarization is a powerful cue for car detection.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Amari, S.-i. 1993. Backpropagation and stochastic gradient descent method. Neurocomputing.
  2. Automatic vehicle detection system in different environment conditions using fast R-CNN. Multimedia Tools and Applications.
  3. Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  4. Road scenes analysis in adverse weather conditions by polarization-encoded images and adapted deep learning. In ITSC.
  5. Cascade R-CNN: High Quality Object Detection and Instance Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
  6. End-to-end object detection with transformers. In Proceedings of the European Conference on Computer Vision (ECCV).
  7. Pseudo-image and sparse points: Vehicle detection with 2D LiDAR revisited by deep learning-based methods. IEEE Transactions on Intelligent Transportation Systems (TITS).
  8. Multi-view 3d object detection network for autonomous driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  9. ImageNet: A Large-Scale Hierarchical Image Database. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  10. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
  11. Weak and occluded vehicle detection in complex infrared environment based on improved YOLOv4. IEEE Access.
  12. The pascal visual object classes (voc) challenge. International journal of computer vision.
  13. Yolox: Exceeding yolo series in 2021. arXiv.
  14. Zero-reference deep curve estimation for low-light image enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  15. Deep residual learning for image recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  16. Calibrated RGB-D salient object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
  17. Jocher, G. 2023. YOLOv8 - Ultraytics — Revolutionizing the World of Vision AI. https://ultralytics.com/yolov8. Accessed April 23, 2023.
  18. Polarized 3d: High-quality depth sensing with polarization cues. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).
  19. Deep polarization cues for transparent object segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  20. Cornernet: Detecting objects as paired keypoints. In Proceedings of the European Conference on Computer Vision (ECCV).
  21. Polarized reflection removal with perfect alignment in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  22. Reflection separation via multi-bounce polarization state tracing. In Proceedings of the European Conference on Computer Vision (ECCV).
  23. Focal loss for dense object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).
  24. Microsoft coco: Common objects in context. In Proceedings of the European Conference on Computer Vision (ECCV).
  25. DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR. In International Conference on Learning Representations (ICLR).
  26. Ssd: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision (ECCV).
  27. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).
  28. RTMDet: An Empirical Study of Designing Real-Time Object Detectors.
  29. Radar based object detection and tracking for autonomous driving. In Proceedings of the IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).
  30. Depth-aware mirror segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
  31. Glass segmentation using intensity and spectral polarization cues. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
  32. Pytorch: An imperative style, high-performance deep learning library. Proceedings of the Conference on Neural Information Processing Systems (NeurIPS).
  33. Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  34. You only look once: Unified, real-time object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  35. YOLOv3: An Incremental Improvement.
  36. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
  37. Very deep convolutional networks for large-scale image recognition. arXiv.
  38. Vision-based vehicle detection and counting system using deep learning in highway scenes. European Transport Research Review.
  39. Sparse r-cnn: End-to-end object detection with learnable proposals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  40. Drone-based RGB-infrared cross-modality vehicle detection via uncertainty-aware learning. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT).
  41. Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of the International Conference on Machine Learning (ICML).
  42. Efficientdet: Scalable and efficient object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  43. Fcos: Fully convolutional one-stage object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).
  44. There is more than meets the eye: Self-supervised multi-object detection and tracking with sound by distilling multimodal knowledge. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  45. Attention is all you need. Proceedings of the Conference on Neural Information Processing Systems (NeurIPS).
  46. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.
  47. CSPNet: A new backbone that can enhance learning capability of CNN. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW).
  48. Separating reflection and transmission images in the wild. In Proceedings of the European Conference on Computer Vision (ECCV).
  49. Big bird: Transformers for longer sequences. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS).
  50. Dynamic R-CNN: Towards high quality object detection via dynamic training. In Proceedings of the European Conference on Computer Vision (ECCV).
  51. DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection.
  52. Varifocalnet: An iou-aware dense object detector. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  53. A hybrid attention-aware fusion network (HAFNet) for building extraction from high-resolution imagery and LiDAR data. Remote Sensing.
  54. Deformable detr: Deformable transformers for end-to-end object detection. arXiv.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now