Let Segment Anything Help Image Dehaze
Abstract: The LLM and high-level vision model have achieved impressive performance improvements with large datasets and model sizes. However, low-level computer vision tasks, such as image dehaze and blur removal, still rely on a small number of datasets and small-sized models, which generally leads to overfitting and local optima. Therefore, we propose a framework to integrate large-model prior into low-level computer vision tasks. Just as with the task of image segmentation, the degradation of haze is also texture-related. So we propose to detect gray-scale coding, network channel expansion, and pre-dehaze structures to integrate large-model prior knowledge into any low-level dehazing network. We demonstrate the effectiveness and applicability of large models in guiding low-level visual tasks through different datasets and algorithms comparison experiments. Finally, we demonstrate the effect of grayscale coding, network channel expansion, and recurrent network structures through ablation experiments. Under the conditions where additional data and training resources are not required, we successfully prove that the integration of large-model prior knowledge will improve the dehaze performance and save training time for low-level visual tasks.
- Night-time dehazing by fusion, in: IEEE International Conference on Image Processing.
- Dense haze: A benchmark for image dehazing with dense-haze and haze-free images. arXiv .
- Nh-haze: An image dehazing benchmark with non-homogeneous hazy and haze-free images, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).
- I-haze: a dehazing benchmark with real hazy and haze-free indoor images .
- O-haze: A dehazing benchmark with real hazy and haze-free outdoor images, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).
- Language models are few-shot learners. Advances in neural information processing systems 33, 1877–1901.
- Language models are few-shot learners .
- Dehazenet: An end-to-end system for single image haze removal. IEEE Transactions on Image Processing 25, 5187–5198.
- Gated context aggregation network for image dehazing and deraining, in: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).
- The cityscapes dataset for semantic urban scene understanding, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3213–3223.
- EPIC, 2022a. https://docs.unrealengine.com/4.27/en-us/building-worlds/fogeffects/.
- EPIC, 2022b. https://docs.unrealengine.com/5.0/en-us.
- The pascal visual object classes (voc) challenge. International Journal of Computer Vision 88, 303–338.
- Semantic understanding of foggy scenes with purely synthetic data. IEEE .
- Single image haze removal using dark channel prior .
- Scaling up visual and vision-language representation learning with noisy text supervision, in: International Conference on Machine Learning, PMLR. pp. 4904–4916.
- Fast haze removal for nighttime image using maximum reflectance prior, in: IEEE Conference on Computer Vision Pattern Recognition.
- Nighttime haze removal based on a new imaging model, in: 2014 IEEE International Conference on Image Processing (ICIP).
- Segment anything. arXiv preprint arXiv:2304.02643 .
- Fifo: Learning fog-invariant features for foggy scene segmentation, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 18911–18921.
- Aod-net: All-in-one dehazing network, in: Proceedings of the IEEE international conference on computer vision, pp. 4770–4778.
- Learning transferable visual models from natural language supervision, in: International conference on machine learning, PMLR. pp. 8748–8763.
- Zero-shot text-to-image generation, in: International Conference on Machine Learning, PMLR. pp. 8821–8831.
- Single image dehazing via multi-scale convolutional neural networks with holistic edges. International Journal of Computer Vision 128, 240–259.
- U-net: Convolutional networks for biomedical image segmentation, in: Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer. pp. 234–241. URL: http://lmb.informatik.uni-freiburg.de/Publications/2015/RFB15a. (available on arXiv:1505.04597 [cs.CV]).
- Semantic foggy scene understanding with synthetic data. INTERNATIONAL JOURNAL OF COMPUTER VISION .
- Vision transformers for single image dehazing. arXiv e-prints .
- Investigating haze-relevant features in a learning framework for image dehazing, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Uformer: A general u-shaped transformer for image restoration, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 17683–17693.
- Two-step image dehazing with intra-domain and inter-domain adaptation. Neurocomputing 485, 1–11.
- Nighttime haze removal with glow and multiple light colors, in: IEEE International Conference on Computer Vision.
- Restormer: Efficient transformer for high-resolution image restoration, in: CVPR.
- Nighttime dehazing with a synthetic benchmark, in: Proceedings of the 28th ACM International Conference on Multimedia, Association for Computing Machinery, New York, NY, USA. p. 2355–2363. URL: https://doi.org/10.1145/3394171.3413763, doi:10.1145/3394171.3413763.
- Learning to restore hazy video: A new real-world dataset and a new method, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9239–9248.
- Curricular contrastive regularization for physics-aware single image dehazing, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5785–5794.
- Scene parsing through ade20k dataset, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 633–641.
Paper Prompts
Sign up for free to create and run prompts on this paper.