1st Place Solution to MultiEarth 2023 Challenge on Multimodal SAR-to-EO Image Translation (2306.12626v1)
Abstract: The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2023) aims to harness the substantial amount of remote sensing data gathered over extensive periods for the monitoring and analysis of Earth's ecosystems'health. The subtask, Multimodal SAR-to-EO Image Translation, involves the use of robust SAR data, even under adverse weather and lighting conditions, transforming it into high-quality, clear, and visually appealing EO data. In the context of the SAR2EO task, the presence of clouds or obstructions in EO data can potentially pose a challenge. To address this issue, we propose the Clean Collector Algorithm (CCA), designed to take full advantage of this cloudless SAR data and eliminate factors that may hinder the data learning process. Subsequently, we applied pix2pixHD for the SAR-to-EO translation and Restormer for image enhancement. In the final evaluation, the team 'CDRL' achieved an MAE of 0.07313, securing the top rank on the leaderboard.
- Earth observation in service of the 2030 agenda for sustainable development. Geo-spatial Information Science, 20(2):77–96, 2017.
- Satellite earth observation for essential climate variables supporting sustainable development goals: A review on applications. Remote Sensing, 15(11):2716, 2023.
- Sar-to-eo image translation with multi-conditional adversarial networks. In 2021 55th Asilomar Conference on Signals, Systems, and Computers, pages 1710–1714. IEEE, 2021.
- Multiearth 2023 – multimodal learning for earth and environment workshop and challenge, 2023.
- Change detection from remotely sensed images: From pixel-based to object-based approaches. ISPRS Journal of photogrammetry and remote sensing, 80:91–106, 2013.
- Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1125–1134, 2017.
- Bbdm: Image-to-image translation with brownian bridge diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1952–1961, 2023.
- Dual pyramid generative adversarial networks for semantic image synthesis. arXiv preprint arXiv:2210.04085, 2022.
- I22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPTsb: Image-to-image schr\\\backslash\” odinger bridge. arXiv preprint arXiv:2302.05872, 2023.
- Unsupervised change detection based on image reconstruction loss. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1352–1361, 2022.
- Self-pair: Synthesizing changes from single source for object change detection in remote sensing imagery. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 6374–6383, 2023.
- High-resolution image synthesis and semantic manipulation with conditional gans. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8798–8807, 2018.
- Mohammed J Zaki. Spade: An efficient algorithm for mining frequent sequences. Machine learning, 42:31–60, 2001.
- Restormer: Efficient transformer for high-resolution image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5728–5739, 2022.
- Separate segmentation of multi-temporal high-resolution remote sensing images for object-based change detection in urban area. Remote Sensing of Environment, 201:243–255, 2017.
- Jingi Ju (3 papers)
- Hyeoncheol Noh (3 papers)
- Minwoo Kim (27 papers)
- Dong-Geol Choi (14 papers)