ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model (2404.08892v1)
Abstract: Remote sensing change detection (CD) is a pivotal technique that pinpoints changes on a global scale based on multi-temporal images. With the recent expansion of deep learning, supervised deep learning-based CD models have shown satisfactory performance. However, CD sample labeling is very time-consuming as it is densely labeled and requires expert knowledge. To alleviate this problem, we introduce ChangeAnywhere, a novel CD sample generation method using the semantic latent diffusion model and single-temporal images. Specifically, ChangeAnywhere leverages the relative ease of acquiring large single-temporal semantic datasets to generate large-scale, diverse, and semantically annotated bi-temporal CD datasets. ChangeAnywhere captures the two essentials of CD samples, i.e., change implies semantically different, and non-change implies reasonable change under the same semantic constraints. We generated ChangeAnywhere-100K, the largest synthesis CD dataset with 100,000 pairs of CD samples based on the proposed method. The ChangeAnywhere-100K significantly improved both zero-shot and few-shot performance on two CD benchmark datasets for various deep learning-based CD models, as demonstrated by transfer experiments. This paper delineates the enormous potential of ChangeAnywhere for CD sample generation and demonstrates the subsequent enhancement of model performance. Therefore, ChangeAnywhere offers a potent tool for remote sensing CD. All codes and pre-trained models will be available at https://github.com/tangkai-RS/ChangeAnywhere.
- “Remote sensing change detection tools for natural resource managers: Understanding concepts and tradeoffs in the design of landscape monitoring projects,” Remote Sensing of Environment, vol. 113, no. 7, pp. 1382–1396, 2009, Monitoring Protected Areas.
- “Deep Learning in Remote Sensing:A comprehensive review and list of resources,” IEEE Geosci. Remote Sens. Mag., vol. 5, no. 4, pp. 8–36, 2017.
- “Syntheworld: A large-scale synthetic dataset for land cover mapping and building change detection,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), January 2024, pp. 8287–8296.
- “A 2d/3d multimodal data simulation approach with applications on urban semantic segmentation, building extraction and change detection,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 205, pp. 74–97, 2023.
- “Scalable multi-temporal remote sensing change data generation via simulating stochastic change process,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 21818–21827.
- “Self-pair: Synthesizing changes from single source for object change detection in remote sensing imagery,” 2023.
- “Change is everywhere: Single-temporal supervised object change detection in remote sensing imagery,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 15193–15202.
- “Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 206, pp. 87–105, 2023.
- “Denoising diffusion probabilistic models,” CoRR, vol. abs/2006.11239, 2020.
- “A comprehensive survey of ai-generated content (aigc): A history of generative ai from gan to chatgpt,” 2023.
- “High-resolution image synthesis with latent diffusion models,” 2021.
- “Zero-shot text-to-image generation,” CoRR, vol. abs/2102.12092, 2021.
- “Imagen video: High definition video generation with diffusion models,” 2022.
- “Snapfusion: Text-to-image diffusion model on mobile devices within two seconds,” 2023.
- “Text-to-image diffusion models in generative ai: A survey,” 2023.
- “Building bridges across spatial and temporal resolutions: Reference-based super-resolution via change priors and conditional diffusion model,” 2024.
- “Srdiff: Single image super-resolution with diffusion probabilistic models,” Neurocomputing, vol. 479, pp. 47–59, 2022.
- “Palette: Image-to-image diffusion models,” ArXiv, vol. abs/2111.05826, 2021.
- “Openearthmap: A benchmark dataset for global high-resolution land cover mapping,” 2022.
- “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 10684–10695.
- “Vector-quantized image modeling with improved vqgan,” 2022.
- “Denoising diffusion implicit models,” 2022.
- “Fully convolutional siamese networks for change detection,” in Proceedings - International Conference on Image Processing, ICIP, 2018, pp. 4063–4067.
- “Snunet-cd: A densely connected siamese network for change detection of vhr images,” IEEE Geosci. Remote Sens. Lett., vol. 19, pp. 1–5, 2022.
- “Remote sensing image change detection with transformers,” IEEE Trans. Geosci. Remote Sens., vol. 60, pp. 1–14, 2022.
- “Changer: Feature interaction is what you need for change detection,” 2022.
- Wele Gedara Chaminda Bandara and Vishal M. Patel, “A transformer-based siamese network for change detection,” 2022.
- “Lightcdnet: Lightweight change detection network based on vhr images,” IEEE Geoscience and Remote Sensing Letters, vol. 20, pp. 1–5, 2023.
- “Asymmetric siamese networks for semantic change detection in aerial images,” IEEE Trans. Geosci. Remote Sens., vol. 60, pp. 1–18, 2022.
- “A deeply supervised attention metric-based network and an open aerial image dataset for remote sensing change detection,” IEEE Trans. Geosci. Remote Sens., vol. 60, pp. 1–16, 2022.
- Open-CD Contributors, “Open-CD: An open source change detection toolbox,” https://github.com/likyoo/open-cd, 2022.
- “An empirical study of remote sensing pretraining,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–20, 2023.