Learning without Exact Guidance: Updating Large-scale High-resolution Land Cover Maps from Low-resolution Historical Labels (2403.02746v3)
Abstract: Large-scale high-resolution (HR) land-cover mapping is a vital task to survey the Earth's surface and resolve many challenges facing humanity. However, it is still a non-trivial task hindered by complex ground details, various landforms, and the scarcity of accurate training labels over a wide-span geographic area. In this paper, we propose an efficient, weakly supervised framework (Paraformer) to guide large-scale HR land-cover mapping with easy-access historical land-cover data of low resolution (LR). Specifically, existing land-cover mapping approaches reveal the dominance of CNNs in preserving local ground details but still suffer from insufficient global modeling in various landforms. Therefore, we design a parallel CNN-Transformer feature extractor in Paraformer, consisting of a downsampling-free CNN branch and a Transformer branch, to jointly capture local and global contextual information. Besides, facing the spatial mismatch of training data, a pseudo-label-assisted training (PLAT) module is adopted to reasonably refine LR labels for weakly supervised semantic segmentation of HR images. Experiments on two large-scale datasets demonstrate the superiority of Paraformer over other state-of-the-art methods for automatically updating HR land-cover maps from LR historical labels.
- Land-cover classification with high-resolution remote sensing images using transferable deep models. Remote Sensing of Environment, 237:111322, 2020.
- Cross-spatiotemporal land-cover classification from vhr remote sensing images with deep learning based domain adaptation. ISPRS Journal of Photogrammetry and Remote Sensing, 191:105–128, 2022.
- Unetformer: A unet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 190:196–214, 2022.
- Landcover. ai: Dataset for automatic mapping of buildings, woodlands, water and roads from aerial imagery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1102–1110, 2021.
- Efficientvit: Lightweight multi-scale attention for high-resolution dense prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 17302–17313, 2023.
- A coarse-to-fine weakly supervised learning method for green plastic cover segmentation using high-resolution remote sensing images. ISPRS Journal of Photogrammetry and Remote Sensing, 188:157–176, 2022.
- Jonathan Cheung-Wai Chan and Desiré Paelinckx. Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sensing of Environment, 112(6):2999–3011, 2008.
- Linknet: Exploiting encoder representations for efficient semantic segmentation. In 2017 IEEE visual communications and image processing (VCIP), pages 1–4. IEEE, 2017.
- Stable classification with limited sample: Transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017. Sci. Bull, 64(370-373):3, 2019.
- Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306, 2021a.
- Building extraction from remote sensing images with sparse token transformers. Remote Sensing, 13(21):4441, 2021b.
- A novel weakly supervised semantic segmentation framework to improve the resolution of land cover product. ISPRS Journal of Photogrammetry and Remote Sensing, 196:73–92, 2023.
- Agriculture-vision: A large aerial image database for agricultural pattern analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2828–2838, 2020.
- J. Cihlar. Land cover mapping of large areas from satellites: Status and research priorities. International Journal of Remote Sensing, 21(6-7):1093–1114, 2000.
- Boxsup: Exploiting bounding boxes to supervise convolutional networks for semantic segmentation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015.
- Coatnet: Marrying convolution and attention for all data sizes. Advances in neural information processing systems, 34:3965–3977, 2021.
- High-resolution land cover mapping through learning with noise correction. IEEE Transactions on Geoscience and Remote Sensing, 60:1–13, 2021.
- Convit: Improving vision transformers with soft convolutional inductive biases. In International Conference on Machine Learning, pages 2286–2296. PMLR, 2021.
- Decision tree classification of land cover from remotely sensed data. Remote sensing of environment, 61(3):399–409, 1997.
- A two-branch cnn architecture for land cover classification of pan and ms imagery. Remote Sensing, 10(11):1746, 2018.
- Polygonal building extraction by frame field learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5891–5900, 2021.
- Global land use/land cover with sentinel 2 and deep learning. In 2021 IEEE international geoscience and remote sensing symposium IGARSS, pages 4704–4707. IEEE, 2021.
- Weakly supervised semantic segmentation using out-of-distribution data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16897–16906, 2022.
- Towards noiseless object contours for weakly supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16856–16865, 2022a.
- Uanet: An uncertainty-aware network for building extraction from remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 62:1–13, 2024.
- Change cross-detection based on label improvements and multi-model fusion for multi-temporal remote sensing images. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, pages 2054–2057. IEEE, 2021.
- The outcome of the 2021 ieee grss data fusion contest—track msd: Multitemporal semantic change detection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:1643–1655, 2022b.
- Breaking the resolution barrier: A low-to-high network for large-scale high-resolution land-cover mapping using low-resolution labels. ISPRS Journal of Photogrammetry and Remote Sensing, 192:244–267, 2022c.
- Sinolc-1: the first 1 m resolution national-scale land-cover map of china created with a deep learning framework and open-access data. Earth System Science Data, 15(11):4749–4780, 2023.
- Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 10012–10022, 2021.
- Label super-resolution networks. In International Conference on Learning Representations, 2018.
- Land cover mapping at very high resolution with rotation equivariant cnns: Towards small yet accurate models. ISPRS journal of photogrammetry and remote sensing, 145:96–107, 2018.
- Land cover classification and feature extraction from national agriculture imagery program (naip) orthoimagery: A review. Photogrammetric Engineering & Remote Sensing, 83(11):737–747, 2017.
- Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:2110.02178, 2021.
- The segment anything model (sam) for remote sensing applications: From zero to one shot. International Journal of Applied Earth Observation and Geoinformation, 124:103540, 2023.
- A global reference database from very high resolution commercial satellite data and methodology for application to landsat derived 30 m continuous field tree cover data. Remote sensing of environment, 165:234–248, 2015.
- Large scale high-resolution land cover mapping with multi-resolution data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12726–12735, 2019.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
- Land use and land cover mapping using deep learning based segmentation approaches and vhr worldview-3 images. Remote Sensing, 14(18):4558, 2022.
- Support vector machines for land cover mapping from remote sensor imagery. Monitoring and Modeling of Global Changes: A Geomatics Perspective, pages 265–279, 2015.
- Multi-resolution transformer network for building and road segmentation of remote sensing image. ISPRS International Journal of Geo-Information, 11(3):165, 2022.
- Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
- High-resolution land cover change detection using low-resolution labels via a semi-supervised deep learning approach-2021 ieee data fusion contest track msd. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, pages 2058–2061. IEEE, 2021.
- Esa worldcover: Global land cover mapping at 10 m resolution for 2020 based on sentinel-1 and 2 data. In AGU Fall Meeting Abstracts, pages GC45I–0915, 2021.
- Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence, 43(10):3349–3364, 2020.
- Loveda: A remote sensing land-cover dataset for domain adaptive semantic segmentation. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021.
- A novel transformer based semantic segmentation scheme for fine-resolution remote sensing images. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2022a.
- Unetformer: A unet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 190:196–214, 2022b.
- Thematic accuracy assessment of the nlcd 2016 land cover for the conterminous united states. Remote Sensing of Environment, 257:112357, 2021.
- samgeo: A python package for segmenting geospatial data with the segment anything model (sam). Journal of Open Source Software, 8(89):5663, 2023.
- Openearthmap: A benchmark dataset for global high-resolution land cover mapping. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 6254–6264, 2023.
- Super resolution guided deep network for land cover classification from remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 60:1–12, 2021.
- Luojia-hssr: A high spatial-spectral resolution remote sensing dataset for land-cover classification with a new 3d-hrnet. Geo-spatial Information Science, pages 1–13, 2022.
- 2020 ieee grss data fusion contest: Global land cover mapping with weak supervision [technical committees]. IEEE Geoscience and Remote Sensing Magazine, 8(1):154–157, 2020.
- Seamless and automated rapeseed mapping for large cloudy regions using time-series optical satellite imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 184:45–62, 2022.
- Glc_fcs30: Global land-cover product with fine classification system at 30 m using time-series landsat imagery. Earth System Science Data, 13(6):2753–2776, 2021.
- Regional semantic contrast and aggregation for weakly supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4299–4309, 2022.
- Zhuohong Li (5 papers)
- Wei He (188 papers)
- Jiepan Li (8 papers)
- Fangxiao Lu (3 papers)
- Hongyan Zhang (14 papers)