Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning without Exact Guidance: Updating Large-scale High-resolution Land Cover Maps from Low-resolution Historical Labels (2403.02746v3)

Published 5 Mar 2024 in cs.CV and cs.LG

Abstract: Large-scale high-resolution (HR) land-cover mapping is a vital task to survey the Earth's surface and resolve many challenges facing humanity. However, it is still a non-trivial task hindered by complex ground details, various landforms, and the scarcity of accurate training labels over a wide-span geographic area. In this paper, we propose an efficient, weakly supervised framework (Paraformer) to guide large-scale HR land-cover mapping with easy-access historical land-cover data of low resolution (LR). Specifically, existing land-cover mapping approaches reveal the dominance of CNNs in preserving local ground details but still suffer from insufficient global modeling in various landforms. Therefore, we design a parallel CNN-Transformer feature extractor in Paraformer, consisting of a downsampling-free CNN branch and a Transformer branch, to jointly capture local and global contextual information. Besides, facing the spatial mismatch of training data, a pseudo-label-assisted training (PLAT) module is adopted to reasonably refine LR labels for weakly supervised semantic segmentation of HR images. Experiments on two large-scale datasets demonstrate the superiority of Paraformer over other state-of-the-art methods for automatically updating HR land-cover maps from LR historical labels.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. Land-cover classification with high-resolution remote sensing images using transferable deep models. Remote Sensing of Environment, 237:111322, 2020.
  2. Cross-spatiotemporal land-cover classification from vhr remote sensing images with deep learning based domain adaptation. ISPRS Journal of Photogrammetry and Remote Sensing, 191:105–128, 2022.
  3. Unetformer: A unet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 190:196–214, 2022.
  4. Landcover. ai: Dataset for automatic mapping of buildings, woodlands, water and roads from aerial imagery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1102–1110, 2021.
  5. Efficientvit: Lightweight multi-scale attention for high-resolution dense prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 17302–17313, 2023.
  6. A coarse-to-fine weakly supervised learning method for green plastic cover segmentation using high-resolution remote sensing images. ISPRS Journal of Photogrammetry and Remote Sensing, 188:157–176, 2022.
  7. Jonathan Cheung-Wai Chan and Desiré Paelinckx. Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sensing of Environment, 112(6):2999–3011, 2008.
  8. Linknet: Exploiting encoder representations for efficient semantic segmentation. In 2017 IEEE visual communications and image processing (VCIP), pages 1–4. IEEE, 2017.
  9. Stable classification with limited sample: Transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017. Sci. Bull, 64(370-373):3, 2019.
  10. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306, 2021a.
  11. Building extraction from remote sensing images with sparse token transformers. Remote Sensing, 13(21):4441, 2021b.
  12. A novel weakly supervised semantic segmentation framework to improve the resolution of land cover product. ISPRS Journal of Photogrammetry and Remote Sensing, 196:73–92, 2023.
  13. Agriculture-vision: A large aerial image database for agricultural pattern analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2828–2838, 2020.
  14. J. Cihlar. Land cover mapping of large areas from satellites: Status and research priorities. International Journal of Remote Sensing, 21(6-7):1093–1114, 2000.
  15. Boxsup: Exploiting bounding boxes to supervise convolutional networks for semantic segmentation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015.
  16. Coatnet: Marrying convolution and attention for all data sizes. Advances in neural information processing systems, 34:3965–3977, 2021.
  17. High-resolution land cover mapping through learning with noise correction. IEEE Transactions on Geoscience and Remote Sensing, 60:1–13, 2021.
  18. Convit: Improving vision transformers with soft convolutional inductive biases. In International Conference on Machine Learning, pages 2286–2296. PMLR, 2021.
  19. Decision tree classification of land cover from remotely sensed data. Remote sensing of environment, 61(3):399–409, 1997.
  20. A two-branch cnn architecture for land cover classification of pan and ms imagery. Remote Sensing, 10(11):1746, 2018.
  21. Polygonal building extraction by frame field learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5891–5900, 2021.
  22. Global land use/land cover with sentinel 2 and deep learning. In 2021 IEEE international geoscience and remote sensing symposium IGARSS, pages 4704–4707. IEEE, 2021.
  23. Weakly supervised semantic segmentation using out-of-distribution data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16897–16906, 2022.
  24. Towards noiseless object contours for weakly supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16856–16865, 2022a.
  25. Uanet: An uncertainty-aware network for building extraction from remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 62:1–13, 2024.
  26. Change cross-detection based on label improvements and multi-model fusion for multi-temporal remote sensing images. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, pages 2054–2057. IEEE, 2021.
  27. The outcome of the 2021 ieee grss data fusion contest—track msd: Multitemporal semantic change detection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:1643–1655, 2022b.
  28. Breaking the resolution barrier: A low-to-high network for large-scale high-resolution land-cover mapping using low-resolution labels. ISPRS Journal of Photogrammetry and Remote Sensing, 192:244–267, 2022c.
  29. Sinolc-1: the first 1 m resolution national-scale land-cover map of china created with a deep learning framework and open-access data. Earth System Science Data, 15(11):4749–4780, 2023.
  30. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 10012–10022, 2021.
  31. Label super-resolution networks. In International Conference on Learning Representations, 2018.
  32. Land cover mapping at very high resolution with rotation equivariant cnns: Towards small yet accurate models. ISPRS journal of photogrammetry and remote sensing, 145:96–107, 2018.
  33. Land cover classification and feature extraction from national agriculture imagery program (naip) orthoimagery: A review. Photogrammetric Engineering & Remote Sensing, 83(11):737–747, 2017.
  34. Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:2110.02178, 2021.
  35. The segment anything model (sam) for remote sensing applications: From zero to one shot. International Journal of Applied Earth Observation and Geoinformation, 124:103540, 2023.
  36. A global reference database from very high resolution commercial satellite data and methodology for application to landsat derived 30 m continuous field tree cover data. Remote sensing of environment, 165:234–248, 2015.
  37. Large scale high-resolution land cover mapping with multi-resolution data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12726–12735, 2019.
  38. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
  39. Land use and land cover mapping using deep learning based segmentation approaches and vhr worldview-3 images. Remote Sensing, 14(18):4558, 2022.
  40. Support vector machines for land cover mapping from remote sensor imagery. Monitoring and Modeling of Global Changes: A Geomatics Perspective, pages 265–279, 2015.
  41. Multi-resolution transformer network for building and road segmentation of remote sensing image. ISPRS International Journal of Geo-Information, 11(3):165, 2022.
  42. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  43. High-resolution land cover change detection using low-resolution labels via a semi-supervised deep learning approach-2021 ieee data fusion contest track msd. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, pages 2058–2061. IEEE, 2021.
  44. Esa worldcover: Global land cover mapping at 10 m resolution for 2020 based on sentinel-1 and 2 data. In AGU Fall Meeting Abstracts, pages GC45I–0915, 2021.
  45. Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence, 43(10):3349–3364, 2020.
  46. Loveda: A remote sensing land-cover dataset for domain adaptive semantic segmentation. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021.
  47. A novel transformer based semantic segmentation scheme for fine-resolution remote sensing images. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2022a.
  48. Unetformer: A unet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 190:196–214, 2022b.
  49. Thematic accuracy assessment of the nlcd 2016 land cover for the conterminous united states. Remote Sensing of Environment, 257:112357, 2021.
  50. samgeo: A python package for segmenting geospatial data with the segment anything model (sam). Journal of Open Source Software, 8(89):5663, 2023.
  51. Openearthmap: A benchmark dataset for global high-resolution land cover mapping. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 6254–6264, 2023.
  52. Super resolution guided deep network for land cover classification from remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 60:1–12, 2021.
  53. Luojia-hssr: A high spatial-spectral resolution remote sensing dataset for land-cover classification with a new 3d-hrnet. Geo-spatial Information Science, pages 1–13, 2022.
  54. 2020 ieee grss data fusion contest: Global land cover mapping with weak supervision [technical committees]. IEEE Geoscience and Remote Sensing Magazine, 8(1):154–157, 2020.
  55. Seamless and automated rapeseed mapping for large cloudy regions using time-series optical satellite imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 184:45–62, 2022.
  56. Glc_fcs30: Global land-cover product with fine classification system at 30 m using time-series landsat imagery. Earth System Science Data, 13(6):2753–2776, 2021.
  57. Regional semantic contrast and aggregation for weakly supervised semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4299–4309, 2022.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Zhuohong Li (5 papers)
  2. Wei He (188 papers)
  3. Jiepan Li (8 papers)
  4. Fangxiao Lu (3 papers)
  5. Hongyan Zhang (14 papers)
Citations (4)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com