Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Scalable Glacier Mapping using Deep Learning and Open Earth Observation Data Matches the Accuracy of Manual Delineation (2401.15113v3)

Published 25 Jan 2024 in cs.CV and cs.LG

Abstract: Accurate global glacier mapping is critical for understanding climate change impacts. Despite its importance, automated glacier mapping at a global scale remains largely unexplored. Here we address this gap and propose Glacier-VisionTransformer-U-Net (GlaViTU), a convolutional-transformer deep learning model, and five strategies for multitemporal global-scale glacier mapping using open satellite imagery. Assessing the spatial, temporal and cross-sensor generalisation shows that our best strategy achieves intersection over union >0.85 on previously unobserved images in most cases, which drops to >0.75 for debris-rich areas such as High-Mountain Asia and increases to >0.90 for regions dominated by clean ice. A comparative validation against human expert uncertainties in terms of area and distance deviations underscores GlaViTU performance, approaching or matching expert-level delineation. Adding synthetic aperture radar data, namely, backscatter and interferometric coherence, increases the accuracy in all regions where available. The calibrated confidence for glacier extents is reported making the predictions more reliable and interpretable. We also release a benchmark dataset that covers 9% of glaciers worldwide. Our results support efforts towards automated multitemporal and global glacier mapping.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (72)
  1. “The 2022 GCOS ECVs Requirements (GCOS 245)”, 2022 URL: https://library.wmo.int/idurl/4/58111
  2. “High Mountain Areas” In IPCC Special Report on the Ocean and Cryosphere in a Changing Climate Cambridge University Press, 2019, pp. 131–202. DOI: 10.1017/9781009157964.004
  3. “Polar Regions” In IPCC Special Report on the Ocean and Cryosphere in a Changing Climate Cambridge University Press, 2019, pp. 203–320. DOI: 10.1017/9781009157964.005
  4. “Global glacier change in the 21st century: Every increase in temperature matters” In Science 379 American Association for the Advancement of Science, 2023, pp. 78–83 DOI: 10.1126/SCIENCE.ABO1324
  5. “Global glacier mass changes and their contributions to sea-level rise from 1961 to 2016” In Nature 568 Nature Publishing Group, 2019, pp. 382–386 DOI: 10.1038/S41586-019-1071-0
  6. “Accelerated global glacier mass loss in the early twenty-first century” In Nature 592 Nature Research, 2021, pp. 726–731 DOI: 10.1038/S41586-021-03436-Z
  7. “Global-scale hydrological response to future glacier mass loss” In Nature Climate Change 8 Nature Publishing Group, 2018, pp. 135–140 DOI: 10.1038/S41558-017-0049-X
  8. J.R. Laghari “Climate change: Melting glaciers bring energy uncertainty” In Nature 502 Nature Publishing Group, 2013, pp. 617–618 DOI: 10.1038/502617a
  9. “Trace element and major ion concentrations and dynamics in glacier snow and melt: Eliot Glacier, Oregon Cascades” In Hydrological Processes 23 John Wiley & Sons, Ltd, 2009, pp. 2987–2996 DOI: 10.1002/HYP.7418
  10. “A global synthesis of biodiversity responses to glacier retreat” In Nature Ecology & Evolution 2019 3 Nature Publishing Group, 2019, pp. 1675–1685 DOI: 10.1038/s41559-019-1042-8
  11. A. Emmer “Glacier Retreat and Glacial Lake Outburst Floods (GLOFs)” In Oxford Research Encyclopedia of Natural Hazard Science Oxford University Press, 2017 DOI: 10.1093/ACREFORE/9780199389407.013.275
  12. RGI Consortium “Randolph Glacier Inventory—A Dataset of Global Glacier Outlines, Version 6.” In Boulder, Colorado USA. NSIDC: National Snow and Ice Data Center., 2017 DOI: 10.7265/4m1f-gd79
  13. GLIMS Consortium “GLIMS Glacier Database, Version 1” In Boulder Colorado, USA. NASA National Snow and Ice Data Center Distributed Active Archive Center., 2015 DOI: 10.7265/N5V98602
  14. “Glacier remote sensing using Sentinel-2. part II: Mapping glacier extents and surface facies, and comparison to Landsat 8” In Remote Sensing 8 MDPI AG, 2016 DOI: 10.3390/rs8070575
  15. “A consistent glacier inventory for Karakoram and Pamir derived from Landsat data: Distribution of debris cover and mapping challenges” In Earth System Science Data 10 Copernicus GmbH, 2018, pp. 1807–1827 DOI: 10.5194/ESSD-10-1807-2018
  16. “Monitoring glaciers in mainland Norway and Svalbard using Sentinel” In NVE Rapport., 2021 URL: https://publikasjoner.nve.no/rapport/2021/rapport2021_03.pdf
  17. Solveig Havstad Winsvold, Andreas Kääb and Christopher Nuth “Regional Glacier Mapping Using Optical Satellite Data Time Series” In IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 Institute of ElectricalElectronics Engineers, 2016, pp. 3698–3711 DOI: 10.1109/JSTARS.2016.2527063
  18. “Challenges and recommendations in mapping of glacier parameters from space: results of the 2008 Global Land Ice Measurements from Space (GLIMS) workshop, Boulder, Colorado, USA” In Annals of Glaciology 50 Cambridge University Press, 2009, pp. 53–69 DOI: 10.3189/172756410790595804
  19. “Comparing the opportunities of LANDSAT-TM and ASTER data for monitoring a debris covered glacier in the italian alps within the GLIMS project” In International Geoscience and Remote Sensing Symposium (IGARSS) 2, 2002, pp. 1044–1046 DOI: 10.1109/IGARSS.2002.1025770
  20. “Monitoring snow and ice surfaces on King George Island, Antarctic Peninsula, with high-resolution TerraSAR-X time series” In Antarctic Science 28 Cambridge University Press, 2016, pp. 135–149 DOI: 10.1017/S0954102015000577
  21. Stefan Lippl, Saurabh Vijay and Matthias Braun “Automatic delineation of debris-covered glaciers using InSAR coherence derived from X-, C- and L-band radar data: A case study of Yazgyl Glacier” In Journal of Glaciology 64 Cambridge University Press, 2018, pp. 811–821 DOI: 10.1017/JOG.2018.70
  22. “Semi-Automated Mapping of Complex-Terrain Mountain Glaciers by Integrating L-Band SAR Amplitude and Interferometric Coherence” In Remote Sensing 14 Multidisciplinary Digital Publishing Institute, 2022 DOI: 10.3390/RS14091993
  23. “Machine-learning classification of debris-covered glaciers using a combination of Sentinel-1/-2 (SAR/optical), Landsat 8 (thermal) and digital elevation data” In Geomorphology 369 Elsevier B.V., 2020 DOI: 10.1016/J.GEOMORPH.2020.107365
  24. Vijay Badrinarayanan, Alex Kendall and Roberto Cipolla “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation” In IEEE Transactions on Pattern Analysis and Machine Intelligence 39 IEEE Computer Society, 2015, pp. 2481–2495 DOI: 10.1109/TPAMI.2016.2644615
  25. “GlacierNet: A Deep-Learning Approach for Debris-Covered Glacier Mapping” In IEEE Access 8, 2020, pp. 83495–83510 DOI: 10.1109/ACCESS.2020.2991187
  26. Z. Xie, V.K. Asari and U.K. Haritashya “Evaluating deep-learning models for debris-covered glacier mapping” In Applied Computing and Geosciences 12 Elsevier B.V., 2021 DOI: https://doi.org/10.1016/j.acags.2021.100071
  27. “Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation” In Lecture Notes in Computer Science 11211 LNCS Springer Verlag, 2018, pp. 833–851 DOI: 10.1007/978-3-030-01234-2˙49
  28. “Glacier classification from Sentinel-2 imagery using spatial-spectral attention convolutional model” In International Journal of Applied Earth Observation and Geoinformation 102 Elsevier B.V., 2021 DOI: 10.1016/j.jag.2021.102445
  29. O. Ronneberger, P. Fischer and T. Brox “U-Net: Convolutional Networks for Biomedical Image Segmentation” In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9351, 2015, pp. 234–241 DOI: 10.48550/arxiv.1505.04597
  30. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”, 2020 DOI: 10.48550/arxiv.2010.11929
  31. “Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition IEEE Computer Society, 2020, pp. 6877–6886 DOI: 10.48550/arxiv.2012.15840
  32. “Segmenter: Transformer for Semantic Segmentation” In Proceedings of the IEEE International Conference on Computer Vision Institute of ElectricalElectronics Engineers Inc., 2021, pp. 7242–7252 DOI: 10.48550/arxiv.2105.05633
  33. “SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers” In Advances in Neural Information Processing Systems 15 Neural information processing systems foundation, 2021, pp. 12077–12090 DOI: 10.48550/arxiv.2105.15203
  34. “Building extraction with vision transformer” In IEEE Transactions on Geoscience and Remote Sensing 60 Institute of ElectricalElectronics Engineers Inc., 2021 DOI: 10.1109/TGRS.2022.3186634
  35. Keyan Chen, Zhengxia Zou and Zhenwei Shi “Building Extraction from Remote Sensing Images with Sparse Token Transformers” In Remote Sensing 13 Multidisciplinary Digital Publishing Institute, 2021, pp. 4441 DOI: 10.3390/RS13214441
  36. “Automated glacier extraction using a Transformer based deep learning approach from multi-sensor remote sensing imagery” In ISPRS Journal of Photogrammetry and Remote Sensing 202, 2023, pp. 303–313 DOI: https://doi.org/10.1016/j.isprsjprs.2023.06.015
  37. “AMD-HookNet for Glacier Front Segmentation” In IEEE Transactions on Geoscience and Remote Sensing 61 Institute of ElectricalElectronics Engineers Inc., 2023 DOI: 10.1109/TGRS.2023.3245419
  38. “HED-UNet: Combined Segmentation and Edge Detection for Monitoring the Antarctic Coastline” In IEEE Transactions on Geoscience and Remote Sensing 60 Institute of ElectricalElectronics Engineers Inc., 2022 DOI: 10.1109/TGRS.2021.3064606
  39. “Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images” In IEEE Transactions on Geoscience and Remote Sensing 60 Institute of ElectricalElectronics Engineers Inc., 2022 DOI: 10.1109/TGRS.2021.3093977
  40. “Land Use and Land Cover Mapping Using Deep Learning Based Segmentation Approaches and VHR Worldview-3 Images” In Remote Sensing 14 Multidisciplinary Digital Publishing Institute, 2022, pp. 4558 DOI: 10.3390/RS14184558
  41. “Combining optical and thermal remote sensing data for mapping debris-covered glaciers (Alamkouh Glaciers, Iran)” In Cold Regions Science and Technology 71 Elsevier, 2012, pp. 73–83 DOI: 10.1016/J.COLDREGIONS.2011.10.004
  42. Rafael Müller, Simon Kornblith and Geoffrey Hinton “When Does Label Smoothing Help?” In Advances in Neural Information Processing Systems 32 Neural information processing systems foundation, 2019 URL: https://arxiv.org/abs/1906.02629v3
  43. “On Calibration of Modern Neural Networks” In 34th International Conference on Machine Learning, ICML 3 International Machine Learning Society (IMLS), 2017, pp. 2130–2143 URL: https://arxiv.org/abs/1706.04599v2
  44. Begüm Demir, Claudio Persello and Lorenzo Bruzzone “Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images” In IEEE Transactions on Geoscience and Remote Sensing 49.3, 2011, pp. 1014–1031 DOI: 10.1109/TGRS.2010.2072929
  45. Mukund Sundararajan, Ankur Taly and Qiqi Yan “Axiomatic Attribution for Deep Networks” In 34th International Conference on Machine Learning, ICML 7 International Machine Learning Society (IMLS), 2017, pp. 5109–5118 URL: https://arxiv.org/abs/1703.01365v2
  46. Christian Kienholz, Regine Hock and Anthony Arendt “A new semi-automatic approach for dividing glacier complexes into individual glaciers” In Journal of Glaciology 59, 2013, pp. 925–937 DOI: 10.3189/2013JoG12J138
  47. “Variable glacier response to atmospheric warming, northern Antarctic Peninsula, 1988-2009” In Cryosphere 6, 2012, pp. 1031–1048 DOI: 10.5194/TC-6-1031-2012
  48. Aniek Lith, Geir Moholdt and Jack Kohler “Svalbard glacier inventory based on Sentinel-2 imagery from summer 2020” Norwegian Polar Institute, 2021 DOI: 10.21334/npolar.2021.1b8631bf
  49. “Glacier shrinkage in the Alps continues unabated as revealed by a new glacier inventory from Sentinel-2” In Earth System Science Data 12 Copernicus GmbH, 2020, pp. 1805–1821 DOI: 10.5194/ESSD-12-1805-2020
  50. Levan G. Tielidze and Roger D. Wheate “The Greater Caucasus Glacier Inventory (Russia, Georgia and Azerbaijan)” In Cryosphere 12 Copernicus GmbH, 2018, pp. 81–94 DOI: 10.5194/TC-12-81-2018
  51. “Ice thickness and volume changes across the Southern Alps, New Zealand, from the little ice age to present” In Scientific Reports 10 Nature Publishing Group, 2020, pp. 1–10 DOI: 10.1038/s41598-020-70276-8
  52. S.H. Winsvold, L.M. Andreassen and C. Kienholz “Glacier area and length changes in Norway from repeat inventories” In Cryosphere 8 Copernicus GmbH, 2014, pp. 1885–1903 DOI: 10.5194/TC-8-1885-2014
  53. “GLAVITU: A Hybrid CNN-Transformer for Multi-Regional Glacier Mapping from Multi-Source Data” In IGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, 2023, pp. 1233–1236 DOI: 10.1109/IGARSS52108.2023.10281828
  54. “Deep Residual Learning for Image Recognition” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2016-December IEEE Computer Society, 2015, pp. 770–778 DOI: 10.48550/arxiv.1512.03385
  55. “TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation.”, 2021 DOI: 10.48550/arxiv.2102.04306
  56. “Squeeze-and-Excitation Networks” In IEEE Transactions on Pattern Analysis and Machine Intelligence 42 IEEE Computer Society, 2017, pp. 2011–2023 DOI: 10.1109/TPAMI.2019.2913372
  57. “ResNeSt: Split-Attention Networks” In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2022-June IEEE Computer Society, 2020, pp. 2735–2745 DOI: 10.1109/CVPRW56347.2022.00309
  58. “Adam: A Method for Stochastic Optimization” In 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings International Conference on Learning Representations, ICLR, 2014 DOI: 10.48550/arxiv.1412.6980
  59. “Focal Loss for Dense Object Detection” In IEEE Transactions on Pattern Analysis and Machine Intelligence 42 IEEE Computer Society, 2017, pp. 318–327 DOI: 10.48550/arxiv.1708.02002
  60. “Rethinking the Inception Architecture for Computer Vision” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2016-December IEEE Computer Society, 2015, pp. 2818–2826 DOI: 10.1109/CVPR.2016.308
  61. “SGDR: Stochastic Gradient Descent with Warm Restarts” In 5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings International Conference on Learning Representations, ICLR, 2016 URL: https://arxiv.org/abs/1608.03983v5
  62. “Corn yield prediction and uncertainty analysis based on remotely sensed variables using a Bayesian neural network approach” In Remote Sensing of Environment 259, 2021, pp. 112408 DOI: https://doi.org/10.1016/j.rse.2021.112408
  63. Clément Dechesne, Pierre Lassalle and Sébastien Lefèvre “Bayesian U-Net: Estimating Uncertainty in Semantic Segmentation of Earth Observation Images” In Remote Sensing 13 Multidisciplinary Digital Publishing Institute, 2021, pp. 3836 DOI: 10.3390/RS13193836
  64. Christopher J. Holder and Muhammad Shafique “Efficient Uncertainty Estimation in Semantic Segmentation via Distillation” In Proceedings of the IEEE International Conference on Computer Vision October Institute of ElectricalElectronics Engineers Inc., 2021, pp. 3080–3087 DOI: 10.1109/ICCVW54120.2021.00343
  65. Rishabh Singh and Jose C. Principe “Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS”, 2022 URL: https://arxiv.org/abs/2211.01999v1
  66. “A Survey of Uncertainty in Deep Neural Networks.”, 2021 DOI: 10.48550/arxiv.2107.03342
  67. “Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning” In 33rd International Conference on Machine Learning, ICML 2016 3 International Machine Learning Society (IMLS), 2015, pp. 1651–1660 DOI: 10.48550/arxiv.1506.02142
  68. Volodymyr Kuleshov, Nathan Fenner and Stefano Ermon “Accurate Uncertainties for Deep Learning Using Calibrated Regression” In 35th International Conference on Machine Learning, ICML 2018 6 International Machine Learning Society (IMLS), 2018, pp. 4369–4377 DOI: 10.48550/arxiv.1807.00263
  69. John Lindsay “WhiteboxTools”, 2018 URL: https://github.com/jblindsay/whitebox-tools
  70. Matt Bartos “Pysheds: simple and fast watershed delineation in python”, 2020 DOI: 10.5281/zenodo.3822494
  71. “Circum-Arctic Changes in the Flow of Glaciers and Ice Caps from Satellite SAR Data between the 1990s and 2017” In Remote Sensing 9 Multidisciplinary Digital Publishing Institute, 2017, pp. 947 DOI: 10.3390/RS9090947
  72. “Gangotri glacier dynamics from multi-sensor SAR and optical data” In Advances in Space Research 72.2, 2023, pp. 309–326 DOI: https://doi.org/10.1016/j.asr.2023.03.001

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com