Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Improving Interpretability of Deep Active Learning for Flood Inundation Mapping Through Class Ambiguity Indices Using Multi-spectral Satellite Imagery (2404.19043v1)

Published 29 Apr 2024 in cs.CV

Abstract: Flood inundation mapping is a critical task for responding to the increasing risk of flooding linked to global warming. Significant advancements of deep learning in recent years have triggered its extensive applications, including flood inundation mapping. To cope with the time-consuming and labor-intensive data labeling process in supervised learning, deep active learning strategies are one of the feasible approaches. However, there remains limited exploration into the interpretability of how deep active learning strategies operate, with a specific focus on flood inundation mapping in the field of remote sensing. In this study, we introduce a novel framework of Interpretable Deep Active Learning for Flood inundation Mapping (IDAL-FIM), specifically in terms of class ambiguity of multi-spectral satellite images. In the experiments, we utilize Sen1Floods11 dataset, and adopt U-Net with MC-dropout. In addition, we employ five acquisition functions, which are the random, K-means, BALD, entropy, and margin acquisition functions. Based on the experimental results, we demonstrate that two proposed class ambiguity indices are effective variables to interpret the deep active learning by establishing statistically significant correlation with the predictive uncertainty of the deep learning model at the tile level. Then, we illustrate the behaviors of deep active learning through visualizing two-dimensional density plots and providing interpretations regarding the operation of deep active learning, in flood inundation mapping.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (87)
  1. Enhancement of detecting permanent water and temporary water in flood disasters by fusing sentinel-1 and sentinel-2 imagery using deep learning algorithms: Demonstration of sen1floods11 benchmark datasets. Remote Sensing 13, 2220.
  2. Visualizing uncertainty in multi-spectral remotely sensed imagery. Computers & Geosciences 28, 337–350.
  3. The power of ensembles for active learning in image classification, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9368–9377.
  4. Deep learning methods for flood mapping: a review of existing applications and future research directions. Hydrology and Earth System Sciences 26, 4345–4378.
  5. Sen1floods11: A georeferenced dataset to train and test deep learning flood algorithms for sentinel-1, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 210–211.
  6. Global active archive of large flood events. Dartmouth Flood Observatory, University of Colorado .
  7. Human-in-the-loop segmentation of earth surface imagery. Earth and Space Science 9, e2021EA002085.
  8. Hyperspectral image classification with convolutional neural network and active learning. IEEE Transactions on Geoscience and Remote Sensing 58, 4604–4616.
  9. Encoder-decoder with atrous separable convolution for semantic image segmentation, in: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818.
  10. Active learning with statistical models. Journal of Artificial Intelligence Research 4, 129–145.
  11. Active learning: Any value for classification of remotely sensed data? Proceedings of the IEEE 101, 593–608.
  12. Uncertainty propagation in models driven by remotely sensed data. Remote Sensing of Environment 76, 373–385.
  13. Bayesian u-net: Estimating uncertainty in semantic segmentation of earth observation images. Remote Sensing 13, 3836.
  14. Active learning-driven siamese network for hyperspectral image classification. Remote Sensing 15, 752.
  15. Tensorflow distributions. arXiv preprint arXiv:1711.10604 .
  16. Monitoring the summer flooding in the poyang lake area of china in 2020 based on sentinel-1 data and multiple convolutional neural networks. International Journal of Applied Earth Observation and Geoinformation 102, 102400.
  17. Dropout as a bayesian approximation: Representing model uncertainty in deep learning, in: Iternational Conference on Machine Learning, PMLR. pp. 1050–1059.
  18. Deep bayesian active learning with image data, in: International Conference on Machine Learning, PMLR. pp. 1183–1192.
  19. Replication across space and time must be weak in the social and environmental sciences. Proceedings of the National Academy of Sciences 118, e2015759118.
  20. On calibration of modern neural networks, in: International Conference on Machine Learning, PMLR. pp. 1321–1330.
  21. Uncertainty estimation for deep learning-based segmentation of roads in synthetic aperture radar imagery. Remote Sensing 13, 1472.
  22. Active learning with convolutional neural networks for hyperspectral image classification using a new bayesian approach. IEEE Transactions on Geoscience and Remote Sensing 56, 6440–6461.
  23. Sentinel-1-based water and flood mapping: Benchmarking convolutional neural networks against an operational rule-based processing chain. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15, 2023–2036.
  24. Probabilistic sar-based water segmentation with adapted bayesian convolutional neural network. Remote Sensing of Environment 285, 113388.
  25. A methodology for the validation of uncertain flood inundation models. Journal of Hydrology 326, 153–165.
  26. Bayesian active learning for classification and preference learning. arXiv preprint arXiv:1112.5745 .
  27. Explainable geoai: can saliency maps help interpret artificial intelligence’s learning process? an empirical study on natural feature detection. International Journal of Geographical Information Science 37, 963–987.
  28. How computer vision can facilitate flood management: A systematic review. International Journal of Disaster Risk Reduction 53, 102030.
  29. Causal-bald: Deep bayesian active learning of outcomes to infer treatment-effects from observational data. Advances in Neural Information Processing Systems 34, 30465–30478.
  30. Caffe: Convolutional architecture for fast feature embedding, in: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 675–678.
  31. Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–9.
  32. Near-real-time flood mapping using off-the-shelf models with sar imagery and deep learning. Remote Sensing 13, 2334.
  33. Exploring sentinel-1 and sentinel-2 diversity for flood inundation mapping using deep learning. ISPRS Journal of Photogrammetry and Remote Sensing 180, 163–173.
  34. We know where we don’t know: 3d bayesian cnns for credible geometric uncertainty. arXiv preprint arXiv:1910.10793 .
  35. Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in Neural Information Processing Systems 30.
  36. A comparative study of uncertainty propagation methods for black-box-type problems. Structural and multidisciplinary optimization 37, 239–253.
  37. Active deep learning for hyperspectral image classification with uncertainty learning. IEEE Geoscience and Remote Sensing Letters 19, 1–5.
  38. Hyperspectral image segmentation using a new bayesian approach with active learning. IEEE Transactions on Geoscience and Remote Sensing 49, 3947–3960.
  39. Geoai: Where machine learning and big data converge in giscience. Journal of Spatial Information Science , 71–77.
  40. Geoai for large-scale image analysis and machine vision: Recent progress of artificial intelligence in geography. ISPRS International Journal of Geo-Information 11, 385.
  41. Segment anything model can not segment anything: Assessing ai foundation model’s generalizability in permafrost mapping. Remote Sensing 16, 797.
  42. Assessment of a new geoai foundation model for flood inundation mapping, in: Proceedings of the 6th ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery, pp. 102–109.
  43. Suggestive data annotation for cnn-based building footprint mapping based on deep active learning and landscape metrics. Remote Sensing 14, 3147.
  44. Active deep learning for classification of hyperspectral images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10, 712–724.
  45. Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440.
  46. On the genaralised distance in science. India 2, 49–55.
  47. Uncertainty in flood inundation mapping: Current issues and future directions. Journal of hydrologic engineering 13, 608–620.
  48. Segmentation of multispectral remote sensing images using active support vector machines. Pattern Recognition Letters 25, 1067–1074.
  49. From local to regional compound flood mapping with deep learning and data fusion techniques. Science of the Total Environment 782, 146927.
  50. Recent trends in the frequency and duration of global floods. Earth System Dynamics 9, 757–783.
  51. Exploiting convnet diversity for flooding identification. IEEE Geoscience and Remote Sensing Letters 15, 1446–1450.
  52. Svm active learning approach for image classification using spatial information. IEEE Transactions on Geoscience and Remote Sensing 52, 2217–2233.
  53. A comprehensive review: active learning for hyperspectral image classifications. Earth Science Informatics , 1–17.
  54. Patch similarity convolutional neural network for urban flood extent mapping using bi-temporal satellite multispectral imagery. Remote Sensing 11, 2492.
  55. Cost-effective global flood segmentation using convolutional neural networks, sentinel-1 and active learning, in: AGU Fall Meeting Abstracts, pp. H51A–04.
  56. An active learning approach to hyperspectral data classification. IEEE Transactions on Geoscience and Remote Sensing 46, 1231–1242.
  57. A survey of deep active learning. ACM Computing Surveys (CSUR) 54, 1–40.
  58. U-net: Convolutional networks for biomedical image segmentation, in: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, Springer. pp. 234–241.
  59. Bayesian active remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing 52, 2186–2196.
  60. Deep active learning in remote sensing for data efficient change detection. arXiv preprint arXiv:2008.11201 .
  61. Active hidden markov models for information extraction, in: International Symposium on Intelligent Data Analysis, Springer. pp. 309–318.
  62. Active learning literature survey .
  63. A mathematical theory of communication. The Bell System Technical Journal 27, 379–423.
  64. Mapping floods from remote sensing data and quantifying the effects of surface obstruction by clouds and vegetation. Remote Sensing of Environment 291, 113556.
  65. Active learning in the spatial domain for remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing 52, 2492–2507.
  66. Climate change impact on flood and extreme precipitation increases with water availability. Scientific reports 10, 13768.
  67. Deep active learning for computer vision: Past and future. APSIPA Transactions on Signal and Information Processing 12.
  68. Satellite imaging reveals increased proportion of population exposed to floods. Nature 596, 80–86.
  69. Active learning for hyperspectral image classification: A comparative review. IEEE Geoscience and Remote Sensing Magazine 10, 256–278.
  70. Efficient object localization using convolutional networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 648–656.
  71. Bayesian layers: A module for neural network uncertainty. Advances in Neural Information Processing Systems 32.
  72. Using active learning to adapt remote sensing image classifiers. Remote Sensing of Environment 115, 2232–2242.
  73. Active learning methods for remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing 47, 2218–2232.
  74. A survey of active learning algorithms for supervised remote sensing image classification. IEEE Journal of Selected Topics in Signal Processing 5, 606–617.
  75. Effect of uncertainty in input and parameter values on model prediction error. Ecological Modelling 105, 337–345.
  76. On calibrating semantic segmentation models: Analyses and an algorithm, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 23652–23662.
  77. Deep high-resolution representation learning for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 3349–3364.
  78. Fwenet: a deep convolutional neural network for flood water body extraction based on sar images. International Journal of Digital Earth 15, 345–361.
  79. A modular processing chain for automated flood monitoring from multi-spectral satellite data. Remote Sensing 11, 2330.
  80. Semantic segmentation of water bodies in very high-resolution satellite and aerial images. Remote Sensing of Environment 287, 113452.
  81. Deal: Difficulty-aware active learning for semantic segmentation, in: Proceedings of the Asian Conference on Computer Vision.
  82. Attentive dual stream siamese u-net for flood detection on multi-temporal sentinel-1 data, in: IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, IEEE. pp. 5222–5225.
  83. Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122 .
  84. Dilated residual networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 472–480.
  85. Flood detection using multiple chinese satellite datasets during 2020 china summer floods. Remote Sensing 14, 51.
  86. An uncertainty descriptor for quantitative measurement of the uncertainty of remote sensing images. Remote Sensing 11, 1560.
  87. An overview of the applications of earth observation satellite data: impacts and future trends. Remote Sensing 14, 1863.
Citations (4)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com