Quantitative Analysis of Primary Attribution Explainable Artificial Intelligence Methods for Remote Sensing Image Classification
Abstract: We present a comprehensive analysis of quantitatively evaluating explainable artificial intelligence (XAI) techniques for remote sensing image classification. Our approach leverages state-of-the-art machine learning approaches to perform remote sensing image classification across multiple modalities. We investigate the results of the models qualitatively through XAI methods. Additionally, we compare the XAI methods quantitatively through various categories of desired properties. Through our analysis, we offer insights and recommendations for selecting the most appropriate XAI method(s) to gain a deeper understanding of the models' decision-making processes. The code for this work is publicly available.
- Remote sensing digital image analysis, vol. 5, Springer, 2022.
- “Ai security for geoscience and remote sensing: Challenges and future trends,” arXiv preprint arXiv:2212.09360, 2022.
- “Quantus: An explainable ai toolkit for responsible evaluation of neural network explanations and beyond,” Journal of Machine Learning Research, vol. 24, no. 34, pp. 1–11, 2023.
- “Finding the right xai method–a guide for the evaluation and ranking of explainable ai methods in climate science,” arXiv preprint arXiv:2303.00652, 2023.
- “A convnet for the 2020s,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 11976–11986.
- “Transformers in vision: A survey,” ACM computing surveys (CSUR), vol. 54, no. 10s, pp. 1–41, 2022.
- “Focal modulation networks,” Advances in Neural Information Processing Systems (NeurIPS), 2022.
- “Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing,” International Journal of Applied Earth Observation and Geoinformation, vol. 103, pp. 102520, 2021.
- “Benchmarking and scaling of deep learning models for land cover image classification,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 195, pp. 250–268, 2023.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” in International Conference on Learning Representations, 2021.
- “Captum: A unified and generic model interpretability library for pytorch,” 2020.
- “Use hirescam instead of grad-cam for faithful explanations of convolutional neural networks,” 2021.
- “A unified approach to interpreting model predictions,” Advances in neural information processing systems, vol. 30, 2017.
- “Deep inside convolutional networks: Visualising image classification models and saliency maps,” 2014.
- “Learning deep features for discriminative localization,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2921–2929.
- “Slic superpixels compared to state-of-the-art superpixel methods,” IEEE transactions on pattern analysis and machine intelligence, vol. 34, no. 11, pp. 2274–2282, 2012.
- Nobuyuki Otsu, “A threshold selection method from gray-level histograms,” IEEE transactions on systems, man, and cybernetics, vol. 9, no. 1, pp. 62–66, 1979.
- Yi Yang and Shawn Newsam, “Bag-of-visual-words and spatial extensions for land-use classification,” in Proceedings of the 18th SIGSPATIAL international conference on advances in geographic information systems, 2010, pp. 270–279.
- “Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 7, pp. 2217–2226, 2019.
- “Mstar extended operating conditions: A tutorial,” Algorithms for Synthetic Aperture Radar Imagery III, vol. 2757, pp. 228–242, 1996.
- “Histogram layers for texture analysis,” IEEE Transactions on Artificial Intelligence, vol. 3, no. 4, pp. 541–552, 2021.
- “Target classification using the deep convolutional networks for sar images,” IEEE transactions on geoscience and remote sensing, vol. 54, no. 8, pp. 4806–4817, 2016.
- “Visualizing and understanding convolutional networks,” 2013.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.