Label Noise Robust Image Representation Learning based on Supervised Variational Autoencoders in Remote Sensing
Abstract: Due to the publicly available thematic maps and crowd-sourced data, remote sensing (RS) image annotations can be gathered at zero cost for training deep neural networks (DNNs). However, such annotation sources may increase the risk of including noisy labels in training data, leading to inaccurate RS image representation learning (IRL). To address this issue, in this paper we propose a label noise robust IRL method that aims to prevent the interference of noisy labels on IRL, independently from the learning task being considered in RS. To this end, the proposed method combines a supervised variational autoencoder (SVAE) with any kind of DNN. This is achieved by defining variational generative process based on image features. This allows us to define the importance of each training sample for IRL based on the loss values acquired from the SVAE and the task head of the considered DNN. Then, the proposed method imposes lower importance to images with noisy labels, while giving higher importance to those with correct labels during IRL. Experimental results show the effectiveness of the proposed method when compared to well-known label noise robust IRL methods applied to RS images. The code of the proposed method is publicly available at https://git.tu-berlin.de/rsim/RS-IRL-SVAE.
- G. Sumbul and B. Demir, “A deep multi-attention driven approach for multi-label remote sensing image classification,” IEEE Access, vol. 8, pp. 95 934–95 946, 2020.
- L. Ding, H. Tang, Y. Liu, Y. Shi, X. X. Zhu, and L. Bruzzone, “Adversarial shape learning for building extraction in VHR remote sensing images,” IEEE Transactions on Image Processing, vol. 31, pp. 678–690, 2022.
- Q. Cheng, H. Huang, Y. Xu, Y. Zhou, H. Li, and Z. Wang, “NWPU-captions dataset and MLCA-net for remote sensing image captioning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–19, 2022.
- H. Zhang, M. Lin, G. Yang, and L. Zhang, “ESCNet: An end-to-end superpixel-enhanced change detection network for very-high-resolution remote sensing images,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 1, pp. 28–42, 2023.
- G. Sumbul and B. Demir, “Plasticity-stability preserving multi-task learning for remote sensing image retrieval,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–16, 2022, doi: 10.1109/TGRS.2022.3160097.
- H. Song, M. Kim, D. Park, Y. Shin, and J.-G. Lee, “Learning from noisy labels with deep neural networks: A survey,” IEEE Transactions on Neural Networks and Learning Systems, 2022, doi: 10.1109/TNNLS.2022.3152527.
- N. Ahmed, R. M. Rahman, M. S. G. Adnan, and B. Ahmed, “Dense prediction of label noise for learning building extraction from aerial drone imagery,” International Journal of Remote Sensing, vol. 42, no. 23, pp. 8906–8929, 2021.
- R. Dong, W. Fang, H. Fu, L. Gan, J. Wang, and P. Gong, “High-resolution land cover mapping through learning with noise correction,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–13, 2022.
- R. Zhang, Z. Chen, S. Zhang, F. Song, G. Zhang, Q. Zhou, and T. Lei, “Remote sensing image scene classification with noisy label distillation,” Remote Sensing, vol. 12, no. 15, p. 2376, 2020.
- J. Kang, R. Fernandez-Beltran, P. Duan, X. Kang, and A. J. Plaza, “Robust normalized softmax loss for deep metric learning-based characterization of remote sensing images with label noise,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 10, pp. 8798–8811, 2021.
- P. Li, X. He, X. Cheng, M. Qiao, D. Song, M. Chen, T. Zhou, J. Li, X. Guo, S. Hu, and Z. Tian, “An improved categorical cross entropy for remote sensing image classification based on noisy labels,” Expert Systems with Applications, vol. 205, p. 117296, 2022.
- T. Burgert, M. Ravanbakhsh, and B. Demir, “On the effects of different types of label noise in multi-label remote sensing image classification,” arXiv preprint arXiv:2207.13975, 2022.
- A. K. Aksoy, M. Ravanbakhsh, and B. Demir, “Multi-label noise robust collaborative learning method for remote sensing image classification,” IEEE Transactions on Neural Networks and Learning Systems, 2022, doi: 10.1109/TNNLS.2022.3209992.
- D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” International Conference on Learning Representations, pp. 1–14, 2014.
- K. Lee, S. Yun, K. Lee, H. Lee, B. Li, and J. Shin, “Robust inference via generative classifiers for handling noisy labels,” International Conference on Machine Learning, pp. 3763–3772, 2019.
- G. Sumbul, A. de Wall, T. Kreuziger, F. Marcelino, H. Costa, P. Benevides, M. Caetano, B. Demir, and V. Markl, “BigEarthNet-MM: A large scale multi-modal multi-label benchmark archive for remote sensing image classification and retrieval,” IEEE Geoscience and Remote Sensing Magazine, vol. 9, no. 3, pp. 174–180, 2021.
- G. Huang, Z. Liu, L. v. d. Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” IEEE Conference on Computer Vision and Pattern Recognition, pp. 2261–2269, 2017.
- T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, “Focal loss for dense object detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, pp. 318–327, 2020.
- T. Ridnik, E. Ben-Baruch, N. Zamir, A. Noy, I. Friedman, M. Protter, and L. Zelnik-Manor, “Asymmetric loss for multi-label classification,” IEEE International Conference on Computer Vision, pp. 82–91, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.