Low-Rank Representations Meets Deep Unfolding: A Generalized and Interpretable Network for Hyperspectral Anomaly Detection (2402.15335v1)
Abstract: Current hyperspectral anomaly detection (HAD) benchmark datasets suffer from low resolution, simple background, and small size of the detection data. These factors also limit the performance of the well-known low-rank representation (LRR) models in terms of robustness on the separation of background and target features and the reliance on manual parameter selection. To this end, we build a new set of HAD benchmark datasets for improving the robustness of the HAD algorithm in complex scenarios, AIR-HAD for short. Accordingly, we propose a generalized and interpretable HAD network by deeply unfolding a dictionary-learnable LLR model, named LRR-Net$+$, which is capable of spectrally decoupling the background structure and object properties in a more generalized fashion and eliminating the bias introduced by vital interference targets concurrently. In addition, LRR-Net$+$ integrates the solution process of the Alternating Direction Method of Multipliers (ADMM) optimizer with the deep network, guiding its search process and imparting a level of interpretability to parameter optimization. Additionally, the integration of physical models with DL techniques eliminates the need for manual parameter tuning. The manually tuned parameters are seamlessly transformed into trainable parameters for deep neural networks, facilitating a more efficient and automated optimization process. Extensive experiments conducted on the AIR-HAD dataset show the superiority of our LRR-Net$+$ in terms of detection performance and generalization ability, compared to top-performing rivals. Furthermore, the compilable codes and our AIR-HAD benchmark datasets in this paper will be made available freely and openly at \url{https://sites.google.com/view/danfeng-hong}.
- A. F. H. Goetz, G. Vane, J. E. Solomon, and B. N. Rock, “Imaging spectrometry for earth remote sensing.” Science, vol. 228, no. 4704, pp. 1147–1153, Jun. 1985.
- D. Hong, B. Zhang, X. Li, Y. Li, C. Li, J. Yao, N. Yokoya, H. Li, P. Ghamisi, X. Jia, A. Plaza, P. Gamba, J. A. Benediktsson, and J. Chanussot, “Spectralgpt: Spectral remote sensing foundation model,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, dOI:10.1109/TPAMI.2024.3362475.
- D. Manolakis and G. Shaw, “Detection algorithms for hyperspectral imaging applications,” IEEE Signal Process. Mag., vol. 19, no. 1, pp. 29–43, Jan. 2002.
- K. Gregor and Y. Lecun, “Learning fast approximations of sparse coding,” in In Proceedings of the 27th International Conference on Int. Conf. Mach. Learn. (ICML’10), Jun. 2010, pp. 399–406.
- Y. Yang, J. Sun, H. Li, and Z. Xu, “ADMM-CSNet: A deep learning approach for image compressive sensing,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 3, pp. 521–538, Mar. 2020.
- W. Li and Q. Du, “Collaborative representation for hyperspectral anomaly detection,” IEEE Trans. Geosci. Remote Sens., vol. 53, no. 3, pp. 1463–1474, Mar. 2015.
- T. Cheng and B. Wang, “Graph and total variation regularized low-rank representation for hyperspectral anomaly detection,” IEEE Trans. Geosci. Remote Sens., vol. 58, no. 1, pp. 391–406, Jan. 2020.
- ——, “Total variation and sparsity regularized decomposition model with union dictionary for hyperspectral anomaly detection,” IEEE Trans. Geosci. Remote Sens., vol. 59, no. 2, pp. 1472–1486, Jul. 2021.
- I. S. Reed and X. Yu, “Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution,” IEEE Trans. Acoust., Speech, Signal Process.,, vol. 38, no. 10, pp. 1760–1770, Oct. 1990.
- N. Huyan, X. Zhang, H. Zhou, and L. Jiao, “Hyperspectral anomaly detection via background and potential anomaly dictionaries construction,” IEEE Trans. Geosci. Remote Sens., vol. 57, no. 4, pp. 2263–2276, Apr. 2019.
- G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171–184, 2013.
- S.-Y. Chen, S. Yang, K. Kalpakis, and C.-I. Chang, “Low-rank decomposition-based anomaly detection,” in Proc. SPIE, vol. 8743, no. 87430N, . 2013, pp. 1–24.
- Y. Niu and B. Wang, “Hyperspectral anomaly detection based on low-rank representation and learned dictionary,” Remote Sens., vol. 8, no. 4, 2016.
- Y. Qu, W. Wang, R. Guo, B. Ayhan, C. Kwan, S. Vance, and H. Qi, “Hyperspectral anomaly detection through spectral unmixing and dictionary-based low-rank decomposition,” IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 8, pp. 4391–4405, 2018.
- Y. Xu, Z. Wu, J. Li, A. Plaza, and Z. Wei, “Anomaly detection in hyperspectral images based on low-rank and sparse representation,” IEEE Trans. Geosci. Remote Sens., vol. 54, no. 4, pp. 1990–2000, Apr. 2016.
- H. Kwon and N. Nasrabadi, “Kernel RX-Algorithm: A nonlinear anomaly detector for hyperspectral imagery,” IEEE Trans. Geosci. Remote Sens., vol. 43, no. 2, pp. 388–397, Feb. 2005.
- J. Zhou, C. Kwan, B. Ayhan, and M. T. Eismann, “A novel cluster kernel rx algorithm for anomaly and change detection using hyperspectral images,” IEEE Trans. Geosci. Remote Sens., vol. 54, no. 11, pp. 6497–6504, Jul. 2016.
- K. Zhang, W. Zuo, and L. Zhang, “Ffdnet: Toward a fast and flexible solution for cnn-based image denoising,” IEEE Trans. on Image Process., vol. 27, no. 9, pp. 4608–4622, May. 2018.
- H. Gao, Y. Zhang, Z. Chen, S. Xu, D. Hong, and B. Zhang, “A multi-depth and multi-branch network for hyperspectral target detection based on band selection,” IEEE Transactions on Geoscience and Remote Sensing, 2023.
- X. Hu, C. Xie, Z. Fan, Q. Duan, D. Zhang, L. Jiang, X. Wei, D. Hong, G. Li, X. Zeng et al., “Hyperspectral anomaly detection using deep learning: A review,” Remote Sensing, vol. 14, no. 9, p. 1973, 2022.
- X. Yang, L. Zhang, H. T. Shen, and Y. Xia, “Hyperspectral anomaly detection via convolutional neural network and autoencoder,” IEEE Trans. on Geosci. and Remote Sens., vol. 57, no. 2, pp. 888–898, . 2019.
- X. Wu, D. Hong, and J. Chanussot, “Uiu-net: U-net in u-net for infrared small object detection,” IEEE Trans. Image Process., vol. 32, pp. 364–376, . 2023.
- D. Hong, B. Zhang, H. Li, Y. Li, J. Yao, C. Li, M. Werner, J. Chanussot, A. Zipf, and X. X. Zhu, “Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networks,” Remote Sensing of Environment, vol. 299, p. 113856, 2023.
- X. Lu, W. Zhang, and J. Huang, “Exploiting embedding manifold of autoencoders for hyperspectral anomaly detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 3, pp. 1527–1537, Nov. 2020.
- W. Chang, L. Li, Y. Wang, and W. Li, “Hyperspectral anomaly detection using generative adversarial network,” in Proceedings of the 28th ACM International Conference on Multimedia, . 2020, pp. 4156–4164.
- W. Xie, J. Zhang, J. Lei, Y. Li, and X. Jia, “Self-spectral learning with gan based spectral-spatial target detection for hyperspectral image,” Neural Networks, vol. 142, no. 8, pp. 375–387, Oct. 2021.
- S. Wang, X. Wang, L. Zhang, and Y. Zhong, “Auto-ad: Autonomous hyperspectral anomaly detection network based on fully convolutional autoencoder,” IEEE Trans. Geosci. Remote Sens., vol. 60, p. 5503314, Mar. 2022.
- H. Shen, M. Jiang, J. Li, C. Zhou, Q. Yuan, and L. Zhang, “Coupling model- and data-driven methods for remote sensing image restoration and fusion: Improving physical interpretability,” IEEE Geosci. Remote Sens. Mag., vol. 10, no. 2, pp. 231–249, Jun. 2022.
- S. Diamond, V. Sitzmann, F. Heide, and G. Wetzstein, “Unrolled optimization with deep priors,” arXiv e-prints, vol. 10, no. 2, pp. 231–249, May. 2017.
- Y. Qian, F. Xiong, Q. Qian, and J. Zhou, “Spectral mixture model inspired network architectures for hyperspectral unmixing,” IEEE Trans. on Geosci. and Remote Sens., vol. 58, no. 10, pp. 7418–7434, Oct. 2020.
- F. Xiong, J. Zhou, S. Tao, J. Lu, and Y. Qian, “Snmf-net: Learning a deep alternating neural network for hyperspectral unmixing,” IEEE Trans. on Geosci. and Remote Sens., vol. 60, pp. 1–16, May. 2022.
- Q. Xie, M. Zhou, Q. Zhao, D. Meng, W. Zuo, and Z. Xu, “Multispectral and hyperspectral image fusion by ms/hs fusion net,” in in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2019, pp. 1585–1594.
- J. Zhang and B. Ghanem, “ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Dec. 2017, pp. 1828–1837.
- S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Found. Trends® Mach. Learn., vol. 3, no. 1, pp. 1–122, Jan. 2011.
- D. Hong, N. Yokoya, J. Chanussot, and X. X. Zhu, “An augmented linear mixing model to address spectral variability for hyperspectral unmixing,” IEEE Transactions on Image Processing, vol. 28, no. 4, pp. 1923–1938, 2019.
- X. Kang, X. Zhang, S. Li, K. Li, J. Li, and J. A. Benediktsson, “Hyperspectral anomaly detection with attribute and edge-preserving filters,” IEEE Trans. Geosci. Remote Sens., vol. 55, no. 10, pp. 5600–5611, Oct. 2017.
- S. Khazai, S. Homayouni, A. Safari, and B. Mojaradi, “Anomaly detection in hyperspectral images based on an adaptive support vector method,” IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 646–650, . 2011.
- J. M. Molero, E. M. Garzón, I. García, and A. Plaza, “Analysis and optimizations of global and local versions of the RX algorithm for anomaly detection in hyperspectral data,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 6, no. 2, pp. 801–814, Oct. 2013.
- Y. Chang, L. Yan, H. Fang, S. Zhong, and W. Liao, “Hsi-denet: Hyperspectral image restoration via convolutional neural network,” IEEE Trans. Geosci. Remote Sens., vol. 57, no. 2, pp. 667–682, . 2019.
- C. Li, B. Zhang, D. Hong, J. Yao, and J. Chanussot, “Lrr-net: An interpretable deep unfolding network for hyperspectral anomaly detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–12, May. 2023.