Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Unfolding ADMM for Enhanced Subspace Clustering of Hyperspectral Images (2404.07112v3)

Published 10 Apr 2024 in cs.CV

Abstract: Deep subspace clustering methods are now prominent in clustering, typically using fully connected networks and a self-representation loss function. However, these methods often struggle with overfitting and lack interpretability. In this paper, we explore an alternative clustering approach based on deep unfolding. By unfolding iterative optimization methods into neural networks, this approach offers enhanced interpretability and reliability compared to data-driven deep learning methods, and greater adaptability and generalization than model-based approaches. Hence, unfolding has become widely used in inverse imaging problems, such as image restoration, reconstruction, and super-resolution, but has not been sufficiently explored yet in the context of clustering. In this work, we introduce an innovative clustering architecture for hyperspectral images (HSI) by unfolding an iterative solver based on the Alternating Direction Method of Multipliers (ADMM) for sparse subspace clustering. To our knowledge, this is the first attempt to apply unfolding ADMM for computing the self-representation matrix in subspace clustering. Moreover, our approach captures well the structural characteristics of HSI data by employing the K nearest neighbors algorithm as part of a structure preservation module. Experimental evaluation of three established HSI datasets shows clearly the potential of the unfolding approach in HSI clustering and even demonstrates superior performance compared to state-of-the-art techniques.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (22)
  1. M. Teke, H. S. Deveci, O. Haliloğlu, S. Z. Gürbüz, and U. Sakarya, “A short survey of hyperspectral remote sensing applications in agriculture,” in 2013 6th International Conference on Recent Advances in Space Technologies (RAST), 2013, pp. 171–176.
  2. M. Shimoni, R. Haelterman, and C. Perneel, “Hypersectral imaging for military and security applications: Combining myriad processing and sensing techniques,” IEEE Geoscience and Remote Sensing Magazine, vol. 7, no. 2, pp. 101–117, 2019.
  3. M. B. Stuart, A. J. McGonigle, and J. R. Willmott, “Hyperspectral imaging in environmental monitoring: A review of recent developments and technological advances in compact field deployable systems,” Sensors, vol. 19, no. 14, p. 3071, 2019.
  4. J. A. Hartigan and M. A. Wong, “Algorithm as 136: A k-means clustering algorithm,” Journal of the Royal Statistical Society. series C (applied statistics), vol. 28, no. 1, pp. 100–108, 1979.
  5. U. Von Luxburg, “A tutorial on spectral clustering,” Statistics and computing, vol. 17, no. 4, pp. 395–416, 2007.
  6. S. Sarfraz, V. Sharma, and R. Stiefelhagen, “Efficient parameter-free clustering using first neighbor relations,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 8934–8943.
  7. S. Huang, H. Zhang, H. Zeng, and A. Pižurica, “From model-based optimization algorithms to deep learning models for clustering hyperspectral images,” Remote Sensing, vol. 15, no. 11, p. 2832, 2023.
  8. S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein et al., “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends® in Machine learning, vol. 3, no. 1, pp. 1–122, 2011.
  9. J. Xie, R. Girshick, and A. Farhadi, “Unsupervised deep embedding for clustering analysis,” in International conference on machine learning.   PMLR, 2016, pp. 478–487.
  10. B. Yang, X. Fu, N. D. Sidiropoulos, and M. Hong, “Towards k-means-friendly spaces: Simultaneous deep learning and clustering,” in international conference on machine learning.   PMLR, 2017, pp. 3861–3870.
  11. P. Ji, T. Zhang, H. Li, M. Salzmann, and I. Reid, “Deep subspace clustering networks,” Advances in Neural Information Processing Systems, vol. 30, 2017.
  12. Y. Cai, Z. Zhang, Z. Cai, X. Liu, and X. Jiang, “Hypergraph-structured autoencoder for unsupervised and semisupervised classification of hyperspectral image,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2021.
  13. X. Li, N. Nadisic, S. Huang, N. Deligiannis, and A. Pižurica, “Model-aware deep learning for the clustering of hyperspectral images with context preservation,” in 2023 31st European Signal Processing Conference (EUSIPCO).   IEEE, 2023, pp. 885–889.
  14. H. Zeng, J. Cao, K. Feng, S. Huang, H. Zhang, H. Luong, and W. Philips, “Degradation-noise-aware deep unfolding transformer for hyperspectral image denoising,” arXiv preprint arXiv:2305.04047, 2023.
  15. V. Kouni, G. Paraskevopoulos, H. Rauhut, and G. C. Alexandropoulos, “Admm-dad net: A deep unfolding network for analysis compressed sensing,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2022, pp. 1506–1510.
  16. C. Zhou and M. R. Rodrigues, “Admm-based hyperspectral unmixing networks for abundance and endmember estimation,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–18, 2021.
  17. P. B. Tankala, “Clustering via deep dictionary learning,” Ph.D. dissertation, 2021.
  18. P. Huang, Y. Huang, W. Wang, and L. Wang, “Deep embedding network for clustering,” in 2014 22nd International conference on pattern recognition.   IEEE, 2014, pp. 1532–1537.
  19. X. Peng, S. Xiao, J. Feng, W.-Y. Yau, and Z. Yi, “Deep subspace clustering with sparsity prior.” in IJCAI, 2016, pp. 1925–1931.
  20. K. Li, Y. Qin, Q. Ling, Y. Wang, Z. Lin, and W. An, “Self-supervised deep subspace clustering for hyperspectral images with adaptive self-expressive coefficient matrix initialization,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 3215–3227, 2021.
  21. V. Monga, Y. Li, and Y. C. Eldar, “Algorithm unrolling: Interpretable, efficient deep learning for signal and image processing,” IEEE Signal Processing Magazine, vol. 38, no. 2, pp. 18–44, 2021.
  22. U. Shaham, K. Stanton, H. Li, B. Nadler, R. Basri, and Y. Kluger, “Spectralnet: Spectral clustering using deep neural networks,” in Proc. ICLR 2018, 2018.
Citations (1)

Summary

We haven't generated a summary for this paper yet.