Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-level Graph Subspace Contrastive Learning for Hyperspectral Image Clustering (2404.05211v1)

Published 8 Apr 2024 in cs.CV

Abstract: Hyperspectral image (HSI) clustering is a challenging task due to its high complexity. Despite subspace clustering shows impressive performance for HSI, traditional methods tend to ignore the global-local interaction in HSI data. In this study, we proposed a multi-level graph subspace contrastive learning (MLGSC) for HSI clustering. The model is divided into the following main parts. Graph convolution subspace construction: utilizing spectral and texture feautures to construct two graph convolution views. Local-global graph representation: local graph representations were obtained by step-by-step convolutions and a more representative global graph representation was obtained using an attention-based pooling strategy. Multi-level graph subspace contrastive learning: multi-level contrastive learning was conducted to obtain local-global joint graph representations, to improve the consistency of the positive samples between views, and to obtain more robust graph embeddings. Specifically, graph-level contrastive learning is used to better learn global representations of HSI data. Node-level intra-view and inter-view contrastive learning is designed to learn joint representations of local regions of HSI. The proposed model is evaluated on four popular HSI datasets: Indian Pines, Pavia University, Houston, and Xu Zhou. The overall accuracies are 97.75%, 99.96%, 92.28%, and 95.73%, which significantly outperforms the current state-of-the-art clustering methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. R. Guan, Z. Li, T. Li, X. Li, J. Yang, and W. Chen, “Classification of heterogeneous mining areas based on rescapsnet and gaofen-5 imagery,” Remote Sensing, vol. 14, no. 13, p. 3216, 2022.
  2. G. Yang, K. Huang, W. Sun, X. Meng, D. Mao, and Y. Ge, “Enhanced mangrove vegetation index based on hyperspectral images for mapping mangrove,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 189, pp. 236–254, 2022.
  3. R. Li, Y. Hu, L. Li, R. Guan, R. Yang, J. Zhan, W. Cai, Y. Wang, H. Xu, and L. Li, “Smwe-gfpnnet: A high-precision and robust method for forest fire smoke detection,” Knowledge-Based Systems, vol. 289, p. 111528, 2024.
  4. Q. Wang, L. Sun, Y. Wang, M. Zhou, M. Hu, J. Chen, Y. Wen, and Q. Li, “Identification of melanoma from hyperspectral pathology image using 3d convolutional networks,” IEEE Transactions on Medical Imaging, vol. 40, no. 1, pp. 218–227, 2020.
  5. Z. Liu, R. Guan, J. Hu, W. Chen, and X. Li, “Remote sensing scene data generation using element geometric transformation and gan-based texture synthesis,” Applied Sciences, vol. 12, no. 8, p. 3972, 2022.
  6. H. Zhai, H. Zhang, P. Li, and L. Zhang, “Hyperspectral image clustering: Current achievements and future lines,” IEEE Geoscience and Remote Sensing Magazine, vol. 9, no. 4, pp. 35–67, 2021.
  7. W. Tu, R. Guan, S. Zhou, C. Ma, X. Peng, Z. Cai, Z. Liu, J. Cheng, and X. Liu, “Attribute-missing graph clustering network,” in Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), 2024.
  8. B. Peng, Y. Yao, J. Lei, L. Fang, and Q. Huang, “Graph-based structural deep spectral-spatial clustering for hyperspectral image,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1–12, 2023.
  9. Z. Wen, Y. Ling, Y. Ren, T. Wu, J. Chen, X. Pu, Z. Hao, and L. He, “Homophily-related: Adaptive hybrid graph filter for multi-view graph clustering,” arXiv preprint arXiv:2401.02682, 2024.
  10. R. Vidal, “Subspace clustering,” IEEE Signal Processing Magazine, vol. 28, no. 2, pp. 52–68, 2011.
  11. C. Cui, Y. Ren, J. Pu, J. Li, X. Pu, T. Wu, Y. Shi, and L. He, “A novel approach for effective multi-view clustering with information-theoretic perspective,” Advances in Neural Information Processing Systems, vol. 36, 2024.
  12. Z. Zhang, Y. Cai, W. Gong, P. Ghamisi, X. Liu, and R. Gloaguen, “Hypergraph convolutional subspace clustering with multihop aggregation for hyperspectral image,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 676–686, 2022.
  13. W. Yan, Y. Zhou, Y. Wang, Q. Zheng, and J. Zhu, “Multi-view semantic consistency based information bottleneck for clustering,” Knowledge-Based Systems, vol. 288, p. 111448, 2024.
  14. Y. Zhou, Q. Zheng, Y. Wang, W. Yan, P. Shi, and J. Zhu, “Mcoco: Multi-level consistency collaborative multi-view clustering,” Expert Systems with Applications, vol. 238, p. 121976, 2024.
  15. E. Elhamifar and R. Vidal, “Sparse subspace clustering: Algorithm, theory, and applications,” IEEE transactions on pattern analysis and machine intelligence, vol. 35, no. 11, pp. 2765–2781, 2013.
  16. C. Cui, Y. Ren, J. Pu, X. Pu, and L. He, “Deep multi-view subspace clustering with anchor graph,” arXiv preprint arXiv:2305.06939, 2023.
  17. H. Zhai, H. Zhang, L. Zhang, P. Li, and A. Plaza, “A new sparse subspace clustering algorithm for hyperspectral remote sensing imagery,” IEEE Geoscience and Remote Sensing Letters, vol. 14, no. 1, pp. 43–47, 2016.
  18. Y. Chen, Y. Tang, Z. Yin, T. Han, B. Zou, and H. Feng, “Single object tracking in satellite videos: A correlation filter-based dual-flow tracker,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 6687–6698, 2022.
  19. Y. Chen, Q. Yuan, Y. Tang, Y. Xiao, J. He, and L. Zhang, “Spirit: Spectral awareness interaction network with dynamic template for hyperspectral object tracking,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–16, 2024.
  20. J. Liu, R. Guan, Z. Li, J. Zhang, Y. Hu, and X. Wang, “Adaptive multi-feature fusion graph convolutional network for hyperspectral image classification,” Remote Sensing, vol. 15, no. 23, p. 5483, 2023.
  21. Y. Cai, Z. Zhang, Z. Cai, X. Liu, X. Jiang, and Q. Yan, “Graph convolutional subspace clustering: A robust subspace clustering framework for hyperspectral image,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 5, pp. 4191–4202, 2021.
  22. L. Yang, Y. Guo, J. Gu, D. Jin, B. Yang, and X. Cao, “Probabilistic graph convolutional network via topology-constrained latent space model,” IEEE Transactions on Cybernetics, vol. 52, no. 4, pp. 2123–2136, 2020.
  23. J. Wang, C. Tang, X. Zheng, X. Liu, W. Zhang, and E. Zhu, “Graph regularized spatial–spectral subspace clustering for hyperspectral band selection,” Neural Networks, vol. 153, pp. 292–302, 2022.
  24. Y. Cai, M. Zeng, Z. Cai, X. Liu, and Z. Zhang, “Graph regularized residual subspace clustering network for hyperspectral image clustering,” Information Sciences, vol. 578, pp. 85–101, 2021.
  25. S. Liu and H. Wang, “Graph convolutional optimal transport for hyperspectral image spectral clustering,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–13, 2022.
  26. Z. Hao, Z. Lu, G. Li, F. Nie, R. Wang, and X. Li, “Ensemble clustering with attentional representation,” IEEE Transactions on Knowledge & Data Engineering, vol. 36, no. 02, pp. 581–593, 2024.
  27. Z. Hao, Z. Lu, F. Nie, R. Wang, and X. Li, “Multi-view k-means with laplacian embedding,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, pp. 1–5.
  28. R. Guan, Z. Li, X. Li, and C. Tang, “Pixel-superpixel contrastive learning and pseudo-label correction for hyperspectral image clustering,” in ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024, pp. 6795–6799.
  29. Y. Cai, Z. Zhang, P. Ghamisi, Y. Ding, X. Liu, Z. Cai, and R. Gloaguen, “Superpixel contracted neighborhood contrastive subspace clustering network for hyperspectral images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–13, 2022.
  30. X. Li, Z. Ni, and T. Zhang, “Mixture of personality improved spiking actor network for efficient multi-agent cooperation,” Frontiers in Neuroscience, vol. 17, p. 1219405, 2023.
  31. R. Guan, Z. Li, W. Tu, J. Wang, Y. Liu, X. Li, C. Tang, and R. Feng, “Contrastive multi-view subspace clustering of hyperspectral images based on graph convolutional networks,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–14, 2024.
  32. L. Liu, Z. Kang, J. Ruan, and X. He, “Multilayer graph contrastive clustering network,” Information Sciences, vol. 613, pp. 256–267, 2022.
  33. T. Li, Y. Cai, Y. Zhang, Z. Cai, and X. Liu, “Deep mutual information subspace clustering network for hyperspectral images,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2022.
  34. Q. Yan, T. Hu, Y. Sun, H. Tang, Y. Zhu, W. Dong, L. Van Gool, and Y. Zhang, “Towards high-quality hdr deghosting with conditional diffusion models,” IEEE Transactions on Circuits and Systems for Video Technology, 2023.
  35. B. Wang, T. Hu, B. Li, X. Chen, and Z. Zhang, “Gatector: A unified framework for gaze object prediction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 19 588–19 597.
  36. X. Zhang, T. Hu, J. He, and Q. Yan, “Efficient content reconstruction for high dynamic range imaging,” in ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024, pp. 7660–7664.
  37. M. Brbić and I. Kopriva, “Multi-view low-rank sparse subspace clustering,” Pattern Recognition, vol. 73, pp. 247–258, 2018.
  38. Y. Xia, X. Shao, T. Ding, and J. Liu, “Prescribed intelligent elliptical pursuing by uavs: A reinforcement learning policy,” Expert Systems with Applications, vol. 249, p. 123547, 2024.
  39. Z. Wang, J. Du, C. Jiang, Z. Zhang, Y. Ren, and Z. Han, “Dynamic packet routing based on acoustic signal curve propagation in the auv-assisted iout,” IEEE Internet of Things Journal, vol. 11, no. 6, pp. 9854–9869, 2024.
  40. Z. Wang, Z. Zhang, J. Wang, C. Jiang, W. Wei, and Y. Ren, “Auv-assisted node repair for iout relying on multiagent reinforcement learning,” IEEE Internet of Things Journal, vol. 11, no. 3, pp. 4139–4151, 2024.
  41. X. Hou, J. Wang, C. Jiang, X. Zhang, Y. Ren, and M. Debbah, “Uav-enabled covert federated learning,” IEEE Transactions on Wireless Communications, vol. 22, no. 10, pp. 6793–6809, 2023.
  42. X. Hou, J. Wang, C. Jiang, Z. Meng, J. Chen, and Y. Ren, “Efficient federated learning for metaverse via dynamic user selection, gradient quantization and resource allocation,” IEEE Journal on Selected Areas in Communications, vol. 42, no. 4, pp. 850–866, 2024.
  43. F. Nie, Z. Hao, and R. Wang, “Multi-class support vector machine with maximizing minimum margin,” arXiv preprint arXiv:2312.06578, 2023.
  44. Y. Liu, X. Yang, S. Zhou, X. Liu, S. Wang, K. Liang, W. Tu, and L. Li, “Simple contrastive graph clustering,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–12, 2023.
  45. Y. Liu, K. Liang, J. Xia, S. Zhou, X. Yang, X. Liu, and S. Z. Li, “Dink-net: Neural clustering on large graphs,” in International Conference on Machine Learning.   PMLR, 2023, pp. 21 794–21 812.
  46. W. Tu, S. Zhou, X. Liu, X. Guo, Z. Cai, E. Zhu, and J. Cheng, “Deep fusion clustering network,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 11, 2021, pp. 9978–9987.
  47. Y. Liu, W. Tu, S. Zhou, X. Liu, L. Song, X. Yang, and E. Zhu, “Deep graph clustering via dual correlation reduction,” in Proceedings of the AAAI conference on artificial intelligence, vol. 36, no. 7, 2022, pp. 7603–7611.
  48. Y. Liu, X. Yang, S. Zhou, X. Liu, Z. Wang, K. Liang, W. Tu, L. Li, J. Duan, and C. Chen, “Hard sample aware network for contrastive deep graph clustering,” in Proceedings of the AAAI conference on artificial intelligence, vol. 37, no. 7, 2023, pp. 8914–8922.
  49. H. Li, Y. Li, G. Zhang, R. Liu, H. Huang, Q. Zhu, and C. Tao, “Global and local contrastive self-supervised learning for semantic segmentation of hr remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–14, 2022.
  50. C. Rodarmel and J. Shan, “Principal component analysis for hyperspectral image classification,” Surveying and Land Information Science, vol. 62, no. 2, pp. 115–122, 2002.
  51. T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, “An efficient k-means clustering algorithm: Analysis and implementation,” IEEE transactions on pattern analysis and machine intelligence, vol. 24, no. 7, pp. 881–892, 2002.
  52. H. Zhang, H. Zhai, L. Zhang, and P. Li, “Spectral–spatial sparse subspace clustering for hyperspectral remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 6, pp. 3672–3684, 2016.
  53. L. Zhang, L. Zhang, B. Du, J. You, and D. Tao, “Hyperspectral image unsupervised classification by robust manifold matrix factorization,” Information Sciences, vol. 485, pp. 154–169, 2019.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now