Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Superpixel-based and Spatially-regularized Diffusion Learning for Unsupervised Hyperspectral Image Clustering (2312.15447v1)

Published 24 Dec 2023 in cs.CV, cs.LG, and stat.AP

Abstract: Hyperspectral images (HSIs) provide exceptional spatial and spectral resolution of a scene, crucial for various remote sensing applications. However, the high dimensionality, presence of noise and outliers, and the need for precise labels of HSIs present significant challenges to HSIs analysis, motivating the development of performant HSI clustering algorithms. This paper introduces a novel unsupervised HSI clustering algorithm, Superpixel-based and Spatially-regularized Diffusion Learning (S2DL), which addresses these challenges by incorporating rich spatial information encoded in HSIs into diffusion geometry-based clustering. S2DL employs the Entropy Rate Superpixel (ERS) segmentation technique to partition an image into superpixels, then constructs a spatially-regularized diffusion graph using the most representative high-density pixels. This approach reduces computational burden while preserving accuracy. Cluster modes, serving as exemplars for underlying cluster structure, are identified as the highest-density pixels farthest in diffusion distance from other highest-density pixels. These modes guide the labeling of the remaining representative pixels from ERS superpixels. Finally, majority voting is applied to the labels assigned within each superpixel to propagate labels to the rest of the image. This spatial-spectral approach simultaneously simplifies graph construction, reduces computational cost, and improves clustering performance. S2DL's performance is illustrated with extensive experiments on three publicly available, real-world HSIs: Indian Pines, Salinas, and Salinas A. Additionally, we apply S2DL to landscape-scale, unsupervised mangrove species mapping in the Mai Po Nature Reserve, Hong Kong, using a Gaofen-5 HSI. The success of S2DL in these diverse numerical experiments indicates its efficacy on a wide range of important unsupervised remote sensing analysis tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (86)
  1. “Hyperspectral remote sensing data analysis and future challenges” In IEEE Geosci. Remote Sens. Mag. 1.2 IEEE, 2013, pp. 6–36
  2. “Recent advances in techniques for hyperspectral image processing” In Remote Sens. Environ. 113 Elsevier, 2009, pp. S110–S122
  3. “Deep learning-based classification of hyperspectral data” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7.6 IEEE, 2014, pp. 2094–2107
  4. “Hyperspectral image clustering: current achievements and future lines” In IEEE Geosci. Remote Sens. Mag. 9.4 IEEE, 2021, pp. 35–67
  5. “Deep learning for hyperspectral image classification: an overview” In IEEE Trans. Geosci. Remote Sens. 57.9 IEEE, 2019, pp. 6690–6709
  6. “Unsupervised detection of ash dieback disease (Hymenoscyphus fraxineus) using diffusion-based hyperspectral image clustering” In Proc. IGARSS, 2022, pp. 2287–2290 IEEE
  7. “Classification of hyperspectral images using SVM with shape-adaptive reconstruction and smoothed total variation” In Proc. IGARSS, 2022, pp. 1368–1371 IEEE
  8. “A review of change detection in multitemporal hyperspectral images: current techniques, applications, and challenges” In IEEE Geosci. Remote Sens. Mag. 7.2 IEEE, 2019, pp. 140–158
  9. “Spectral variability in hyperspectral data unmixing: a comprehensive review” In IEEE Geosci. Remote Sens. Mag. 9.4 IEEE, 2021, pp. 223–270
  10. “Hyperspectral unmixing overview: geometrical, statistical, and sparse regression-based approaches” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 5.2 IEEE, 2012, pp. 354–379
  11. Rob Heylen, Mario Parente and Paul Gader “A review of nonlinear hyperspectral unmixing methods” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7.6 IEEE, 2014, pp. 1844–1868
  12. Kangning Cui and Robert J Plemmons “Unsupervised classification of AVIRIS-NG hyperspectral images” In Proc. WHISPERS, 2021, pp. 1–5 IEEE
  13. Naoto Yokoya, Claas Grohnfeldt and Jocelyn Chanussot “Hyperspectral and multispectral data fusion: a comparative review of the recent literature” In IEEE Geosci. Remote Sens. Mag. 5.2 IEEE, 2017, pp. 29–56
  14. “Hyperspectral pansharpening: a review” In IEEE Geosci. Remote Sens. Mag. 3.3 IEEE, 2015, pp. 27–46
  15. “Deep learning for pixel-level image fusion: Recent advances and future prospects” In Inf. Fusion 42 Elsevier, 2018, pp. 158–173
  16. “Detecting change due to alluvial gold mining in Peruvian rainforest using recursive convolutional neural networks and contrastive learning” In Fall Meeting, 2022 AGU
  17. “Superpixel-level global and local similarity graph-based clustering for large hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2021, pp. 1–16
  18. “Self-supervised locality preserving low-pass graph convolutional embedding for large-scale hyperspectral image clustering” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–16
  19. “Hyperspectral image unsupervised classification by robust manifold matrix factorization” In Inf. Sci. 485 Elsevier, 2019, pp. 154–169
  20. “Graph convolutional subspace clustering: A robust subspace clustering framework for hyperspectral image” In IEEE Trans. Geosci. Remote Sens. 59.5 IEEE, 2020, pp. 4191–4202
  21. “Graph-based structural deep spectral-spatial clustering for hyperspectral image” In IEEE Trans. Instrum. Meas. IEEE, 2023
  22. Shaoguang Huang, Hongyan Zhang and Aleksandra Pižurica “Hybrid-hypergraph regularized multiview subspace clustering for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2021, pp. 1–16
  23. “A new sparse subspace clustering algorithm for hyperspectral remote sensing imagery” In IEEE Geosci. Remote Sens. Lett. 14.1 IEEE, 2016, pp. 43–47
  24. Rong Wang, Feiping Nie and Weizhong Yu “Fast spectral clustering with anchor graph for large hyperspectral images” In IEEE Geosci. Remote Sens. Lett. 14.11 IEEE, 2017, pp. 2003–2007
  25. Yang Zhao, Yuan Yuan and Qi Wang “Fast spectral clustering for unsupervised hyperspectral image classification” In Remote Sens. 11.4 MDPI, 2019, pp. 399
  26. “Spatial-spectral clustering with anchor graph for hyperspectral image” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–13
  27. “Spectral-spatial superpixel anchor graph-based clustering for hyperspectral imagery” In IEEE Geosci. Remote Sens. Lett. IEEE, 2023
  28. Charles M Bachmann, Thomas L Ainsworth and Robert A Fusina “Exploiting manifold geometry in hyperspectral imagery” In IEEE Trans. Geosci. Remote Sens. 43.3 IEEE, 2005, pp. 441–454
  29. James M Murphy and Mauro Maggioni “Unsupervised clustering and active learning of hyperspectral images with nonlinear diffusion” In IEEE Trans. Geosci. Remote Sens. 57.3 IEEE, 2019, pp. 1829–1845
  30. “Diffusion maps” In Appl. Comput. Harm. Anal. 21.1 Elsevier, 2006, pp. 5–30
  31. “Noise reduction in hyperspectral imagery: overview and application” In Remote Sens. 10.3 MDPI, 2018, pp. 482
  32. Wanyuan Cai, Junzheng Jiang and Jiang Qian “Large-scale hyperspectral image restoration via a superpixel distributed algorithm based on graph signal processing” In IEEE Trans. Geosci. Remote Sens. 61 IEEE, 2023, pp. 1–17
  33. “Advances in spectral-spatial classification of hyperspectral images” In Proc. IEEE 101.3 IEEE, 2012, pp. 652–675
  34. “SuperPCA: a superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery” In IEEE Trans. Geosci. Remote Sens. 56.8 IEEE, 2018, pp. 4581–4593
  35. Jiayi Li, Hongyan Zhang and Liangpei Zhang “Efficient superpixel-level multitask joint sparse representation for hyperspectral image classification” In IEEE Trans. Geosci. Remote Sens. 53.10 IEEE, 2015, pp. 5338–5351
  36. Sam L Polk and James M Murphy “Multiscale clustering of hyperspectral images through spectral-spatial diffusion geometry” In Proc. IGARSS, 2021, pp. 4688–4691 IEEE
  37. James M Murphy and Mauro Maggioni “Spectral–spatial diffusion geometry for hyperspectral image clustering” In IEEE Geosci. Remote Sens. Lett. 17.7 IEEE, 2019, pp. 1243–1247
  38. James M Murphy “Spatially regularized active diffusion learning for high-dimensional images” In Pattern Recognit. Lett. 135 Elsevier, 2020, pp. 213–220
  39. “GF-5 hyperspectral data for species mapping of mangrove in Mai Po, Hong Kong” In Remote Sens. 12.4 MDPI, 2020, pp. 656
  40. T. Hastie, R. Tibshirani and J.H. Friedman “The elements of statistical learning: data mining, inference, and prediction” Springer Series in Statistics, 2009
  41. “Unsupervised diffusion and volume maximization-based clustering of hyperspectral images” In Remote Sens. 15.4 MDPI, 2023, pp. 1053
  42. J MacQueen “Classification and analysis of multivariate observations” In Proc. 5th Berkeley Symp. Math. Statist. Probability 1.14, 1967, pp. 281–297 Oakland, CA, USA
  43. Geoffrey J McLachlan, Sharon X Lee and Suren I Rathnayake “Finite mixture models” In Annu. Rev. Stat. Appl. 6 Annual Reviews, 2019, pp. 355–378
  44. “A density-based algorithm for discovering clusters in large spatial databases with noise” In kdd 96.34, 1996, pp. 226–231
  45. James M Murphy and Sam L Polk “A multiscale environment for learning by diffusion” In Appl. Comput. Harm. Anal. 57 Elsevier, 2022, pp. 58–100
  46. Mauro Maggioni and James M Murphy “Learning by unsupervised nonlinear diffusion” In J. Mach. Learn. Res. 20, 2019, pp. 1–56
  47. “Clustering by fast search and find of density peaks” In Science 344.6191 American Association for the Advancement of Science, 2014, pp. 1492–1496
  48. “A survey of clustering with deep learning: from the perspective of network architecture” In IEEE Access 6 IEEE, 2018, pp. 39501–39514
  49. “Large-scale hyperspectral image clustering using contrastive learning” In arXiv preprint arXiv:2111.07945, 2021
  50. “Superpixel contracted neighborhood contrastive subspace clustering network for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–13
  51. “Unsupervised self-correlated learning smoothy enhanced locality preserving graph convolution embedding clustering for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–16
  52. “Self-supervised deep subspace clustering for hyperspectral images with adaptive self-expressive coefficient matrix initialization” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 14 IEEE, 2021, pp. 3215–3227
  53. “Tree species classification from hyperspectral data using graph-regularized neural networks” In arXiv preprint arXiv:2208.08675, 2022
  54. Anh Nguyen, Jason Yosinski and Jeff Clune “Deep neural networks are easily fooled: High confidence predictions for unrecognizable images” In Proc. CVPR, 2015, pp. 427–436
  55. “Intriguing properties of neural networks” In arXiv preprint arXiv:1312.6199, 2013
  56. Benjamin D Haeffele, Chong You and René Vidal “A critique of self-expressive deep subspace clustering” In arXiv preprint arXiv:2010.03697, 2020
  57. Andrew Ng, Michael Jordan and Yair Weiss “On spectral clustering: analysis and an algorithm” In NeurIPS 14, 2001
  58. “Active diffusion and VCA-assisted image segmentation of hyperspectral images” In Proc. IGARSS, 2022, pp. 1364–1367 IEEE
  59. “Unsupervised spatial-spectral hyperspectral image reconstruction and clustering with diffusion geometry” In Proc. WHISPERS, 2022, pp. 1–5 IEEE
  60. “Fuzzy embedded clustering based on bipartite graph for large-scale hyperspectral image” In IEEE Geosci. Remote Sens. Lett. 19 IEEE, 2021, pp. 1–5
  61. “Entropy rate superpixel segmentation” In Proc. CVPR, 2011, pp. 2097–2104 IEEE
  62. “Superpixel segmentation: a benchmark” In Signal Process. Image Commun. 56 Elsevier, 2017, pp. 28–39
  63. Pedro F. Felzenszwalb and Daniel P. Huttenlocher “Efficient graph-based image segmentation” In Int. J. Comput. Vis. 59, 2004, pp. 167–181
  64. Dai Tang, Huazhu Fu and Xiaochun Cao “Topology preserved regular superpixel” In Proc. ICME, 2012, pp. 765–768 IEEE
  65. “Intrinsic manifold SLIC: a simple and efficient method for computing content-sensitive superpixels” In IEEE Trans. Pattern Anal. Mach. Intell. 40.3 IEEE, 2017, pp. 653–666
  66. “SLIC superpixels compared to state-of-the-art superpixel methods” In IEEE Trans. Pattern Anal. Mach. Intell. 34.11, 2012, pp. 2274–2282
  67. “Watersheds in digital spaces: an efficient algorithm based on immersion simulations” In IEEE Trans. Pattern Anal. Mach. Intell. 13.6, 1991, pp. 583–598
  68. “Quick shift and kernel methods for mode seeking” In Proc. ECCV Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 705–718
  69. “Mean shift: a robust approach toward feature space analysis” In IEEE Trans. Pattern Anal. Mach. Intell. 24.5, 2002, pp. 603–619
  70. “Spectral–spatial classification of hyperspectral images with a superpixel-based discriminative sparse model” In IEEE Trans. Geosci. Remote Sens. 53.8 IEEE, 2015, pp. 4186–4201
  71. “Classification of hyperspectral images by exploiting spectral–spatial information of superpixel via multiple kernels” In IEEE Trans. Geosci. Remote Sens. 53.12 IEEE, 2015, pp. 6663–6674
  72. Philip Sellars, Angelica I Aviles-Rivero and Carola-Bibiane Schönlieb “Superpixel contracted graph-based learning for hyperspectral image classification” In IEEE Trans. Geosci. Remote Sens. 58.6 IEEE, 2020, pp. 4180–4193
  73. “SuperBF: superpixel-based bilateral filtering algorithm and its application in feature extraction of hyperspectral images” In IEEE Access 7, 2019, pp. 147796–147807
  74. “Automatic image segmentation With superpixels and image-level labels” In IEEE Access 7, 2019, pp. 10999–11009
  75. G.L. Nemhauser, L.A. Wolsey and M.L. Fisher “An analysis of approximations for maximizing submodular set functions” Mathematical Programming, 1978
  76. “Dynamic graph-based label propagation for density peaks clustering” In Expert Syst. Appl. 115 Elsevier, 2019, pp. 314–328
  77. Alina Beygelzimer, Sham Kakade and John Langford “Cover trees for nearest neighbor” In Proc. ICML, 2006, pp. 97–104
  78. “Peak-graph-based fast density peak clustering for image segmentation” In IEEE Signal Process. Lett. 28 IEEE, 2021, pp. 897–901
  79. Jacob Cohen “A coefficient of agreement for nominal scales” In Educ. Psychol. Meas. 20.1 Sage Publications Sage CA: Thousand Oaks, CA, 1960, pp. 37–46
  80. Sam L Polk “Diffusion-Based Clustering of High-Dimensional Datasets”, 2022
  81. “Mapping the distribution of mangrove species in the Core Zone of Mai Po Marshes Nature Reserve, Hong Kong, using hyperspectral data and high-resolution data” In Int. J. Appl. Earth Obs. Geoinf. 33 Elsevier, 2014, pp. 226–231
  82. “Textural–spectral feature-based species classification of mangroves in Mai Po nature reserve from worldview-3 imagery” In Remote Sens. 8.1, 2016
  83. “Hyperspectral image classification via superpixel spectral metrics representation” In IEEE Signal Process. Lett. 25.10 IEEE, 2018, pp. 1520–1524
  84. “Unsupervised segmentation of hyperspectral remote sensing images with superpixels” In Remote Sens. Appl. Soc. Environ. 28 Elsevier, 2022, pp. 100823
  85. Marina Meilă “Comparing clusterings—an information based distance” In J. Multivar. Anal. 98.5 Elsevier, 2007, pp. 873–895
  86. Mauro Maggioni and James M Murphy “Learning by active nonlinear diffusion” In Found. Data Sci. 1.3 American Institute of Mathematical Sciences, 2019, pp. 271–291
Citations (12)

Summary

We haven't generated a summary for this paper yet.