Superpixel-based and Spatially-regularized Diffusion Learning for Unsupervised Hyperspectral Image Clustering (2312.15447v1)
Abstract: Hyperspectral images (HSIs) provide exceptional spatial and spectral resolution of a scene, crucial for various remote sensing applications. However, the high dimensionality, presence of noise and outliers, and the need for precise labels of HSIs present significant challenges to HSIs analysis, motivating the development of performant HSI clustering algorithms. This paper introduces a novel unsupervised HSI clustering algorithm, Superpixel-based and Spatially-regularized Diffusion Learning (S2DL), which addresses these challenges by incorporating rich spatial information encoded in HSIs into diffusion geometry-based clustering. S2DL employs the Entropy Rate Superpixel (ERS) segmentation technique to partition an image into superpixels, then constructs a spatially-regularized diffusion graph using the most representative high-density pixels. This approach reduces computational burden while preserving accuracy. Cluster modes, serving as exemplars for underlying cluster structure, are identified as the highest-density pixels farthest in diffusion distance from other highest-density pixels. These modes guide the labeling of the remaining representative pixels from ERS superpixels. Finally, majority voting is applied to the labels assigned within each superpixel to propagate labels to the rest of the image. This spatial-spectral approach simultaneously simplifies graph construction, reduces computational cost, and improves clustering performance. S2DL's performance is illustrated with extensive experiments on three publicly available, real-world HSIs: Indian Pines, Salinas, and Salinas A. Additionally, we apply S2DL to landscape-scale, unsupervised mangrove species mapping in the Mai Po Nature Reserve, Hong Kong, using a Gaofen-5 HSI. The success of S2DL in these diverse numerical experiments indicates its efficacy on a wide range of important unsupervised remote sensing analysis tasks.
- “Hyperspectral remote sensing data analysis and future challenges” In IEEE Geosci. Remote Sens. Mag. 1.2 IEEE, 2013, pp. 6–36
- “Recent advances in techniques for hyperspectral image processing” In Remote Sens. Environ. 113 Elsevier, 2009, pp. S110–S122
- “Deep learning-based classification of hyperspectral data” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7.6 IEEE, 2014, pp. 2094–2107
- “Hyperspectral image clustering: current achievements and future lines” In IEEE Geosci. Remote Sens. Mag. 9.4 IEEE, 2021, pp. 35–67
- “Deep learning for hyperspectral image classification: an overview” In IEEE Trans. Geosci. Remote Sens. 57.9 IEEE, 2019, pp. 6690–6709
- “Unsupervised detection of ash dieback disease (Hymenoscyphus fraxineus) using diffusion-based hyperspectral image clustering” In Proc. IGARSS, 2022, pp. 2287–2290 IEEE
- “Classification of hyperspectral images using SVM with shape-adaptive reconstruction and smoothed total variation” In Proc. IGARSS, 2022, pp. 1368–1371 IEEE
- “A review of change detection in multitemporal hyperspectral images: current techniques, applications, and challenges” In IEEE Geosci. Remote Sens. Mag. 7.2 IEEE, 2019, pp. 140–158
- “Spectral variability in hyperspectral data unmixing: a comprehensive review” In IEEE Geosci. Remote Sens. Mag. 9.4 IEEE, 2021, pp. 223–270
- “Hyperspectral unmixing overview: geometrical, statistical, and sparse regression-based approaches” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 5.2 IEEE, 2012, pp. 354–379
- Rob Heylen, Mario Parente and Paul Gader “A review of nonlinear hyperspectral unmixing methods” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7.6 IEEE, 2014, pp. 1844–1868
- Kangning Cui and Robert J Plemmons “Unsupervised classification of AVIRIS-NG hyperspectral images” In Proc. WHISPERS, 2021, pp. 1–5 IEEE
- Naoto Yokoya, Claas Grohnfeldt and Jocelyn Chanussot “Hyperspectral and multispectral data fusion: a comparative review of the recent literature” In IEEE Geosci. Remote Sens. Mag. 5.2 IEEE, 2017, pp. 29–56
- “Hyperspectral pansharpening: a review” In IEEE Geosci. Remote Sens. Mag. 3.3 IEEE, 2015, pp. 27–46
- “Deep learning for pixel-level image fusion: Recent advances and future prospects” In Inf. Fusion 42 Elsevier, 2018, pp. 158–173
- “Detecting change due to alluvial gold mining in Peruvian rainforest using recursive convolutional neural networks and contrastive learning” In Fall Meeting, 2022 AGU
- “Superpixel-level global and local similarity graph-based clustering for large hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2021, pp. 1–16
- “Self-supervised locality preserving low-pass graph convolutional embedding for large-scale hyperspectral image clustering” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–16
- “Hyperspectral image unsupervised classification by robust manifold matrix factorization” In Inf. Sci. 485 Elsevier, 2019, pp. 154–169
- “Graph convolutional subspace clustering: A robust subspace clustering framework for hyperspectral image” In IEEE Trans. Geosci. Remote Sens. 59.5 IEEE, 2020, pp. 4191–4202
- “Graph-based structural deep spectral-spatial clustering for hyperspectral image” In IEEE Trans. Instrum. Meas. IEEE, 2023
- Shaoguang Huang, Hongyan Zhang and Aleksandra Pižurica “Hybrid-hypergraph regularized multiview subspace clustering for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2021, pp. 1–16
- “A new sparse subspace clustering algorithm for hyperspectral remote sensing imagery” In IEEE Geosci. Remote Sens. Lett. 14.1 IEEE, 2016, pp. 43–47
- Rong Wang, Feiping Nie and Weizhong Yu “Fast spectral clustering with anchor graph for large hyperspectral images” In IEEE Geosci. Remote Sens. Lett. 14.11 IEEE, 2017, pp. 2003–2007
- Yang Zhao, Yuan Yuan and Qi Wang “Fast spectral clustering for unsupervised hyperspectral image classification” In Remote Sens. 11.4 MDPI, 2019, pp. 399
- “Spatial-spectral clustering with anchor graph for hyperspectral image” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–13
- “Spectral-spatial superpixel anchor graph-based clustering for hyperspectral imagery” In IEEE Geosci. Remote Sens. Lett. IEEE, 2023
- Charles M Bachmann, Thomas L Ainsworth and Robert A Fusina “Exploiting manifold geometry in hyperspectral imagery” In IEEE Trans. Geosci. Remote Sens. 43.3 IEEE, 2005, pp. 441–454
- James M Murphy and Mauro Maggioni “Unsupervised clustering and active learning of hyperspectral images with nonlinear diffusion” In IEEE Trans. Geosci. Remote Sens. 57.3 IEEE, 2019, pp. 1829–1845
- “Diffusion maps” In Appl. Comput. Harm. Anal. 21.1 Elsevier, 2006, pp. 5–30
- “Noise reduction in hyperspectral imagery: overview and application” In Remote Sens. 10.3 MDPI, 2018, pp. 482
- Wanyuan Cai, Junzheng Jiang and Jiang Qian “Large-scale hyperspectral image restoration via a superpixel distributed algorithm based on graph signal processing” In IEEE Trans. Geosci. Remote Sens. 61 IEEE, 2023, pp. 1–17
- “Advances in spectral-spatial classification of hyperspectral images” In Proc. IEEE 101.3 IEEE, 2012, pp. 652–675
- “SuperPCA: a superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery” In IEEE Trans. Geosci. Remote Sens. 56.8 IEEE, 2018, pp. 4581–4593
- Jiayi Li, Hongyan Zhang and Liangpei Zhang “Efficient superpixel-level multitask joint sparse representation for hyperspectral image classification” In IEEE Trans. Geosci. Remote Sens. 53.10 IEEE, 2015, pp. 5338–5351
- Sam L Polk and James M Murphy “Multiscale clustering of hyperspectral images through spectral-spatial diffusion geometry” In Proc. IGARSS, 2021, pp. 4688–4691 IEEE
- James M Murphy and Mauro Maggioni “Spectral–spatial diffusion geometry for hyperspectral image clustering” In IEEE Geosci. Remote Sens. Lett. 17.7 IEEE, 2019, pp. 1243–1247
- James M Murphy “Spatially regularized active diffusion learning for high-dimensional images” In Pattern Recognit. Lett. 135 Elsevier, 2020, pp. 213–220
- “GF-5 hyperspectral data for species mapping of mangrove in Mai Po, Hong Kong” In Remote Sens. 12.4 MDPI, 2020, pp. 656
- T. Hastie, R. Tibshirani and J.H. Friedman “The elements of statistical learning: data mining, inference, and prediction” Springer Series in Statistics, 2009
- “Unsupervised diffusion and volume maximization-based clustering of hyperspectral images” In Remote Sens. 15.4 MDPI, 2023, pp. 1053
- J MacQueen “Classification and analysis of multivariate observations” In Proc. 5th Berkeley Symp. Math. Statist. Probability 1.14, 1967, pp. 281–297 Oakland, CA, USA
- Geoffrey J McLachlan, Sharon X Lee and Suren I Rathnayake “Finite mixture models” In Annu. Rev. Stat. Appl. 6 Annual Reviews, 2019, pp. 355–378
- “A density-based algorithm for discovering clusters in large spatial databases with noise” In kdd 96.34, 1996, pp. 226–231
- James M Murphy and Sam L Polk “A multiscale environment for learning by diffusion” In Appl. Comput. Harm. Anal. 57 Elsevier, 2022, pp. 58–100
- Mauro Maggioni and James M Murphy “Learning by unsupervised nonlinear diffusion” In J. Mach. Learn. Res. 20, 2019, pp. 1–56
- “Clustering by fast search and find of density peaks” In Science 344.6191 American Association for the Advancement of Science, 2014, pp. 1492–1496
- “A survey of clustering with deep learning: from the perspective of network architecture” In IEEE Access 6 IEEE, 2018, pp. 39501–39514
- “Large-scale hyperspectral image clustering using contrastive learning” In arXiv preprint arXiv:2111.07945, 2021
- “Superpixel contracted neighborhood contrastive subspace clustering network for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–13
- “Unsupervised self-correlated learning smoothy enhanced locality preserving graph convolution embedding clustering for hyperspectral images” In IEEE Trans. Geosci. Remote Sens. 60 IEEE, 2022, pp. 1–16
- “Self-supervised deep subspace clustering for hyperspectral images with adaptive self-expressive coefficient matrix initialization” In IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 14 IEEE, 2021, pp. 3215–3227
- “Tree species classification from hyperspectral data using graph-regularized neural networks” In arXiv preprint arXiv:2208.08675, 2022
- Anh Nguyen, Jason Yosinski and Jeff Clune “Deep neural networks are easily fooled: High confidence predictions for unrecognizable images” In Proc. CVPR, 2015, pp. 427–436
- “Intriguing properties of neural networks” In arXiv preprint arXiv:1312.6199, 2013
- Benjamin D Haeffele, Chong You and René Vidal “A critique of self-expressive deep subspace clustering” In arXiv preprint arXiv:2010.03697, 2020
- Andrew Ng, Michael Jordan and Yair Weiss “On spectral clustering: analysis and an algorithm” In NeurIPS 14, 2001
- “Active diffusion and VCA-assisted image segmentation of hyperspectral images” In Proc. IGARSS, 2022, pp. 1364–1367 IEEE
- “Unsupervised spatial-spectral hyperspectral image reconstruction and clustering with diffusion geometry” In Proc. WHISPERS, 2022, pp. 1–5 IEEE
- “Fuzzy embedded clustering based on bipartite graph for large-scale hyperspectral image” In IEEE Geosci. Remote Sens. Lett. 19 IEEE, 2021, pp. 1–5
- “Entropy rate superpixel segmentation” In Proc. CVPR, 2011, pp. 2097–2104 IEEE
- “Superpixel segmentation: a benchmark” In Signal Process. Image Commun. 56 Elsevier, 2017, pp. 28–39
- Pedro F. Felzenszwalb and Daniel P. Huttenlocher “Efficient graph-based image segmentation” In Int. J. Comput. Vis. 59, 2004, pp. 167–181
- Dai Tang, Huazhu Fu and Xiaochun Cao “Topology preserved regular superpixel” In Proc. ICME, 2012, pp. 765–768 IEEE
- “Intrinsic manifold SLIC: a simple and efficient method for computing content-sensitive superpixels” In IEEE Trans. Pattern Anal. Mach. Intell. 40.3 IEEE, 2017, pp. 653–666
- “SLIC superpixels compared to state-of-the-art superpixel methods” In IEEE Trans. Pattern Anal. Mach. Intell. 34.11, 2012, pp. 2274–2282
- “Watersheds in digital spaces: an efficient algorithm based on immersion simulations” In IEEE Trans. Pattern Anal. Mach. Intell. 13.6, 1991, pp. 583–598
- “Quick shift and kernel methods for mode seeking” In Proc. ECCV Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 705–718
- “Mean shift: a robust approach toward feature space analysis” In IEEE Trans. Pattern Anal. Mach. Intell. 24.5, 2002, pp. 603–619
- “Spectral–spatial classification of hyperspectral images with a superpixel-based discriminative sparse model” In IEEE Trans. Geosci. Remote Sens. 53.8 IEEE, 2015, pp. 4186–4201
- “Classification of hyperspectral images by exploiting spectral–spatial information of superpixel via multiple kernels” In IEEE Trans. Geosci. Remote Sens. 53.12 IEEE, 2015, pp. 6663–6674
- Philip Sellars, Angelica I Aviles-Rivero and Carola-Bibiane Schönlieb “Superpixel contracted graph-based learning for hyperspectral image classification” In IEEE Trans. Geosci. Remote Sens. 58.6 IEEE, 2020, pp. 4180–4193
- “SuperBF: superpixel-based bilateral filtering algorithm and its application in feature extraction of hyperspectral images” In IEEE Access 7, 2019, pp. 147796–147807
- “Automatic image segmentation With superpixels and image-level labels” In IEEE Access 7, 2019, pp. 10999–11009
- G.L. Nemhauser, L.A. Wolsey and M.L. Fisher “An analysis of approximations for maximizing submodular set functions” Mathematical Programming, 1978
- “Dynamic graph-based label propagation for density peaks clustering” In Expert Syst. Appl. 115 Elsevier, 2019, pp. 314–328
- Alina Beygelzimer, Sham Kakade and John Langford “Cover trees for nearest neighbor” In Proc. ICML, 2006, pp. 97–104
- “Peak-graph-based fast density peak clustering for image segmentation” In IEEE Signal Process. Lett. 28 IEEE, 2021, pp. 897–901
- Jacob Cohen “A coefficient of agreement for nominal scales” In Educ. Psychol. Meas. 20.1 Sage Publications Sage CA: Thousand Oaks, CA, 1960, pp. 37–46
- Sam L Polk “Diffusion-Based Clustering of High-Dimensional Datasets”, 2022
- “Mapping the distribution of mangrove species in the Core Zone of Mai Po Marshes Nature Reserve, Hong Kong, using hyperspectral data and high-resolution data” In Int. J. Appl. Earth Obs. Geoinf. 33 Elsevier, 2014, pp. 226–231
- “Textural–spectral feature-based species classification of mangroves in Mai Po nature reserve from worldview-3 imagery” In Remote Sens. 8.1, 2016
- “Hyperspectral image classification via superpixel spectral metrics representation” In IEEE Signal Process. Lett. 25.10 IEEE, 2018, pp. 1520–1524
- “Unsupervised segmentation of hyperspectral remote sensing images with superpixels” In Remote Sens. Appl. Soc. Environ. 28 Elsevier, 2022, pp. 100823
- Marina Meilă “Comparing clusterings—an information based distance” In J. Multivar. Anal. 98.5 Elsevier, 2007, pp. 873–895
- Mauro Maggioni and James M Murphy “Learning by active nonlinear diffusion” In Found. Data Sci. 1.3 American Institute of Mathematical Sciences, 2019, pp. 271–291