Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Embedded Hyperspectral Band Selection with Adaptive Optimization for Image Semantic Segmentation (2401.11420v2)

Published 21 Jan 2024 in cs.CV

Abstract: The selection of hyperspectral bands plays a pivotal role in remote sensing and image analysis, with the aim of identifying the most informative spectral bands while minimizing computational overhead. This paper introduces a pioneering approach for hyperspectral band selection that offers an embedded solution, making it well-suited for resource-constrained or real-time applications. Our proposed method, embedded hyperspectral band selection (EHBS), excels in selecting the best bands without needing prior processing, seamlessly integrating with the downstream task model. This is achieved through stochastic band gates along with an approximation of the $l0$ norm on the number of selected bands as the regularization term and the integration of a dynamic optimizer, DoG, which removes the need for the required tuning of the learning rate. We conduct experiments on two distinct semantic-segmentation hyperspectral benchmark datasets, demonstrating their superiority in terms of accuracy and ease of use compared to many common and state-of-the-art methods. Furthermore, our contributions extend beyond hyperspectral band selection. Our approach's adaptability to other tasks, especially those involving grouped features, opens promising avenues for broader applications within the realm of deep learning, such as feature selection for feature groups.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. https://github.com/eecn/Hyperspectral-Classification.
  2. Pavia university scene. ehu.eus/ccwintco/index.php/Hyperspectral_Remote_Sensing_Scenes##Pavia_University_scene.
  3. Salinas scence. http://www.ehu.eus/ccwintco/index.php/Hyperspectral_Remote_Sensing_Scenes##Salinas.
  4. Genevera I. Allen. Automatic feature selection via weighted kernels and regularization. Journal of Computational and Graphical Statistics, 22(2):284–299, 2013.
  5. Hsi-drive: A dataset for the research of hyperspectral image processing applied to autonomous driving systems. In 2021 IEEE Intelligent Vehicles Symposium (IV), pages 866–873, 2021.
  6. R. Battiti. Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks, 5(4):537–550, 1994.
  7. Towards virtual h&e staining of hyperspectral lung histology images using conditional generative adversarial networks. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), pages 64–71, 2017.
  8. 3-d deep learning approach for remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing, 56(8):4420–4434, 2018.
  9. Bs-nets: An end-to-end framework for band selection of hyperspectral image. IEEE Transactions on Geoscience and Remote Sensing, 58(3):1969–1984, 2019.
  10. Dropout feature ranking for deep learning models. CoRR, abs/1712.08645, 2017.
  11. A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification. IEEE transactions on geoscience and remote sensing, 37(6):2631–2641, 1999.
  12. Constrained band selection for hyperspectral imagery. IEEE transactions on geoscience and remote sensing, 44(6):1575–1585, 2006.
  13. An image is worth 16x16 words: Transformers for image recognition at scale. CoRR, abs/2010.11929, 2020.
  14. Similarity-based unsupervised band selection for hyperspectral image analysis. IEEE geoscience and remote sensing letters, 5(4):564–568, 2008.
  15. Sparse-input neural networks for high-dimensional nonparametric regression and classification. arXiv preprint arXiv:1711.07592, 2017.
  16. Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning. Artificial Intelligence in Agriculture, 4:31–38, 2020.
  17. Band selection for hyperspectral image classification using mutual information. IEEE Geoscience and Remote Sensing Letters, 3(4):522–526, 2006.
  18. Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. Journal of Biomedical Optics, 22, 06 2017.
  19. Recursive spectral similarity measure-based band selection for anomaly detection in hyperspectral imagery. Journal of Optics, 13(1):015401, 2010.
  20. Deep convolutional neural networks for hyperspectral image classification. Journal of Sensors, 2015:1–12, 2015.
  21. Visual method for spectral band selection. IEEE Geoscience and Remote Sensing Letters, 1(2):101–106, 2004.
  22. Dog is sgd’s best friend: A parameter-free dynamic step size schedule. In International Conference on Machine Learning, 2023.
  23. Wrappers for feature subset selection. Artificial Intelligence, 97(1):273–324, 1997. Relevance.
  24. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25, 2012.
  25. Deep learning-based semantic segmentation of remote sensing images: a review. Frontiers in Ecology and Evolution, 2023.
  26. Marena Manley. Near-infrared spectroscopy and hyperspectral imaging: non-destructive analysis of biological materials. Chemical Society Reviews, 43(24):8200–8214, 2014.
  27. Clustering-based hyperspectral band selection using information measures. IEEE Transactions on Geoscience and Remote Sensing, 45(12):4158–4171, 2007.
  28. Classification of hyperspectral remote sensing images with support vector machines. IEEE Transactions on geoscience and remote sensing, 42(8):1778–1790, 2004.
  29. Hyperspectral unmixing using a neural network autoencoder. IEEE Access, 6:25646–25656, 2018.
  30. Feature selection using deep neural networks. pages 1–6, 07 2015.
  31. Hyperspectral cnn for image classification & band selection, with application to face recognition. Technical report KUL/ESAT/PSI/1604, KU Leuven, ESAT, Leuven, Belgium, 2016.
  32. Hyperspectral band selection: A review. IEEE Geoscience and Remote Sensing Magazine, 7(2):118–139, 2019.
  33. Band selection using improved sparse subspace clustering for hyperspectral imagery classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(6):2784–2797, 2015.
  34. Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), 58(1):267–288, 1996.
  35. Optimal clustering framework for hyperspectral band selection. IEEE Transactions on Geoscience and Remote Sensing, 56(10):5910–5922, 2018.
  36. Feature selection using stochastic gates. In Hal Daumé III and Aarti Singh, editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 10648–10659. PMLR, 13–18 Jul 2020.
  37. Hyperspectral classification based on lightweight 3-d-cnn with transfer learning. IEEE Transactions on Geoscience and Remote Sensing, 57(8):5813–5828, 2019.
Citations (1)

Summary

We haven't generated a summary for this paper yet.