PRIME: Blind Multispectral Unmixing Using Virtual Quantum Prism and Convex Geometry (2407.15358v2)
Abstract: Multispectral unmixing (MU) is critical due to the inevitable mixed pixel phenomenon caused by the limited spatial resolution of typical multispectral images in remote sensing. However, MU mathematically corresponds to the underdetermined blind source separation problem, thus highly challenging, preventing researchers from tackling it. Previous MU works all ignore the underdetermined issue, and merely consider scenarios with more bands than sources. This work attempts to resolve the underdetermined issue by further conducting the light-splitting task using a network-inspired virtual prism, and as this task is challenging, we achieve so by incorporating the very advanced quantum feature extraction techniques. We emphasize that the prism is virtual (allowing us to fix the spectral response as a simple deterministic matrix), so the virtual hyperspectral image (HSI) it generates has no need to correspond to some real hyperspectral sensor; in other words, it is good enough as long as the virtual HSI satisfies some fundamental properties of light splitting (e.g., non-negativity and continuity). With the above virtual quantum prism, we know that the virtual HSI is expected to possess some desired simplex structure. This allows us to adopt the convex geometry to unmix the spectra, followed by downsampling the pure spectra back to the multispectral domain, thereby achieving MU. Experimental evidence shows great potential of our MU algorithm, termed as prism-inspired multispectral endmember extraction (PRIME).
- C.-H. Lin and J. M. Bioucas-Dias, “Nonnegative blind source separation for ill-conditioned mixtures via John ellipsoid,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 5, pp. 2209–2223, 2021.
- J. M. Bioucas-Dias, A. Plaza, N. Dobigeon, M. Parente, Q. Du, P. Gader, and J. Chanussot, “Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 5, no. 2, pp. 354–379, 2012.
- M. D. Craig, “Minimum-volume transforms for remotely sensed data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 32, no. 3, pp. 542–552, 1994.
- C.-H. Lin, C.-Y. Chi, Y.-H. Wang, and T.-H. Chan, “A fast hyperplane-based minimum-volume enclosing simplex algorithm for blind hyperspectral unmixing,” IEEE Transactions on Signal Processing, vol. 64, no. 8, pp. 1946–1961, 2016.
- A. Packer, “NP-hardness of largest contained and smallest containing simplices for V- and H-polytopes,” Discrete and Computational Geometry, vol. 28, no. 3, pp. 349–377, 2002.
- S. A. Vavasis, “On the complexity of nonnegative matrix factorization,” SIAM Journal on Optimization, vol. 20, no. 3, pp. 1364–1377, 2010.
- J. Cai, H. Chatoux, C. Boust, and A. Mansouri, “Extending the unmixing methods to multispectral images,” arXiv preprint arXiv:2111.11893, 2021.
- J. Nascimento and J. Dias, “Vertex component analysis: A fast algorithm to unmix hyperspectral data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 43, no. 4, pp. 898–910, 2005.
- W. Xiong, C.-I. Chang, C.-C. Wu, K. Kalpakis, and H. M. Chen, “Fast algorithms to implement N-FINDR for hyperspectral endmember extraction,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 4, no. 3, pp. 545–564, 2011.
- R. Rajabi and H. Ghassemian, “Spectral unmixing of hyperspectral imagery using multilayer NMF,” IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 1, pp. 38–42, 2014.
- C.-H. Lin, R. Wu, W.-K. Ma, C.-Y. Chi, and Y. Wang, “Maximum volume inscribed ellipsoid: A new simplex-structured matrix factorization framework via facet enumeration and convex optimization,” SIAM Journal on Imaging Sciences, vol. 11, no. 2, pp. 1651–1679, 2018.
- A. Beck and M. Teboulle, “A fast iterative shrinkage-thresholding algorithm for linear inverse problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183–202, 2009.
- Y. Xie, K. Xie, and S. Xie, “Underdetermined blind source separation of speech mixtures unifying dictionary learning and sparse representation,” International Journal of Machine Learning and Cybernetics, vol. 12, pp. 3573–3583, 2021.
- B. Ma and T. Zhang, “Underdetermined blind source separation based on source number estimation and improved sparse component analysis,” Circuits, Systems, and Signal Processing, vol. 40, pp. 3417–3436, 2021.
- H. Sawada, S. Araki, and S. Makino, “Underdetermined convolutive blind source separation via frequency bin-wise clustering and permutation alignment,” IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 3, pp. 516–527, 2011.
- H.-G. Ma, Q.-B. Jiang, Z.-Q. Liu, G. Liu, and Z.-Y. Ma, “A novel blind source separation method for single-channel signal,” Signal Processing, vol. 90, no. 12, pp. 3232–3241, 2010.
- J. M. Nascimento and J. M. Dias, “Does independent component analysis play a role in unmixing hyperspectral data?” IEEE Transactions on Geoscience and Remote Sensing, vol. 43, no. 1, pp. 175–187, 2005.
- C.-H. Lin, T.-H. Lin, T.-H. Lin, and T.-H. Lin, “Fast reconstruction of hyperspectral image from its RGB counterpart using ADMM-Adam theory,” in Proc. IEEE Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, Rome, Italy, Sep. 13-16, 2022, pp. 1–5.
- C.-H. Lin, Y.-C. Lin, and P.-W. Tang, “ADMM-ADAM: A new inverse imaging framework blending the advantages of convex optimization and deep learning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–16, 2022.
- Y. Li, R.-G. Zhou, R. Xu, J. Luo, and S.-X. Jiang, “A quantum mechanics-based framework for EEG signal feature extraction and classification,” IEEE Transactions on Emerging Topics in Computing, vol. 10, no. 1, pp. 211–222, 2020.
- P.-W. Tang, C.-H. Lin, and Y. Liu, “Transformer-driven inverse problem transform for fast blind hyperspectral image dehazing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–14, 2024.
- C.-H. Lin and Y.-Y. Chen, “HyperQUEEN: Hyperspectral quantum deep network for image restoration,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–20, 2023.
- C.-H. Lin, F. Ma, C.-Y. Chi, and C.-H. Hsieh, “A convex optimization-based coupled nonnegative matrix factorization algorithm for hyperspectral and multispectral data fusion,” IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 3, pp. 1652–1667, 2017.
- J. Li and J. M. Bioucas-Dias, “Minimum volume simplex analysis: A fast algorithm to unmix hyperspectral data,” in Proc. IEEE International Geoscience and Remote Sensing Symposium, vol. 3, Boston, MA, USA, Jul. 7-11, 2008, pp. III – 250–III – 253.
- C.-H. Lin and S.-S. Young, “Signal subspace identification for incomplete hyperspectral image with applications to various inverse problems,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–16, 2024.
- C.-H. Lin, C.-Y. Chi, L. Chen, D. J. Miller, and Y. Wang, “Detection of sources in non-negative blind source separation by minimum description length criterion,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 9, pp. 4022–4037, 2018.
- D. D. Lee and H. S. Seung, “Learning the parts of objects by non-negative matrix factorization,” Nature, vol. 401, no. 6755, pp. 788–791, 1999.
- C.-H. Lin, W.-K. Ma, W.-C. Li, C.-Y. Chi, and A. Ambikapathi, “Identifiability of the simplex volume minimization criterion for blind hyperspectral unmixing: The no-pure-pixel case,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 10, pp. 5530–5546, 2015.
- C.-H. Lin, A. Ambikapathi, W.-C. Li, and C.-Y. Chi, “On the endmember identifiability of Craig’s criterion for hyperspectral unmixing: A statistical analysis for three-source case,” in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, Canada, May. 26-31, 2013, pp. 2139–2143.
- J. R. Patel, M. V. Joshi, and J. S. Bhatt, “Abundance estimation using discontinuity preserving and sparsity-induced priors,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 7, pp. 2148–2158, 2019.
- M.-D. Iordache, J. M. Bioucas-Dias, and A. Plaza, “Total variation spatial regularization for sparse hyperspectral unmixing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 11, pp. 4484–4502, 2012.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in Proc. International Conference for Learning Representations, San Diego, CA, USA, May. 7-9, 2015.
- C.-H. Lin, M.-C. Chu, and P.-W. Tang, “CODE-MM: Convex deep mangrove mapping algorithm based on optical satellite images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–19, 2023.
- C.-H. Lin, C.-Y. Hsieh, and J.-T. Lin, “CODE-IF: A convex/deep image fusion algorithm for efficient hyperspectral super-resolution,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–18, 2024.
- T.-H. Lin and C.-H. Lin, “Hyperspectral change detection using semi-supervised graph neural network and convex deep learning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–18, 2023.
- D. Ulyanov, A. Vedaldi, and V. Lempitsky, “Deep image prior,” in Proc. IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, Jun. 18-23, 2018, pp. 9446–9454.
- M. Weigold, J. Barzen, F. Leymann, and M. Salm, “Encoding patterns for quantum algorithms,” IET Quantum Communication, vol. 2, no. 4, pp. 141–152, 2021.
- L. Wald, T. Ranchin, and M. Mangolini, “Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images,” Photogrammetric Engineering and Remote Sensing, vol. 63, no. 6, pp. 691–699, 1997.
- NASA Jet Propulsion Laboratory, “Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) Data Portal,” https://aviris.jpl.nasa.gov/dataportal/.
- L. Loncan, L. B. de Almeida, J. M. Bioucas-Dias, X. Briottet, J. Chanussot, N. Dobigeon, S. Fabre, W. Liao, G. A. Licciardi, M. Simões, J.-Y. Tourneret, M. A. Veganzones, G. Vivone, Q. Wei, and N. Yokoya, “Hyperspectral pansharpening: A review,” IEEE Geoscience and Remote Sensing Magazine, vol. 3, no. 3, pp. 27–46, 2015.
- Q. Wei, J. Bioucas-Dias, N. Dobigeon, and J.-Y. Tourneret, “Hyperspectral and multispectral image fusion based on a sparse representation,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 7, pp. 3658–3668, 2015.
- R. Hennequin, B. David, and R. Badeau, “Beta-divergence as a subclass of Bregman divergence,” IEEE Signal Processing Letters, vol. 18, no. 2, pp. 83–86, 2011.