Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Hyperspectral unmixing for Raman spectroscopy via physics-constrained autoencoders (2403.04526v1)

Published 7 Mar 2024 in cs.LG, cs.AI, and cs.CV

Abstract: Raman spectroscopy is widely used across scientific domains to characterize the chemical composition of samples in a non-destructive, label-free manner. Many applications entail the unmixing of signals from mixtures of molecular species to identify the individual components present and their proportions, yet conventional methods for chemometrics often struggle with complex mixture scenarios encountered in practice. Here, we develop hyperspectral unmixing algorithms based on autoencoder neural networks, and we systematically validate them using both synthetic and experimental benchmark datasets created in-house. Our results demonstrate that unmixing autoencoders provide improved accuracy, robustness and efficiency compared to standard unmixing methods. We also showcase the applicability of autoencoders to complex biological settings by showing improved biochemical characterization of volumetric Raman imaging data from a monocytic cell.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (96)
  1. Raman spectroscopy of biological tissues. Applied Spectroscopy Reviews, 42(5):493–541, 2007.
  2. Raman spectroscopy of biological tissues. Applied spectroscopy reviews, 50(1):46–111, 2015.
  3. Using raman spectroscopy to characterize biological materials. Nature protocols, 11(4):664–687, 2016.
  4. Richard L McCreery. Raman spectroscopy for chemical analysis. John Wiley & Sons, 2005.
  5. Modern Raman spectroscopy: a practical approach. John Wiley & Sons, 2019.
  6. Johannes Arnoldus Koningstein. Introduction to the Theory of the Raman Effect. Springer Science & Business Media, 2012.
  7. Herman A Szymanski. Raman spectroscopy: theory and practice. Springer Science & Business Media, 2012.
  8. Norman Colthup. Introduction to infrared and Raman spectroscopy. Elsevier, 2012.
  9. Raman techniques: fundamentals and frontiers. Nanoscale research letters, 14:1–34, 2019.
  10. Raman based molecular imaging and analytics: a magic bullet for biomedical applications!? Analytical chemistry, 88(1):133–151, 2016.
  11. Sebastian Schlücker. Surface-enhanced raman spectroscopy: Concepts and chemical applications. Angewandte Chemie International Edition, 53(19):4756–4795, 2014.
  12. Raman spectroscopy for chemical biology research. Journal of the American Chemical Society, 144(43):19651–19667, 2022.
  13. Giuseppe Pezzotti. Raman spectroscopy in cell biology and microbiology. Journal of Raman Spectroscopy, 52(12):2348–2443, 2021.
  14. Raman spectroscopy: an evolving technique for live cell studies. Analyst, 141(12):3590–3600, 2016.
  15. Raman spectroscopy: techniques and applications in the life sciences. Advances in Optics and Photonics, 9(2):315–428, 2017.
  16. Recent progress in surface-enhanced raman spectroscopy for biological and biomedical applications: from cells to clinics. Chemical Society Reviews, 46(13):3945–3961, 2017.
  17. Raman spectroscopy for medical diagnostics—from in-vitro biofluid assays to in-vivo cancer detection. Advanced drug delivery reviews, 89:121–134, 2015.
  18. Raman spectroscopy and regenerative medicine: a review. NPJ Regenerative medicine, 2(1):12, 2017.
  19. Clinical instrumentation and applications of raman spectroscopy. Chemical Society Reviews, 45(7):1958–1979, 2016.
  20. Vibrational spectroscopy fingerprinting in medicine: from molecular to clinical practice. Materials, 12(18):2884, 2019.
  21. Applications of raman spectroscopy in cancer diagnosis. Cancer and Metastasis Reviews, 37(4):691–717, 2018.
  22. Raman spectroscopy for the detection of cancers and precancers. Journal of biomedical optics, 1(1):31–70, 1996.
  23. Advancing raman spectroscopy from research to clinic: Translational potential and challenges. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 260:119957, 2021.
  24. Fundamentals and applications of raman-based techniques for the design and development of active biomedical materials. Advanced Materials, page 2210807, 2023.
  25. Challa SSR Kumar. Raman spectroscopy for nanomaterials characterization. Springer Science & Business Media, 2012.
  26. Research progress of raman spectroscopy in drug analysis. Aaps Pharmscitech, 19(7):2921–2928, 2018.
  27. Raman spectroscopy in pharmaceutical product design. Advanced drug delivery reviews, 89:3–20, 2015.
  28. Applications of raman spectroscopy in pharmaceutical analysis. TrAC Trends in Analytical Chemistry, 21(12):869–877, 2002.
  29. Surface-enhanced raman spectroscopy (sers) for environmental analyses, 2010.
  30. Surface enhanced raman spectroscopy in environmental analysis, monitoring and assessment. Science of The Total Environment, 720:137601, 2020.
  31. Applications of surface-enhanced raman spectroscopy in environmental detection. Analytical Science Advances, 3(3-4):113–145, 2022.
  32. Raman spectroscopy in the analysis of food and pharmaceutical nanomaterials. Journal of food and drug analysis, 22(1):29–48, 2014.
  33. Review of surface enhanced raman spectroscopic (sers) detection of synthetic chemical pesticides. TrAC Trends in Analytical Chemistry, 85:73–82, 2016.
  34. Infrared and Raman Spectroscopy in Forensic Science. Wiley Online Library, 2012.
  35. Bloodstains, paintings, and drugs: Raman spectroscopy applications in forensic science. Forensic Chemistry, 8:111–133, 2018.
  36. Emad L Izake. Forensic and homeland security applications of modern portable raman spectroscopy. Forensic science international, 202(1-3):1–8, 2010.
  37. Analyzing raman spectroscopic data. Physical Sciences Reviews, 4(2):20170043, 2018.
  38. Chemometric analysis in raman spectroscopy from experimental design to machine learning–based modeling. Nature Protocols, 16(12):5426–5459, 2021.
  39. Review of multidimensional data processing approaches for raman and infrared spectroscopy. EPJ Techniques and Instrumentation, 2:1–38, 2015.
  40. Spectral pre and post processing for infrared and raman spectroscopy of biological tissues and cells. Chemical Society Reviews, 45(7):1865–1878, 2016.
  41. Spectral unmixing combined with raman imaging, a preferable analytic technique for molecule visualization. Applied Spectroscopy Reviews, 52(5):417–438, 2017.
  42. Relevant aspects of unmixing/resolution analysis for the interpretation of biological vibrational hyperspectral images. TrAC Trends in Analytical Chemistry, 94:130–140, 2017.
  43. Michael E Winter. N-findr: An algorithm for fast autonomous spectral end-member determination in hyperspectral data. In Imaging Spectrometry V, volume 3753, pages 266–275. SPIE, 1999.
  44. Vertex component analysis: A fast algorithm to unmix hyperspectral data. IEEE transactions on Geoscience and Remote Sensing, 43(4):898–910, 2005.
  45. Solving least squares problems. SIAM, 1995.
  46. Daniel C Heinz et al. Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery. IEEE transactions on geoscience and remote sensing, 39(3):529–545, 2001.
  47. Spectral unmixing and clustering algorithms for assessment of single cells by raman microscopic imaging. Theoretical Chemistry Accounts, 130:1249–1260, 2011.
  48. Spectral unmixing. IEEE signal processing magazine, 19(1):44–57, 2002.
  49. A Thomas Harris. Spectral mapping tools from the earth sciences applied to spectral microscopy data. Cytometry Part A: The Journal of the International Society for Analytical Cytology, 69(8):872–879, 2006.
  50. Blind hyperspectral unmixing using autoencoders: A critical comparison. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:1340–1372, 2022.
  51. Recent advances in hyperspectral unmixing using sparse techniques and deep learning. Hyperspectral Image Analysis: Advances in Machine Learning and Signal Processing, pages 377–405, 2020.
  52. Self-supervised learning in remote sensing: A review. arXiv preprint arXiv:2206.13188, 2022.
  53. Deep learning in hyperspectral unmixing: A review. In IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, pages 2189–2192. IEEE, 2020.
  54. Integration of physics-based and data-driven models for hyperspectral image unmixing. arXiv preprint arXiv:2206.05508, 2022.
  55. Deep learning techniques for unmixing of hyperspectral stimulated raman scattering images. In 2021 IEEE International Conference on Big Data (Big Data), pages 5862–5864. IEEE, 2021.
  56. Multivariate curve resolution with autoencoders for cars microspectroscopy. In Computational Imaging Conference, IS&T Electronic Imaging, 2023.
  57. Autoencoders. In Deep learning, chapter 14, pages 499–523. MIT Press, 2016. \urlhttp://www.deeplearningbook.org.
  58. A versatile deep learning architecture for classification and label-free prediction of hyperspectral images. Nature machine intelligence, 3(4):306–315, 2021.
  59. High-speed chemical imaging by dense-net learning of femtosecond stimulated raman scattering. The journal of physical chemistry letters, 11(20):8573–8578, 2020.
  60. Pixel-level multimodal fusion deep networks for predicting subcellular organelle localization from label-free live-cell imaging. Frontiers in Genetics, 13:1002327, 2022.
  61. Hyperspectral unmixing via deep convolutional neural networks. IEEE Geoscience and Remote Sensing Letters, 15(11):1755–1759, 2018.
  62. Convolutional autoencoder for spectral–spatial hyperspectral unmixing. IEEE Transactions on Geoscience and Remote Sensing, 59(1):535–549, 2020.
  63. Hyperspectral unmixing using deep convolutional autoencoder. International Journal of Remote Sensing, 41(12):4799–4819, 2020.
  64. Hyperspectral unmixing using transformer network. IEEE Transactions on Geoscience and Remote Sensing, 60:1–16, 2022.
  65. Endnet: Sparse autoencoder network for endmember extraction and hyperspectral unmixing. IEEE Transactions on Geoscience and Remote Sensing, 57(1):482–496, 2018.
  66. udas: An untied denoising autoencoder with sparsity for spectral unmixing. IEEE Transactions on Geoscience and Remote Sensing, 57(3):1698–1712, 2018.
  67. Stacked nonnegative sparse autoencoders for robust hyperspectral unmixing. IEEE Geoscience and Remote Sensing Letters, 15(9):1427–1431, 2018.
  68. Nonnegative sparse autoencoder for robust endmember extraction from remotely sensed hyperspectral images. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pages 205–208. IEEE, 2017.
  69. Spectral unmixing through part-based non-negative constraint denoising autoencoder. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pages 209–212. IEEE, 2017.
  70. Unsupervised hyperspectral unmixing via nonlinear autoencoders. IEEE Transactions on Geoscience and Remote Sensing, 60:1–13, 2021.
  71. Hyperspectral unmixing for additive nonlinear models with a 3-d-cnn autoencoder network. IEEE Transactions on Geoscience and Remote Sensing, 60:1–15, 2021.
  72. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  73. The spectral image processing system (sips)—interactive visualization and analysis of imaging spectrometer data. Remote sensing of environment, 44(2-3):145–163, 1993.
  74. Ramanspy: An open-source python package for integrative raman spectroscopy data analysis. arXiv preprint arXiv:2307.13650, 2023.
  75. Comparative study between a new nonlinear model and common linear model for analysing laboratory simulated-forest hyperspectral data. International Journal of Remote Sensing, 30(11):2951–2962, 2009.
  76. Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches. IEEE journal of selected topics in applied earth observations and remote sensing, 5(2):354–379, 2012.
  77. Quantitative volumetric raman imaging of three dimensional cell cultures. Nature communications, 8(1):14843, 2017.
  78. Cholesterol metabolism and efflux in human thp-1 macrophages. Arteriosclerosis, thrombosis, and vascular biology, 18(10):1589–1599, 1998.
  79. Cholesterol, inflammation and innate immunity. Nature Reviews Immunology, 15(2):104–116, 2015.
  80. Cellular cholesterol regulates monocyte deformation. Journal of biomechanics, 52:83–88, 2017.
  81. High-throughput molecular imaging via deep-learning-enabled raman spectroscopy. Analytical chemistry, 93(48):15850–15860, 2021.
  82. Nonlinear unmixing of hyperspectral images: Models and algorithms. IEEE Signal processing magazine, 31(1):82–94, 2013.
  83. A review of nonlinear hyperspectral unmixing methods. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(6):1844–1868, 2014.
  84. Bruce Hapke. Bidirectional reflectance spectroscopy: 1. theory. Journal of Geophysical Research: Solid Earth, 86(B4):3039–3054, 1981.
  85. Nonlinear unmixing of hyperspectral images using a generalized bilinear model. IEEE Transactions on Geoscience and Remote Sensing, 49(11):4153–4162, 2011.
  86. Unmixing hyperspectral images using the generalized bilinear model. In 2011 IEEE International Geoscience and Remote Sensing Symposium, pages 1886–1889. IEEE, 2011.
  87. A multilinear mixing model for nonlinear spectral unmixing. IEEE transactions on geoscience and remote sensing, 54(1):240–251, 2015.
  88. Supervised nonlinear spectral unmixing using a postnonlinear mixing model for hyperspectral imagery. IEEE Transactions on Image Processing, 21(6):3017–3025, 2012.
  89. Layer normalization. arXiv preprint arXiv:1607.06450, 2016.
  90. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, 15(1):1929–1958, 2014.
  91. Baseline correction for infrared spectra using adaptive smoothness parameter penalized least squares method. Spectroscopy Letters, 53(3):222–233, 2020.
  92. A simple algorithm for despiking raman spectra. Chemometrics and Intelligent Laboratory Systems, 179:82–84, 2018.
  93. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry, 36(8):1627–1639, 1964.
  94. Baseline correction with asymmetric least squares smoothing. Leiden University Medical Centre Report, 1(1):5, 2005.
  95. Label-free live-cell imaging of nucleic acids using stimulated raman scattering microscopy. ChemPhysChem, 13(4):1054–1059, 2012.
  96. Tensorflow: a system for large-scale machine learning. In Osdi, volume 16, pages 265–283. Savannah, GA, USA, 2016.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets