Papers
Topics
Authors
Recent
Search
2000 character limit reached

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Published 15 Oct 2024 in cs.CV | (2410.19786v1)

Abstract: Acoustic-Resolution Photoacoustic Microscopy (AR-PAM) is promising for subcutaneous vascular imaging, but its spatial resolution is constrained by the Point Spread Function (PSF). Traditional deconvolution methods like Richardson-Lucy and model-based deconvolution use the PSF to improve resolution. However, accurately measuring the PSF is difficult, leading to reliance on less accurate blind deconvolution techniques. Additionally, AR-PAM suffers from long scanning times, which can be reduced via down-sampling, but this necessitates effective image recovery from under-sampled data, a task where traditional interpolation methods fall short, particularly at high under-sampling rates. To address these challenges, we propose an approach based on Implicit Neural Representations (INR). This method learns a continuous mapping from spatial coordinates to initial acoustic pressure, overcoming the limitations of discrete imaging and enhancing AR-PAM's resolution. By treating the PSF as a learnable parameter within the INR framework, our technique mitigates inaccuracies associated with PSF estimation. We evaluated our method on simulated vascular data, showing significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) over conventional methods. Qualitative enhancements were also observed in leaf vein and in vivo mouse brain microvasculature images. When applied to a custom AR-PAM system, experiments with pencil lead demonstrated that our method delivers sharper, higher-resolution results, indicating its potential to advance photoacoustic microscopy.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Paul C. Beard. Biomedical photoacoustic imaging. Interface Focus, 1:602 – 631, 2011.
  2. Dual-pulse nonlinear photoacoustic technique: a practical investigation. Biomedical optics express, 6 8:2923–33, 2015.
  3. Lihong V. Wang. Multiscale photoacoustic microscopy and computed tomography. Nature photonics, 3 9:503–509, 2009.
  4. Structural and functional photoacoustic molecular tomography aided by emerging contrast agents. Chemical Society reviews, 43 20:7132–70, 2014.
  5. Photoacoustic imaging for the study of oxygen saturation and total hemoglobin in bone healing and non-union formation. Photoacoustics, 28, 2022.
  6. Review on practical photoacoustic microscopy. Photoacoustics, 15, 2019.
  7. Optical-resolution photoacoustic microscopy with a needle-shaped beam. Nature Photonics, 17:89–95, 2022.
  8. Quantitative analysis on in vivo tumor‐microvascular images from optical‐resolution photoacoustic microscopy. Journal of Biophotonics, 12, 2019.
  9. Optical-resolution photoacoustic microscopy of brain vascular imaging in small animal tumor model using nanosecond solid-state laser. Neurophotonics and Biomedical Spectroscopy, 2019.
  10. Fully integrated photoacoustic microscopy and photoplethysmography of human in vivo. Photoacoustics, 27, 2022.
  11. Acoustic resolution photoacoustic doppler velocimetry in blood-mimicking fluids. Scientific Reports, 6, 2016.
  12. Sparsity-based reconstruction for super-resolved limited-view photoacoustic computed tomography deep in a scattering medium. Optics letters, 43 10:2221–2224, 2018.
  13. In vivo photoacoustic microscopy with 7.6-µm axial resolution using a commercial 125-mhz ultrasonic transducer. Journal of Biomedical Optics, 17, 2012.
  14. Blind-deconvolution optical-resolution photoacoustic microscopy in vivo. Optics express, 21 6:7316–27, 2013.
  15. Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm. Biomedical optics express, 13 2:1026–1044, 2021.
  16. Accelerating photoacoustic microscopy by reconstructing undersampled images using diffusion models. Scientific Reports, 14, 2024.
  17. Sparse sampling photoacoustic reconstruction with graph regularization group sparse dictionary. Applied Optics, 2024.
  18. Real-time whole-brain imaging of hemodynamics and oxygenation at micro-vessel resolution with ultrafast wide-field photoacoustic microscopy. Light, Science & Applications, 11, 2022.
  19. Review of deep learning for photoacoustic imaging. Photoacoustics, 21, 2020.
  20. High-resolution photoacoustic microscopy with deep penetration through learning. Photoacoustics, 25, 2021.
  21. High-fidelity deconvolution for acoustic-resolution photoacoustic microscopy enabled by convolutional neural networks. Photoacoustics, 26, 2022.
  22. Implicit neural representations with periodic activation functions. ArXiv, abs/2006.09661, 2020.
  23. Nerf++: Analyzing and improving neural radiance fields. ArXiv, abs/2010.07492, 2020.
  24. Deepsdf: Learning continuous signed distance functions for shape representation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 165–174, 2019.
  25. Self-supervised coordinate projection network for sparse-view computed tomography. IEEE Transactions on Computational Imaging, 9:517–529, 2022.
  26. Coil: Coordinate-based internal learning for tomographic imaging. IEEE Transactions on Computational Imaging, 7:1400–1412, 2021.
  27. Nerp: Implicit neural representation learning with prior embedding for sparsely sampled image reconstruction. IEEE Transactions on Neural Networks and Learning Systems, 35:770–782, 2021.
  28. Limited-view photoacoustic imaging reconstruction via high-quality self-supervised neural representation. ArXiv, abs/2407.03663, 2024.
  29. Biomedical ultrasound beam forming. Ultrasound in medicine & biology, 20 5:403–28, 1994.
  30. Deep and domain transfer learning aided photoacoustic microscopy: Acoustic resolution to optical resolution. IEEE Transactions on Medical Imaging, 41:3636–3648, 2022.
  31. Photoacoustic microscopy with sparse data by convolutional neural networks. Photoacoustics, 22, 2021.
  32. On the spectral bias of neural networks. In International Conference on Machine Learning, 2018.
  33. Fourier features let networks learn high frequency functions in low dimensional domains. ArXiv, abs/2006.10739, 2020.
  34. Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics (TOG), 41:1 – 15, 2022.
  35. Point spread functions and deconvolution of ultrasonic images. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 62:531–544, 2015.
  36. Non-blind and blind deconvolution under poisson noise using fractional-order total variation. Journal of Mathematical Imaging and Vision, 62:1238 – 1255, 2020.
  37. Reconstructing undersampled photoacoustic microscopy images using deep learning. IEEE Transactions on Medical Imaging, 40:562–570, 2020.
  38. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.