Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations
Abstract: Acoustic-Resolution Photoacoustic Microscopy (AR-PAM) is promising for subcutaneous vascular imaging, but its spatial resolution is constrained by the Point Spread Function (PSF). Traditional deconvolution methods like Richardson-Lucy and model-based deconvolution use the PSF to improve resolution. However, accurately measuring the PSF is difficult, leading to reliance on less accurate blind deconvolution techniques. Additionally, AR-PAM suffers from long scanning times, which can be reduced via down-sampling, but this necessitates effective image recovery from under-sampled data, a task where traditional interpolation methods fall short, particularly at high under-sampling rates. To address these challenges, we propose an approach based on Implicit Neural Representations (INR). This method learns a continuous mapping from spatial coordinates to initial acoustic pressure, overcoming the limitations of discrete imaging and enhancing AR-PAM's resolution. By treating the PSF as a learnable parameter within the INR framework, our technique mitigates inaccuracies associated with PSF estimation. We evaluated our method on simulated vascular data, showing significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) over conventional methods. Qualitative enhancements were also observed in leaf vein and in vivo mouse brain microvasculature images. When applied to a custom AR-PAM system, experiments with pencil lead demonstrated that our method delivers sharper, higher-resolution results, indicating its potential to advance photoacoustic microscopy.
- Paul C. Beard. Biomedical photoacoustic imaging. Interface Focus, 1:602 – 631, 2011.
- Dual-pulse nonlinear photoacoustic technique: a practical investigation. Biomedical optics express, 6 8:2923–33, 2015.
- Lihong V. Wang. Multiscale photoacoustic microscopy and computed tomography. Nature photonics, 3 9:503–509, 2009.
- Structural and functional photoacoustic molecular tomography aided by emerging contrast agents. Chemical Society reviews, 43 20:7132–70, 2014.
- Photoacoustic imaging for the study of oxygen saturation and total hemoglobin in bone healing and non-union formation. Photoacoustics, 28, 2022.
- Review on practical photoacoustic microscopy. Photoacoustics, 15, 2019.
- Optical-resolution photoacoustic microscopy with a needle-shaped beam. Nature Photonics, 17:89–95, 2022.
- Quantitative analysis on in vivo tumor‐microvascular images from optical‐resolution photoacoustic microscopy. Journal of Biophotonics, 12, 2019.
- Optical-resolution photoacoustic microscopy of brain vascular imaging in small animal tumor model using nanosecond solid-state laser. Neurophotonics and Biomedical Spectroscopy, 2019.
- Fully integrated photoacoustic microscopy and photoplethysmography of human in vivo. Photoacoustics, 27, 2022.
- Acoustic resolution photoacoustic doppler velocimetry in blood-mimicking fluids. Scientific Reports, 6, 2016.
- Sparsity-based reconstruction for super-resolved limited-view photoacoustic computed tomography deep in a scattering medium. Optics letters, 43 10:2221–2224, 2018.
- In vivo photoacoustic microscopy with 7.6-µm axial resolution using a commercial 125-mhz ultrasonic transducer. Journal of Biomedical Optics, 17, 2012.
- Blind-deconvolution optical-resolution photoacoustic microscopy in vivo. Optics express, 21 6:7316–27, 2013.
- Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm. Biomedical optics express, 13 2:1026–1044, 2021.
- Accelerating photoacoustic microscopy by reconstructing undersampled images using diffusion models. Scientific Reports, 14, 2024.
- Sparse sampling photoacoustic reconstruction with graph regularization group sparse dictionary. Applied Optics, 2024.
- Real-time whole-brain imaging of hemodynamics and oxygenation at micro-vessel resolution with ultrafast wide-field photoacoustic microscopy. Light, Science & Applications, 11, 2022.
- Review of deep learning for photoacoustic imaging. Photoacoustics, 21, 2020.
- High-resolution photoacoustic microscopy with deep penetration through learning. Photoacoustics, 25, 2021.
- High-fidelity deconvolution for acoustic-resolution photoacoustic microscopy enabled by convolutional neural networks. Photoacoustics, 26, 2022.
- Implicit neural representations with periodic activation functions. ArXiv, abs/2006.09661, 2020.
- Nerf++: Analyzing and improving neural radiance fields. ArXiv, abs/2010.07492, 2020.
- Deepsdf: Learning continuous signed distance functions for shape representation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 165–174, 2019.
- Self-supervised coordinate projection network for sparse-view computed tomography. IEEE Transactions on Computational Imaging, 9:517–529, 2022.
- Coil: Coordinate-based internal learning for tomographic imaging. IEEE Transactions on Computational Imaging, 7:1400–1412, 2021.
- Nerp: Implicit neural representation learning with prior embedding for sparsely sampled image reconstruction. IEEE Transactions on Neural Networks and Learning Systems, 35:770–782, 2021.
- Limited-view photoacoustic imaging reconstruction via high-quality self-supervised neural representation. ArXiv, abs/2407.03663, 2024.
- Biomedical ultrasound beam forming. Ultrasound in medicine & biology, 20 5:403–28, 1994.
- Deep and domain transfer learning aided photoacoustic microscopy: Acoustic resolution to optical resolution. IEEE Transactions on Medical Imaging, 41:3636–3648, 2022.
- Photoacoustic microscopy with sparse data by convolutional neural networks. Photoacoustics, 22, 2021.
- On the spectral bias of neural networks. In International Conference on Machine Learning, 2018.
- Fourier features let networks learn high frequency functions in low dimensional domains. ArXiv, abs/2006.10739, 2020.
- Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics (TOG), 41:1 – 15, 2022.
- Point spread functions and deconvolution of ultrasonic images. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 62:531–544, 2015.
- Non-blind and blind deconvolution under poisson noise using fractional-order total variation. Journal of Mathematical Imaging and Vision, 62:1238 – 1255, 2020.
- Reconstructing undersampled photoacoustic microscopy images using deep learning. IEEE Transactions on Medical Imaging, 40:562–570, 2020.
- Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.