Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior (2312.07226v1)

Published 12 Dec 2023 in eess.IV and cs.CV

Abstract: Photoacoustic Microscopy (PAM) images integrating the advantages of optical contrast and acoustic resolution have been widely used in brain studies. However, there exists a trade-off between scanning speed and image resolution. Compared with traditional raster scanning, rotational scanning provides good opportunities for fast PAM imaging by optimizing the scanning mechanism. Recently, there is a trend to incorporate deep learning into the scanning process to further increase the scanning speed.Yet, most such attempts are performed for raster scanning while those for rotational scanning are relatively rare. In this study, we propose a novel and well-performing super-resolution framework for rotational scanning-based PAM imaging. To eliminate adjacent rows' displacements due to subject motion or high-frequency scanning distortion,we introduce a registration module across odd and even rows in the preprocessing and incorporate displacement degradation in the training. Besides, gradient-based patch selection is proposed to increase the probability of blood vessel patches being selected for training. A Transformer-based network with a global receptive field is applied for better performance. Experimental results on both synthetic and real datasets demonstrate the effectiveness and generalizability of our proposed framework for rotationally scanned PAM images'super-resolution, both quantitatively and qualitatively. Code is available at https://github.com/11710615/PAMSR.git.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. Deep burst super-resolution, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9209–9218.
  2. Label-free intraoperative histology of bone tissue via deep-learning-assisted ultraviolet photoacoustic microscopy. Nature Biomedical Engineering , 1–11.
  3. Wide-field polygon-scanning photoacoustic microscopy of oxygen saturation at 1-mhz a-line rate. Photoacoustics 20, 100195.
  4. Ultracompact high-resolution photoacoustic microscopy. Optics letters 43, 1615–1618.
  5. Deep-learning-based motion-correction algorithm in optical resolution photoacoustic microscopy. Visual Computing for Industry, Biomedicine, and Art 2, 1–6.
  6. Activating more pixels in image super-resolution transformer, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 22367–22377.
  7. Dual aggregation transformer for image super-resolution, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 12312–12321.
  8. Second-order attention network for single image super-resolution, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 11065–11074.
  9. Reconstructing undersampled photoacoustic microscopy images using deep learning. IEEE transactions on medical imaging 40, 562–570.
  10. Burst image restoration and enhancement, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5759–5768.
  11. Generative adversarial networks. Communications of the ACM 63, 139–144.
  12. Detachable head-mounted photoacoustic microscope in freely moving mice. Optics letters 46, 6055–6058.
  13. Convolutional autoencoder-based reconstruction of vascular structures in photoacoustic images, in: Biomedical Spectroscopy, Microscopy, and Imaging, SPIE. pp. 193–200.
  14. Depth-resolved optical imaging and microscopy of vascular compartment dynamics during somatosensory stimulation. Neuroimage 35, 89–104.
  15. Portable optical resolution photoacoustic microscopy (porpam) for human oral imaging. Optics letters 42, 4434–4437.
  16. Photoacoustic imaging of brain functions: Wide filed-of-view functional imaging with high spatiotemporal resolution. Laser & Photonics Reviews 16, 2100304.
  17. Super-resolution localization photoacoustic microscopy using intrinsic red blood cells as contrast absorbers. Light: Science & Applications 8, 103.
  18. Photo-realistic single image super-resolution using a generative adversarial network, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4681–4690.
  19. Swinir: Image restoration using swin transformer, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1833–1844.
  20. Details or artifacts: A locally discriminative learning approach to realistic image super-resolution, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5657–5666.
  21. Enhanced deep residual networks for single image super-resolution, in: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 136–144.
  22. Swin transformer: Hierarchical vision transformer using shifted windows, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022.
  23. Learning the degradation distribution for blind image super-resolution, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6063–6072.
  24. Structure-preserving super resolution with gradient guidance, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 7769–7778.
  25. Optical-resolution photoacoustic microscopy for in vivo imaging of single capillaries. Optics letters 33, 929–931.
  26. Pyramid attention network for image restoration. International Journal of Computer Vision , 1–19.
  27. Single image super-resolution via a holistic attention network, in: European conference on computer vision, Springer. pp. 191–207.
  28. Inverted multiscale optical resolution photoacoustic microscopy. Journal of biophotonics 10, 1580–1585.
  29. High-resolution in vivo imaging of rhesus cerebral cortex with ultrafast portable photoacoustic microscopy. NeuroImage 238, 118260.
  30. Quantitative investigation of vascular response to mesenteric venous thrombosis using large-field-of-view photoacoustic microscopy. Journal of Biophotonics 12, e201900198.
  31. Two-photon high-resolution measurement of partial pressure of oxygen in cerebral vasculature and tissue. Nature methods 7, 755–759.
  32. Three-dimensional reconstructing undersampled photoacoustic microscopy images using deep learning. Photoacoustics 29, 100429.
  33. Towards multimodal atlases of the human brain. Nature Reviews Neuroscience 7, 952–966.
  34. Linking brain vascular physiology to hemodynamic response in ultra-high field mri. Neuroimage 168, 279–295.
  35. Deep image prior for undersampling high-speed photoacoustic microscopy. Photoacoustics 22, 100266.
  36. Photoacoustic tomography: in vivo imaging from organelles to organs. science 335, 1458–1462.
  37. A practical guide to photoacoustic tomography in the life sciences. Nature methods 13, 627–638.
  38. Real-esrgan: Training real-world blind super-resolution with pure synthetic data, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1905–1914.
  39. Uformer: A general u-shaped transformer for image restoration, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 17683–17693.
  40. Deep edge guided recurrent residual learning for image super-resolution. IEEE Transactions on Image Processing 26, 5895–5907.
  41. High-speed label-free functional photoacoustic microscopy of mouse brain in action. Nature methods 12, 407–410.
  42. Optical-resolution photoacoustic microscopy based on two-dimensional scanning galvanometer. Applied Physics Letters 100, 023702.
  43. Restormer: Efficient transformer for high-resolution image restoration, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5728–5739.
  44. Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imaging. Nature biotechnology 24, 848–851.
  45. Designing a practical degradation model for deep blind image super-resolution, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4791–4800.
  46. The unreasonable effectiveness of deep features as a perceptual metric, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 586–595.
  47. Image super-resolution using very deep residual channel attention networks, in: Proceedings of the European conference on computer vision (ECCV), pp. 286–301.
  48. Residual dense network for image super-resolution, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2472–2481.
  49. Photoacoustic microscopy with sparse data by convolutional neural networks. Photoacoustics 22, 100242.
  50. Real-time whole-brain imaging of hemodynamics and oxygenation at micro-vessel resolution with ultrafast wide-field photoacoustic microscopy. Light: Science & Applications 11, 138.
  51. Modeling deformable gradient compositions for single-image super-resolution, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5417–5425.
  52. Fast high-resolution miniature two-photon microscopy for brain imaging in freely behaving mice. Nature methods 14, 713–719.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - 11710615/PAMSR (1 star)