Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Image Scanning Microscopy Reconstruction by Autocorrelation Inversion (2404.08946v1)

Published 13 Apr 2024 in physics.optics, physics.app-ph, and physics.comp-ph

Abstract: Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a pinhole in front of a single-element detector. However, the pinhole also rejects useful photons and beating the diffraction limit comes at the price of irremediably compromising the signal-to-noise ratio (SNR) of the data. Image scanning microscopy (ISM) emerged as the natural evolution of CLSM, exploiting a small array detector in place of the pinhole and the single-element detector. Each sensitive element is small enough to achieve sub-diffraction resolution through the confocal effect, but the size of the whole detector is large enough to guarantee excellent collection efficiency and SNR. However, the raw data produced by an ISM setup consists of a 4D dataset which can be seen as a set of confocal-like images. Thus, fusing the dataset into a single super-resolved image requires a dedicated reconstruction algorithm. Conventional methods are multi-image deconvolution, which requires prior knowledge of the system point spread functions (PSF), or adaptive pixel reassignment (APR), which is effective only on a limited range of experimental conditions. In this work, we describe and validate a novel concept for ISM image reconstruction based on autocorrelation inversion. We leverage unique properties of the autocorrelation to discard low-frequency components and maximize the resolution of the reconstructed image, without any assumption on the image or any knowledge of the PSF. Our results push the quality of the ISM reconstruction beyond the level provided by APR and open new perspectives for multi-dimensional image processing.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. C.J.R. Sheppard and A. Choudhury. Image formation in the scanning microscope. Optica Acta: International Journal of Optics, 24:1051–1073, 10 1977.
  2. Colin Sheppard. Super-resolution by confocal fluorescent microscopy. Optik, 60:391–396, 1982.
  3. Colin Sheppard. Super-resolution in confocal imaging. Optik, 80:53–54, 1988.
  4. The new 2d superresolution mode for zeiss airyscan. Nature Methods, 14:1223–1223, 12 2017.
  5. Image scanning microscopy. Physical Review Letters, 104:198101, 5 2010.
  6. Spad-based asynchronous-readout array detectors for image-scanning microscopy. Optica, 7:755, 7 2020.
  7. A robust and versatile platform for image scanning microscopy enabling super-resolution flim. Nature Methods, 16:175–178, 2 2019.
  8. The brighteyes-ttm as an open-source time-tagging module for democratising single-photon microscopy. Nature Communications, 13:7406, 12 2022.
  9. Compact and effective photon-resolved image scanning microscope. Advanced Photonics, 6, 1 2024.
  10. Super-resolution enhancement by quantum image scanning microscopy. Nature Photonics, 13:116–122, 2 2019.
  11. Sofism: Super-resolution optical fluctuation image scanning microscopy. Optica, 7:1308, 10 2020.
  12. Focus image scanning microscopy for sharp and gentle super-resolved microscopy. Nature Communications, 13, 12 2022.
  13. Two-photon image-scanning microscopy with spad array and blind image reconstruction. Biomedical Optics Express, 11:2905, 6 2020.
  14. Superresolution by image scanning microscopy using pixel reassignment. Optics Letters, 38:2889, 8 2013.
  15. Optical photon reassignment microscopy (opra). Optical Nanoscopy, 2:1–6, 2013.
  16. Re-scan confocal microscopy: scanning twice for better resolution. Biomedical Optics Express, 4:2644, 11 2013.
  17. Instant super-resolution imaging in live cells and embryos via analog image processing. Nature Methods, 10:1122–1126, 11 2013.
  18. Image scanning microscopy with a quadrant detector. Optics Letters, 40:5355, 2015.
  19. Pixel reassignment in image scanning microscopy: a re-evaluation. Journal of the Optical Society of America A, 37:154, 1 2020.
  20. Richardson–lucy deconvolution as a general tool for combining images with complementary strengths. ChemPhysChem, 15:794–800, 3 2014.
  21. Reconstructing the image scanning microscopy dataset: an inverse problem. Inverse Problems, 39:064004, 6 2023.
  22. Pyfocus – a python package for vectorial calculations of focused optical fields under realistic conditions. application to toroidal foci. Computer Physics Communications, 275, 6 2022.
  23. Open-source tools enable accessible and advanced image scanning microscopy data analysis. Nature Photonics, 17:457–458, 6 2023.
  24. Beyond multi view deconvolution for inherently aligned fluorescence tomography. Scientific Reports, 11(1):15723, 2021.
  25. Image recovery from correlations. JOSA A, 9(8):1266–1272, 1992.
  26. Phase retrieval with application to optical imaging: a contemporary overview. IEEE signal processing magazine, 32(3):87–109, 2015.
  27. James R Fienup. Reconstruction of an object from the modulus of its fourier transform. Optics letters, 3(1):27–29, 1978.
  28. James R Fienup. Phase retrieval algorithms: a personal tour. Applied optics, 52(1):45–56, 2013.
  29. Imre Csiszar. Why least squares and maximum entropy? an axiomatic approach to inference for linear inverse problems. The Annals of Statistics, 19, 12 1991.
  30. Convergence of the schulz-snyder phase retrieval algorithm to local minima. JOSA A, 23(8):1835–1845, 2006.
  31. Improvement in resolution by nearly confocal microscopy. Applied Optics, 21:778, 3 1982.
  32. Superconcentration of light: circumventing the classical limit to achievable irradiance. Opt. Lett., 41(9):2109–2112, May 2016.
  33. Measuring image resolution in optical nanoscopy. Nature Methods, 10:557–562, 4 2013.
  34. Evaluating image resolution in stimulated emission depletion microscopy. Optica, 5:32, 1 2018.
  35. Fourier ring correlation simplifies image restoration in. Nature Communications, 10:1–45, 2019.
  36. Deconvolved image restoration from auto-correlations. IEEE Transactions on Image Processing, 30:1332–1341, 2020.
  37. Phase-retrieval with incomplete autocorrelations using deep convolutional autoencoders. arXiv preprint arXiv:2304.09303, 2023.
  38. Blind deconvolution in autocorrelation inversion for multiview light-sheet microscopy. Microscopy Research and Technique, 85(6):2282–2291, 2022.
  39. Tomographic sted microscopy. Biomed. Opt. Express, 11(6):3139–3163, Jun 2020.
  40. Ism-assisted tomographic sted microscopy. Opt. Express, 30(2):939–956, Jan 2022.
  41. Multiview confocal super-resolution microscopy. Nature, 600(7888):279–284, 2021.
  42. Mattia Donato. BrightEyes-MCS. https://github.com/VicidominiLab/BrightEyes-MCS.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com