Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Single-sample image-fusion upsampling of fluorescence lifetime images (2404.13102v1)

Published 19 Apr 2024 in eess.IV, cs.CV, physics.bio-ph, and physics.optics

Abstract: Fluorescence lifetime imaging microscopy (FLIM) provides detailed information about molecular interactions and biological processes. A major bottleneck for FLIM is image resolution at high acquisition speeds, due to the engineering and signal-processing limitations of time-resolved imaging technology. Here we present single-sample image-fusion upsampling (SiSIFUS), a data-fusion approach to computational FLIM super-resolution that combines measurements from a low-resolution time-resolved detector (that measures photon arrival time) and a high-resolution camera (that measures intensity only). To solve this otherwise ill-posed inverse retrieval problem, we introduce statistically informed priors that encode local and global dependencies between the two single-sample measurements. This bypasses the risk of out-of-distribution hallucination as in traditional data-driven approaches and delivers enhanced images compared for example to standard bilinear interpolation. The general approach laid out by SiSIFUS can be applied to other image super-resolution problems where two different datasets are available.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. I. Georgakoudi and K. P. Quinn, Optical imaging using endogenous contrast to assess metabolic state, Annual review of biomedical engineering 14, 351 (2012).
  2. E. B. van Munster and T. W. Gadella, Fluorescence lifetime imaging microscopy (flim), Microscopy Techniques , 143 (2005).
  3. M. Y. Berezin and S. Achilefu, Fluorescence lifetime measurements and biological imaging, Chemical reviews 110, 2641 (2010).
  4. J. R. Lakowicz, Time-Domain Lifetime Measurements, in Principles of Fluorescence Spectroscopy, edited by J. R. Lakowicz (Springer US, Boston, MA, 2006) pp. 97–155.
  5. J. R. Lakowicz, Principles of fluorescence spectroscopy (Springer, 2006).
  6. J. A. Jo, Q. Fang, and L. Marcu, Ultrafast method for the analysis of fluorescence lifetime imaging microscopy data based on the laguerre expansion technique, IEEE Journal of Selected Topics in Quantum Electronics 11, 835 (2005).
  7. R. M. Ballew and J. Demas, An error analysis of the rapid lifetime determination method for the evaluation of single exponential decays, Analytical Chemistry 61, 30 (1989).
  8. R. F. Laine, C. Poudel, and C. F. Kaminski, A method for the fast and photon-efficient analysis of time-domain fluorescence lifetime image data over large dynamic ranges, Journal of Microscopy 287, 138 (2022).
  9. T. Knöpfel and C. Song, Optical voltage imaging in neurons: moving from technology development to practical tool, Nature Reviews Neuroscience 20, 719 (2019).
  10. Matplotlib, Interpolations for imshow.
  11. S. Fadnavis, Image interpolation techniques in digital image processing: an overview, International Journal of Engineering Research and Applications 4, 70 (2014).
  12. E. J. Candès, J. Romberg, and T. Tao, Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information, IEEE Transactions on information theory 52, 489 (2006).
  13. W. T. Freeman, T. R. Jones, and E. C. Pasztor, Example-based super-resolution, IEEE Computer graphics and Applications 22, 56 (2002).
  14. R. Timofte, V. De Smet, and L. Van Gool, Anchored neighborhood regression for fast example-based super-resolution, in Proceedings of the IEEE international conference on computer vision (2013) pp. 1920–1927.
  15. Z. Wang, J. Chen, and S. C. Hoi, Deep learning for image super-resolution: A survey, IEEE transactions on pattern analysis and machine intelligence 43, 3365 (2020).
  16. V. Kapitány, AI for time-resolved imaging: from fluorescence lifetime to single-pixel time of flight, Ph.D. thesis, University of Glasgow (2023).
  17. D. Glasner, S. Bagon, and M. Irani, Super-resolution from a single image, in 2009 IEEE 12th international conference on computer vision (IEEE, 2009) pp. 349–356.
  18. K.-H. Thung, P.-T. Yap, and D. Shen, Multi-stage diagnosis of alzheimer’s disease with incomplete multimodal data via multi-task deep learning, in International Workshop on Deep Learning in Medical Image Analysis (Springer, 2017) pp. 160–168.
  19. A. Chambolle, An algorithm for total variation minimization and applications, Journal of Mathematical imaging and vision 20, 89 (2004).
  20. W. Becker, Spc-qc-104: Precision flim and fast flim in one (2023).
  21. D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980  (2014).
  22. H. Szmacinski and J. R. Lakowicz, Fluorescence lifetime-based sensing and imaging, Sensors and Actuators B: Chemical 29, 16 (1995).
  23. J. R. Lakowicz, Radiative decay engineering: biophysical and biomedical applications, Analytical biochemistry 298, 1 (2001).
  24. M. Stöckl and A. Herrmann, Detection of lipid domains in model and cell membranes by fluorescence lifetime imaging microscopy, Biochimica et Biophysica Acta (BBA)-Biomembranes 1798, 1444 (2010).
  25. R. Dosselmann and X. D. Yang, A comprehensive assessment of the structural similarity index, Signal, Image and Video Processing 5, 81 (2011).
  26. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, A statistical evaluation of recent full reference image quality assessment algorithms, IEEE Transactions on image processing 15, 3440 (2006).
  27. R. Zhang, Lpips v0.1.4 (2021).
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now