Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy (2403.16974v1)
Abstract: The use of fluorescent molecules to create long sequences of low-density, diffraction-limited images enables highly-precise molecule localization. However, this methodology requires lengthy imaging times, which limits the ability to view dynamic interactions of live cells on short time scales. Many techniques have been developed to reduce the number of frames needed for localization, from classic iterative optimization to deep neural networks. Particularly, deep algorithm unrolling utilizes both the structure of iterative sparse recovery algorithms and the performance gains of supervised deep learning. However, the robustness of this approach is highly dependant on having sufficient training data. In this paper we introduce deep unrolled self-supervised learning, which alleviates the need for such data by training a sequence-specific, model-based autoencoder that learns only from given measurements. Our proposed method exceeds the performance of its supervised counterparts, thus allowing for robust, dynamic imaging well below the diffraction limit without any labeled training samples. Furthermore, the suggested model-based autoencoder scheme can be utilized to enhance generalization in any sparse recovery framework, without the need for external training data.
- E. Betzig, “Proposed method for molecular optical imaging,” Optics Letters, vol. 20, pp. 237–239, 1995.
- “Imaging intracellular fluorescent proteins at nanometer resolution,” Science, vol. 313, pp. 1642–1645, 2006.
- “Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM),” Nature Methods, vol. 3, pp. 793–796, 2006.
- “FALCON: fast and unbiased reconstruction of high-density super-resolution microscopy data,” Scientific Reports, vol. 4, pp. 1–9, 2014.
- “Faster STORM using compressed sensing,” Nature Methods, vol. 9, pp. 721–726, 2012.
- “Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI),” Proceedings of the National Academy of Sciences of the United States of America, vol. 106(52), pp. 22287–22292, 2009.
- “Sparsity-based super-resolution microscopy from correlation information,” Optics Express, vol. 26-14, pp. 18238–18269, 2018.
- “SPARCOM: Sparsity based super-resolution correlation microscopy,” SIAM J. on Img. Sci., vol. 12-1, pp. 392–419, 2019.
- “Deep learning massively accelerates super-resolution localization microscopy,” Nature Biotechnology, vol. 36, pp. 460–468, 2018.
- “Deep-STORM: super-resolution single-molecule microscopy by deep learning,” Optica, vol. 5, pp. 458–464, 2018.
- “Deep learning enables fast and dense single-molecule localization with high accuracy,” Nature Methods, vol. 18, pp. 1082–1090, 2021.
- Y.C. Eldar, Sampling Theory: Beyond Bandlimited Systems, Cambridge University Press, 2015.
- Y.C. Eldar and G. Kutyniok, Compressed sensing: theory and applications, Cambridge University Press, 2012.
- “Pushing the limits of sparse support recovery using correlation information,” IEEE Transactions on Signal Processing, vol. 63-3, pp. 711–726, 2015.
- “Deep-learning-based image reconstruction and enhancement in optical microscopy,” Proceedings of the IEEE, vol. 108, pp. 30–50, 2020.
- “Deep unrolled recovery in sparse biological imaging,” IEEE Signal Processing Magazine, vol. 39-2, pp. 45–57, 2022.
- “Model-based deep learning: On the intersection of deep learning and optimization,” IEEE Access, vol. 10, pp. 115384–115398, 2022.
- K. Gregor and Y. LeCun, “Learning fast approximations of sparse coding,” Proc. of 27th Int. Conf. on machine learning, pp. 399 – 406, 2010.
- G. Dardikman-Yoffe and Y. C. Eldar, “Learned SPARCOM: Unfolded deep super-resolution microscopy,” Optics Express, vol. 28-19, pp. 27736 – 27763, 2020.
- “Deep image prior,” IEEE conference on computer vision and pattern recognition, pp. 9446–9454, 2018.
- “Zero-shot super-resolution using deep internal learning,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3118–3126, 2018.
- “Dual back-projection-based internal learning for blind super-resolution,” IEEE Signal Processing Letters, vol. 27, pp. 1190–1194, 2020.
- “SMORE: A self-supervised anti-aliasing and super-resolution algorithm for MRI using deep learning,” IEEE Transactions on Medical Imaging, vol. 40, no. 3, pp. 805–817, 2021.
- “Real-world single image super-resolution: A brief review,” Information Fusion, vol. 79, pp. 124–145, 2022.
- R. Tibshirani, “Regression shrinkage and selection via the lasso,” Journal of the Royal Statistical Society. Series B (Methodological), vol. 58-1, pp. 267 – 288, 1996.
- X.P. Zhang, “Thresholding neural network for adaptive noise reduction,” IEEE transactions on neural networks, vol. 10, pp. 567–584, 2001.
- “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2017.
- gilidar/LSPARCOM, https://github.com/gilidar/LSPARCOM.
- “Quantitative evaluation of software packages for single-molecule localization microscopy,” Nature methods, vol. 12, no. 8, pp. 717–724, 2015.
- “ThunderSTORM: a comprehensive imagej plug-in for PALM and STORM data analysis and super-resolution imaging,” Bioinformatics, vol. 30, no. 16, pp. 2389–2390, 2014.
- “Democratising deep learning for microscopy with zerocostdl4mic,” Nature Communications, vol. 12, no. 2276, 2021.
- A. Beck and M. Teboulle, “Gradient-based algorithms with applications to signal-recovery problems,” in Convex Optimization in Signal Processing and Communications, Y. C. Eldar and D. P. Palomar, Eds., pp. 42–88. Cambridge university press, Cambridge, UK, 2009.
- C. Leterrier and Laine R. F., “ZeroCostDL4Mic - DeepSTORM training and example dataset,” Zenodo, 2020, https://doi.org/10.5281/zenodo.3959089.