Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
134 tokens/sec
GPT-4o
10 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Denoiser-based projections for 2-D super-resolution multi-reference alignment (2204.04754v3)

Published 10 Apr 2022 in eess.IV and eess.SP

Abstract: We study the 2-D super-resolution multi-reference alignment (SR-MRA) problem: estimating an image from its down-sampled, circularly-translated, and noisy copies. The SR-MRA problem serves as a mathematical abstraction of the structure determination problem for biological molecules. Since the SR-MRA problem is ill-posed without prior knowledge, accurate image estimation relies on designing priors that well-describe the statistics of the images of interest. In this work, we build on recent advances in image processing, and harness the power of denoisers as priors of images. In particular, we suggest to use denoisers as projections, and design two computational frameworks to estimate the image: projected expectation-maximization and projected method of moments. We provide an efficient GPU implementation, and demonstrate the effectiveness of these algorithms by extensive numerical experiments on a wide range of parameters and images.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. The generalized method of moments for multi-reference alignment. IEEE Transactions on Signal Processing, 70:1377–1388, 2022.
  2. Multireference alignment is easier with an aperiodic translation distribution. IEEE Transactions on Information Theory, 65(6):3565–3584, 2018.
  3. Estimation under group actions: recovering orbits from invariants. Applied and Computational Harmonic Analysis, 66:236–319, 2023.
  4. Non-unique games over compact groups and orientation estimation in cryo-EM. Inverse Problems, 36(6), 2020.
  5. Amir Beck. First-order methods in optimization. SIAM, 2017.
  6. Gradient-based algorithms with applications to signal recovery. Convex optimization in signal processing and communications, pages 42–88, 2009.
  7. Single-particle cryo-electron microscopy: Mathematical theory, computational challenges, and opportunities. IEEE Signal Processing Magazine, 37(2):58–76, 2020.
  8. Toward single particle reconstruction without particle picking: Breaking the detection limit. SIAM Journal on Imaging Sciences, 16(2):886–910, 2023.
  9. Bispectrum inversion with application to multireference alignment. IEEE Transactions on Signal Processing, 66(4):1037–1050, 2017.
  10. Dihedral multi-reference alignment. IEEE Transactions on Information Theory, 68(5):3489–3499, 2022.
  11. Compactification of the rigid motions group in image processing. SIAM Journal on Imaging Sciences, 15(3):1041–1078, 2022.
  12. Super-resolution multi-reference alignment. Information and Inference: A Journal of the IMA, 11(2):533–555, 2022.
  13. Multi-target detection with rotations. Inverse Problems and Imaging, 2022.
  14. Heterogeneous multireference alignment: A single pass approach. In CISS, pages 1–6, 2018.
  15. Plug-and-play unplugged: Optimization-free reconstruction using consensus equilibrium. SIAM Journal on Imaging Sciences, 11(3):2001–2020, 2018.
  16. Plug-and-Play ADMM for image restoration: Fixed-point convergence and applications. IEEE Transactions on Computational Imaging, 3(1):84–98, 2017.
  17. Patrick L Combettes*. Solving monotone inclusions via compositions of nonexpansive averaged operators. Optimization, 53(5-6):475–504, 2004.
  18. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on image processing, 16(8):2080–2095, 2007.
  19. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1):1–22, 1977.
  20. A characterization of proximity operators. Journal of Mathematical Imaging and Vision, 62(6):773–789, 2020.
  21. Flexisp: a flexible camera image processing framework. ACM Trans. Graph., 33(6), nov 2014.
  22. Richard Henderson. The potential and limitations of neutrons, electrons and X-rays for atomic resolution microscopy of unstained biological molecules. Quarterly reviews of biophysics, 28(2):171–193, 1995.
  23. An accelerated expectation-maximization algorithm for multi-reference alignment. IEEE Transactions on Signal Processing, 70:3237–3248, 2022.
  24. A plug-and-play priors approach for solving nonlinear imaging inverse problems. IEEE Signal Processing Letters, 24(12):1872–1876, 2017.
  25. Exploiting prior knowledge about biological macromolecules in cryo-EM structure determination. IUCrJ, 8(1), 2021.
  26. Two-dimensional multi-target detection: An autocorrelation analysis approach. IEEE Transactions on Signal Processing, 70:835–849, 2022.
  27. A stochastic approximate expectation-maximization for structure determination directly from cryo-EM micrographs. arXiv preprint arXiv:2303.02157, 2023.
  28. ∇∇\nabla∇-prox: Differentiable proximal algorithm modeling for large-scale optimization. ACM Trans. Graph., 42(4), jul 2023.
  29. 3D ab initio modeling in cryo-EM by autocorrelation analysis. In ISBI, pages 1569–1573. IEEE, 2018.
  30. Learning proximal operators: Using denoising networks for regularizing inverse imaging problems. In ICCV, 2017.
  31. Jean-Jacques Moreau. Proximité et dualité dans un espace hilbertien. Bull. Soc. Math. France, 93(2):273–299, 1965.
  32. A stochastic kinematic model of class averaging in single-particle electron microscopy. The International journal of robotics research, 30(6):730–754, 2011.
  33. The sample complexity of multireference alignment. SIAM Journal on Mathematics of Data Science, 1(3):497–517, 2019.
  34. cryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination. Nature methods, 14(3):290–296, 2017.
  35. Regularization by denoising: Clarifications and new interpretations. IEEE Transactions on Computational Imaging, 5(1):52–67, 2019.
  36. The little engine that could: Regularization by denoising (RED). SIAM Journal on Imaging Sciences, 10(4):1804–1844, 2017.
  37. Poisson inverse problems by the Plug-and-Play scheme. Journal of Visual Communication and Image Representation, 41:96–108, 2016.
  38. A certifiably correct algorithm for synchronization over the special Euclidean group. In Algorithmic Foundations of Robotics XII, pages 64–79. Springer, 2020.
  39. Plug-and-play methods provably converge with properly trained denoisers. In International Conference on Machine Learning, volume 97, pages 5546–5557, 09–15 Jun 2019.
  40. Plug-and-play methods provably converge with properly trained denoisers. In International Conference on Machine Learning, 2019.
  41. Sjors HW Scheres. RELION: implementation of a Bayesian approach to cryo-EM structure determination. Journal of structural biology, 180(3):519–530, 2012.
  42. Method of moments for 3D single particle ab initio modeling with non-uniform distribution of viewing angles. Inverse Problems, 36(4):044003, 2020.
  43. Block coordinate regularization by denoising. In Proc. Ann. Conf. Neural Information Processing Systems (NeurIPS), May 2019.
  44. An online plug-and-play algorithm for regularized image reconstruction. IEEE Transactions on Computational Imaging, 2019.
  45. An online plug-and-play algorithm for regularized image reconstruction. IEEE Transactions on Computational Imaging, 5(3):395–408, 2019.
  46. Image restoration by iterative denoising and backward projections. IEEE Transactions on Image Processing, 28(3):1220–1234, 2018.
  47. Super-resolution via image-adapted denoising CNNs: Incorporating external and internal learning. IEEE Signal Processing Letters, 26(7):1080–1084, 2019.
  48. Plug-and-play priors for model based reconstruction. In IEEE Global Conference on Signal and Information Processing, pages 945–948, 2013.
  49. Tuning-free plug-and-play proximal algorithm for inverse imaging problems. In ICML, pages 10158–10169, 2020.
  50. Hybrid steepest descent method for variational inequality problem over the fixed point set of certain quasi-nonexpansive mappings. 2005.
  51. Score-based diffusion priors for multi-target detection. In 2024 58th Annual Conference on Information Sciences and Systems (CISS), pages 1–6. IEEE, 2024.
  52. Plug-and-play image restoration with deep denoiser prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.
  53. Learning deep CNN denoiser prior for image restoration. In CVPR, pages 3929–3938, 2017.
  54. An adaptive variational model for multireference alignment with mixed noise. In 2022 IEEE international conference on bioinformatics and biomedicine (BIBM), pages 692–699. IEEE, 2022.
  55. Computational methods for in situ structural studies with cryogenic electron tomography. Frontiers in Cellular and Infection Microbiology, 13, 2023.
  56. Fast translation invariant classification of hrr range profiles in a zero phase representation. IEE Proceedings-Radar, Sonar and Navigation, 150(6):411–418, 2003.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets