Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Fast and Provable Algorithm for Sparse Phase Retrieval (2309.02046v2)

Published 5 Sep 2023 in cs.IT, math.IT, and math.OC

Abstract: We study the sparse phase retrieval problem, which seeks to recover a sparse signal from a limited set of magnitude-only measurements. In contrast to prevalent sparse phase retrieval algorithms that primarily use first-order methods, we propose an innovative second-order algorithm that employs a Newton-type method with hard thresholding. This algorithm overcomes the linear convergence limitations of first-order methods while preserving their haLLMark per-iteration computational efficiency. We provide theoretical guarantees that our algorithm converges to the $s$-sparse ground truth signal $\mathbf{x}{\natural} \in \mathbb{R}n$ (up to a global sign) at a quadratic convergence rate after at most $O(\log (\Vert\mathbf{x}{\natural} \Vert /x_{\min}{\natural}))$ iterations, using $\Omega(s2\log n)$ Gaussian random samples. Numerical experiments show that our algorithm achieves a significantly faster convergence rate than state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. Iterative hard thresholding for compressed sensing. Applied and Computational Harmonic Analysis, 27(3):265–274, 2009.
  2. Jian-Feng Cai and Ke Wei. Solving systems of phaseless equations via Riemannian optimization with optimal sampling complexity. Journal of Computational Mathematics, 2023.
  3. Solving phase retrieval with random initial guess is nearly as good as by spectral initialization. Applied and Computational Harmonic Analysis, 58:60–84, 2022a.
  4. Sample-efficient sparse phase retrieval via stochastic alternating minimization. IEEE Transactions on Signal Processing, 70:4951–4966, 2022b.
  5. Sparse signal recovery from phaseless measurements via hard thresholding pursuit. Applied and Computational Harmonic Analysis, 56:367–390, 2022c.
  6. Fast projected Newton-like method for precision matrix estimation under total positivity. In Advances in Neural Information Processing Systems, volume 36, pp.  73348–73370, 2023a.
  7. Nearly optimal bounds for the global geometric landscape of phase retrieval. Inverse Problems, 39(7):075011, 2023b.
  8. Provable sample-efficient sparse phase retrieval initialized by truncated power method. Inverse Problems, 39(7):075008, jun 2023c.
  9. Optimal rates of convergence for noisy sparse phase retrieval via thresholded Wirtinger flow. The Annals of Statistics, 44(5):2221–2251, 2016.
  10. Decoding by linear programming. IEEE Transactions on Information Theory, 51(12):4203–4215, 2005.
  11. Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming. Communications on Pure and Applied Mathematics, 66(8):1241–1274, 2013.
  12. Phase retrieval via Wirtinger flow: Theory and algorithms. IEEE Transactions on Information Theory, 61(4):1985–2007, 2015.
  13. Solving random quadratic systems of equations is nearly as easy as solving linear systems. Communications on Pure and Applied Mathematics, 70(5):822–883, 2017.
  14. Gradient descent with random initialization: Fast global convergence for nonconvex phase retrieval. Mathematical Programming, 176(1):5–37, 2019.
  15. Kaczmarz method for solving quadratic equations. IEEE Signal Processing Letters, 23(9):1183–1187, 2016.
  16. Nonconvex optimization meets low-rank matrix factorization: An overview. IEEE Transactions on Signal Processing, 67(20):5239–5269, 2019.
  17. An algebraic characterization of injectivity in phase retrieval. Applied and Computational Harmonic Analysis, 38(2):346–356, 2015.
  18. Phase retrieval from very few measurements. Linear Algebra and its Applications, 449:475–499, 2014.
  19. Simon Foucart. Hard thresholding pursuit: An algorithm for compressive sensing. SIAM Journal on Numerical Analysis, 49(6):2543–2563, 2011.
  20. An invitation to compressive sensing. In A Mathematical Introduction to Compressive Sensing, pp. 1–39. 2013.
  21. Phaseless recovery using the Gauss-Newton method. IEEE Transactions on Signal Processing, 65(22):5885–5896, 2017.
  22. Phasemax: Convex phase retrieval via basis pursuit. IEEE Transactions on Information Theory, 64(4):2675–2689, 2018.
  23. An elementary proof of convex phase retrieval in the natural parameter space via the linear program phasemax. Communications in Mathematical Sciences, 16(7):2047–2051, 2018.
  24. Sample-efficient algorithms for recovering structured signals from magnitude-only measurements. IEEE Transactions on Information Theory, 65(7):4434–4456, 2019.
  25. Toward the optimal construction of a loss function without spurious local minima for solving quadratic equations. IEEE Transactions on Information Theory, 66(5):3242–3260, 2019.
  26. Globally convergent Levenberg-Marquardt method for phase retrieval. IEEE Transactions on Information Theory, 65(4):2343–2359, 2018.
  27. Implicit regularization in nonconvex statistical estimation: Gradient descent converges linearly for phase retrieval, matrix completion, and blind deconvolution. Foundations of Computational Mathematics, 20:451–632, 2020.
  28. An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy, 109(10):1256–1262, 2009.
  29. Newton-step-based hard thresholding algorithms for sparse signal recovery. IEEE Transactions on Signal Processing, 68:6594–6606, 2020.
  30. Extending X-ray crystallography to allow the imaging of noncrystalline materials, cells, and single protein complexes. Annual Review of Physical Chemistry, 59(1):387–410, 2008.
  31. Cosamp: Iterative signal recovery from incomplete and inaccurate samples. Applied and Computational Harmonic Analysis, 26(3):301–321, 2009.
  32. Phase retrieval using alternating minimization. Advances in Neural Information Processing Systems, 26, 2013.
  33. CPRL–An extension of compressive sensing to the phase retrieval problem. Advances in Neural Information Processing Systems, 25, 2012.
  34. Phase retrieval with application to optical imaging: A contemporary overview. IEEE Signal Processing Magazine, 32(3):87–109, 2015.
  35. Mahdi Soltanolkotabi. Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization. IEEE Transactions on Information Theory, 65(4):2374–2400, 2019.
  36. A geometric analysis of phase retrieval. Foundations of Computational Mathematics, 18(5):1131–1198, 2018.
  37. Irene Waldspurger. Phase retrieval with random Gaussian sensing vectors by alternating projections. IEEE Transactions on Information Theory, 64(5):3301–3312, 2018.
  38. Phase recovery, MaxCut and complex semidefinite programming. Mathematical Programming, 149(1):47–81, 2015.
  39. Solving systems of random quadratic equations via truncated amplitude flow. IEEE Transactions on Information Theory, 64(2):773–794, 2017a.
  40. Sparse phase retrieval via truncated amplitude flow. IEEE Transactions on Signal Processing, 66(2):479–491, 2017b.
  41. Phase retrieval for sparse signals. Applied and Computational Harmonic Analysis, 37(3):531–544, 2014.
  42. Ke Wei. Solving systems of phaseless equations via Kaczmarz methods: A proof of concept study. Inverse Problems, 31(12):125008, 2015.
  43. A nonconvex approach for phase retrieval: Reshaped wirtinger flow and incremental algorithms. Journal of Machine Learning Research, 18, 2017.
  44. Compressive phase retrieval via reweighted amplitude flow. IEEE Transactions on Signal Processing, 66(19):5029–5040, 2018.
  45. Global and quadratic convergence of Newton hard-thresholding pursuit. The Journal of Machine Learning Research, 22(1):599–643, 2021.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com