A Fast and Provable Algorithm for Sparse Phase Retrieval (2309.02046v2)
Abstract: We study the sparse phase retrieval problem, which seeks to recover a sparse signal from a limited set of magnitude-only measurements. In contrast to prevalent sparse phase retrieval algorithms that primarily use first-order methods, we propose an innovative second-order algorithm that employs a Newton-type method with hard thresholding. This algorithm overcomes the linear convergence limitations of first-order methods while preserving their haLLMark per-iteration computational efficiency. We provide theoretical guarantees that our algorithm converges to the $s$-sparse ground truth signal $\mathbf{x}{\natural} \in \mathbb{R}n$ (up to a global sign) at a quadratic convergence rate after at most $O(\log (\Vert\mathbf{x}{\natural} \Vert /x_{\min}{\natural}))$ iterations, using $\Omega(s2\log n)$ Gaussian random samples. Numerical experiments show that our algorithm achieves a significantly faster convergence rate than state-of-the-art methods.
- Iterative hard thresholding for compressed sensing. Applied and Computational Harmonic Analysis, 27(3):265–274, 2009.
- Jian-Feng Cai and Ke Wei. Solving systems of phaseless equations via Riemannian optimization with optimal sampling complexity. Journal of Computational Mathematics, 2023.
- Solving phase retrieval with random initial guess is nearly as good as by spectral initialization. Applied and Computational Harmonic Analysis, 58:60–84, 2022a.
- Sample-efficient sparse phase retrieval via stochastic alternating minimization. IEEE Transactions on Signal Processing, 70:4951–4966, 2022b.
- Sparse signal recovery from phaseless measurements via hard thresholding pursuit. Applied and Computational Harmonic Analysis, 56:367–390, 2022c.
- Fast projected Newton-like method for precision matrix estimation under total positivity. In Advances in Neural Information Processing Systems, volume 36, pp. 73348–73370, 2023a.
- Nearly optimal bounds for the global geometric landscape of phase retrieval. Inverse Problems, 39(7):075011, 2023b.
- Provable sample-efficient sparse phase retrieval initialized by truncated power method. Inverse Problems, 39(7):075008, jun 2023c.
- Optimal rates of convergence for noisy sparse phase retrieval via thresholded Wirtinger flow. The Annals of Statistics, 44(5):2221–2251, 2016.
- Decoding by linear programming. IEEE Transactions on Information Theory, 51(12):4203–4215, 2005.
- Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming. Communications on Pure and Applied Mathematics, 66(8):1241–1274, 2013.
- Phase retrieval via Wirtinger flow: Theory and algorithms. IEEE Transactions on Information Theory, 61(4):1985–2007, 2015.
- Solving random quadratic systems of equations is nearly as easy as solving linear systems. Communications on Pure and Applied Mathematics, 70(5):822–883, 2017.
- Gradient descent with random initialization: Fast global convergence for nonconvex phase retrieval. Mathematical Programming, 176(1):5–37, 2019.
- Kaczmarz method for solving quadratic equations. IEEE Signal Processing Letters, 23(9):1183–1187, 2016.
- Nonconvex optimization meets low-rank matrix factorization: An overview. IEEE Transactions on Signal Processing, 67(20):5239–5269, 2019.
- An algebraic characterization of injectivity in phase retrieval. Applied and Computational Harmonic Analysis, 38(2):346–356, 2015.
- Phase retrieval from very few measurements. Linear Algebra and its Applications, 449:475–499, 2014.
- Simon Foucart. Hard thresholding pursuit: An algorithm for compressive sensing. SIAM Journal on Numerical Analysis, 49(6):2543–2563, 2011.
- An invitation to compressive sensing. In A Mathematical Introduction to Compressive Sensing, pp. 1–39. 2013.
- Phaseless recovery using the Gauss-Newton method. IEEE Transactions on Signal Processing, 65(22):5885–5896, 2017.
- Phasemax: Convex phase retrieval via basis pursuit. IEEE Transactions on Information Theory, 64(4):2675–2689, 2018.
- An elementary proof of convex phase retrieval in the natural parameter space via the linear program phasemax. Communications in Mathematical Sciences, 16(7):2047–2051, 2018.
- Sample-efficient algorithms for recovering structured signals from magnitude-only measurements. IEEE Transactions on Information Theory, 65(7):4434–4456, 2019.
- Toward the optimal construction of a loss function without spurious local minima for solving quadratic equations. IEEE Transactions on Information Theory, 66(5):3242–3260, 2019.
- Globally convergent Levenberg-Marquardt method for phase retrieval. IEEE Transactions on Information Theory, 65(4):2343–2359, 2018.
- Implicit regularization in nonconvex statistical estimation: Gradient descent converges linearly for phase retrieval, matrix completion, and blind deconvolution. Foundations of Computational Mathematics, 20:451–632, 2020.
- An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy, 109(10):1256–1262, 2009.
- Newton-step-based hard thresholding algorithms for sparse signal recovery. IEEE Transactions on Signal Processing, 68:6594–6606, 2020.
- Extending X-ray crystallography to allow the imaging of noncrystalline materials, cells, and single protein complexes. Annual Review of Physical Chemistry, 59(1):387–410, 2008.
- Cosamp: Iterative signal recovery from incomplete and inaccurate samples. Applied and Computational Harmonic Analysis, 26(3):301–321, 2009.
- Phase retrieval using alternating minimization. Advances in Neural Information Processing Systems, 26, 2013.
- CPRL–An extension of compressive sensing to the phase retrieval problem. Advances in Neural Information Processing Systems, 25, 2012.
- Phase retrieval with application to optical imaging: A contemporary overview. IEEE Signal Processing Magazine, 32(3):87–109, 2015.
- Mahdi Soltanolkotabi. Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization. IEEE Transactions on Information Theory, 65(4):2374–2400, 2019.
- A geometric analysis of phase retrieval. Foundations of Computational Mathematics, 18(5):1131–1198, 2018.
- Irene Waldspurger. Phase retrieval with random Gaussian sensing vectors by alternating projections. IEEE Transactions on Information Theory, 64(5):3301–3312, 2018.
- Phase recovery, MaxCut and complex semidefinite programming. Mathematical Programming, 149(1):47–81, 2015.
- Solving systems of random quadratic equations via truncated amplitude flow. IEEE Transactions on Information Theory, 64(2):773–794, 2017a.
- Sparse phase retrieval via truncated amplitude flow. IEEE Transactions on Signal Processing, 66(2):479–491, 2017b.
- Phase retrieval for sparse signals. Applied and Computational Harmonic Analysis, 37(3):531–544, 2014.
- Ke Wei. Solving systems of phaseless equations via Kaczmarz methods: A proof of concept study. Inverse Problems, 31(12):125008, 2015.
- A nonconvex approach for phase retrieval: Reshaped wirtinger flow and incremental algorithms. Journal of Machine Learning Research, 18, 2017.
- Compressive phase retrieval via reweighted amplitude flow. IEEE Transactions on Signal Processing, 66(19):5029–5040, 2018.
- Global and quadratic convergence of Newton hard-thresholding pursuit. The Journal of Machine Learning Research, 22(1):599–643, 2021.