Papers
Topics
Authors
Recent
Search
2000 character limit reached

Projected Gradient Descent for Spectral Compressed Sensing via Symmetric Hankel Factorization

Published 14 Mar 2024 in cs.IR | (2403.09031v2)

Abstract: Current spectral compressed sensing methods via Hankel matrix completion employ symmetric factorization to demonstrate the low-rank property of the Hankel matrix. However, previous non-convex gradient methods only utilize asymmetric factorization to achieve spectral compressed sensing. In this paper, we propose a novel nonconvex projected gradient descent method for spectral compressed sensing via symmetric factorization named Symmetric Hankel Projected Gradient Descent (SHGD), which updates only one matrix and avoids a balancing regularization term. SHGD reduces about half of the computation and storage costs compared to the prior gradient method based on asymmetric factorization. {Besides, the symmetric factorization employed in our work is completely novel to the prior low-rank factorization model, introducing a new factorization ambiguity under complex orthogonal transformation}. Novel distance metrics are designed for our factorization method and a linear convergence guarantee to the desired signal is established with $O(r2\log(n))$ observations. Numerical simulations demonstrate the superior performance of the proposed SHGD method in phase transitions and computation efficiency compared to state-of-the-art methods.

Authors (3)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. L. Potter, E. Ertin, J. Parker, and M. Cetin, “Sparsity and compressed sensing in radar imaging,” Proc. IEEE, vol. 98, no. 6, pp. 1006–1020, 2010.
  2. J. A. Tropp, J. N. Laska, M. F. Duarte, J. K. Romberg, and R. G. Baraniuk, “Beyond nyquist: Efficient sampling of sparse bandlimited signals,” IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 520–544, 2010.
  3. M. Lustig, D. Donoho, and J. M. Pauly, “Sparse MRI: The application of compressed sensing for rapid MR imaging,” Magn. Reson. Med., vol. 58, no. 6, pp. 1182–1195, 2007.
  4. J. L. Paredes, G. R. Arce, and Z. Wang, “Ultra-wideband compressed sensing: Channel estimation,” IEEE J. Sel. Top. Signal Process., vol. 1, no. 3, pp. 383–395, 2007.
  5. Y. Chen and Y. Chi, “Robust spectral compressed sensing via structured matrix completion,” IEEE Trans. Inf. Theory, vol. 60, no. 10, pp. 6576–6601, 2014.
  6. J.-F. Cai, T. Wang, and K. Wei, “Spectral compressed sensing via projected gradient descent,” SIAM J. Optim., vol. 28, no. 3, pp. 2625–2653, 2018.
  7. J.-F. Cai, T. Wang, and K. Wei, “Fast and provable algorithms for spectrally sparse signal reconstruction via low-rank hankel matrix completion,” Appl. Comput. Harmon. Anal., vol. 46, no. 1, pp. 94–121, 2019.
  8. X. Zhang, Y. Liu, and W. Cui, “Spectrally sparse signal recovery via hankel matrix completion with prior information,” IEEE Trans. Signal Process., vol. 69, pp. 2174–2187, 2021.
  9. G. Tang, B. N. Bhaskar, P. Shah, and B. Recht, “Compressed sensing off the grid,” IEEE Trans. Inf. Theory, vol. 59, no. 11, pp. 7465–7490, 2013.
  10. R. A. Horn and C. R. Johnson, Matrix Analysis. USA: Cambridge University Press, 2nd ed., 2012.
  11. R. A. Horn and D. I. Merino, “The jordan canonical forms of complex orthogonal and skew-symmetric matrices,” Linear Algebra Appl., vol. 302-303, pp. 411–421, 1999.
  12. F. T. Luk and S. Qiao, “Using complex-orthogonal transformations to diagonalize a complex symmetric matrix,” in Opt. Photon., 1997.
  13. V. D. Didenko and V. A. Chernetskii, “The riemann boundary problem with a complex orthogonal matrix,” Math. Notes Acad. Sci. USSR, vol. 23, pp. 220–227, Mar. 1978.
  14. E. Candès, J. Romberg, and T. Tao, “Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information,” IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489 – 509, 2006.
  15. D. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289 –1306, 2006.
  16. J. Shen, J.-S. Chen, H.-D. Qi, and N. Xiu, “A penalized method of alternating projections for weighted low-rank hankel matrix optimization,” Math. Program. Comput., vol. 14, no. 3, pp. 417–450, 2022.
  17. Q. Zheng and J. Lafferty, “Convergence analysis for rectangular matrix completion using Burer-Monteiro factorization and gradient descent,” arXiv:1605.07051, 2016.
  18. W. Xu and S. Qiao, “A fast symmetric SVD algorithm for square hankel matrices,” Linear Algebra Appl., vol. 428, no. 2-3, pp. 550–563, 2008.
  19. F. Andersson, M. Carlsson, and P.-A. Ivert, “A fast alternating projection method for complex frequency estimation,” arXiv:1107.2028, 2011.
  20. K. Wei, J.-F. Cai, T. F. Chan, and S. Leung, “Guarantees of riemannian optimization for low rank matrix recovery,” SIAM J. Matrix Anal. Appl., vol. 37, no. 3, pp. 1198–1222, 2016.
  21. K. Wei, J.-F. Cai, T. F. Chan, and S. Leung, “Guarantees of riemannian optimization for low rank matrix completion,” Inverse Probl. Imag., vol. 14, no. 2, pp. 233–265, 2020.
  22. X. Wu, Z. Yang, J.-F. Cai, and Z. Xu, “Spectral super-resolution on the unit circle via gradient descent,” in IEEE Int. Conf. Acoust., Speech, Signal Process., 2023.
  23. S. Mao and J. Chen, “Blind super-resolution of point sources via projected gradient descent,” IEEE Trans. Signal Process., vol. 70, pp. 4649–4664, 2022.
  24. J. Yin, S. Peng, Z. Yang, B. Chen, and Z. Lin, “Hypergraph based semi-supervised symmetric nonnegative matrix factorization for image clustering,” Pattern Recogn., vol. 137, p. 109274, May 2023.
  25. Z. He, S. Xie, R. Zdunek, G. Zhou, and A. Cichocki, “Symmetric nonnegative matrix factorization: Algorithms and applications to probabilistic clustering,” IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 2117–2131, 2011.
  26. Y. Chen and M. J. Wainwright, “Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees,” arxiv:1509.03025, 2015.
  27. P. Comon, G. Golub, L.-H. Lim, and B. Mourrain, “Symmetric tensors and symmetric tensor rank,” SIAM J. Matrix Anal. Appl, vol. 30, pp. 1254–1279, Jan. 2008.
  28. J. Brachat, P. Comon, B. Mourrain, and E. Tsigaridas, “Symmetric tensor decomposition,” Linear Algebra Appl., vol. 433, pp. 1851–1872, Dec. 2010.
  29. J. Cai, M. Baskaran, B. Meister, and R. Lethin, “Optimization of symmetric tensor computations,” in IEEE High Perform. Extreme Comput. Conf., pp. 1–7, 2015.
  30. E. J. Candès and B. Recht, “Exact matrix completion via convex optimization,” Found. Comput. Math., vol. 9, no. 6, pp. 717–772, 2009.
  31. W. Liao and A. Fannjiang, “MUSIC for single-snapshot spectral estimation: Stability and super-resolution,” Appl. Comput. Harmon. Anal., vol. 40, no. 1, pp. 33–67, 2016.
  32. Y. Cherapanamjeri, K. Gupta, and P. Jain, “Nearly optimal robust matrix completion,” in Proc. Int. Conf. Mach. Learn., pp. 797–805, 2017.
  33. P. Jain, P. Netrapalli, and S. Sanghavi, “Low-rank matrix completion using alternating minimization,” in Proc. 45th Annu. ACM symp. Theory Comput., pp. 665–674, ACM, 2013.
  34. S. Zhang, Y. Hao, M. Wang, and J. H. Chow, “Multichannel hankel matrix completion through nonconvex optimization,” IEEE J. Sel. Top. Signal Process., vol. 12, no. 4, pp. 617–632, 2018.
  35. S. Zhang and M. Wang, “Correction of corrupted columns through fast robust hankel matrix completion,” IEEE Trans. Signal Process., vol. 67, no. 10, pp. 2580–2594, 2019.
  36. A. M. Chebotarev and A. E. Teretenkov, “Singular value decomposition for the takagi factorization of symmetric matrices,” Appl. Math. Comput., vol. 234, pp. 380–384, 2014.
  37. K. D. Ikramov, “Takagi’s decomposition of a symmetric unitary matrix as a finite algorithm,” Comp. Math. Math. Phys., vol. 52, no. 1, pp. 1–3, 2012.
  38. S. Tu, R. Boczar, M. Simchowitz, M. Soltanolkotabi, and B. Recht, “Low-rank solutions of linear matrix equations via procrustes flow,” in Proc. Int. Conf. Mach. Learn., pp. 964–973, 2016.
  39. C. Ma, K. Wang, Y. Chi, and Y. Chen, “Implicit regularization in nonconvex statistical estimation: Gradient descent converges linearly for phase retrieval, matrix completion, and blind deconvolution,” Found. Comput. Math., vol. 20, no. 3, pp. 451–632, 2019.
  40. R. Vershynin, High-Dimensional Probability. Cambridge University Press, 2018.
  41. J. B. Sanson, P. M. Tome, D. Castanheira, A. Gameiro, and P. P. Monteiro, “High-resolution delay-doppler estimation using received communication signals for OFDM radar-communication system,” IEEE Trans. Veh. Technol., vol. 69, pp. 13112–13123, nov 2020.
  42. H. Nikookar and R. Prasad, “Multicarrier transmission with nonuniform carriers in a multipath channel,” in Proc. Int. Conf. Univ. Pers. Commun., IEEE, 1996.
  43. Q. Yang, Z. Wang, and Q. Huang, “An efficient non-uniform multi-tone system based on ramanujan sums,” in Proc. 2nd Joint Int. Inf. Tech. Mech. Electron. Eng. Conf., Atlantis Press, 2017.
  44. C. R. Berger, B. Demissie, J. Heckenbach, P. Willett, and S. Zhou, “Signal processing for passive radar using ofdm waveforms,” IEEE J. Sel. Top. Signal Process., vol. 4, no. 1, pp. 226–238, 2010.
  45. C. Ma, Y. Li, and Y. Chi, “Beyond procrustes: Balancing-free gradient descent for asymmetric low-rank matrix sensing,” IEEE Trans. Signal Process., vol. 69, pp. 867–877, 2021.
  46. B. Recht, “A simpler approach to matrix completion,” J. Mach. Learn. Res., vol. 12, p. 3413–3430, 2011.
  47. J. A. Tropp, “User-friendly tail bounds for sums of random matrices,” Found. Comput. Math., vol. 12, no. 4, pp. 389–434, 2012.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.