Subspace-Informed Matrix Completion (2405.07890v3)
Abstract: In this work, we consider the matrix completion problem, where the objective is to reconstruct a low-rank matrix from a few observed entries. A commonly employed approach involves nuclear norm minimization. For this method to succeed, the number of observed entries needs to scale at least proportional to both the rank of the ground-truth matrix and the coherence parameter. While the only prior information is oftentimes the low-rank nature of the ground-truth matrix, in various real-world scenarios, additional knowledge about the ground-truth low-rank matrix is available. For instance, in collaborative filtering, Netflix problem, and dynamic channel estimation in wireless communications, we have partial or full knowledge about the signal subspace in advance. Specifically, we are aware of some subspaces that form multiple angles with the column and row spaces of the ground-truth matrix. Leveraging this valuable information has the potential to significantly reduce the required number of observations. To this end, we introduce a multi-weight nuclear norm optimization problem that concurrently promotes the low-rank property as well the information about the available subspaces. The proposed weights are tailored to penalize each angle corresponding to each basis of the prior subspace independently. We further propose an optimal weight selection strategy by minimizing the coherence parameter of the ground-truth matrix, which is equivalent to minimizing the required number of observations. Simulation results validate the advantages of incorporating multiple weights in the completion procedure. Specifically, our proposed multi-weight optimization problem demonstrates a substantial reduction in the required number of observations compared to the state-of-the-art methods.
- E. J. Candès and B. Recht, “Exact matrix completion via convex optimization,” Foundations of Computational mathematics, vol. 9, no. 6, p. 717, 2009.
- B. Recht, “A simpler approach to matrix completion.,” Journal of Machine Learning Research, vol. 12, no. 12, 2011.
- E. J. Candes and Y. Plan, “Matrix completion with noise,” Proceedings of the IEEE, vol. 98, no. 6, pp. 925–936, 2010.
- B. Recht, M. Fazel, and P. A. Parrilo, “Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization,” SIAM review, vol. 52, no. 3, pp. 471–501, 2010.
- D. Gross, Y.-K. Liu, S. T. Flammia, S. Becker, and J. Eisert, “Quantum state tomography via compressed sensing,” Physical review letters, vol. 105, no. 15, p. 150401, 2010.
- J. P. Haldar and Z.-P. Liang, “Spatiotemporal imaging with partially separable functions: A matrix recovery approach,” in 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 716–719, IEEE, 2010.
- B. Zhao, J. P. Haldar, C. Brinegar, and Z.-P. Liang, “Low rank matrix recovery for real-time cardiac mri,” in 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 996–999, IEEE, 2010.
- N. Srebro and R. R. Salakhutdinov, “Collaborative filtering in a non-uniform world: Learning with the weighted trace norm,” in Advances in Neural Information Processing Systems, pp. 2056–2064, 2010.
- A. Aravkin, R. Kumar, H. Mansour, B. Recht, and F. J. Herrmann, “Fast methods for denoising matrix completion formulations, with applications to robust seismic data interpolation,” SIAM Journal on Scientific Computing, vol. 36, no. 5, pp. S237–S266, 2014.
- J. Bennett, S. Lanning, et al., “The netflix prize,” in Proceedings of KDD cup and workshop, vol. 2007, p. 35, New York, 2007.
- X. Li, J. Fang, H. Li, and P. Wang, “Millimeter wave channel estimation via exploiting joint sparse and low-rank structures,” IEEE Transactions on Wireless Communications, vol. 17, no. 2, pp. 1123–1133, 2017.
- W. Shen, L. Dai, B. Shim, S. Mumtaz, and Z. Wang, “Joint CSIT acquisition based on low-rank matrix completion for FDD massive MIMO systems,” IEEE Communications Letters, vol. 19, no. 12, pp. 2178–2181, 2015.
- S. T. Valduga, “Transceiver design for massive MIMO systems: approaches based on matrix completion, beam selection and random pilots,” 2018.
- A. M.-C. So and Y. Ye, “Theory of semidefinite programming for sensor network localization,” Mathematical Programming, vol. 109, no. 2-3, pp. 367–384, 2007.
- S. Daei, A. Amini, and F. Haddadi, “Optimal weighted low-rank matrix recovery with subspace prior information,” arXiv preprint arXiv:1809.10356, 2018.
- A. Eftekhari, D. Yang, and M. B. Wakin, “Weighted matrix completion and recovery with prior subspace information,” IEEE Transactions on Information Theory, vol. 64, no. 6, pp. 4044–4071, 2018.
- N. Rao, H.-F. Yu, P. Ravikumar, and I. S. Dhillon, “Collaborative filtering with graph information: Consistency and scalable methods.,” in NIPS, vol. 2, p. 7, Citeseer, 2015.
- T. Zhou, H. Shan, A. Banerjee, and G. Sapiro, “Kernelized probabilistic matrix factorization: Exploiting graphs and side information,” in Proceedings of the 2012 SIAM international Conference on Data mining, pp. 403–414, SIAM, 2012.
- R. Angst, C. Zach, and M. Pollefeys, “The generalized trace-norm and its application to structure-from-motion problems,” in 2011 International Conference on Computer Vision, pp. 2502–2509, IEEE, 2011.
- P. Jain and I. S. Dhillon, “Provable inductive matrix completion,” arXiv preprint arXiv:1306.0626, 2013.
- M. Xu, R. Jin, and Z.-H. Zhou, “Speedup matrix completion with side information: Application to multi-label learning,” in Advances in neural information processing systems, pp. 2301–2309, 2013.
- K. Mohan and M. Fazel, “Reweighted nuclear norm minimization with application to system identification,” in Proceedings of the 2010 American Control Conference, pp. 2953–2959, IEEE, 2010.
- H. S. F. Ardakani, S. Daei, and F. Haddadi, “Multi-weight nuclear norm minimization for low-rank matrix recovery in presence of subspace prior information,” IEEE Transactions on Signal Processing, vol. 70, pp. 3000–3010, 2022.
- H. Fathi, E. Rangriz, and V. Pourahmadi, “Two novel algorithms for low-rank matrix completion problem,” IEEE Signal Processing Letters, vol. 28, pp. 892–896, 2021.
- H. Ardakani, S. Fazael, S. Daei, and F. Haddadi, “A greedy algorithm for matrix recovery with subspace prior information,” arXiv preprint arXiv:1907.11868, 2019.
- S. Daei, G. Fodor, M. Skoglund, and M. Telek, “Towards optimal pilot spacing and power control in multi-antenna systems operating over non-stationary rician aging channels,” arXiv preprint arXiv:2401.13368, 2024.
- Y. Chen, S. Bhojanapalli, S. Sanghavi, and R. Ward, “Completing any low-rank matrix, provably,” The Journal of Machine Learning Research, vol. 16, no. 1, pp. 2999–3034, 2015.
- S. Foucart and H. Rauhut, “A mathematical introduction to compressive sensing,” Bull. Am. Math, vol. 54, pp. 151–165, 2017.