Handling The Non-Smooth Challenge in Tensor SVD: A Multi-Objective Tensor Recovery Framework (2311.13958v3)
Abstract: Recently, numerous tensor singular value decomposition (t-SVD)-based tensor recovery methods have shown promise in processing visual data, such as color images and videos. However, these methods often suffer from severe performance degradation when confronted with tensor data exhibiting non-smooth changes. It has been commonly observed in real-world scenarios but ignored by the traditional t-SVD-based methods. In this work, we introduce a novel tensor recovery model with a learnable tensor nuclear norm to address such a challenge. We develop a new optimization algorithm named the Alternating Proximal Multiplier Method (APMM) to iteratively solve the proposed tensor completion model. Theoretical analysis demonstrates the convergence of the proposed APMM to the Karush-Kuhn-Tucker (KKT) point of the optimization problem. In addition, we propose a multi-objective tensor recovery framework based on APMM to efficiently explore the correlations of tensor data across its various dimensions, providing a new perspective on extending the t-SVD-based method to higher-order tensor cases. Numerical experiments demonstrated the effectiveness of the proposed method in tensor completion.
- Self-motion-assisted tensor completion method for background initialization in complex video sequences. IEEE Transactions on Image Processing, 29:1915–1928, 2019.
- Tensor robust principal component analysis with a new tensor nuclear norm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(4):925–938, 2019.
- Novel methods for multilinear data completion and de-noising based on tensor-svd. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3842–3849, 2014.
- Low-rank tensor completion with a new tensor nuclear norm induced by invertible linear transforms. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5996–6004, 2019.
- Exact low tubal rank tensor recovery from gaussian measurements. arXiv preprint arXiv:1806.02511, 2018.
- Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery. Information Sciences, 423:376–397, 2018.
- Matrix completion with noise. Proceedings of the IEEE, 98(6):925–936, 2010.
- Exact matrix completion via convex optimization. Foundations of Computational Mmathematics, 9(6):717–772, 2009.
- Robust principal component analysis? Journal of the ACM (JACM), 58(3):1–37, 2011.
- Sparse and low-rank matrix decompositions. IFAC Proceedings Volumes, 42(10):1493–1498, 2009.
- Robust pca via outlier pursuit. IEEE Transactions on Information Theory, 58(5):3047–3064, 2012.
- Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization. In Neural Information Processing Systems, volume 58, pages 289–298, 2009.
- Frank L Hitchcock. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematics and Physics, 6(1-4):164–189, 1927.
- Frank L Hitchcock. Multiple invariants and generalized rank of a p-way matrix or tensor. Journal of Mathematics and Physics, 7(1-4):39–79, 1928.
- Tensor decompositions and applications. SIAM Review, 51(3):455–500, 2009.
- Ledyard R Tucker. Implications of factor analysis of three-way matrices for measurement of change. Problems in measuring change, 15(122-137):3, 1963.
- Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Problems, 27(2):025010, 2011.
- Tensor completion for estimating missing values in visual data. IEEE Transactions on Pattern Analysis Machine Intelligence, 35(1):208–220, 2013.
- Tensor n-tubal rank and its convex relaxation for low-rank tensor recovery. Information Sciences, 532:170–189, 2020.
- Low-rank high-order tensor completion with applications in visual data. IEEE Transactions on Image Processing, 31:2433–2448, 2022.
- Svd-based tensor-completion technique for background initialization. IEEE Transactions on Image Processing, 27(6):3114–3126, 2018.
- Handling slice permutations variability in tensor recovery. Proceedings of the AAAI Conference on Artificial Intelligence, 36(3):3499–3507, 2022.
- Tensor q-rank: new data dependent definition of tensor rank. Machine Learning, 110(7):1867–1900, 2021.
- Robust face recognition via sparse representation. IEEE transactions on pattern analysis and machine intelligence, 31(2):210–227, 2008.
- Sparse principal component analysis. Journal of computational and graphical statistics, 15(2):265–286, 2006.
- Kronecker-basis-representation based tensor sparsity and its applications to tensor recovery. IEEE transactions on pattern analysis and machine intelligence, 40(8):1888–1902, 2017.
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proceedings Eighth IEEE International Conference on Computer Vision., volume 2, pages 416–423, 2001.