Papers
Topics
Authors
Recent
2000 character limit reached

A New Low-Rank Learning Robust Quaternion Tensor Completion Method for Color Video Inpainting Problem and Fast Algorithms

Published 16 Jun 2023 in cs.CV, cs.NA, and math.NA | (2306.09652v1)

Abstract: The color video inpainting problem is one of the most challenging problem in the modern imaging science. It aims to recover a color video from a small part of pixels that may contain noise. However, there are less of robust models that can simultaneously preserve the coupling of color channels and the evolution of color video frames. In this paper, we present a new robust quaternion tensor completion (RQTC) model to solve this challenging problem and derive the exact recovery theory. The main idea is to build a quaternion tensor optimization model to recover a low-rank quaternion tensor that represents the targeted color video and a sparse quaternion tensor that represents noise. This new model is very efficient to recover high dimensional data that satisfies the prior low-rank assumption. To solve the case without low-rank property, we introduce a new low-rank learning RQTC model, which rearranges similar patches classified by a quaternion learning method into smaller tensors satisfying the prior low-rank assumption. We also propose fast algorithms with global convergence guarantees. In numerical experiments, the proposed methods successfully recover color videos with eliminating color contamination and keeping the continuity of video scenery, and their solutions are of higher quality in terms of PSNR and SSIM values than the state-of-the-art algorithms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (26)
  1. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers”, Foundations and Trends® in Machine Learning, 3 (2011), pp. 1–122.
  2. J. Chen and M. Ng, “Color Image Inpainting via Robust Pure Quaternion Matrix Completion: Error Bound and Weighted Loss”, SIAM Journal on Imaging Sciences 15, 3 (2022), pp. 1469–1498.
  3. K. Fukuchi, K. Miyazato, A. Kimura, S. Takagi, and J. Yamato, “Saliency-based video segmentation with graph cuts and sequentially updated priors”, IEEE International Conference on Multimedia and Expo (2009), pp. 638–641.
  4. K. Gao and Z. Huang, “Tensor Robust Principal Component Analysis via Tensor Fibered Rank and ℓpsubscriptℓ𝑝\ell_{p}roman_ℓ start_POSTSUBSCRIPT italic_p end_POSTSUBSCRIPT Minimization”, SIAM Journal on Imaging Sciences, vol. 16, no. 1 (2023), pp. 423–460.
  5. W. R. Hamilton, “Elements of Quaternion”, Longmans, Green and Co., London (1866).
  6. B. Huang, C. Mu, D. Goldfarb, and J. Wright, “Provable low-rank tensor recovery”, Optim.-Online, vol. 4252, no. 2, (2014), Art. no. 4252.
  7. H. Huang, Y. Liu, Z. Long and C. Zhu, “Robust Low-Rank Tensor Ring Completion”, IEEE Transactions on Big Data, (2023), pp. 1–14.
  8. Z. Jia, Q. Jin, M. Ng, and X. Zhao, “Non-local robust quaternion matrix completion for large-scale color image and video Inpainting”, IEEE Transactions on Image Processing, 31 (2022), pp. 3868-3883.
  9. Z. Jia, S. Ling, and M. Zhao, “Color two-dimensional principal component analysis for face recognitionbased on quaternion model”, Lecture Notes in Computer Science, 10361 (2017), pp. 177-189.
  10. Z. Jia, M. Ng, and G. Song, “Robust quaternion matrix completion with applications to image inpainting”, Numerical Linear Algebra with Applications, 26(4) (2019), pp. e2245.
  11. T. Jiang, X. Zhao, H. Zhang and M. Ng, “Dictionary Learning With Low-Rank Coding Coefficients for Tensor Completion”, IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 2 (2023), pp. 932-946.
  12. T.  Kolda, and B.  Bader, “Tensor decompositions and applications”, SIAM Review, 51, 3 (2009), pp. 455–500.
  13. Y. Li, D. Qiu, and X. Zhang, “Robust Low Transformed Multi-Rank Tensor Completion With Deep Prior Regularization for Multi-Dimensional Image Recovery”, IEEE Transactions on Big Data, (2023), pp. 1–14.
  14. J. Liu, P. Musialski, P. Wonka, and J. Ye, “Tensor completion for estimating missing values in visual data”, ICCV (2009), pp. 2114–2121.
  15. C. Lu, J. Feng, Y. Chen, W. Liu, Z. Lin, and S. Yan, “Tensor robust principal component analysis with a new tensor nuclear norm”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 4 (2020), pp. 925–938.
  16. Y. Luo, X. Zhao, T. Jiang, Y. Chang, M. Ng and C. Li, “Self-Supervised Nonlinear Transform-Based Tensor Nuclear Norm for Multi-Dimensional Image Recovery”, IEEE Transactions on Image Processing, vol. 31 (2022), pp. 3793-3808.
  17. J. Miao, K. I. Kou, and W. Liu, “Low-rank quaternion tensor completion for recovering color videos and images”, Pattern Recognition, vol. 107 (2020), Art. no. 107505.
  18. M. Ng, X. Zhang, X. Zhao, “Patched-tube unitary transform for robust tensor completion”, Pattern Recognition, vol. 100 (2020), Art. no. 107181..
  19. G. Song, M. Ng, and X. Zhang, “Robust tensor completion using transformed tensor singular value decomposition”, Numerical Linear Algebra with Applications, 27 (3) (2020), e2299.
  20. L. Tucker, “Some mathematical notes on three-mode factor analysis”, Psychometrika, 31, 3 (1966), pp. 279–311.
  21. Z. Wang, A. Bovik, H. Sheikh and E. Simoncelli, “Image quality assessment: from error visibility to structural similarity”, IEEE Transactions on Image Processing vol. 13, no. 4 (2004), pp. 600–612.
  22. T. Xu, X. Kong, Q. Shen, Y. Chen, and Y. Zhou, “Deep and Low-Rank Quaternion Priors for Color Image Processing”, IEEE Transactions on Circuits and Systems for Video Technology (2022), doi: 10.1109/TCSVT.2022.3233589.
  23. J. Yang, D. Zhang, A. Frangi, and J. Yang, “Two-dimensional PCA: A new approach to appearance-based face representation and recognition”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1 (2004), pp. 131-137.
  24. F. Zhang, “Quaternions and matrices of quaternions”, Linear Algebra and its Applications, 251 (1997), pp. 21–57.
  25. Z. Zhang and S. Aeron, “Exact Tensor Completion Using t-SVD”, IEEE Transactions on Signal Processing, vol. 65, no. 6 (2017), pp. 1511-1526.
  26. X. Zhao, M. Bai, D. Sun, and L. Zheng, “Robust Tensor Completion: Equivalent Surrogates, Error Bounds, and Algorithms”, SIAM Journal on Imaging Sciences, vol. 15, no. 2 (2022), pp. 625–669.
Citations (1)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.