Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Novel Truncated Norm Regularization Method for Multi-channel Color Image Denoising (2307.07932v2)

Published 16 Jul 2023 in eess.IV and cs.LG

Abstract: Due to the high flexibility and remarkable performance, low-rank approximation methods has been widely studied for color image denoising. However, those methods mostly ignore either the cross-channel difference or the spatial variation of noise, which limits their capacity in real world color image denoising. To overcome those drawbacks, this paper is proposed to denoise color images with a double-weighted truncated nuclear norm minus truncated Frobenius norm minimization (DtNFM) method. Through exploiting the nonlocal self-similarity of the noisy image, the similar structures are gathered and a series of similar patch matrices are constructed. For each group, the DtNFM model is conducted for estimating its denoised version. The denoised image would be obtained by concatenating all the denoised patch matrices. The proposed DtNFM model has two merits. First, it models and utilizes both the cross-channel difference and the spatial variation of noise. This provides sufficient flexibility for handling the complex distribution of noise in real world images. Second, the proposed DtNFM model provides a close approximation to the underlying clean matrix since it can treat different rank components flexibly. To solve the problem resulted from DtNFM model, an accurate and effective algorithm is proposed by exploiting the framework of the alternating direction method of multipliers (ADMM). The generated subproblems are discussed in detail. And their global optima can be easily obtained in closed-form. Rigorous mathematical derivation proves that the solution sequences generated by the algorithm converge to a single critical point. Extensive experiments on synthetic and real noise datasets demonstrate that the proposed method outperforms many state-of-the-art color image denoising methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. S. Minaee, Y. Boykov, F. Porikli, A. Plaza, N. Kehtarnavaz, and D. Terzopoulos, “Image segmentation using deep learning: A survey,” IEEE Trans. Pattern Anal. and Mach. Intell., vol. 44, no. 7, pp. 3523–3542, Jul. 2022.
  2. H. Sheng, R. Cong, D. Yang, R. Chen, S. Wang, and Z. Cui, “Urbanlf: A comprehensive light field dataset for semantic segmentation of urban scenes,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 11, pp. 7880–7893, Nov. 2022.
  3. X. Wang, D. Peng, M. Yan, and P. Hu, “Correspondence-free domain alignment for unsupervised cross-domain image retrieval,” in Proc. AAAI Conf. Artif. Intell., 2023, pp. 10 200–10 208.
  4. X. Wang, D. Peng, P. Hu, Y. Gong, and Y. Chen, “Cross-domain alignment for zero-shot sketch-based image retrieval,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 11, pp. 7024–7035, Nov. 2023.
  5. D.-Y. Chen, C.-C. Chen, and L.-W. Kang, “Visual depth guided color image rain streaks removal using sparse coding,” IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 8, pp. 1430–1455, Aug. 2014.
  6. L. Liu, C. L. P. Chen, X. You, Y. Y. Tang, Y. Zhang, and S. Li, “Mixed noise removal via robust constrained sparse representation,” IEEE Trans. Circuits Syst. Video Technol., vol. 28, no. 9, pp. 2177–2189, Sep. 2018.
  7. L. Sha, D. Schonfeld, and J. Wang, “Graph laplacian regularization with sparse coding for image restoration and representation,” IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 7, pp. 2000–2014, Jul. 2020.
  8. H. Liu, J. Zhang, and R. Xiong, “Cas: Correlation adaptive sparse modeling for image denoising,” IEEE Trans. Comput. Imag., vol. 7, pp. 638–647, May 2021.
  9. B. Jiang, Y. Lu, B. Zhang, and G. Lu, “Few-shot learning for image denoising,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 9, pp. 4741–4753, Sep. 2023.
  10. K. Zhang, W. Zuo, and L. Zhang, “FFDNet: Toward a fast and flexible solution for cnn-based image denoising,” IEEE Trans. Image Process., vol. 27, no. 9, pp. 4608–4622, Sep. 2018.
  11. K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang, “Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising,” IEEE Trans. Image Process., vol. 26, no. 7, pp. 3142–3155, Jul. 2017.
  12. K. Zhang, Y. Li, W. Zuo, L. Zhang, L. Van Gool, and R. Timofte, “Plug-and-play image restoration with deep denoiser prior,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 10, pp. 6360–6376, Oct. 2021.
  13. C. Ren, X. He, C. Wang, and Z. Zhao, “Adaptive consistency prior based deep network for image denoising,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., June 2021, pp. 8596–8606.
  14. W. Xu, Q. Zhu, N. Qi, and D. Chen, “Deep sparse representation based image restoration with denoising prior,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 10, pp. 6530–6542, Apr. 2022.
  15. X. Zhang, J. Zheng, D. Wang, and L. Zhao, “Exemplar-based denoising: A unified low-rank recovery framework,” IEEE Trans. Circuits Syst. Video Technol., vol. 30, pp. 2538–2549, Aug. 2020.
  16. T. Xu, X. Kong, Q. Shen, Y. Chen, and Y. Zhou, “Deep and low-rank quaternion priors for color image processing,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 7, pp. 3119–3132, Jul. 2023.
  17. H. Wang, Y. Li, Y. Cen, and Z. He, “Multi-matrices low-rank decomposition with structural smoothness for image denoising,” IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 2, pp. 349–361, Feb. 2020.
  18. M. Xie, X. Liu, and X. Yang, “Novel hybrid low-rank tensor approximation for hyperspectral image mixed denoising based on global-guided-nonlocal prior mechanism,” IEEE Trans. Geosci. Remote Sens., vol. 60, pp. 1–17, Oct. 2022.
  19. J. Xu, L. Zhang, D. Zhang, and X. Feng, “Multi-channel weighted nuclear norm minimization for real color image denoising,” in Proc. IEEE Int. Conf. Comput. Vis., 2017, pp. 1105–1113.
  20. X. Huang, B. Du, and W. Liu, “Multichannel color image denoising via weighted schatten p-norm minimization,” in Proc. Int. Joint Conf. Artif. Intell., 2020, pp. 637–644.
  21. Y. Shan, D. Hu, Z. Wang, and T. Jia, “Multi-channel nuclear norm minus frobenius norm minimization for color image denoising,” Signal Process., vol. 207, p. 108959, Jun. 2023.
  22. A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for image denoising,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 60–65.
  23. S. Wang, L. Zhang, and Y. Liang, “Nonlocal spectral prior model for low-level vision,” in Proc. Asi. Conf. Comput. Vis., 2012, p. 231–244.
  24. E.-J. Candès and B. Recht, “Exact matrix completion via convex optimization,” Found. Comut. Math., vol. 9, no. 6, pp. 717–772, Apr. 2009.
  25. D. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289–1306, Apr. 2006.
  26. M. Fazel, H. Hindi, and S. Boyd, “A rank minimization heuristic with application to minimum order system approximation,” in Proc. American Control Conf., 2001, pp. 4734–4739.
  27. J. Cai, E.-J. Candès, and Z. Shen, “A singular value thresholding algorithm for matrix completion,” SIAM J. Optim., vol. 20, no. 4, pp. 1956–1982, Mar. 2010.
  28. S. Ma, D. Goldfarb, and L. Chen, “Fixed point and bregman iterative methods for matrix rank minimization,” Mathematical Programming, vol. 128, pp. 321–353, Sep. 2011.
  29. K. Toh and S. Yun, “An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems,” Pac. J. Optim., vol. 6, no. 615-640, p. 15, Mar. 2010.
  30. S. Gu, Q. Xie, D. Meng, W. Zuo, X. Feng, and L. Zhang, “Weighted nuclear norm minimization and its applications to low level vision,” Int. J. Comput. Vis., vol. 121, p. 183–208, Jul. 2017.
  31. S. Gu, L. Zhang, W. Zuo, and X. Feng, “Weighted nuclear norm minimization with application to image denoising,” in Proc. IEEE Int. Conf. Comput. Vis., 2014, pp. 2862–2869.
  32. Y. Chen, X. Xiao, and Y. Zhou, “Low-rank quaternion approximation for color image processing,” IEEE Trans. Image Process., vol. 29, pp. 1426–1439, Sep. 2020.
  33. T.-H. Oh, Y.-W. Tai, J.-C. Bazin, H. Kim, and I. Kweon, “Partial sum minimization of singular values in robust pca: Algorithm and applications,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 4, pp. 744–758, Apr. 2016.
  34. Y. Wang, Q. Yao, and J. Kwok, “A scalable, adaptive and sound nonconvex regularizer for low-rank matrix learning,” in Proc. Int. World Wide Web Conf., 2021, p. 1798–1808.
  35. Z. Wang, Y. Liu, X. Luo, J. Wang, C. Gao, D. Peng, and W. Chen, “Large-scale affine matrix rank minimization with a novel nonconvex regularizer,” IEEE Trans. Neural Netw. Learn. Syst., vol. 33, no. 9, pp. 4661–4675, Sep. 2022.
  36. Z. Wang, W. Wang, J. Wang, and S. Chen, “Fast and efficient algorithm for matrix completion via closed-form 2/3-thresholding operator,” Neurocomputing, vol. 330, pp. 212–222, Feb. 2019.
  37. Z. Wang, D. Hu, X. Luo, W. Wang, J. Wang, and W. Chen, “Performance guarantees of transformed schatten-1 regularization for exact low-rank matrix recovery,” Int. J. Mach. Learn. Cybern., vol. 12, pp. 3379–3395, Jun. 2021.
  38. Z. Wang, C. Gao, X. Luo, M. Tang, J. Wang, and W. Chen, “Accelerated inexact matrix completion algorithm via closed-form q-thresholding (q=1/2,2/3)𝑞1223(q=1/2,2/3)( italic_q = 1 / 2 , 2 / 3 ) operator,” Int. J. Mach. Learn. Cybern., vol. 11, pp. 2327–2339, Apr. 2020.
  39. Y. Xie, S. Gu, Y. Liu, W. Zuo, W. Zhang, and L. Zhang, “Weighted schatten p𝑝pitalic_p-norm minimization for image denoising and background subtraction,” IEEE Trans. Image Process., vol. 25, no. 10, pp. 4842–4857, Oct. 2016.
  40. W. Zuo, D. Meng, L. Zhang, X. Feng, and D. Zhang, “A generalized iterated shrinkage algorithm for non-convex sparse coding,” in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 217–224.
  41. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space,” in Proc. IEEE Int. Conf. Image Process., vol. 1, 2007, pp. I – 313–I – 316.
  42. Y. Yu, Y. Zhang, and S. Yuan, “Quaternion-based weighted nuclear norm minimization for color image denoising,” Neurocomputing, vol. 332, pp. 283–297, Mar. 2019.
  43. T. Ma, Y. Lou, and T. Huang, “Truncated ℓ1−2subscriptℓ12\ell_{1-2}roman_ℓ start_POSTSUBSCRIPT 1 - 2 end_POSTSUBSCRIPT models for sparse recovery and rank minimization,” SIAM Journal on Imaging Sciences, vol. 10, no. 3, pp. 1346–1380, Aug. 2017.
  44. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171–184, Apr. 2013.
  45. T. Liu, D. Hu, Z. Wang, J. Gou, and W. Chen, “Hyperspectral image denoising using nonconvex fraction function,” IEEE Geosci. Remote Sens. Lett., vol. 20, p. Article 5508105, 2023.
  46. Z. Liu, D. Hu, Z. Wang, J. Gou, and T. Jia, “Latlrr for subspace clustering via reweighted frobenius norm minimization,” Expert Syst. Appl., vol. 224, p. 119977, Aug. 2023.
  47. M. Xie, X. Liu, X. Yang, and W. Cai, “Multichannel image completion with mixture noise: Adaptive sparse low-rank tensor subspace meets nonlocal self-similarity,” IEEE Trans. Cybern., vol. 53, no. 12, pp. 7521–7534, May 2023.
  48. M. Xie, X. Liu, and X. Yang, “A nonlocal self-similarity-based weighted tensor low-rank decomposition for multichannel image completion with mixture noise,” IEEE Trans. Neural Netw. Learn. Syst., vol. 35, no. 1, pp. 73–87, May 2022.
  49. J.-B. Hiriart-Urruty, “Generalized differentiability / duality and optimization for problems dealing with differences of convex functions,” in Proc. Convexity and Duality in Optimization, 1985, pp. 37–70.
  50. B. Leung, G. Jeon, and E. Dubois, “Least-squares luma–chroma demultiplexing algorithm for bayer demosaicking,” IEEE Trans. Image Process., vol. 20, no. 7, pp. 1885–1894, Jul. 2011.
  51. G. Chen, F. Zhu, and P. Heng, “An efficient statistical method for image noise level estimation,” in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 477–485.
  52. S. W. Zamir, A. Arora, S. Khan, M. Hayat, F. S. Khan, and M. Yang, “Restormer: Efficient transformer for high-resolution image restoration,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2022, pp. 5718–5729.
  53. W. He, Q. Yao, C. Li, N. Yokoya, Q. Zhao, H. Zhang, and L. Zhang, “Non-local meets global: An iterative paradigm for hyperspectral image restoration,” IEEE Trans. Pattern Anal. and Mach. Intell., vol. 44, no. 4, pp. 2089–2107, 2022.
  54. S. Nam, Y. Hwang, Y. Matsushita, and S. J. Kim, “A holistic approach to cross-channel image noise modeling and its application to image denoising,” in Proc. IEEE Int. Conf. Comput. Vis., 2016, pp. 1683–1691.
  55. Z. Wang, X. Cun, J. Bao, W. Zhou, J. Liu, and H. Li, “Uformer: A general u-shaped transformer for image restoration,” in Proc. IEEE Int. Conf. Comput. Vis., 2022, pp. 17 662–17 672.
  56. C. Tian, Y. Xu, W. Zuo, B. Du, C.-W. Lin, and D. Zhang, “Designing and training of a dual cnn for image denoising,” Knowl. Based Syst., vol. 226, p. 106949, Aug. 2021.
  57. M. Chang, Q. Li, H. Feng, and Z. Xu, “Spatial-adaptive network for single image denoising,” in Eur. Conf. Comput. Vis., 2020, pp. 171–187.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Yiwen Shan (2 papers)
  2. Dong Hu (13 papers)
  3. Zhi Wang (261 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now