Powerful Lossy Compression for Noisy Images (2403.14135v2)
Abstract: Image compression and denoising represent fundamental challenges in image processing with many real-world applications. To address practical demands, current solutions can be categorized into two main strategies: 1) sequential method; and 2) joint method. However, sequential methods have the disadvantage of error accumulation as there is information loss between multiple individual models. Recently, the academic community began to make some attempts to tackle this problem through end-to-end joint methods. Most of them ignore that different regions of noisy images have different characteristics. To solve these problems, in this paper, our proposed signal-to-noise ratio~(SNR) aware joint solution exploits local and non-local features for image compression and denoising simultaneously. We design an end-to-end trainable network, which includes the main encoder branch, the guidance branch, and the signal-to-noise ratio~(SNR) aware branch. We conducted extensive experiments on both synthetic and real-world datasets, demonstrating that our joint solution outperforms existing state-of-the-art methods.
- “Checkerboard context model for efficient learned image compression,” in CVPR, 2021.
- “Entroformer: A transformer-based entropy model for learned image compression,” in ICLR, 2022.
- “Unified multivariate gaussian mixture for efficient neural image compression,” in CVPR, 2022.
- “Lossy compression of noisy images,” TIP, vol. 7, no. 12, pp. 1641–1652, 1998.
- “Lossy compression of noisy images based on visual quality: a comprehensive study,” EURASIP Journal on Advances in Signal Processing, vol. 2010, pp. 1–13, 2010.
- “Towards image denoising in the latent space of learning-based compression,” in Applications of Digital Image Processing XLIV, 2021.
- “Optimizing image compression via joint learning with denoising,” in ECCV, 2022.
- “Narv: An efficient noise-adaptive resnet vae for joint image compression and denoising,” in ICMEW, 2023.
- “Vsnr: A wavelet-based visual signal-to-noise ratio for natural images,” TIP, vol. 16, no. 9, pp. 2284–2298, 2007.
- “End-to-end optimized image compression,” in ICLR, 2017.
- “Variational image compression with a scale hyperprior,” in ICLR, 2018.
- “Lossy image compression with compressive autoencoders,” ICLR, 2017.
- “Autoencoder based image compression: Can the learning be quantization independent?,” in ICASSP, 2018.
- “Learned image compression with discretized gaussian mixture likelihoods and attention modules,” in CVPR, 2020.
- “Channel-wise autoregressive entropy models for learned image compression,” in ICIP, 2020.
- Antonin Chambolle, “An algorithm for total variation minimization and applications,” Journal of Mathematical imaging and vision, vol. 20, pp. 89–97, 2004.
- “A non-local algorithm for image denoising,” in CVPR, 2005.
- “Weighted nuclear norm minimization with application to image denoising,” in CVPR, 2014.
- “Toward convolutional blind denoising of real photographs,” in CVPR, 2019.
- “Transfer learning from synthetic to real-noise denoising with adaptive instance normalization,” in CVPR, 2020.
- “Dynamic slimmable denoising network,” TIP, vol. 32, pp. 1583–1598, 2023.
- “Masked image training for generalizable deep image denoising,” in CVPR, 2023.
- “Joint demosaicking and denoising by fine-tuning of bursts of raw images,” in ICCV, 2019.
- “End-to-end learning for joint image demosaicing, denoising and super-resolution,” in CVPR, 2021.
- “Joint image compression and denoising via latent-space scalability,” Frontiers in Signal Processing, vol. 2, pp. 932873, 2022.
- “Joint autoregressive and hierarchical priors for learned image compression,” in NeurIPS, 2018.
- Jarek Duda, “Asymmetric numeral systems: Entropy coding combining speed of huffman coding with compression rate of arithmetic coding,” arXiv preprint arXiv:1311.2540, 2013.
- “Attention is all you need,” in NeurIPS, 2017.
- “A unified end-to-end framework for efficient deep image compression,” arXiv preprint arXiv:2002.03370, 2020.
- “Workshop and challenge on learned image compression,” 2021.
- Eastman Kodak Company, “Kodak lossless true color image suite,” 1999.
- “A high-quality denoising dataset for smartphone cameras,” in CVPR, 2018.
- “Adaptive consistency prior based deep network for image denoising,” in CVPR, 2021.
- “Burst denoising with kernel prediction networks,” in CVPR, 2018.
- “Pytorch: An imperative style, high-performance deep learning library,” in NeurIPS, 2019.
- “Compressai: a pytorch library and evaluation platform for end-to-end compression research,” arXiv preprint arXiv:2011.03029, 2020.
- “Adam: A method for stochastic optimization,” in ICLR, 2015.
- “Enhanced invertible encoding for learned image compression,” in ACM MM, 2021.
- Joint Video Experts Team (JVET), “Vvc official test model vtm,” Accessed on April 5, 2021.
- Fabrice Bellard, “Bpg image format,” 2015.
- Shilv Cai (5 papers)
- Xiaoguo Liang (1 paper)
- Shuning Cao (4 papers)
- Luxin Yan (33 papers)
- Sheng Zhong (57 papers)
- Liqun Chen (42 papers)
- Xu Zou (27 papers)