Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Restoration of the JPEG Maximum Lossy Compressed Face Images with Hourglass Block based on Early Stopping Discriminator (2306.12757v1)

Published 22 Jun 2023 in eess.IV and cs.CV

Abstract: When a JPEG image is compressed using the loss compression method with a high compression rate, a blocking phenomenon can occur in the image, making it necessary to restore the image to its original quality. In particular, restoring compressed images that are unrecognizable presents an innovative challenge. Therefore, this paper aims to address the restoration of JPEG images that have suffered significant loss due to maximum compression using a GAN-based net-work method. The generator in this network is based on the U-Net architecture and features a newly presented hourglass structure that can preserve the charac-teristics of deep layers. Additionally, the network incorporates two loss functions, LF Loss and HF Loss, to generate natural and high-performance images. HF Loss uses a pretrained VGG-16 network and is configured using a specific layer that best represents features, which can enhance performance for the high-frequency region. LF Loss, on the other hand, is used to handle the low-frequency region. These two loss functions facilitate the generation of images by the generator that can deceive the discriminator while accurately generating both high and low-frequency regions. The results show that the blocking phe-nomenon in lost compressed images was removed, and recognizable identities were generated. This study represents a significant improvement over previous research in terms of image restoration performance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (26)
  1. Quality Analysis of the Conversion According to the Compression Rate from the PNG Image to the JPEG Image. In Proceedings of the Korean Institute of Information Technology (KIIT), pages 109-111, 2021.
  2. Restoration of JPEG Loss Compressed Image based on Pix2Pix: A Preliminary Study. In Proceedings of the Korean Institute of Information Technology (KIIT), pages 53-53, 2022.
  3. Learning better lossless compression using lossy compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 6638-6647, 2020.
  4. Flexible Lossy Compression for Selective Encrypted Image With Image Inpainting. IEEE Transactions on Circuits and Systems for Video Technology, 29, 11, pages 3341-3355, 2019.
  5. On Perceptual Lossy Compression: The Cost of Perceptual Reconstruction and An Optimal Training Framework. arXiv preprint arXiv:2106.02782, pages 1-16, 2021.
  6. Effect on Reconstruction of Images by Applying Fractal Based Lossy Compression Followed by Symmetrical Encryption Techniques. In Proceedings of the International Conference on Computing, Communication and Networking Technologies (ICCCNT), pages 1-7, 2020.
  7. Very Deep Convolutional Networks for Large-Scale Image Recognition. In Proceedings of the International Conference on Learning Representations (ICLR), pages 1-14, 2015.
  8. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, 27, pages 2672-2680, 2014.
  9. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pages 1125-113.
  10. Conditional Generative Adversarial Nets. arXiv preprint arXiv:1411.1784 v1, pages 1-7, 2014.
  11. Progressive Growing of GANs for Improved Quality, Stability, and Variation. In Proceedings of the Conference on Learning Representations (ICLR), pages 1-26, 2018.
  12. A Style-Based Generator Architecture for Generative Adversarial Networks. In Proceedings of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages 4401-4410, 2019.
  13. Arbitrary Style Transfer in Real-Time With Adaptive Instance Normalization. In Proceedings of the IEEE International Conf. on Computer Vision (ICCV), pages 1501-1510, 2017.
  14. Analyzing and Improving the Image Quality of StyleGAN. In Proceedings of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages 8110-8119, 2020.
  15. Training Generative Adversarial Networks with Limited Data. arXiv preprint arXiv:2006.06676 v2, pages 1-37, 2020.
  16. Deformable GANs for Pose-Based Human Image Generation. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 3408-3416, 2018.
  17. Traffic Accident Detection in First-Person Videos based on Depth and Background Motion Estimation. Journal of Korean Institute of Information Technology (JKIIT), 19, 3, pages 25-34, 2021.
  18. Algorithm Development of Cloud Removal from Solar Images Based on Pix2Pix Network. CMC-COMPUTERS MATERIALS & CONTINUA (CMC), 71, 2, pages 3497-3512, 2022.
  19. Image Super-Resolution Using Deep Convolutional Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2, pages 295-307, 2016.
  20. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conf. on computer vision and pattern recognition (CVPR), pages 1874-1883, 2016.
  21. Accurate image super-resolution using very deep convolutional networks. In Proceedings of the IEEE conf. on computer vision and pattern recognition (CVPR), pages 1646-1654, 2016.
  22. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conf. on computer vision and pattern recognition (CVPR), pages 4681-4690, 2017.
  23. Precomputed real-time texture synthesis with markovian generative adversarial networks. In Proceedings of the European Conf. on Computer Vision (ECCV), pages 702-716, 2016.
  24. Image Quality Metrics: PSNR vs. SSIM. In Proceedings of the International Conf. on Pattern Recognition (ICPR), pages 2366-2369, 2010.
  25. Image information and visual quality. IEEE Transactions on Image Processing, 15, 2, pages 430-444, 2006.
  26. waifu2x, Available online: http://waifu2x.udp.jp/index.ko.html (accessed on 7 Jun 2023)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now