Deep Image Restoration For Image Anti-Forensics (2405.02751v1)
Abstract: While image forensics is concerned with whether an image has been tampered with, image anti-forensics attempts to prevent image forensics methods from detecting tampered images. The competition between these two fields started long before the advancement of deep learning. JPEG compression, blurring and noising, which are simple methods by today's standards, have long been used for anti-forensics and have been the subject of much research in both forensics and anti-forensics. Although these traditional methods are old, they make it difficult to detect fake images and are used for data augmentation in training deep image forgery detection models. In addition to making the image difficult to detect, these methods leave traces on the image and consequently degrade the image quality. Separate image forensics methods have also been developed to detect these traces. In this study, we go one step further and improve the image quality after these methods with deep image restoration models and make it harder to detect the forged image. We evaluate the impact of these methods on image quality. We then test both our proposed methods with deep learning and methods without deep learning on the two best existing image manipulation detection models. In the obtained results, we show how existing image forgery detection models fail against the proposed methods. Code implementation will be publicly available at https://github.com/99eren99/DIRFIAF .
- Digital image forgery detection using artificial neural network and auto regressive coefficients. In 2006 Canadian Conference on Electrical and Computer Engineering, pages 194–197, 2006.
- Blind detection of photomontage using higher order statistics. In 2004 IEEE International Symposium on Circuits and Systems (ISCAS), volume 5, pages V–V, 2004.
- Mantra-net: Manipulation tracing network for detection and localization of image forgeries with anomalous features. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9535–9544, 2019.
- Improved dct coefficient analysis for forgery localization in jpeg images. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2444–2447, 2011.
- Using noise inconsistencies for blind image forensics. Image and Vision Computing, 27(10):1497–1503, 2009. Special Section: Computer Vision Methods for Ambient Intelligence.
- Image forgery localization via fine-grained analysis of cfa artifacts. IEEE Transactions on Information Forensics and Security, 7(5):1566–1577, 2012.
- Camera trace erasing. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2947–2956, 2020.
- A generative adversarial network framework for jpeg anti-forensics. In 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pages 1442–1447, 2020.
- Anti-forensics of median filtering and contrast enhancement. Journal of Visual Communication and Image Representation, 66:102682, 2020.
- Diffusion models meet image counter-forensics. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 3925–3935, January 2024.
- Wei Fan. Towards digital image anti-forensics via image restoration. Theses, Université Grenoble Alpes ; Beihang university (Pékin), April 2015.
- Fusion transformer with object mask guidance for image forgery analysis, 2024.
- Trufor: Leveraging all-round clues for trustworthy image forgery detection and localization, 2023.
- Noiseprint: A cnn-based camera model fingerprint. IEEE Transactions on Information Forensics and Security, 15:144–159, 2020.
- Exploring multi-modal fusion for image manipulation detection and localization. In Proc. 30th Int. Conf. on MultiMedia Modeling (MMM 2024), Jan.-Feb. 2024.
- A deep learning approach to universal image manipulation detection using a new convolutional layer. In Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security, IH&MMSec ’16, page 5–10, New York, NY, USA, 2016. Association for Computing Machinery.
- Rich models for steganalysis of digital images. IEEE Transactions on Information Forensics and Security, 7(3):868–882, 2012.
- Coverage — a novel database for copy-move forgery detection. 2016 IEEE International Conference on Image Processing (ICIP), pages 161–165, 2016.
- Exposing digital image forgeries by illumination color classification. IEEE Transactions on Information Forensics and Security, 8(7):1182–1194, 2013.
- Papers with Code - COVERAGE Benchmark (Image Manipulation Detection) — paperswithcode.com. https://paperswithcode.com/sota/image-manipulation-detection-on-coverage. [Accessed 02-05-2024].
- Papers with Code - DSO-1 Benchmark (Image Manipulation Detection) — paperswithcode.com. https://paperswithcode.com/sota/image-manipulation-detection-on-dso-1. [Accessed 02-05-2024].
- Towards flexible blind jpeg artifacts removal. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4997–5006, 2021.
- Restormer: Efficient transformer for high-resolution image restoration. In CVPR, 2022.
- Swinir: Image restoration using swin transformer. arXiv preprint arXiv:2108.10257, 2021.
- Swinfir: Revisiting the swinir with fast fourier convolution and improved training for image super-resolution. arXiv preprint arXiv:2208.11247, 2022.
- Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600–612, 2004.
- No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12):4695–4708, 2012.
- Deep image composition meets image forgery, 2024.
- Eren Tahir (2 papers)
- Mert Bal (2 papers)