Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis (2403.18471v1)

Published 27 Mar 2024 in cs.CV

Abstract: The rapid progress in deep learning has given rise to hyper-realistic facial forgery methods, leading to concerns related to misinformation and security risks. Existing face forgery datasets have limitations in generating high-quality facial images and addressing the challenges posed by evolving generative techniques. To combat this, we present DiffusionFace, the first diffusion-based face forgery dataset, covering various forgery categories, including unconditional and Text Guide facial image generation, Img2Img, Inpaint, and Diffusion-based facial exchange algorithms. Our DiffusionFace dataset stands out with its extensive collection of 11 diffusion models and the high-quality of the generated images, providing essential metadata and a real-world internet-sourced forgery facial image dataset for evaluation. Additionally, we provide an in-depth analysis of the data and introduce practical evaluation protocols to rigorously assess discriminative models' effectiveness in detecting counterfeit facial images, aiming to enhance security in facial image authentication processes. The dataset is available for download at \url{https://github.com/Rapisurazurite/DiffFace}.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Faceswap. https://github.com/MarekKowalski/FaceSwap/.
  2. Fakeapp. https://www.fakeapp.com/, 2018.
  3. faceswap-gan. https://github.com/shaoanlu/faceswap-GAN, 2019.
  4. Parents and children: Distinguishing multimodal deepfakes from natural images. arXiv preprint arXiv:2304.00500, 2023.
  5. Cifake: Image classification and explainable identification of ai-generated synthetic images. arXiv preprint arXiv:2303.14126, 2023.
  6. End-to-end reconstruction-classification learning for face forgery detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4113–4122, 2022.
  7. Discovering transferable forensic features for cnn-generated images detection. In European Conference on Computer Vision, pages 671–689. Springer, 2022.
  8. Perception prioritized training of diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11472–11481, 2022.
  9. On the detection of digital face manipulation. In CVPR, pages 5781–5790, 2020.
  10. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780–8794, 2021.
  11. The deepfake detection challenge (dfdc) preview dataset. arXiv preprint arXiv:1910.08854, 2019.
  12. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  13. Forgerynet: A versatile benchmark for comprehensive forgery analysis. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4360–4369, 2021.
  14. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020.
  15. Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection. In CVPR, 2020.
  16. Davis E King. Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research, 10:1755–1758, 2009.
  17. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  18. Deepfakes: a new threat to face recognition? assessment and detection. arXiv preprint arXiv:1812.08685, 2018.
  19. Convolutional deep belief networks on cifar-10. Unpublished manuscript, 40(7):1–9, 2010.
  20. Celeb-df: A large-scale challenging dataset for deepfake forensics. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3207–3216, 2020.
  21. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13, pages 740–755. Springer, 2014.
  22. Pseudo numerical methods for diffusion models on manifolds. In International Conference on Learning Representations, 2022.
  23. Deep learning face attributes in the wild. In Proceedings of International Conference on Computer Vision (ICCV), 2015.
  24. Global texture enhancement for fake face detection in the wild. In CVPR, 2020.
  25. Generalizing face forgery detection with high-frequency features. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 16317–16326, 2021.
  26. Sdedit: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073, 2021.
  27. Towards universal fake image detectors that generalize across generative models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 24480–24489, 2023.
  28. Sdd-fiqa: unsupervised face image quality assessment with similarity distribution distance. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7670–7679, 2021.
  29. Deepfacelab: A simple, flexible and extensible face swapping framework. arXiv preprint arXiv:2005.05535, 2020.
  30. Thinking in frequency: Face forgery detection by mining frequency-aware clues. In ECCV, 2020.
  31. Towards the detection of diffusion model deepfakes. arXiv preprint arXiv:2210.14571, 2022.
  32. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10684–10695, 2022.
  33. Faceforensics++: Learning to detect manipulated facial images. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1–11, 2019.
  34. De-fake: Detection and attribution of fake images generated by text-to-image diffusion models. arXiv preprint arXiv:2210.06998, 2022.
  35. Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning, pages 2256–2265. PMLR, 2015.
  36. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020.
  37. An information theoretic approach for attention-driven face forgery detection. In European Conference on Computer Vision, pages 111–127. Springer, 2022a.
  38. Dual contrastive learning for general face forgery detection. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 2316–2324, 2022b.
  39. Cnn-generated images are surprisingly easy to spot… for now. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8695–8704, 2020.
  40. Dire for diffusion-generated image detection. arXiv preprint arXiv:2303.09295, 2023.
  41. Tedigan: Text-guided diverse face image generation and manipulation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  42. Exposing deep fakes using inconsistent head poses. In ICASSP, 2019.
  43. Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv:1506.03365, 2015.
  44. Multi-attentional deepfake detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2185–2194, 2021.
  45. Diffswap: High-fidelity and controllable face swapping via 3d-aware masked diffusion. CVPR, 2023.
  46. Genimage: A million-scale benchmark for detecting ai-generated image. arXiv preprint arXiv:2306.08571, 2023.
  47. Wilddeepfake: A challenging real-world dataset for deepfake detection. In Proceedings of the 28th ACM international conference on multimedia, pages 2382–2390, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Zhongxi Chen (4 papers)
  2. Ke Sun (136 papers)
  3. Ziyin Zhou (8 papers)
  4. Xianming Lin (11 papers)
  5. Xiaoshuai Sun (91 papers)
  6. Liujuan Cao (73 papers)
  7. Rongrong Ji (315 papers)
Citations (6)
View on Semantic Scholar