Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 86 tok/s
Gemini 2.5 Pro 53 tok/s Pro
GPT-5 Medium 19 tok/s Pro
GPT-5 High 25 tok/s Pro
GPT-4o 84 tok/s Pro
Kimi K2 129 tok/s Pro
GPT OSS 120B 430 tok/s Pro
Claude Sonnet 4 37 tok/s Pro
2000 character limit reached

Deepfake Detection and the Impact of Limited Computing Capabilities (2402.14825v1)

Published 8 Feb 2024 in cs.CV, cs.LG, and eess.IV

Abstract: The rapid development of technologies and artificial intelligence makes deepfakes an increasingly sophisticated and challenging-to-identify technique. To ensure the accuracy of information and control misinformation and mass manipulation, it is of paramount importance to discover and develop artificial intelligence models that enable the generic detection of forged videos. This work aims to address the detection of deepfakes across various existing datasets in a scenario with limited computing resources. The goal is to analyze the applicability of different deep learning techniques under these restrictions and explore possible approaches to enhance their efficiency.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Analysis survey on deepfake detection and recognition with convolutional neural networks. In 2022 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pages 1–7, 2022. doi: 10.1109/HORA55278.2022.9799858.
  2. Vivit: A video vision transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 6836–6846, October 2021.
  3. Fake generated painting detection via frequency analysis. In 2020 IEEE International Conference on Image Processing (ICIP), pages 1256–1260, 2020. doi: 10.1109/ICIP40778.2020.9190892.
  4. The mever deepfake detection service: Lessons learnt from developing and deploying in the wild. In Proceedings of the 1st International Workshop on Multimedia AI against Disinformation, MAD ’22, page 59–68, New York, NY, USA, 2022. Association for Computing Machinery. ISBN 9781450392426. doi: 10.1145/3512732.3533587.
  5. A comparative analysis of fake image detection in generative adversarial networks and variational autoencoders. In 2023 International Conference on Decision Aid Sciences and Applications (DASA), pages 223–230, 2023. doi: 10.1109/DASA59624.2023.10286604.
  6. Detecting deepfake videos based on spatiotemporal attention and convolutional LSTM. Information Sciences, 601:58–70, jul 2022.
  7. The deepfake detection challenge (dfdc) dataset, 2020.
  8. Deep learning. MIT press, 2016.
  9. D. Güera and E. J. Delp. Deepfake video detection using recurrent neural networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pages 1–6, 2018. doi: 10.1109/AVSS.2018.8639163.
  10. Deepfakes detection based on heart rate estimation: Single- and multi-frame. In Handbook of Digital Face Manipulation and Detection, pages 255–273. Springer International Publishing, 2022. doi: 10.1007/978-3-030-87664-7_12.
  11. J. J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. In Feynman and Computation, pages 7–19. CRC Press, 2002. doi: 10.1201/9780429500459-2.
  12. Exposing gan-generated faces using inconsistent corneal specular highlights, 2020.
  13. Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2886–2895, 2020. doi: 10.1109/CVPR42600.2020.00296.
  14. Countering malicious DeepFakes: Survey, battleground, and horizon. International Journal of Computer Vision, 130(7):1678–1734, may 2022. doi: 10.1007/s11263-022-01606-8.
  15. P. Korshunov and S. Marcel. Deepfakes: a new threat to face recognition? assessment and detection, 2018.
  16. N. Kshetri. The economics of deepfakes. Computer, 56(8):89–94, 2023.
  17. Advancing high fidelity identity swapping for forgery detection. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5073–5082, 2020a. doi: 10.1109/CVPR42600.2020.00512.
  18. In ictu oculi: Exposing ai created fake videos by detecting eye blinking. In 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pages 1–7, 2018. doi: 10.1109/WIFS.2018.8630787.
  19. Celeb-df: A large-scale challenging dataset for deepfake forensics. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3204–3213, 2020b. doi: 10.1109/CVPR42600.2020.00327.
  20. I. Loshchilov and F. Hutter. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2017.
  21. Identifying emerging cyber security threats and challenges for 2030. European Union Agency for Cybersecurity (ENISA), Athens-Heraklion, Greece, 64, 2023.
  22. S. McCloskey and M. Albright. Detecting gan-generated imagery using saturation cues. In 2019 IEEE International Conference on Image Processing (ICIP), pages 4584–4588, 2019. doi: 10.1109/ICIP.2019.8803661.
  23. C. Otto. Comparing the performance of deepfake detection methods on benchmark datasets, 2020.
  24. Y. Pan and Y. Li. Toward understanding why adam converges faster than sgd for transformers. arXiv preprint arXiv:2306.00204, 2023.
  25. Faceforensics++: Learning to detect manipulated facial images. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 1–11, 2019. doi: 10.1109/ICCV.2019.00009.
  26. S. I. Serengil and A. Ozpinar. Hyperextended lightface: A facial attribute analysis framework. In 2021 International Conference on Engineering and Emerging Technologies (ICEET), pages 1–4, 2021. doi: 10.1109/ICEET53442.2021.9659697.
  27. A convolutional lstm based residual network for deepfake video detection, 2020.
  28. One detector to rule them all: Towards a general deepfake attack detection framework. In Proceedings of the Web Conference 2021, WWW ’21, page 3625–3637, New York, NY, USA, 2021. Association for Computing Machinery. ISBN 9781450383127. doi: 10.1145/3442381.3449809.
  29. A closer look at spatiotemporal convolutions for action recognition. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6450–6459, 2018. doi: 10.1109/CVPR.2018.00675.
  30. A. D. Vairamani. Analyzing DeepFakes videos by face warping artifacts. In DeepFakes, pages 35–55. CRC Press, jul 2022. doi: 10.1201/9781003231493-4.
  31. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  32. M2tr: Multi-modal multi-scale transformers for deepfake detection. In Proceedings of the 2022 International Conference on Multimedia Retrieval, ICMR ’22, page 615–623, New York, NY, USA, 2022. Association for Computing Machinery. ISBN 9781450392389. doi: 10.1145/3512527.3531415.
  33. Y. Wang and A. Dantcheva. A video is worth more than 1000 lies. comparing 3dcnn approaches for detecting deepfakes. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pages 515–519, 2020. doi: 10.1109/FG47880.2020.00089.
  34. Local attention and long-distance interaction of rPPG for deepfake detection. The Visual Computer, mar 2023. doi: 10.1007/s00371-023-02833-x.
  35. Wider face: A face detection benchmark. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5525–5533, 2016.
  36. Exposing deep fakes using inconsistent head poses. In ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8261–8265, 2019. doi: 10.1109/ICASSP.2019.8683164.
  37. Istvt: Interpretable spatial-temporal video transformer for deepfake detection. IEEE Transactions on Information Forensics and Security, 18:1335–1348, 2023. doi: 10.1109/TIFS.2023.3239223.
  38. Wilddeepfake: A challenging real-world dataset for deepfake detection. In Proceedings of the 28th ACM International Conference on Multimedia, MM ’20, page 2382–2390, New York, NY, USA, 2020. Association for Computing Machinery. ISBN 9781450379885. doi: 10.1145/3394171.3413769.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Lightbulb On Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 post and received 0 likes.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up to View