Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Non-Consensual Synthetic Intimate Imagery: Prevalence, Attitudes, and Knowledge in 10 Countries (2402.01721v2)

Published 26 Jan 2024 in cs.CY, cs.AI, and cs.HC

Abstract: Deepfake technologies have become ubiquitous, "democratizing" the ability to manipulate photos and videos. One popular use of deepfake technology is the creation of sexually explicit content, which can then be posted and shared widely on the internet. Drawing on a survey of over 16,000 respondents in 10 different countries, this article examines attitudes and behaviors related to "deepfake pornography" as a specific form of non-consensual synthetic intimate imagery (NSII). Our study found that deepfake pornography behaviors were considered harmful by respondents, despite nascent societal awareness. Regarding the prevalence of deepfake porn victimization and perpetration, 2.2% of all respondents indicated personal victimization, and 1.8% all of respondents indicated perpetration behaviors. Respondents from countries with specific legislation still reported perpetration and victimization experiences, suggesting NSII laws are inadequate to deter perpetration. Approaches to prevent and reduce harms may include digital literacy education, as well as enforced platform policies, practices, and tools which better detect, prevent, and respond to NSII content.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (83)
  1. 2023. Remove involuntary fake pornography from Google. https://support.google.com/websearch/answer/9116649?hl=en
  2. Ali Acilar and Øystein Sæbø. 2023. Towards understanding the gender digital divide: A systematic literature review. Global knowledge, memory and communication 72, 3 (2023), 233–249.
  3. The State of Deepfakes: Landscape, Threats, and Impact. Technical Report. Deeptrace Labs.
  4. Shelby Akerley. 2020. Let’s Talk about (Fake) Sex Baby: A Deep Dive into the Distributive Harms of Deepfake Pornography. Ariz. LJ Emerging Tech. 4 (2020), i.
  5. Transdisciplinary AI observatory—retrospective analyses and future-oriented contradistinctions. Philosophies 6, 1 (2021), 6.
  6. Tomas J. Aragon. 2020. epitools: Epidemiology Tools. https://CRAN.R-project.org/package=epitools R package version 0.5-10.1.
  7. Gender differences in videoed accounts of victim blaming for revenge porn for self-taken and stealth-taken sexually explicit images and videos. (2021).
  8. Youth Law Australia. 2021. Image-Based Abuse — Youth Law Australia. https://yla.org.au/nt/topics/internet-phones-and-technology/image-based-abuse/
  9. Shannon Bond. 2023. It takes a few dollars and 8 minutes to create a deepfake. And that’s only the start. NPR (2023). https://www.npr.org/2023/03/23/1165146797/it-takes-a-few-dollars-and-8-minutes-to-create-a-deepfake-and-thats-only-the-sta
  10. Sarah Bothamley and Ruth J Tully. 2017. Understanding revenge pornography: Public perceptions of revenge pornography and victim blaming. Journal of Aggression, Conflict and Peace Research 10, 1 (2017), 1–10.
  11. Testing human ability to detect ‘deepfake’images of human faces. Journal of Cybersecurity 9, 1 (2023), tyad011.
  12. A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT. arXiv:2303.04226 [cs.AI]
  13. Chance Carter. 2022. Reflections on Revenge Porn: Illustrating Why the Legal System Should Adopt a Comprehensive Response to Nonconsensual Pornography in the US. Mont. L. Rev. 83 (2022), 293.
  14. Korea Law Translation Center. 2019. Act On Special Cases Concerning The Punishment Of Sexual Crimes. (2019). https://elaw.klri.re.kr/kor_service/lawView.do?hseq=51555&lang=ENG
  15. Bobby Chesney and Danielle Citron. 2019. Deep fakes: A looming challenge for privacy, democracy, and national security. Calif. L. Rev. 107 (2019), 1753.
  16. Danielle Keats Citron and Mary Anne Franks. 2014. Criminalizing revenge porn. Wake Forest L. Rev. 49 (2014), 345.
  17. Justin D Cochran and Stuart A Napshin. 2021. Deepfakes: awareness, concerns, and platform accountability. Cyberpsychology, Behavior, and Social Networking 24, 3 (2021), 164–172.
  18. Samantha Cole. 2018. Pornhub Is Banning AI-Generated Fake Porn Videos, Says They’re Nonconsensual. Vice (2018). https://www.vice.com/en/article/zmwvdw/pornhub-bans-deepfakes
  19. Rob Cover. 2022. Deepfake culture: the emergence of audio-video deception as an object of social anxiety and regulation. Continuum 36, 4 (2022), 609–621.
  20. Rebecca A Delfino. 2019. Pornographic deepfakes: The case for federal criminalization of revenge porn’s next tragic act. Fordham L. Rev. 88 (2019), 887.
  21. The DeepFake Detection Challenge (DFDC) Dataset. arXiv:2006.07397 [cs.CV]
  22. Suzie Dunn. 2021. Women, not politicians, are targeted most often by Deepfake videos. Centre for International Governance Innovation (2021). https://www.cigionline.org/articles/women-not-politicians-are-targeted-most-often-deepfake-videos/?s=03
  23. The relationship between sextortion during COVID-19 and pre-pandemic intimate partner violence: A large study of victimization among diverse US men and women. Victims & Offenders 18, 2 (2023), 338–355.
  24. eSafety Commissioner. n.d.. Image-Based Abuse. https://www.esafety.gov.au/key-topics/image-based-abuse
  25. Mattia Falduti and Sergio Tessaris. 2022. On the use of chatbots to report non-consensual intimate images abuses: The legal expert perspective. In Proceedings of the 2022 ACM Conference on Information Technology for Social Good. 96–102.
  26. Hany Farid. 2022. Creating, using, misusing, and detecting deep fakes. Journal of Online Trust and Safety 1, 4 (2022).
  27. Matthew Feeney. 2021. Deepfake Laws Risk Creating More Problems Than They Solve. Regulatory Transparency Project (2021). https://rtp.fedsoc.org/wp-content/uploads/Paper-Deepfake-Laws-Risk-Creating-More-Problems-Than-They-Solve.pdf
  28. The Federal” Deepfakes” Law. The Journal of Robotics, Artificial Intelligence & Law 3 (2020).
  29. Celebrity status, sex, and variation in psychopathy predicts judgements of and proclivity to generate and distribute deepfake pornography. Computers in Human Behavior 129 (2022), 107141.
  30. Victim-blaming and image-based sexual abuse. Journal of Criminology 56, 1 (2023), 7–25.
  31. Greg Freedman Ellis and Ben Schneider. 2023. srvyr: ’dplyr’-Like Syntax for Summary Statistics of Survey Data. https://CRAN.R-project.org/package=srvyr R package version 1.2.0.
  32. Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal Implications. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 103, 19 pages. https://doi.org/10.1145/3491102.3517446
  33. The Emergence of Deepfakes and its Societal Implications: A Systematic Review. TTO (2021), 28–39.
  34. Anne Pechenik Gieseke. 2020. ”The New Weapon of Choice”: Law’s Current Inability to Properly Address Deepfake Pornography. Vand. L. Rev. 73 (2020), 1479.
  35. Jeffrey Gottfried. 2019. About three-quarters of Americans favor steps to restrict altered videos and images. (2019).
  36. Deepfake detection by human crowds, machines, and machine-informed crowds. Proceedings of the National Academy of Sciences 119, 1 (2022), e2110013119.
  37. Keith Raymond Harris. 2021. Video on demand: what deepfakes do and how they harm. Synthese 199, 5-6 (2021), 13373–13391.
  38. Image-based sexual abuse: A study on the causes and consequences of non-consensual nude or sexual imagery. Routledge.
  39. Sean Hollister. 2023. Reddit’s AI porn ban has a carveout for Rule 34. https://www.theverge.com/2023/7/6/21525998/reddit-ai-porn-fictional-characters-carveout-sexual-images
  40. Tyrone Kirchengast. 2020. Deepfakes and image manipulation: criminalisation and control. Information & Communications Technology Law 29, 3 (2020), 308–323.
  41. Fooled twice: People cannot detect deepfakes but think they can. Iscience 24, 11 (2021).
  42. Pavel Korshunov and Sébastien Marcel. 2020. Deepfake detection: humans vs. machines. arXiv preprint arXiv:2009.03155 (2020).
  43. Matthew B Kugler and Carly Pace. 2021. Deepfake privacy: Attitudes and regulation. Nw. UL Rev. 116 (2021), 611.
  44. Amanda Lawson. 2023. A Look at Global Deepfake Regulation Approaches. Responsible Artificial Intelligence Institute (April 2023).
  45. Min Joo Lee. 2021. Webcam modelling in Korea: censorship, pornography, and eroticism. Porn Studies 8, 4 (2021), 485–498.
  46. Minghui Li and Yan Wan. 2023. Norms or fun? The influence of ethical concerns and perceived enjoyment on the regulation of deepfake information. Internet Research (2023).
  47. Thomas Lumley. 2023. survey: analysis of complex survey samples. R package version 4.2.
  48. Sophie Maddocks. 2020. ‘A Deepfake Porn Plot Intended to Silence Me’: exploring continuities between pornographic and ‘political’deep fakes. Porn Studies 7, 4 (2020), 415–423.
  49. Wookjae Maeng and Joonhwan Lee. 2022. Designing and evaluating a chatbot for survivors of image-based sexual abuse. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–21.
  50. Warning: Humans Cannot Reliably Detect Speech Deepfakes. arXiv preprint arXiv:2301.07829 (2023).
  51. Karolina Mania. 2020. The legal implications and remedies concerning revenge porn and fake porn: a common law perspective. Sexuality & Culture 24, 6 (2020), 2079–2097.
  52. Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied intelligence 53, 4 (2023), 3974–4026.
  53. Beyond ‘revenge porn’: The continuum of image-based sexual abuse. Feminist legal studies 25 (2017), 25–46.
  54. Joseph D. Morelle. 2023. Preventing Deepfakes of Intimate Images Act. https://www.congress.gov/bill/117th-congress/house-bill/9631/text
  55. Understanding the attitudes and motivations of adults who engage in image-based abuse. (2019).
  56. Aakash Varma Nadimpalli and Ajita Rattani. 2022. GBDF: gender balanced deepfake dataset towards fair deepfake detection. arXiv preprint arXiv:2207.10246 (2022).
  57. Sophie J Nightingale and Hany Farid. 2022. AI-synthesized faces are indistinguishable from real faces and more trustworthy. Proceedings of the National Academy of Sciences 119, 8 (2022), e2120481119.
  58. Office of the eSafety Commissioner Australia. 2023. Regulatory schemes. https://www.esafety.gov.au/about-us/who-we-are/regulatory-schemes##image-based-abuse-scheme.
  59. Carl Öhman. 2020. Introducing the pervert’s dilemma: a contribution to the critique of Deepfake Pornography. Ethics and Information Technology 22, 2 (2020), 133–140.
  60. Justin W Patchin and Sameer Hinduja. 2020. Sextortion among adolescents: Results from a national survey of US youth. Sexual Abuse 32, 1 (2020), 30–54.
  61. Anastasia Powell and Nicola Henry. 2019. Technology-facilitated sexual violence victimization: Results from an online survey of Australian adults. Journal of interpersonal violence 34, 17 (2019), 3637–3665.
  62. Image based sexual abuse: An international study of victims and perpetrators. Funded by ARC Discovery Project Grant (2020).
  63. Deepfake Videos in the Wild: Analysis and Detection. In Proceedings of the Web Conference 2021 (Ljubljana, Slovenia) (WWW ’21). Association for Computing Machinery, New York, NY, USA, 981–992. https://doi.org/10.1145/3442381.3449978
  64. R Core Team. 2023. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/
  65. Md Shohel Rana and Andrew H. Sung. 2023. Deepfake Detection: A Tutorial. In Proceedings of the 9th ACM International Workshop on Security and Privacy Analytics (Charlotte, NC, USA) (IWSPA ’23). Association for Computing Machinery, New York, NY, USA, 55–56. https://doi.org/10.1145/3579987.3586562
  66. Regina Rini and Leah Cohen. 2022. Deepfakes, deep harms. J. Ethics & Soc. Phil. 22 (2022), 143.
  67. Yanet Ruvalcaba and Asia A Eaton. 2020. Nonconsensual pornography among US adults: a sexual scripts framework on victimization, perpetration, and health correlates for women and men. Psychology of violence 10, 1 (2020), 68.
  68. Georgina Ryan-White et al. 2022. Cyberflashing and Deepfake Pornography. (2022).
  69. Paul Sandle. 2021. UK’s YouGov says demand from Silicon Valley clients holding up. Reuters (March 2021). https://www.reuters.com/business/uks-yougov-says-demand-silicon-valley-clients-holding-up-2023-03-21/
  70. Online Harassment in Majority Contexts: Examining Harms and Remedies across Countries. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  71. ” It Matches My Worldview”: Examining Perceptions and Attitudes Around Fake Videos. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–15.
  72. Protection of Victims of Deep Fake Pornography in a Legal Perspective in Indonesia. International Journal of Multicultural and Multireligious Understanding 10, 1 (2023), 383–390.
  73. A systematic literature review on the effectiveness of deepfake detection techniques. Journal of Cyber Security Technology 7, 2 (2023), 83–113.
  74. Lisa Sugiura and April Smith. 2020. Victim blaming, responsibilization and resilience in online sexual abuse and harassment. Victimology: Research, Policy and Activism (2020), 45–79.
  75. Gail M Sullivan and Anthony R Artino Jr. 2013. Analyzing and interpreting data from Likert-type scales. Journal of graduate medical education 5, 4 (2013), 541–542.
  76. Is it real? A study on detecting deepfake videos. Proceedings of the Association for Information Science and Technology 57, 1 (2020), e366.
  77. Loc Trinh and Yan Liu. 2021. An Examination of Fairness of AI Models for Deepfake Detection. arXiv:2105.00558 [cs.CV]
  78. Kate Walker and Emma Sleath. 2017. A systematic review of the current knowledge regarding revenge pornography and non-consensual sharing of sexually explicit media. Aggression and violent behavior 36 (2017), 9–24.
  79. Moncarol Y Wang. 2022. Don’t Believe Your Eyes: Fighting Deepfaked Nonconsensual Pornography with Tort Law. U. Chi. Legal F. (2022), 415.
  80. Mika Westerlund. 2019. The emergence of deepfake technology: A review. Technology innovation management review 9, 11 (2019).
  81. Limits and possibilities for “Ethical AI” in open source: A study of deepfakes. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 2035–2046.
  82. Deressa Wodajo and Solomon Atnafu. 2021. Deepfake video detection using convolutional vision transformer. arXiv preprint arXiv:2102.11126 (2021).
  83. A comprehensive analysis of ai biases in deepfake detection with massively annotated databases. arXiv preprint arXiv:2208.05845 (2022).
Citations (8)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets