Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
38 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards A Diffractive Analysis of Prompt-Based Generative AI (2403.01783v1)

Published 4 Mar 2024 in cs.HC

Abstract: Recent developments in prompt-based generative AI has given rise to discourse surrounding the perceived ethical concerns, economic implications, and consequences for the future of cultural production. As generative imagery becomes pervasive in mainstream society, dominated primarily by emerging industry leaders, we encourage that the role of the CHI community be one of inquiry; to investigate the numerous ways in which generative AI has the potential to, and already is, augmenting human creativity. In this paper, we conducted a diffractive analysis exploring the potential role of prompt-based interfaces in artists' creative practice. Over a two week period, seven visual artists were given access to a personalised instance of Stable Diffusion, fine-tuned on a dataset of their work. In the following diffractive analysis, we identified two dominant modes adopted by participants, AI for ideation, and AI for production. We furthermore present a number of ethical design considerations for the future development of generative AI interfaces.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize File Document Download Save Streamline Icon: https://streamlinehq.com PDF File Document Download Save Streamline Icon: https://streamlinehq.com Markdown Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (68)
  1. [n. d.]. U.S. Copyright Office, Artificial Intelligence and Copyright. https://www.federalregister.gov/documents/2023/08/30/2023-18624/artificial-intelligence-and-copyright
  2. Perceptions of the Fourth Industrial Revolution and Artificial Intelligence Impact on Society. arXiv preprint arXiv:2308.02030 (2023).
  3. AUTOMATIC1111. 2022. Stable Diffusion Web UI. https://github.com/AUTOMATIC1111/stable-diffusion-webui
  4. Andy Baio. 2022. AI Data Laundering: How Academic and Nonprofit Researchers Shield Tech Companies from Accountability. https://waxy.org/2022/09/ai-data-laundering-how-academic-and-nonprofit-researchers-shield-tech-companies-from-accountability/
  5. Karen Barad. 2003. Posthumanist performativity: Toward an understanding of how matter comes to matter. Signs: Journal of women in culture and society 28, 3 (2003), 801–831.
  6. Karen Barad. 2018. Diffracting diffraction: Cutting together-apart. In Diffracted Worlds-Diffractive Readings. Routledge, 4–23.
  7. Rosi Braidotti. 2019. Posthuman knowledge. John Wiley & Sons.
  8. The Prompt Artists. In Proceedings of the 15th Conference on Creativity and Cognition (Virtual Event, USA) (C&C ’23). Association for Computing Machinery, 75–87. https://doi.org/10.1145/3591196.3593515
  9. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 1941–1954.
  10. Suk Kyoung Choi and Steve DiPaola. 2023. AI as other: An art-as-research approach to generative AI art practice. (2023).
  11. Artist support networks: Implications for future creativity support tools. In Designing Interactive Systems Conference. 232–246.
  12. On the Machine Condition and its Creative Expression.. In ICCC. 342–349.
  13. Computational creativity: The final frontier?. In Ecai, Vol. 2012. Montpelier, 21–16.
  14. An enactive model of creativity for computational collaboration and co-creation. Creativity in the digital age (2015), 109–133.
  15. Mark d’Inverno and Jon McCormack. 2015. Heroic versus collaborative AI for the arts. (2015).
  16. Who gets credit for AI-generated art? Iscience 23, 9 (2020).
  17. Gerhard Fischer. 2004. Social Creativity: Turning Barriers into Opportunities for Collaborative Design. In Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices - Volume 1 (Toronto, Ontario, Canada) (PDC 04). Association for Computing Machinery, 152–161. https://doi.org/10.1145/1011870.1011889
  18. Joel E Fischer. 2023. Generative AI Considered Harmful. (2023).
  19. Nick J Fox and Pam Alldred. 2015. Inside the research-assemblage: New materialism and the micropolitics of social inquiry. Sociological Research Online 20, 2 (2015), 122–140.
  20. Nick J Fox and Pam Alldred. 2021. Applied Research, Diffractive Methodology, and the Research-Assemblage: Challenges and Opportunities. Sociological Research Online 0, 0 (2021), 13607804211029978. https://doi.org/10.1177/13607804211029978 arXiv:https://doi.org/10.1177/13607804211029978
  21. Nick J Fox and Pam Alldred. 2023. Applied research, diffractive methodology, and the research-assemblage: challenges and opportunities. Sociological Research Online 28, 1 (2023), 93–109.
  22. Christopher Frauenberger. 2019. Entanglement HCI: The Next Wave? ACM Transactions on Computer-Human Interaction (TOCHI) 27, 1 (2019), 1–27.
  23. Mapping the landscape of creativity support tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–18.
  24. Social Dynamics of AI Support in Creative Writing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (¡conf-loc¿, ¡city¿Hamburg¡/city¿, ¡country¿Germany¡/country¿, ¡/conf-loc¿) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 245, 15 pages. https://doi.org/10.1145/3544548.3580782
  25. Generative adversarial networks. Commun. ACM 63, 11 (2020), 139–144.
  26. Eduard C Gross. 2023. The Creative Paradox of AI: Enabler or Disruptor of Human Imagination? Bulletin of the Transilvania University of Braşov. Series VII: Social Sciences• Law (2023), 69–74.
  27. Victor Hall. 2022. EveryDream Trainer. https://github.com/victorchall/EveryDream-trainer
  28. Donna Haraway. 2006. A cyborg manifesto: Science, technology, and socialist-feminism in the late 20th century. In The international handbook of virtual learning environments. Springer, 117–158.
  29. Tim Harrford. 2016. Messy: How to Be Creative and Resilient in a Tidy-Minded World. Little Brown and Company, London, UK.
  30. Jan Hatzius et al. 2023. The Potentially Large Effects of Artificial Intelligence on Economic Growth (Briggs/Kodnani). Goldman Sachs (2023).
  31. José Hernández-Orallo and Karina Vold. 2019. AI extenders: the ethical and societal implications of humans cognitively extended by AI. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. 507–513.
  32. Jonathan Ho and Tim Salimans. 2022. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598 (2022).
  33. James Hutson and Ana Schnellmann. 2023. The Poetry of Prompts: The Collaborative Role of Generative Artificial Intelligence in the Creation of Poetry and the Anxiety of Machine Influence. Global Journal of Computer Science and Technology: D 23, 1 (2023).
  34. Angel Hsing-Chi Hwang. 2022. Too late to be creative? AI-empowered tools in creative processes. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–9.
  35. Francisco Ibarrola and Kazjon Grace. 2023. Prompt diversification for iterating with text-to-image models. In Proceedings of the Fourteenth International Conference on Computational Creativity, ICCC.
  36. IBISWorld. 2023. Tattoo Artists in the US. https://www.ibisworld.com/united-states/market-research-reports/tattoo-artists-industry/
  37. Designing Participatory AI: Creative Professionals’ Worries and Expectations about Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–8.
  38. AI Art and its Impact on Artists. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 363–374.
  39. Generative AI meets Responsible AI: Practical Challenges and Opportunities. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 5805–5806.
  40. Large-scale Text-to-Image Generation Models for Visual Artists’ Creative Works. Proceedings of the 28th International Conference on Intelligent User Interfaces, 919–933.
  41. Steen Nepper Larsen. 2014. Compulsory creativity: A critique of cognitive capitalism. Culture Unbound 6, 1 (2014), 159–177.
  42. Adopting Diffractive Reading to Advance HCI Research: A Case Study on Technology for Aging. ACM Trans. Comput.-Hum. Interact. 28, 5, Article 32 (Aug. 2021), 29 pages. https://doi.org/10.1145/3462326
  43. Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systems. In Proceedings of the Fourteenth International Conference on Computational Creativity, ICCC.
  44. Vivian Liu and Lydia B Chilton. 2022. Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–23.
  45. Explainable computational creativity. In Proceedings of the 2020 International Conference in Computational Creativity. ICCC.
  46. Lisa A Mazzei. 2014. Beyond an easy sense: A diffractive analysis. Qualitative inquiry 20, 6 (2014), 742–746.
  47. Is Writing Prompts Really Making Art?. In International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar). Springer, 196–211.
  48. In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound. In Proceeding of ACM SIGCHI 2019, Anind Dey and Shengdong Zhao (Eds.). ACM SIGCHI, ACM, New York, NY, Paper No. 38. https://doi.org/10.1145/3290605.3300268
  49. Elzė Sigutė Mikalonytė and Markus Kneer. 2022. Can artificial intelligence make art?: Folk intuitions as to whether AI-driven robots can be viewed as artists and produce art. ACM Transactions on Human-Robot Interaction (THRI) 11, 4 (2022), 1–19.
  50. Co-Writing Screenplays and Theatre Scripts with Language Models: Evaluation by Industry Professionals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (¡conf-loc¿, ¡city¿Hamburg¡/city¿, ¡country¿Germany¡/country¿, ¡/conf-loc¿) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 355, 34 pages. https://doi.org/10.1145/3544548.3581225
  51. GenAICHI: generative AI and HCI. In CHI conference on human factors in computing systems extended abstracts. 1–7.
  52. Charlotte Nordmoen and Andrew P McPherson. 2022. Making space for material entanglements: A diffractive analysis of woodwork and the practice of making an interactive system. In Designing Interactive Systems Conference. 415–423.
  53. Building an apparatus: Refractive, reflective, and diffractive readings of trace data. Journal of the Association for Information Systems 21, 1 (2020), 10.
  54. Using Text-to-Image Generation for Architectural Design Ideation. arXiv preprint arXiv:2304.10182 (2023).
  55. Aida Ponce Del Castillo. 2023. Generative AI, generating precariousness for workers? AI & SOCIETY (2023), 1–2.
  56. Learning Transferable Visual Models From Natural Language Supervision. arXiv:2103.00020 [cs.CV]
  57. Nina Rajcic and Jon McCormack. 2023. Message Ritual: A Posthuman Account of Living with Lamp. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  58. Jeba Rezwana and Mary Lou Maher. 2022. Designing creative AI partners with COFI: A framework for modeling interaction in human-AI co-creative systems. ACM Transactions on Computer-Human Interaction (2022).
  59. High-Resolution Image Synthesis with Latent Diffusion Models. arXiv:2112.10752 [cs.CV]
  60. Mark A Runco. 1991. Divergent thinking. Ablex Publishing, Westport, Connecticut.
  61. Mark A Runco and Sureyya Yoruk. 2014. The neuroscience of divergent thinking. Activitas Nervosa Superior 56 (2014), 1–16.
  62. Pamela Samuelson. 2023. Generative AI meets copyright. Science 381, 6654 (2023), 158–161.
  63. Téo Sanchez. 2023. Examining the Text-to-Image Community of Practice: Why and How do People Prompt Generative AIs?. In Proceedings of the 15th Conference on Creativity and Cognition. 43–61.
  64. Ben Shneiderman. 2000. Creating Creativity: User Interfaces for Supporting Innovation. ACM Trans. Comput.-Hum. Interact. 7, 1 (mar 2000), 114–138. https://doi.org/10.1145/344949.345077
  65. Notto JW Thelle and Philippe Pasquier. 2021. Spire Muse: A Virtual Musical Partner for Creative Brainstorming. In NIME 2021. PubPub.
  66. Mixed-initiative co-creativity. (2014).
  67. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI ’22). Association for Computing Machinery, New York, NY, USA, 841–852. https://doi.org/10.1145/3490099.3511105
  68. Explainable AI for designers: A human-centered perspective on mixed-initiative co-creation. In 2018 IEEE conference on computational intelligence and games (CIG). IEEE, 1–8.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Nina Rajcic (10 papers)
  2. Maria Teresa Llano (12 papers)
  3. Jon McCormack (27 papers)
Citations (5)
View on Semantic Scholar
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets