The Effects of Generative AI on Design Fixation and Divergent Thinking (2403.11164v1)
Abstract: Generative AI systems have been heralded as tools for augmenting human creativity and inspiring divergent thinking, though with little empirical evidence for these claims. This paper explores the effects of exposure to AI-generated images on measures of design fixation and divergent thinking in a visual ideation task. Through a between-participants experiment (N=60), we found that support from an AI image generator during ideation leads to higher fixation on an initial example. Participants who used AI produced fewer ideas, with less variety and lower originality compared to a baseline. Our qualitative analysis suggests that the effectiveness of co-ideation with AI rests on participants' chosen approach to prompt creation and on the strategies used by participants to generate ideas in response to the AI's suggestions. We discuss opportunities for designing generative AI systems for ideation support and incorporating these AI tools into ideation workflows.
- A review of design fixation: research directions and key factors. InternatIonal Journal of Design Creativity and Innovation 6, 2 (2018), 22–35. https://doi.org/10.1080/21650349.2017.1320232
- Design fixations among information design students: What has been seen cannot be unseen. In DS 74: Proceedings of the 14th International Conference on Engineering & Product Design Education (E&PDE12) Design Education for Future Wellbeing,. Design Society, Antwerp, Belguim. https://www.designsociety.org/download-publication/33183/design_fixations_among_information_design_students_what_has_been_seen_cannot_be_unseen
- Audi MediaCenter. 2022. Reinventing the wheel? “FelGAN” inspires new rim designs with AI — Audi MediaCenter. https://www.audi-mediacenter.com/en/press-releases/reinventing-the-wheel-felgan-inspires-new-rim-designs-with-ai-15097
- The Effects of Individual Differences in Working Memory Capacity and Design Environment on Design Fixation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56 (9 2012), 1977–1981. https://doi.org/10.1177/1071181312561293
- An individual differences approach to design fixation: Comparing laboratory and field research. In Design, User Experience, and Usability. Design Philosophy, Methods, and Tools. DUXU 2013. Lecture Notes in Computer Science. Springer, Berlin Heidelberg, 13–21. https://doi.org/10.1007/978-3-642-39229-0
- Iouri Belski and Ianina Belski. 2015. Application of TRIZ in improving the creativity of engineering experts. Procedia Engineering 131 (2015), 792–797. https://doi.org/10.1016/j.proeng.2015.12.379
- Virginia Braun and Victoria Clarke. 2022. Thematic analysis: a practical guide. SAGE Publications Inc., Thousand Oaks, California,United states.
- Paul-Christian Bürkner. 2017. brms: An R Package for Bayesian Multilevel Models Using Stan. Journal of Statistical Software 80, 1 (2017), 1–28. https://doi.org/10.18637/jss.v080.i01
- Utilizing EEG to Explore Design Fixation during Creative Idea Generation. Computational Intelligence and Neuroscience 2021 (2021). https://doi.org/10.1155/2021/6619598
- Design fixation on non-verbal stimuli: The influence of simple vs rich pictorial information on design problem-solving. In Proceedings of the ASME Design Engineering Technical Conference. ASME, San Diego, California, USA., 995–1002. https://doi.org/10.1115/DETC2009-86826
- Stan: A probabilistic programming language. Journal of statistical software 76 (2017).
- Hernan Casakin and Gabriela Goldschmidt. 1999. Expertise and the use of visual analogy: implications for design education. Design Studies 20, 2 (3 1999), 153–175. https://doi.org/10.1016/S0142-694X(98)00032-5
- A new strategy to reduce design fixation: Presenting partial photographs to designers. Design Studies 35, 4 (2014), 374–391. https://doi.org/10.1016/J.DESTUD.2014.02.004
- Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. ACM, New York, NY, USA, 1941–1954. https://doi.org/10.1145/3563657.3596001
- Evangelia G Chrysikou and Robert W Weisberg. 2005. Following the Wrong Footsteps: Fixation Effects of Pictorial Examples in a Design Problem-Solving Task. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 5 (2005), 1134–1148.
- John Joon Young Chung. 2022. Artistic User Expressions in AI-powered Creativity Support Tools. In UIST 2022 Adjunct - Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, New York, NY, USA, 1–4. https://doi.org/10.1145/3526114.3558531
- Nathan Crilly. 2015. Fixation and creativity in concept development: The attitudes and practices of expert designers. Design Studies 38 (5 2015), 54–91. https://doi.org/10.1016/J.DESTUD.2015.01.002
- Nathan Crilly and Carlos Cardoso. 2017. Where next for research on fixation, inspiration and creativity in design? Design Studies 50 (5 2017), 1–38. https://doi.org/10.1016/J.DESTUD.2017.02.001
- Creative sketching partner: A co-creative sketching tool to inspire design creativity. In Proceedings of the 10th International Conference on Computational Creativity, ICCC 2019. Association for Computational Creativity, North Carolina, 358–359.
- Edward de Bono. 2008. Six Thinking Hats (revised edition ed.). Penguin, United Kingdom.
- Idea Generation Mechanisms: Comparing the Influence of Classification, Combination, Building on Others, and Stimulation Mechanisms on Ideation Effectiveness. Journal of Mechanical Design, Transactions of the ASME 143, 12 (12 2021), 1 – 46. https://doi.org/10.1115/1.4051239/1109505
- How Generative AI Can Augment Human Creativity. https://hbr.org/2023/07/how-generative-ai-can-augment-human-creativity)
- Lorenzo Fiorineschi and Federico Rotini. 2023. Uses of the novelty metrics proposed by Shah et al.: what emerges from the literature? Design Science 9 (5 2023), e11. https://doi.org/10.1017/DSJ.2023.9
- Design fixation and intelligent design aids. In Artificial Intelligence in Design ’94. Springer, Dordrecht, 483–495. https://doi.org/10.1007/978-94-011-0928-4
- Joy Paul Guilford. 1956. The structure of intellect. Psychological bulletin 53, 4 (1956), 267–293. https://doi.org/10.1037/h0040755
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52, C (1 1988), 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
- Creative AI for HRI Design Explorations. In HRI ’23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. Association for Computing Machinery, New York, NY, USA, 40–50. https://doi.org/10.1145/3568294.3580035
- Overcoming design fixation through education and creativity methods. In Proceedings of the International Conference on Engineering Design, ICED, Vol. 7 DS75-07. The Design Society, Seoul Korea, 139–148. https://www.designsociety.org/download-publication/34578/overcoming_design_fixation_through_education_and_creativity_methods
- Angel Hsing Chi Hwang. 2022. Too Late to be Creative? AI-Empowered Tools in Creative Processes. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3491101.3503549
- David G. Jansson and Steven M. Smith. 1991. Design fixation. Design Studies 12, 1 (1 1991), 3–11. https://doi.org/10.1016/0142-694X(91)90003-F
- The Intersection of Users, Roles, Interactions, and Technologies in Creativity Support Tools; The Intersection of Users, Roles, Interactions, and Technologies in Creativity Support Tools. In Designing Interactive Systems Conference 2021. ACM, New York, NY, USA, 1817 –1833. https://doi.org/10.1145/3461778
- Creative sketching partner: An analysis of human-AI co-creativity. In International Conference on Intelligent User Interfaces, Proceedings IUI. Association for Computing Machinery, New York, NY, USA, 221–230. https://doi.org/10.1145/3377325.3377522
- Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4521–4532. https://doi.org/10.1145/2858036.2858465
- To Be Biased or Not to Be: Choosing between Design Fixation and Design Intentionality. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 349–354. https://doi.org/10.1145/2468356.2468418
- ImageSense: An Intelligent Collaborative Ideation Tool to Support Diverse Human-Computer Partnerships. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (5 2020), 27. https://doi.org/10.1145/3392850
- Aaron Kozbelt and Yana Durmysheva. 2007. Understanding Creativity Judgments of Invented Alien Creatures: The Roles of Invariants and Other Predictors*. The Journal of Creative Behavior 41, 4 (12 2007), 223–248. https://doi.org/10.1002/J.2162-6057.2007.TB01072.X
- Bart Lamiroy and Emmanuelle Potier. 2022. Lamuse: Leveraging Artificial Intelligence for Sparking Inspiration. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13221 LNCS (2022), 148–161. https://doi.org/10.1007/978-3-031-03789-4{_}10/FIGURES/6
- Design fixation from initial examples: Provided versus self-Generated ideas. Journal of Mechanical Design, Transactions of the ASME 142, 10 (10 2020), 101402. https://doi.org/10.1115/1.4046446/1074761
- Makayla Lewis. 2023. AIxArtist: A First-Person Tale of Interacting with Artificial Intelligence to Escape Creative Block.
- A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty. Journal of Mechanical Design (JMD) 132, 4 (4 2010), 041003. https://doi.org/10.1115/1.4001110
- Andrés Lucero. 2012. Framing, Aligning, Paradoxing, Abstracting, and Directing: How Design Mood Boards Work. In Proceedings of the Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 438–447.
- Abraham S. Luchins. 1942. Mechanization in problem solving: The effect of Einstellung. Psychological Monographs 54, 6 (1942), i–95. https://doi.org/10.1037/h0093502
- Marian Mazzone and Ahmed Elgammal. 2019. Art, Creativity, and the Potential of Artificial Intelligence. Arts 2019, Vol. 8, Page 26 8, 1 (2 2019), 26. https://doi.org/10.3390/ARTS8010026
- Richard McElreath. 2020. Statistical rethinking: A Bayesian course with examples in R and Stan (2e). Chapman and Hall/CRC.
- Overcoming design fixation: Design by analogy studies and nonintuitive findings. AI EDAM 30, 2 (5 2016), 185–199. https://doi.org/10.1017/S0890060416000068
- Maria Adriana Neroni and Nathan Crilly. 2021. How to Guard Against Fixation? Demonstrating Individual Vulnerability is More Effective Than Warning of General Risk. The Journal of Creative Behavior 55, 2 (6 2021), 447–463. https://doi.org/10.1002/JOCB.465
- A Terry Purcell and John S Gero. 1996. Design and other types of fixation. Design studies 17 (1996), 363–383. https://doi.org/10.1016/S0142-694X(96)00023-3
- Picture This: AI-Assisted Image Generation as a Resource for Problem Construction in Creative Problem-Solving. In Proceedings of the 15th Conference on Creativity and Cognition. Association for Computing Machinery (ACM), New York, NY, USA, 262–268. https://doi.org/10.1145/3591196.3596823
- Evaluating creativity support tools in HCI research. In DIS 2020 - Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, Inc, New York, NY, USA, 457–476. https://doi.org/10.1145/3357236.3395474
- Lori Rosenkopf and Atul Nerkar. 2001. Beyond local search: boundary-spanning, exploration, and impact in the optical disk industry. Strategic Management Journal 22, 4 (4 2001), 287–306. https://doi.org/10.1002/SMJ.160
- DesIGN: Design inspiration from generative networks. Computer Vision – ECCV 2018 Workshops. ECCV 2018. Lecture Notes in Computer Science() 11131 (2019), 0–0. https://doi.org/10.1007/978-3-030-11015-4
- Martin Schmettow. 2021. New statistics for design researchers. Springer.
- Metrics for measuring ideation effectiveness. Design Studies 24, 2 (3 2003), 111–134. https://doi.org/10.1016/S0142-694X(02)00034-0
- Integrating AI in Human-Human Collaborative Ideation. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3544549.3573802
- Camera obscurer: Generative art for design inspiration. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11453 LNCS (2019), 51–68. https://doi.org/10.1007/978-3-030-16667-0{_}4/TABLES/3
- Ut Na Sio and Thomas C. Ormerod. 2009. Does Incubation Enhance Problem Solving? A Meta-Analytic Review. Psychological Bulletin 135, 1 (1 2009), 94–120. https://doi.org/10.1037/A0014212
- Shifting the focus: An objective look at design fixation. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8012 LNCS, PART 1 (2013), 144–151. https://doi.org/10.1007/978-3-642-39229-0{_}17/COVER
- Steven M. Smith and Julie Linsey. 2011. A Three-Pronged Approach for Overcoming Design Fixation. The Journal of Creative Behavior 45, 2 (6 2011), 83–91. https://doi.org/10.1002/J.2162-6057.2011.TB01087.X
- Constraining effects of examples a creative generation task. In. Memorv & Cognition 21, 6 (1993), 837–845.
- Gareth Terry and Nikki Hayfield. 2021. Essentials of Thematic Analysis. American Psychological Association, Washington, DC, USA. https://uwe-repository.worktribe.com/output/7240960
- Idea representation and elaboration in design inspiration and fixation experiments. International Journal of Design Creativity and Innovation 6, 1-2 (2018), 93–113. https://doi.org/10.1080/21650349.2017.1362360
- Fluency results in design fixation experiments: An additional explanation. In 4th International Conference on Design Creativity, ICDC 2016. The Design Society, Atlanta, GA, USA, 1–8.
- Inspiration and Fixation: The Influences of Example Designs and System Properties in Idea Generation. Journal of Mechanical Design 139, 3 (2017), 031101. https://doi.org/10.1115/1.4035540
- Luis A. Vasconcelos and Nathan Crilly. 2016. Inspiration and fixation: Questions, methods, findings, and challenges. Design Studies 42 (1 2016), 1–32. https://doi.org/10.1016/J.DESTUD.2015.11.001
- Rank-Normalization, Folding, and Localization: An Improved R^^𝑅\widehat{R}over^ start_ARG italic_R end_ARG for Assessing Convergence of MCMC (with Discussion). Bayesian Analysis 16, 2 (2021), 667 – 718. https://doi.org/10.1214/20-BA1221
- Mathias Peter Verheijden and Mathias Funk. 2023. Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3544549.3585680
- Vimal Viswanathan and Julie Linsey. 2012. Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost. Proceedings of the ASME Design Engineering Technical Conference 9 (6 2012), 119–130. https://doi.org/10.1115/DETC2011-47862
- A study on the effects of example familiarity and modality on design fixation. Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM 30, 2 (2016), 171–184. https://doi.org/10.1017/S0890060416000056
- Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). (2011).
- T. B. Ward. 1994. Structured Imagination: the Role of Category Structure in Exemplar Generation. Cognitive Psychology 27, 1 (8 1994), 1–40. https://doi.org/10.1006/COGP.1994.1010
- Exploring Creativity Support for Concept Art Ideation. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585684
- Redefining Creativity in the Era of AI? Perspectives of Computer Scientists and New Media Artists. Creativity Research Journal (2022), 1–17. https://doi.org/10.1080/10400419.2022.2107850
- Robert J. Youmans. 2011a. Design Fixation in the Wild: Design Environments and Their Influence on Fixation. The Journal of Creative Behavior 45, 2 (6 2011), 101–107. https://doi.org/10.1002/J.2162-6057.2011.TB01089.X
- Robert J. Youmans. 2011b. The effects of physical prototyping and group work on the reduction of design fixation. Design Studies 32, 2 (3 2011), 115–138. https://doi.org/10.1016/J.DESTUD.2010.08.001
- Robert J. Youmans and Tomasz Arciszewski. 2014a. Design Fixation: A Cloak of Many Colors. In Design Computing and Cognition ’12. Springer, Dordrecht, 115–129. https://doi.org/10.1007/978-94-017-9112-0
- Robert J. Youmans and Thomaz Arciszewski. 2014b. Design fixation: Classifications and modern methods of prevention. AI EDAM 28, 2 (2014), 129–137. https://doi.org/10.1017/S0890060414000043
- Samangi Wadinambiarachchi (1 paper)
- Ryan M. Kelly (5 papers)
- Saumya Pareek (1 paper)
- Qiushi Zhou (3 papers)
- Eduardo Velloso (11 papers)