Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Design Principles for Generative AI Applications (2401.14484v1)

Published 25 Jan 2024 in cs.HC and cs.AI

Abstract: Generative AI applications present unique design challenges. As generative AI technologies are increasingly being incorporated into mainstream applications, there is an urgent need for guidance on how to design user experiences that foster effective and safe use. We present six principles for the design of generative AI applications that address unique characteristics of generative AI UX and offer new interpretations and extensions of known issues in the design of AI applications. Each principle is coupled with a set of design strategies for implementing that principle via UX capabilities or through the design process. The principles and strategies were developed through an iterative process involving literature review, feedback from design practitioners, validation against real-world generative AI applications, and incorporation into the design process of two generative AI applications. We anticipate the principles to usefully inform the design of generative AI applications by driving actionable design recommendations.

Design Principles for Enhancing Generative AI Applications

The paper, Design Principles for Generative AI Applications, presents a structured analysis of design strategies necessary to create effective and user-friendly generative AI applications. As generative AI technologies are increasingly integrated into both consumer and enterprise applications, establishing effective design guidelines is crucial for creating user experiences that are both intuitive and beneficial. Authored by Justin D. Weisz and colleagues from IBM Research AI, the work introduces a framework of six design principles, each associated with practicable design strategies. These principles are derived from an iterative research process, involving a review of existing literature, feedback from design practitioners, and validation against existing generative AI applications.

Overview of Design Principles

The authors categorize their design principles into two groups: three principles offer new perspectives on the design challenges associated with AI systems, and three principles are unique to generative AI. This dual approach provides a comprehensive guideline framework for diverse scenarios.

  1. Design Responsibly: This principle emphasizes understanding real user needs over developing technology for its own sake. It stresses the importance of minimizing user harm and balancing stakeholder values.
  2. Design for Mental Models: Recognizing that users form mental models to understand systems, this principle includes strategies to help users effectively interact with generative AI. It includes orienting users to generative variability, teaching effective usage, and capturing user expectations.
  3. Design for Appropriate Trust {content} Reliance: This principle addresses the calibration of user trust, highlighting the importance of helping users discern when to rely on AI outputs. Strategies include making system capabilities clear, providing output rationales, and using design elements to prevent overreliance.
  4. Design for Generative Variability: Unique to generative AI, this principle addresses the variability in outputs produced by generative models. It includes strategies for leveraging multiple outputs and aiding users in managing and curating these outputs.
  5. Design for Co-Creation: This principle centers on fostering collaboration between users and AI in the creative process, allowing user influence over generative AI through thoughtful design of interaction modalities.
  6. Design for Imperfection: Acknowledging that AI outputs can be imperfect, this principle suggests designing features that allow users to recognize, evaluate, and improve imperfect outputs, helping them work constructively with AI imperfections.

Implications and Future Directions

This structured approach to designing generative AI applications not only enhances user experience but also mitigates potential risks, such as user reliance on flawed AI outputs or misinterpreted outputs due to poorly formed mental models. By focusing on user-centered design and responsible AI deployment, these principles aim to align AI development with user expectations and ethical standards.

The practical significance of these principles lies in their validated applicability across different stages of design—both in conceptual ideation and in evaluative stages within existing systems. This reinforces their potential utility for a wide range of AI-infused products. By establishing these foundational principles, the paper addresses a critical gap in existing human-AI interaction guidelines which have primarily focused on discriminative AI systems.

Moving forward, as generative AI technologies evolve, so too must these design principles. Future research could explore how these principles hold up across emerging generative AI technologies beyond the current scope, such as in AI-driven virtual reality applications or advanced interactive narrative systems. It also raises the opportunity for expanding these guidelines to integrate more deeply into the technical development processes, potentially influencing datasets, training processes, and model selection to be more closely aligned with end-user experiences.

Overall, the paper presents a pivotal advance in AI UX design, offering actionable insights that can significantly contribute to safer and more effective deployment of generative AI technologies in practice.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (196)
  1. Adobe. 2023. Adobe Releases New Firefly Generative AI Models and Web App; Integrates Firefly Into Creative Cloud and Adobe Express. https://news.adobe.com/news/news-details/2023/Adobe-Releases-New-Firefly-Generative-AI-Models-and-Web-App-Integrates-Firefly-Into-Creative-Cloud-and-Adobe-Express/default.aspx.
  2. Cross-cultural web design guidelines. In Proceedings of the 14th International Web for All Conference. 1–4.
  3. A Study of mobile apps in the banking Industry. International Journal of Digital Society (IJDS) 10, 3 (2019), 1524–1533.
  4. Reem Alnanih and Olga Ormandjieva. 2016. Mapping HCI principles to design quality of mobile user interfaces in healthcare applications. Procedia Computer Science 94 (2016), 75–82.
  5. Towards mobile design guidelines-based cultural values for elderly Arabic users. Journal of Fundamental and Applied Sciences 10, 2S (2018), 964–977.
  6. Oscar Alvarado and Annika Waern. 2018. Towards algorithmic experience: Initial efforts for social media contexts. In Proceedings of the 2018 chi conference on human factors in computing systems. 1–12.
  7. Guidelines for human-AI interaction. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–13.
  8. Apple Computer, Inc. 1987. Apple human interface guidelines: The Apple desktop interface. Addison Wesley Publishing Company.
  9. Apple, Inc. 2022. Human Interface Guidelines for Machine Learning. Retrieved 14-Aug-2023 from https://developers.apple.com/design/human-interface-guidelines/technologies/machine-learning/introduction
  10. Maryam Ashoori and Justin D Weisz. 2019. In AI we trust? Factors that influence trustworthiness of AI-infused decision-making processes. arXiv preprint arXiv:1912.02675 (2019).
  11. Ethical guidelines for solving ethical issues and developing AI systems. In Product-Focused Software Process Improvement: 21st International Conference, PROFES 2020, Turin, Italy, November 25–27, 2020, Proceedings 21. Springer, 331–346.
  12. Shaowen Bardzell. 2010. Feminist HCI: taking stock and outlining an agenda for design. In Proceedings of the SIGCHI conference on human factors in computing systems. 1301–1310.
  13. UX: Designing for Copilot — DIS214H. Microsoft Developer. https://youtu.be/WiCVEMH4HTI
  14. Shirley Ann Becker. 2004. A study of web usability for older adults seeking online health resources. ACM Transactions on Computer-Human Interaction (TOCHI) 11, 4 (2004), 387–406.
  15. Hyper-shaku (Border-crossing): Towards the Multi-modal Gesture-controlled Hyper-Instrument.. In NIME. 352–357.
  16. Nigel Bevan. 2005. Guidelines and standards for web usability. In Proceedings of HCI International, Vol. 2005. Citeseer, 10.
  17. Typology of Risks of Generative Text-to-Image Models. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 396–410.
  18. IBM AI Ethics Board. 2023. Foundation models: Opportunities, risks and mitigations. Retrieved 05-Sep-2023 from https://www.ibm.com/downloads/cas/E5KE5KRZ
  19. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021).
  20. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877–1901.
  21. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 1877–1901. https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  22. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–21.
  23. Future design of accessibility in games: A design vocabulary. International Journal of Human-Computer Studies 131 (2019), 64–71.
  24. How Novelists Use Generative Language Models: An Exploratory User Study.. In HAI-GEN+ user2agent@ IUI.
  25. James J Cappel and Zhenyu Huang. 2007. A usability analysis of company websites. Journal of Computer Information Systems 48, 1 (2007), 117–123.
  26. From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads. arXiv preprint arXiv:2305.15336 (2023).
  27. Parameter-Efficient Fine-Tuning Design Spaces. arXiv preprint arXiv:2301.01821 (2023).
  28. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021).
  29. CogMol: Target-specific and selective drug design for COVID-19 using deep generative models. Advances in Neural Information Processing Systems 33 (2020), 4320–4332.
  30. Kulsiri Chirayus and Aziz Nanthaamornphong. 2020. Cognitive mobile design guidelines for the elderly: a preliminary study. In 2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). IEEE, 673–678.
  31. Design vocabulary for human–IoT systems communication. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–11.
  32. Gestural Inputs as Control Interaction for Generative Human-AI Co-Creation. In Workshops at the International Conference on Intelligent User Interfaces (IUI).
  33. Knowing me, knowing you: theory of mind in AI. Psychological medicine 50, 7 (2020), 1057–1061.
  34. Empirically studying participatory sense-making in abstract drawing with a co-creative cognitive agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces. 196–207.
  35. Jailbreaker: Automated Jailbreak Across Multiple Large Language Model Chatbots. arXiv preprint arXiv:2307.08715 (2023).
  36. Exploring how machine learning practitioners (try to) use fairness toolkits. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 473–484.
  37. Mixed-initiative creative interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 628–635.
  38. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
  39. DW Dodson and NL Shields Jr. 1978. Development of user guidelines for ECAS display design, volume 1. (1978). https://ntrs.nasa.gov/api/citations/19790007504/downloads/19790007504.pdf
  40. A survey for in-context learning. arXiv preprint arXiv:2301.00234 (2022).
  41. UX design innovation: Challenges for working with machine learning as a design material. In Proceedings of the 2017 chi conference on human factors in computing systems. 278–288.
  42. Elizabeth Edenberg and Alexandra Wood. 2023. Disambiguating Algorithmic Bias: From Neutrality to Justice. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 691–704.
  43. Expanding explainability: Towards social transparency in ai systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–19.
  44. Human-Centered Explainable AI (HCXAI): beyond opening the black-box of AI. In CHI conference on human factors in computing systems extended abstracts. 1–7.
  45. WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models. arXiv preprint arXiv:2306.15087 (2023).
  46. How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 2263–2280.
  47. Giorgio Franceschelli and Mirco Musolesi. 2022. Copyright in generative deep learning. Data & Policy 4 (2022), e17.
  48. Batya Friedman. 1996. Value-sensitive design. interactions 3, 6 (1996), 16–23.
  49. Helena Anna Frijns and Christina Schmidbauer. 2021. Design Guidelines for Collaborative Industrial Robot User Interfaces. In Human-Computer Interaction–INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30–September 3, 2021, Proceedings, Part III 18. Springer, 407–427.
  50. Sakiko Fukuda-Parr and Elizabeth Gibbons. 2021. Emerging consensus on ‘ethical AI’: Human rights critique of stakeholder guidelines. Global Policy 12 (2021), 32–44.
  51. Uncurated image-text datasets: Shedding light on demographic bias. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6957–6966.
  52. HAI-GEN 2021: 2nd Workshop on Human-AI Co-Creation with Generative Models. In 26th International Conference on Intelligent User Interfaces-Companion. 15–17.
  53. Vlad Petre Glăveanu. 2014. Distributed creativity: What is it? Springer.
  54. Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–20.
  55. Establishment of Design Strategies and Design Models of Human Computer Interaction Interface Based on User Experience. In Design, User Experience, and Usability: Theory and Practice: 7th International Conference, DUXU 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part I 7. Springer, 60–76.
  56. Generative adversarial nets. Advances in neural information processing systems 27 (2014).
  57. Towards a Framework for Human-AI Interaction Patterns in Co-Creative GAN Applications. Joint Proceedings of the ACM IUI Workshops 2022, March 2022, Helsinki, Finland (2022).
  58. Jonathan Grudin. 1990. The computer reaches out: The historical continuity of interface design. In Proceedings of the SIGCHI conference on Human factors in computing systems. 261–268.
  59. Thilo Hagendorff. 2020. The ethics of AI ethics: An evaluation of guidelines. Minds and machines 30, 1 (2020), 99–120.
  60. Toxigen: A large-scale machine-generated dataset for adversarial and implicit hate speech detection. arXiv preprint arXiv:2203.09509 (2022).
  61. Leveraging Microsoft’s mobile usability guidelines: Conceptualizing and developing scales for mobile application usability. International Journal of Human-Computer Studies 89 (2016), 35–53.
  62. Lars Erik Holmquist. 2017. Intelligence on tap: artificial intelligence as a new design material. interactions 24, 4 (2017), 28–33.
  63. Business (mis) use cases of generative ai. arXiv preprint arXiv:2003.07679 (2020).
  64. What people like in mobile finance apps: An analysis of user reviews. In Proceedings of the 17th international conference on mobile and ubiquitous multimedia. 293–304.
  65. IBM. 2022a. Design for AI. Retrieved 14-Aug-2023 from https://www.ibm.com/design/ai/
  66. IBM. 2022b. What is AI ethics? Retrieved 14-Aug-2023 from https://www.ibm.com/topics/ai-ethics
  67. Designing Participatory AI: Creative Professionals’ Worries and Expectations about Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–8.
  68. Viewpoints AI: Procedurally Representing and Reasoning about Gestures.. In DiGRA conference.
  69. How different groups prioritize ethical values for responsible AI. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 310–323.
  70. BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset. arXiv preprint arXiv:2307.04657 (2023).
  71. Jiyou Jia and Bilan Zhang. 2018. Design guidelines for mobile MOOC learning—an empirical study. In Blended Learning. Enhancing Learning Success: 11th International Conference, ICBL 2018, Osaka, Japan, July 31-August 2, 2018, Proceedings 11. Springer, 347–356.
  72. The global landscape of AI ethics guidelines. Nature machine intelligence 1, 9 (2019), 389–399.
  73. Jeff Johnson. 2020. Designing with the mind in mind: simple guide to understanding user interface design guidelines. Morgan Kaufmann.
  74. Measuring sharedness of team-related knowledge: Design and validation of a shared mental model instrument. Human Resource Development International 10, 4 (2007), 437–454.
  75. Nick Jones and Matthew Moffitt. 2016. Ethical guidelines for mobile app development within health and mental health fields. Professional Psychology: Research and Practice 47, 2 (2016), 155.
  76. Generative models for direct generation of cnc toolpaths. In 2018 25th International Conference on Mechatronics and Machine Vision in Practice (M2VIP). IEEE, 1–6.
  77. Anna Kantosalo and Tapio Takala. 2020. Five C’s for Human-Computer Co-Creativity-An Update on Classical Creativity Perspectives.. In ICCC. 17–24.
  78. Mobile taskflow in context: a screenshot study of smartphone usage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2009–2018.
  79. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 4401–4410.
  80. Capturing Humans’ Mental Models of AI: An Item Response Theory Approach. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1723–1734.
  81. Kamran Khowaja and Siti Salwah Salim. 2020. A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD). Universal Access in the Information Society 19, 4 (2020), 739–781.
  82. Huhn Kim. 2010. Effective organization of design guidelines reflecting designer’s design strategies. International Journal of Industrial Ergonomics 40, 6 (2010), 669–688.
  83. Propile: Probing privacy leakage in large language models. arXiv preprint arXiv:2307.01881 (2023).
  84. One AI Does Not Fit All: A Cluster Analysis of the Laypeople’s Perception of AI Roles. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–20.
  85. LMCanvas: Object-Oriented Interaction to Personalize Large Language Model-Powered Writing Environments. arXiv preprint arXiv:2303.15125 (2023).
  86. Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
  87. Social acceptability in HCI: A survey of methods, measures, and design strategies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–19.
  88. Evaluating Mixed-Initiative Creative Interfaces via Expressive Range Coverage Analysis.. In IUI Workshops. 34–45.
  89. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS digital health 2, 2 (2023), e0000198.
  90. Sri Kurniawan and Panayiotis Zaphiris. 2005. derived web design guidelines for older people. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility. 129–135.
  91. Gshard: Scaling giant models with conditional computation and automatic sharding. arXiv preprint arXiv:2006.16668 (2020).
  92. Barbara Leporini and Fabio Paternò. 2008. Applying web usability criteria for vision-impaired users: does it really improve task performance? Intl. Journal of Human–Computer Interaction 24, 1 (2008), 17–47.
  93. Clayton Lewis and Cathleen Wharton. 1997. Cognitive walkthroughs. In Handbook of human-computer interaction. Elsevier, 717–732.
  94. Understanding challenges for developers to create accurate privacy nutrition labels. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–24.
  95. Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Transactions on Computer-Human Interaction (2022).
  96. Understanding iOS privacy nutrition labels: An exploratory large-scale analysis of app store data. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
  97. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110 (2022).
  98. Questioning the AI: informing design practices for explainable AI user experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.
  99. Joseph Carl Robnett Licklider and Welden E Clark. 1962. On-line man-computer communication. In Proceedings of the May 1-3, 1962, spring joint computer conference. 113–128.
  100. CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classes. arXiv preprint arXiv:2308.06921 (2023).
  101. Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. The International Journal of Management Education 21, 2 (2023), 100790.
  102. Vivian Liu. 2023. Beyond Text-to-Image: Multimodal Prompts to Explore Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–6.
  103. Vivian Liu and Lydia B Chilton. 2021. Neurosymbolic Generation of 3D Animal Shapes through Semantic Controls.. In IUI Workshops.
  104. Vivian Liu and Lydia B Chilton. 2022. Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–23.
  105. Novice-AI music co-creation via AI-steering tools for deep generative models. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
  106. Todd Lubart. 2005. How can computers be partners in the creative process: classification and commentary on the special issue. International Journal of Human-Computer Studies 63, 4-5 (2005), 365–369.
  107. Nicola Lucchi. 2023. ChatGPT: A Case Study on Copyright Challenges for Generative Artificial Intelligence Systems. European Journal of Risk Regulation (2023), 1–23.
  108. Stable bias: Analyzing societal representations in diffusion models. arXiv preprint arXiv:2303.11408 (2023).
  109. I Lupanda and JT Janse van Rensburg. 2021. Design Guidelines for Mobile Applications. In International Conference Interfaces & Human Computer Interaction. 92–99.
  110. Co-designing checklists to understand organizational challenges and opportunities around fairness in AI. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–14.
  111. Mary Lou Maher. 2012. Computational and collective creativity: Who’s being creative?. In ICCC. Citeseer, 67–71.
  112. HAI-GEN 2023: 4th Workshop on Human-AI Co-Creation with Generative Models. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces. 190–192.
  113. State of the Art of Web Usability Guidelines. In Handbook of human factors in Web design, Kim-Phuong L Vu and Robert W Proctor (Eds.). Crc Press.
  114. FOCUS AND MODALITY: DEFINING A ROADMAP TO FUTURE AI-HUMAN TEAMING IN DESIGN. Proceedings of the Design Society 3 (2023), 1905–1914.
  115. Categorised ethical guidelines for large scale mobile HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1853–1862.
  116. How generative ai models such as chatgpt can be (mis) used in spc practice, education, and research? an exploratory study. Quality Engineering (2023), 1–29.
  117. Cade Metz. 2022. Meet GPT-3. It Has Learned to Code (and Blog and Argue). (Published 2020). https://www.nytimes.com/2020/11/24/science/artificial-intelligence-ai-gpt3.html
  118. Mobile App Usability Index (MAUI) for improving mobile banking adoption. In 2015 International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE). IEEE, 313–320.
  119. A multidisciplinary survey and framework for design and evaluation of explainable AI systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 11, 3-4 (2021), 1–45.
  120. HCAI@NeurIPS 2022, Human Centered AI. In Annual Conference on Neural Information Processing Systems.
  121. Interactional Co-Creativity of Human and AI in Analogy-Based Design. In International Conference on Computational Creativity.
  122. GenAICHI: Generative AI and HCI. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
  123. Mixed initiative generative AI interfaces: An analytic framework for generative AI applications. ICCC 2020 Workshop, The Future of Co-Creative Systems. https://computationalcreativity.net/workshops/cocreative-iccc20/papers/Future_of_co-creative_systems_185.pdf
  124. Stacey F Nagata. 2003. Multitasking and interruptions during mobile web tasks. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 47. SAGE Publications Sage CA: Los Angeles, CA, 1341–1345.
  125. Jakob Nielsen. 1994. Enhancing the explanatory power of usability heuristics. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 152–158.
  126. Jakob Nielsen. 1995. Scenarios in discount usability engineering. In Scenario-Based Design: Envisioning work and technology in system development. 59–83.
  127. Jakob Nielsen. 2023. AI: First New UI Paradigm in 60 Years. Nielsen Norman Group (18 06 2023). https://www.nngroup.com/articles/ai-paradigm/
  128. Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 249–256.
  129. Adapting a Generic Platform for Poetry Generation to Produce Spanish Poems.. In ICCC. 63–71.
  130. OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL]
  131. Jonas Oppenlaender. 2022. A taxonomy of prompt modifiers for text-to-image generation. arXiv preprint arXiv:2204.13988 2 (2022).
  132. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730–27744.
  133. Google PAIR. 2021. People+AI Guidebook. Google. https://pair.withgoogle.com/guidebook/
  134. Toward accessible mobile application design: developing mobile application accessibility guidelines for people with visual impairment. HCI Korea (2014), 31–38.
  135. Risk-Aware Image Generation by Estimating and Propagating Uncertainty. (2023).
  136. Analysis of web content delivery effectiveness and efficiency in responsive web design using material design guidelines and User Centered Design. In 2017 International Conference on Sustainable Information Engineering and Technology (SIET). IEEE, 435–441.
  137. Improving language understanding by generative pre-training. (2018).
  138. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
  139. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 (2022).
  140. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10684–10695.
  141. Dagfinn Rømen and Dag Svanæs. 2012. Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users. Universal Access in the Information Society 11 (2012), 375–385.
  142. Implementing ethics for a mobile app deployment. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. 406–415.
  143. The Programmer’s Assistant: Conversational Interaction with a Large Language Model for Software Development. In 28th International Conference on Intelligent User Interfaces.
  144. Mattias Rost and Sebastian Andreasson. 2023. Stable Walk: An interactive environment for exploring Stable Diffusion outputs. 3124 (2023). http://ceur-ws.org/Vol-3359/paper14.pdf
  145. Interacting with Large Language Models: A Case Study on AI-Aided Brainstorming for Guesstimation Problems. In HHAI 2023: Augmenting Human Intellect. IOS Press, 153–167.
  146. Rolling the Dice: Imagining Generative AI as a Dungeons & Dragons Storytelling Companion. arXiv preprint arXiv:2304.01860 (2023).
  147. Regina Schober. 2022. Passing the Turing test? AI generated poetry and posthuman creativity. Artificial Intelligence and Human Enhancement: Affirmative and Critical Approaches in the Humanities 21 (2022), 151.
  148. Machines as teammates: A research agenda on AI in team collaboration. Information & management 57, 2 (2020), 103174.
  149. On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning. arXiv preprint arXiv:2212.08061 (2022).
  150. Yashraj Shashikant Sharma. 2023. Generating Wildfire Risk Maps for Critical Infrastructure Systems Using Integrated Generative AI and Simulation Techniques Under Information Uncertainty. Ph. D. Dissertation. State University of New York at Buffalo.
  151. Towards usability guidelines for mobile websites and applications. Wirtschaftsinformatik Proceedings (2015). https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1106&context=wi2015
  152. Ben Shneiderman. 2020a. Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 10, 4 (2020), 1–31.
  153. Ben Shneiderman. 2020b. Human-centered artificial intelligence: Reliable, safe & trustworthy. International Journal of Human–Computer Interaction 36, 6 (2020), 495–504.
  154. Ben Shneiderman and Michael Muller. 2023. On AI Anthropomorphism. Human-Centered AI (Medium) (10 April 2023). https://medium.com/human-centered-ai/on-ai-anthropomorphism-abff4cecc5ae
  155. Designing the user interface: strategies for effective human-computer interaction. Pearson.
  156. Design guidelines for user transactions with battlefield automated systems: Prototype for a handbook. ARI Researoh Product (1984), 84–08.
  157. Raymond C Sidorsky and Robert N Parrish. 1980. Guidelines and criteria for human-computer interface design of battlefield automated systems. In Proceedings of the Human Factors Society Annual Meeting, Vol. 24. SAGE Publications Sage CA: Los Angeles, CA, 98–102.
  158. The effectiveness of MAE pre-pretraining for billion-scale pretraining. arXiv preprint arXiv:2303.13496 (2023).
  159. Sidney L Smith and Jane N Mosier. 1986. Guidelines for designing user interface software. Citeseer.
  160. A framework of touchscreen interaction design recommendations for children (tidrc) characterizing the gap between research evidence and design practice. In Proceedings of the 18th ACM international conference on interaction design and children. 419–431.
  161. Angie Spoto and Natalia Oleynik. 2017. Library of Mixed-Initiative Creative Interfaces. Retrieved 14-Aug-2023 from http://mici.codingconduct.cc/
  162. Actionable UI Design Guidelines for Smartphone Applications Inclusive of Low-Literate Users. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–30.
  163. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv preprint arXiv:2206.04615 (2022).
  164. Bridging the gap between privacy by design and privacy in practice. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 3415–3422.
  165. Interactive and visual prompt engineering for ad-hoc task adaptation with large language models. IEEE transactions on visualization and computer graphics 29, 1 (2022), 1146–1156.
  166. Investigating Explainability of Generative AI for Code through Scenario-based Design. In 27th International Conference on Intelligent User Interfaces. 212–228.
  167. Mitigating gender bias in natural language processing: Literature review. arXiv preprint arXiv:1906.08976 (2019).
  168. Considerations for AI fairness for people with disabilities. AI Matters 5, 3 (2019), 40–63.
  169. Designing co-creative ai for virtual environments. In Creativity and Cognition. 1–11.
  170. Attention is all you need. Advances in neural information processing systems 30 (2017).
  171. Nationality Bias in Text Generation. arXiv preprint arXiv:2302.02463 (2023).
  172. How to evaluate trust in AI-assisted decision making? A survey of empirical methodologies. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–39.
  173. Mathias Peter Verheijden and Mathias Funk. 2023. Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–8.
  174. Learning embodied sound-motion mappings: Evaluating AI-generated dance improvisation. In Creativity and Cognition. 1–9.
  175. ”It Felt Like Having a Second Mind”: Investigating Human-AI Co-creativity in Prewriting with Large Language Models. arXiv preprint arXiv:2307.10811 (2023).
  176. Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI Challenges. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  177. Towards mutual theory of mind in human-ai interaction: How language reflects what students perceive about a virtual teaching assistant. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.
  178. Multitask prompt tuning enables parameter-efficient transfer learning. arXiv preprint arXiv:2303.02861 (2023).
  179. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824–24837.
  180. Ethical and social risks of harm from language models. arXiv preprint arXiv:2112.04359 (2021).
  181. HAI-GEN 2022: 3rd Workshop on Human-AI Co-Creation with Generative Models. In 27th International Conference on Intelligent User Interfaces. 4–6.
  182. Toward general design principles for generative AI applications. In Joint Proceedings of the IUI 2023 Workshops: HAI-GEN, ITAH, MILC, SHAI, SketchRec, SOCIALIZE co-located with the ACM International Conference on Intelligent User Interfaces, Vol. 3124. CEUR. http://ceur-ws.org/Vol-3359/paper14.pdf
  183. Perfection Not Required? Human-AI Partnerships in Code Translation. In 26th International Conference on Intelligent User Interfaces. 402–412.
  184. Better together? an evaluation of ai-supported code translation. In 27th International Conference on Intelligent User Interfaces. 369–391.
  185. A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv preprint arXiv:2302.11382 (2023).
  186. Trustworthy AI development guidelines for human system interaction. In 2020 13th International Conference on Human System Interaction (HSI). IEEE, 130–136.
  187. Alan FT Winfield. 2018. Experiments in artificial theory of mind: From safety to story-telling. Frontiers in Robotics and AI 5 (2018), 75.
  188. A comparative analysis of industry human-AI interaction guidelines. arXiv preprint arXiv:2010.11761 (2020).
  189. Sang Michael Xie and Sewon Min. 2022. How does in-context learning work? A framework for understanding the differences from traditional supervised learning. http://ai.stanford.edu/blog/understanding-incontext/
  190. Large Language Models as Optimizers. arXiv preprint arXiv:2309.03409 (2023).
  191. How Experienced Designers of Enterprise Applications Engage AI as a Design Material. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13.
  192. Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People+ AI Guidebook. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–13.
  193. Why Johnny can’t prompt: how non-AI experts try (and fail) to design LLM prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–21.
  194. Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. arXiv preprint arXiv:2306.05685 (2023).
  195. Shuoyang Zheng. 2023. StyleGAN-Canvas: Augmenting StyleGAN3 for Real-Time Human-AI Co-Creation. (2023).
  196. Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593 (2019).
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Justin D. Weisz (26 papers)
  2. Jessica He (5 papers)
  3. Michael Muller (70 papers)
  4. Gabriela Hoefer (2 papers)
  5. Rachel Miles (1 paper)
  6. Werner Geyer (20 papers)
Citations (58)
Youtube Logo Streamline Icon: https://streamlinehq.com