Papers
Topics
Authors
Recent
2000 character limit reached

AI-Assisted Causal Pathway Diagram for Human-Centered Design (2403.08111v1)

Published 12 Mar 2024 in cs.HC, cs.AI, and cs.CL

Abstract: This paper explores the integration of causal pathway diagrams (CPD) into human-centered design (HCD), investigating how these diagrams can enhance the early stages of the design process. A dedicated CPD plugin for the online collaborative whiteboard platform Miro was developed to streamline diagram creation and offer real-time AI-driven guidance. Through a user study with designers (N=20), we found that CPD's branching and its emphasis on causal connections supported both divergent and convergent processes during design. CPD can also facilitate communication among stakeholders. Additionally, we found our plugin significantly reduces designers' cognitive workload and increases their creativity during brainstorming, highlighting the implications of AI-assisted tools in supporting creative work and evidence-based designs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (107)
  1. Hussam Alkaissi and Samy I McFarlane. 2023. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus 15, 2 (2023). https://doi.org/10.7759/cureus.35179
  2. Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets. arXiv preprint arXiv:2310.09985 (2023). https://arxiv.org/abs/2310.09985
  3. Stefania Altavilla and E Blanco. 2020. Are AI tools going to be the new designers? A taxonomy for measuring the level of automation of design activities. In Proceedings of the Design Society: DESIGN Conference, Vol. 1. Cambridge University Press, 81–90. https://doi.org/10.1017/dsd.2020.286
  4. InspirationWall: Supporting Idea Generation Through Automatic Information Exploration. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. 103–106. https://doi.org/10.1145/2757226.2757252
  5. Crowdboard: Augmenting In-Person Idea Generation with Real-Time Crowds. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 106–118. https://doi.org/10.1145/3059454.3059477
  6. Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Prompts. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–22. https://doi.org/10.1145/3586183.3606719
  7. Design Sprint: A Practical Guidebook for Building Great Digital Products. O’Reilly Media, Inc.
  8. Jordan Beck and Hamid R Ekbia. 2018. The Theory-Practice Gap as Generative Metaphor. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–11. https://doi.org/10.1145/3173574.3174194
  9. Jordan Beck and Erik Stolterman. 2016. Examining Practical, Everyday Theory Use in Design Research. She Ji: The Journal of Design, Economics, and Innovation 2, 2 (2016), 125–140. https://doi.org/10.1016/j.sheji.2016.01.010
  10. Benjamin B Bederson and Ben Shneiderman. 2003. The Craft of Information Visualization: Readings and Reflections. Morgan Kaufmann.
  11. David Benyon. 2013. Designing interactive systems: A comprehensive guide to HCI, UX and interaction design.
  12. On the Opportunities and Risks of Foundation Models. arXiv preprint arXiv:2108.07258 (2021). https://arxiv.org/abs/2108.07258
  13. Sparks of Artificial General Intelligence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712 (2023). https://arxiv.org/abs/2303.12712
  14. VINS: Visual Search for Mobile User Interface Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14. https://doi.org/10.1145/3411764.3445762
  15. DesignAID: Using Generative AI and Semantic Diversity for Design Inspiration. In Proceedings of The ACM Collective Intelligence Conference. 1–11. https://doi.org/10.1145/3582269.3615596
  16. John Millar Carroll. 1991. Designing Interaction: Psychology at the Human-Computer Interface. CUP Archive.
  17. John M Carroll. 2003. HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science. Elsevier.
  18. On the benefits and pitfalls of analogies for innovative design: Ideation performance based on analogical distance, commonness, and modality of examples. (2011).
  19. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces. 329–340. https://doi.org/10.1145/3172944.3172983
  20. Translational Resources: Reducing the Gap Between Academic Research and HCI Practice. In Proceedings of the 2017 Conference on Designing Interactive Systems. 957–968. https://doi.org/10.1145/3064663.3064667
  21. Behavior Change Design Sprints. In Proceedings of the 2018 Designing Interactive Systems Conference. 791–803. https://doi.org/10.1145/3196709.3196739
  22. A Translational Science Model for HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3290605.3300231
  23. James P Connell and Anne C Kubisch. 1998. Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. New Approaches to Evaluating Community Initiatives 2, 15-44 (1998), 1–16.
  24. Theory-Driven Design Strategies for Technologies that Support Behavior Change in Everyday Life. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 405–414. https://doi.org/10.1145/1518701.1518766
  25. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science 4, 1 (2009), 1–15. https://doi.org/10.1186/1748-5908-4-50
  26. The Idea Machine: LLM-based Expansion, Rewriting, Combination, and Suggestion of Ideas. In Proceedings of the 14th Conference on Creativity and Cognition. 623–627. https://doi.org/10.1145/3527927.3535197
  27. Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study. Implementation Science Communications 1, 1 (2020), 1–13. https://doi.org/10.1186/s43058-020-00020-w
  28. Paul Dourish. 2006. Implications for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 541–550. https://doi.org/10.1145/1124772.1124855
  29. Stefania Druga and Nancy Otero. 2023. Scratch Copilot Evaluation: Assessing AI-Assisted Creative Coding for Families. arXiv preprint arXiv:2305.10417 (2023). https://arxiv.org/abs/2305.10417
  30. Charles Eames and Ray Eames. 1952. Eames House of Cards. https://eames.com/en/house-of-cards
  31. Richard F Elmore. 1979. Backward Mapping: Implementation Research and Policy Decisions. Political Science Quarterly 94, 4 (1979), 601–616. https://doi.org/10.2307/2149628
  32. When happy accidents spark creativity: Bringing collaborative speculation to life with generative AI. arXiv preprint arXiv:2206.00533 (2022). https://arxiv.org/abs/2206.00533
  33. Gallery D.C: auto-created GUI component gallery for design search and knowledge discovery. In Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings. 80–84. https://doi.org/10.1145/3510454.3516873
  34. Aidin Ferdowsi and Walid Saad. 2023. Brainstorming Generative Adversarial Networks (BGANs): Towards Multi-Agent Generative Models With Distributed Datasets. IEEE Internet of Things Journal (2023). https://doi.org/10.1109/JIOT.2023.3319630
  35. AI in design idea development: A workshop on creativity and human-AI collaboration. PROCEEDINGS OF DRS (2022), 1–17. https://doi.org/10.21606/drs.2022.414
  36. JW Frens and BJ Hengeveld. 2013. To Make Is To Grasp. In 5th Intermational Congress of International Association of Societies of Design Research (IASDR), 26-30 August 2013, Tokyo.
  37. Mapping the Landscape of Creativity Support Tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–18. https://doi.org/10.1145/3290605.3300619
  38. Creativity support systems: A systematic mapping study. Thinking Skills and Creativity 21 (2016), 109–122. https://doi.org/10.1016/j.tsc.2016.05.009
  39. Katy Ilonka Gero and Lydia B Chilton. 2019a. How a Stylistic, Machine-Generated Thesaurus Impacts a Writer’s Process. In Proceedings of the 2019 Conference on Creativity and Cognition. 597–603. https://doi.org/10.1145/3325480.3326573
  40. Katy Ilonka Gero and Lydia B Chilton. 2019b. Metaphoria: An Algorithmic Companion for Metaphor Creation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3290605.3300526
  41. Esra Gonen. 2020. Tim Brown, Change by Design: How Design Thinking Transforms Organizations and Inspires Innovation (2009). Markets, Globalization & Development Review 4, 2 (2020). https://doi.org/10.23860/MGDR-2019-04-02-08
  42. Reprioritizing the Relationship Between HCI Research and Practice: Bubble-Up and Trickle-Down Effects. In Proceedings of the 2014 Conference on Designing Interactive Systems. 725–734. https://doi.org/10.1145/2598510.2598595
  43. Emrecan Gulay and Andrés Lucero. 2019. Integrated Workflows: Generating Feedback Between Digital and Physical Realms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3290605.3300290
  44. Mind the Theoretical Gap: Interpreting, Using, and Developing Behavioral Theory in HCI Research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3307–3316. https://doi.org/10.1145/2470654.2466452
  45. C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model. arXiv preprint arXiv:2401.12586 (2024). https://arxiv.org/abs/2401.12586
  46. Large Language Models are Zero-Shot Rankers for Recommender Systems. arXiv preprint arXiv:2305.08845 (2023). https://arxiv.org/abs/2305.08845
  47. What is in the Cards: Exploring Uses, Patterns, and Trends in Design Cards. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18. https://doi.org/10.1145/3544548.3580712
  48. Angel Hsing-Chi Hwang. 2022. Too Late to be Creative? AI-Empowered Tools in Creative Processes. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–9. https://doi.org/10.1145/3491101.3503549
  49. FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18. https://doi.org/10.1145/3411764.3445093
  50. Comparing the Ideation Quality of Humans With Generative Artificial Intelligence. IEEE Engineering Management Review (2024). https://doi.org/10.1109/EMR.2024.3353338
  51. Supporting Reinterpretation in Computer-Aided Conceptual Design. In EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling. 151–158.
  52. Mechanical Novel: Crowdsourcing Complex Work through Reflection and Revision. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. 233–245. https://doi.org/10.1145/2998181.2998196
  53. Metaphorian: Leveraging Large Language Models to Support Extended Metaphor Creation for Science Writing. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 115–135.
  54. DiaryMate: Exploring the Roles of Large Language Models in Facilitating AI-mediated Journaling. In CHI 2023 Workshop on Intelligent and Interactive Writing Assistants (In2Writing).
  55. Beyond the Obvious-Towards a Creativity Support System using AI-driven Inspiration. In AMCIS. https://aisel.aisnet.org/amcis2020/cognitive_in_is/cognitive_in_is/7
  56. Large-scale Text-to-Image Generation Models for Visual Artists’ Creative Works. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 919–933. https://doi.org/10.1145/3581641.3584078
  57. Robert E Kraut and Paul Resnick. 2012. Building Successful Online Communities: Evidence-Based Social Design. MIT Press.
  58. Creative Data Work in the Design Process. In Proceedings of the 2019 on Creativity and Cognition. 346–358. https://doi.org/10.1145/3325480.3325500
  59. Anne LaFond and Montana Cherney. 2021. A Theory of Change for Guiding the Integration of Human-Centered Design Into Global Health Programming. Global Health: Science and Practice 9, Supplement 2 (2021), S209–S216. https://doi.org/10.9745/GHSP-D-21-00334
  60. Drawing with Reframer: Emergence and Control in Co-Creative AI. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 264–277. https://doi.org/10.1145/3581641.3584095
  61. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19. https://doi.org/10.1145/3491102.3502030
  62. Optimizing Implementation in Cancer Control (OPTICC): protocol for an implementation science center. Implementation Science Communications 2, 1 (2021), 1–16. https://doi.org/10.1186/s43058-021-00117-w
  63. The mechanics of implementation strategies and measures: advancing the study of implementation mechanisms. Implementation Science Communications 3, 1 (2022), 1–11. https://doi.org/10.1186/s43058-022-00358-3
  64. From Classification to Causality: Advancing Understanding of Mechanisms of Change in Implementation Science. Frontiers in Public Health 6 (2018), 136. https://doi.org/10.3389/fpubh.2018.00136
  65. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3313831.3376590
  66. TurKit: human computation algorithms on mechanical turk. In Proceedings of the 23nd annual ACM Symposium on User Interface Software and Technology. 57–66. https://doi.org/10.1145/1866029.1866040
  67. AI Assistance for UX: A Literature Review Through Human-Centered AI. arXiv preprint arXiv:2402.06089 (2024). https://arxiv.org/abs/2402.06089
  68. Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7. https://doi.org/10.1145/3544549.3574132
  69. Leveraging Human-Centered Design to Implement Modern Psychological Science: Return on an Early Investment. American Psychologist 75, 8 (2020), 1067. https://doi.org/10.1037/amp0000652
  70. Destroy All Humans: The Dematerialisation of the Designer in an Age of Automation and its Impact on Graphic Design—A Literature Review. International Journal of Art & Design Education 42, 3 (2023), 367–383. https://doi.org/10.1111/jade.12460
  71. Tony McCaffrey. 2018. Human-AI Synergy in Creativity and Innovation. Artificial Intelligence: Emerging Trends and Applications; IntechOpen: London, UK (2018), 143. https://doi.org/10.5772/intechopen.75310
  72. Causal pathway diagrams: A toolkit for improving the impact of implementation strategies. (2023).
  73. Miro. 2023. Miro. https://miro.com
  74. Co-Writing Screenplays and Theatre Scripts with Language Models: Evaluation by Industry Professionals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–34. https://doi.org/10.1145/3544548.3581225
  75. A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems. ACM Transactions on Interactive Intelligent Systems 11, 3-4 (2021), 1–45. https://doi.org/10.1145/3387166
  76. Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine. arXiv preprint arXiv:2311.16452. https://arxiv.org/abs/2311.16452
  77. Donald A Norman. 2010. The Research-Practice Gap: The Need for Translational Developers. Interactions 17, 4 (2010), 9–12. https://doi.org/10.1145/1806491.1806494
  78. Elazar J Pedhazur and Fred Nichols Kerlinger. 1982. Multiple Regression in Behavioral Research: Explanation and Prediction.
  79. AngleKindling: Supporting Journalistic Angle Ideation with Large Language Models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16. https://doi.org/10.1145/3544548.3580907
  80. Johan Redstrom. 2017. Making Design Theory. MIT Press.
  81. Supermind Ideator: Exploring generative AI to support creative problem-solving. arXiv preprint arXiv:2311.01937 (2023). https://arxiv.org/abs/2311.01937
  82. David J Roedl and Erik Stolterman. 2013. Design Research at CHI and its Applicability to Design Practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1951–1954. https://doi.org/10.1145/2470654.2466257
  83. Yvonne Rogers. 2004. New theoretical approaches for HCI. Annual review of information science and technology 38, 1 (2004), 87–143.
  84. Yvonne Rogers. 2022. HCI Theory: Classical, Modern, and Contemporary. Springer Nature. https://doi.org/10.1007/978-3-031-02197-8
  85. Interaction Design: Beyond Human-Computer Interaction. (2002).
  86. Simulating the Human in HCD with ChatGPT: Redesigning Interaction Design with AI. Interactions 31, 1 (2024), 24–31. https://doi.org/10.1145/3637436
  87. Donald A Schon. 1983. The Reflective Practitioner: How Professionals Think in Action. Basic Books New York.
  88. Ben Shneiderman. 2002. Creativity Support Tools. Commun. ACM 45, 10 (2002), 116–120. https://doi.org/10.1145/570907.570945
  89. Ben Shneiderman and Catherine Plaisant. 2010. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Pearson.
  90. Theory of Change.
  91. A Practical Take on Theory in HCI. White paper (2019).
  92. Questionable Concepts: Critique as a Resource for Designing with Eighty Somethings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1169–1178. https://doi.org/10.1145/2207676.2208567
  93. ”It Felt Like Having a Second Mind”: Investigating Human-AI Co-creativity in Prewriting with Large Language Models. arXiv preprint arXiv:2307.10811 (2023). https://arxiv.org/abs/2307.10811
  94. Qian Wan and Zhicong Lu. 2023. Investigating Semantically-enhanced Exploration of GAN Latent Space via a Digital Mood Board. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–5. https://doi.org/10.1145/3544549.3585740
  95. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work. 103–106. https://doi.org/10.1145/1718918.1718938
  96. Kai Wang and Jeffrey V Nickerson. 2017. A literature review on individual creativity support systems. Computers in Human Behavior 74 (2017), 139–151. https://doi.org/10.1016/j.chb.2017.04.035
  97. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824–24837.
  98. A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT. arXiv preprint arXiv:2302.11382 (2023). https://arxiv.org/abs/2302.11382
  99. A Survey on Large Language Models for Recommendation. arXiv preprint arXiv:2305.19860 (2023). https://arxiv.org/abs/2305.19860
  100. Albena Yaneva. 2005. Scaling Up and Down: Extraction Trials in Architectural Design. Social Studies of Science 35, 6 (2005), 867–894. https://doi.org/10.1177/0306312705053053
  101. Eric York. 2023. Evaluating ChatGPT: Generative AI in UX Design and Web Development Pedagogy. In Proceedings of the 41st ACM International Conference on Design of Communication. 197–201. https://doi.org/10.1145/3615335.3623035
  102. Robert J Youmans and Thomaz Arciszewski. 2014. Design fixation: Classifications and modern methods of prevention. Artificial Intelligence for Engineering Design, Analysis and Manufacturing 28, 2 (2014), 129–137. https://doi.org/10.1017/S0890060414000043
  103. Lixiu Yu and Jeffrey V Nickerson. 2011. Cooks or Cobblers? Crowd Creativity through Combination. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1393–1402. https://doi.org/10.1145/1978942.1979147
  104. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. 841–852. https://doi.org/10.1145/3490099.3511105
  105. Towards Image Design Space Exploration in Spreadsheets with LLM Formulae. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–3. https://doi.org/10.1145/3586182.3615790
  106. Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–21. https://doi.org/10.1145/3544548.3581388
  107. StoryDrawer: A Child–AI Collaborative Drawing System to Support Children’s Creative Visual Storytelling. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3491102.3501914

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free