Papers
Topics
Authors
Recent
2000 character limit reached

From Paper to Card: Transforming Design Implications with Generative AI (2403.08137v1)

Published 12 Mar 2024 in cs.HC, cs.AI, and cs.CL

Abstract: Communicating design implications is common within the HCI community when publishing academic papers, yet these papers are rarely read and used by designers. One solution is to use design cards as a form of translational resource that communicates valuable insights from papers in a more digestible and accessible format to assist in design processes. However, creating design cards can be time-consuming, and authors may lack the resources/know-how to produce cards. Through an iterative design process, we built a system that helps create design cards from academic papers using an LLM and text-to-image model. Our evaluation with designers (N=21) and authors of selected papers (N=12) revealed that designers perceived the design implications from our design cards as more inspiring and generative, compared to reading original paper texts, and the authors viewed our system as an effective way of communicating their design implications. We also propose future enhancements for AI-generated design cards.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. Design Card Sets: Systematic Literature Survey and Card Sorting Study. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 419–428. https://doi.org/10.1145/3357236.3395516
  2. RePlay: Touchscreen Interaction Substitution Method for Accessible Gaming. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction. 1–12. https://doi.org/10.1145/3447526.3472044
  3. Semantically Consistent Hierarchical Text to Fashion Image Synthesis with an Enhanced-Attentional Generative Adversarial Network. In 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). IEEE, 3121–3124. https://doi.org/10.1109/ICCVW.2019.00379
  4. Khadeeja Alkhuzai and Alena Denisova. 2021. Evaluating the Use of Persuasive Design Cards for Novice Designers. Journal of usability studies 16, 2 (2021), 91–120. https://uxpajournal.org/persuasive-design-cards-novice-designers
  5. Tal August and Katharina Reinecke. 2019. Pay Attention, Please: Formal Language Improves Attention in Volunteer and Paid Online Experiments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11. https://doi.org/10.1145/3290605.3300478
  6. Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing. arXiv preprint arXiv:2203.00130 (2022). https://doi.org/10.48550/arXiv.2203.00130
  7. Constitutional AI: Harmlessness from AI Feedback. arXiv preprint arXiv:2212.08073 (2022). https://doi.org/10.48550/arXiv.2212.08073
  8. Keep it Simple: How Visual Complexity and Preferences Impact Search Efficiency on Websites. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376849
  9. Dan S Bloomberg. 2008. Color quantization using modified median cut. Leptonica (2008). http://leptonica.org/papers/mediancut.pdf
  10. Ali Borji. 2022. Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2. arXiv preprint arXiv:2210.00586 (2022). https://doi.org/10.48550/arXiv.2210.00586
  11. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706QP063OA
  12. An Empirical Study of Older Adult’s Voice Assistant Use for Health Information Seeking. ACM Transactions on Interactive Intelligent Systems (TiiS) 12, 2 (2022), 1–32. https://doi.org/10.1145/3484507
  13. Language Models are Few-Shot Learners. Advances in Neural Information Processing Systems 33 (2020), 1877–1901. https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  14. TLDR: Extreme Summarization of Scientific Documents. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, 4766–4777. https://doi.org/10.18653/v1/2020.findings-emnlp.428
  15. How Novelists Use Generative Language Models: An Exploratory User Study. In HAI-GEN+ user2agent@ IUI. https://ceur-ws.org/Vol-2848/HAI-GEN-Paper-3.pdf
  16. Using symbolic meaning as a means to design for happiness: The development of a card set for designers. (2016). https://doi.org/10.21606/drs.2016.424
  17. Exploring the Use of a Voice-based Conversational Agent to Empower Adolescents with Autism Spectrum Disorder. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3411764.3445116
  18. Mobile Interface Design for Low-Literacy Populations. In Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium. 91–100. https://doi.org/10.1145/2110363.2110377
  19. David Chung and Rung-Huei Liang. 2015. Understanding the Usefulness of Ideation Tools with the Grounding Lenses. In Proceedings of the Third International Symposium of Chinese CHI. 13–22. https://doi.org/10.1145/2739999.2740002
  20. TaleBrush: Sketching Stories with Generative Pretrained Language Models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19. https://doi.org/10.1145/3491102.3501819
  21. Translational Resources: Reducing the Gap Between Academic Research and HCI Practice. In Proceedings of the 2017 Conference on Designing Interactive Systems. 957–968. https://doi.org/10.1145/3064663.3064667
  22. Behavior Change Design Sprints. In Proceedings of the 2018 Designing Interactive Systems Conference. 791–803. https://doi.org/10.1145/3196709.3196739
  23. A Translational Science Model for HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3290605.3300231
  24. Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits. In 2022 ACM Conference on Fairness, Accountability, and Transparency. 473–484. https://doi.org/10.1145/3531146.3533113
  25. Tango Cards: A Card-Based Design Tool for Informing the Design of Tangible Learning Games. In Proceedings of the 2014 Conference on Designing Interactive Systems. 695–704. https://doi.org/10.1145/2598510.2598601
  26. Wikipedia Risks. Commun. ACM 48, 12 (2005), 152–152. https://doi.org/10.1145/1101779.1101804
  27. MS2: Multi-Document Summarization of Medical Studies. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 7494–7513. https://doi.org/10.18653/v1/2021.emnlp-main.594
  28. The Idea Machine: LLM-based Expansion, Rewriting, Combination, and Suggestion of Ideas. In Creativity and Cognition. 623–627. https://doi.org/10.1145/3527927.3535197
  29. Guo Freeman and Divine Maloney. 2021. Body, Avatar, and Me: The Presentation and Perception of Self in Social Virtual Reality. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (2021), 1–27. https://doi.org/10.1145/3432938
  30. DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents. In AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v36i1.19943
  31. An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion. arXiv preprint arXiv:2208.01618 (2022). https://doi.org/10.48550/arXiv.2208.01618
  32. Paul Haeberli. 1990. Paint by Numbers: Abstract Image Representations. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques. 207–214. https://doi.org/10.1145/97879.97902
  33. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. In NIPS. https://proceedings.neurips.cc/paper_files/paper/2017/file/8a1d694707eb0fefe65871369074926d-Paper.pdf
  34. What is in the Cards: Exploring Uses, Patterns, and Trends in Design Cards. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3544548.3580712
  35. IDEO. 2023. Method Cards. https://www.ideo.com/post/method-cards
  36. How Older Adults Use Online Videos for Learning. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3544548.3580671
  37. In Helping a Vulnerable Bot, You Help Yourself: Designing a Social Bot as a Care-Receiver to Promote Mental Health and Reduce Stigma. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3313831.3376743
  38. We-toon: A Communication Support System between Writers and Artists in Collaborative Webtoon Sketch Revision. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–14. https://doi.org/10.1145/3526113.3545612
  39. Large-Scale Text-to-Image Generation Models for Visual Artists’ Creative Works. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 919–933. https://doi.org/10.1145/3581641.3584078
  40. Comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3290605.3300777
  41. Richard J Lamberski and Francis M Dwyer. 1983. The Instructional Effect of Coding [Color and Black and White] on Information Acquisition and Retrieval. ECTJ 31, 1 (1983), 9–21. https://doi.org/10.1007/BF02765207
  42. CIST@CL-SciSumm 2020, LongSumm 2020: Automatic Scientific Document Summarization. In Proceedings of the First Workshop on Scholarly Document Processing. Association for Computational Linguistics, 225–234. https://doi.org/10.18653/v1/2020.sdp-1.25
  43. GPTEval: NLG Evaluation using GPT-4 with Better Human Alignment. arXiv preprint arXiv:2303.16634 (2023). https://doi.org/10.48550/arXiv.2303.16634
  44. The Design with Intent Method: A design tool for influencing user behaviour. Applied Ergonomics 41, 3 (2010), 382–392. https://doi.org/10.1016/j.apergo.2009.09.001
  45. Patrice Lopez. 2009. GROBID: Combining Automatic Bibliographic Data Recognition and Term Extraction for Scholarship Publications. In Research and Advanced Technology for Digital Libraries: 13th European Conference, ECDL 2009, Corfu, Greece, September 27-October 2, 2009. Proceedings 13. Springer, 473–474. https://doi.org/10.1007/978-3-642-04346-8_62
  46. Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articles. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 8068–8074. https://doi.org/10.18653/v1/2020.emnlp-main.648
  47. Including the Experiences of Physically Disabled Players in Mainstream Guidelines for Movement-Based Games. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3501867
  48. Co-designing Mobile Online Safety Applications with Children. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–9. https://doi.org/10.1145/3173574.3174097
  49. DALL·E 2 Preview - Risks and Limitations. (2022).
  50. ACM CHI Conference on Human Factors in Computing Systems. 2023. Guide to a Successful Submission. https://chi2023.acm.org/for-authors/presenting/papers/guide-to-a-successful-submission
  51. John V Pavlik. 2023. Collaborating With ChatGPT: Considering the Implications of Generative Artificial Intelligence for Journalism and Media Education. Journalism & Mass Communication Educator (2023). https://doi.org/10.1177/10776958221149577
  52. Hierarchical Text-Conditional Image Generation with CLIP Latents. arXiv preprint arXiv:2204.06125 (2022). https://doi.org/10.48550/arXiv.2204.06125
  53. Named Entity Recognition Based Automatic Generation of Research Highlights. In Proceedings of the Third Workshop on Scholarly Document Processing. Association for Computational Linguistics, 163–169. https://aclanthology.org/2022.sdp-1.18
  54. Studying Always-On Electricity Feedback in the Home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1995–1998. https://doi.org/10.1145/1753326.1753628
  55. High-Resolution Image Synthesis With Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10684–10695. https://doi.org/10.1109/CVPR52688.2022.01042
  56. Robin Roy and James P Warren. 2019. Card-based design tools: A review and analysis of 155 card decks for designers and designing. Design Studies 63 (2019), 125–154. https://doi.org/10.1016/j.destud.2019.04.002
  57. Generating Implications for Design through Design Research. In Proceedings of the SIGCHI conference on human factors in computing systems. 1971–1980. https://doi.org/10.1145/2556288.2557357
  58. ExplAIn Yourself! Transparency for Positive UX in Autonomous Driving. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3411764.3446647
  59. Automatic Slide Generation for Scientific Papers. In SciKnow@K-CAP. http://ceur-ws.org/Vol-2526/paper2.pdf
  60. Operationalizing and Implementing Pretrained, Large Artificial Intelligence Linguistic Models in the US Health Care System: Outlook of Generative Pretrained Transformer 3 (GPT-3) as a Service Model. JMIR Medical Informatics 10, 2 (2022), e32875. https://doi.org/10.2196/32875
  61. SAGA: Collaborative Storytelling with GPT-3. In Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing. 163–166. https://doi.org/10.1145/3462204.3481771
  62. Rashi Shrivastava. 2023. ChatGPT is coming to a customer service chatbot near you. https://www.forbes.com/sites/rashishrivastava/2023/01/09/chatgpt-is-coming-to-a-customer-service-chatbot-near-you/
  63. CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3526113.3545617
  64. User Expectations of Conversational Chatbots Based on Online Reviews. In Designing Interactive Systems Conference 2021. https://doi.org/10.1145/3461778.3462125
  65. Creating Crowdsourced Research Talks at Scale. In Proceedings of the 2018 World Wide Web Conference. 1–11. https://doi.org/10.1145/3178876.3186031
  66. A melody-conditioned lyrics language model. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 163–172. https://doi.org/10.18653/v1/N18-1015
  67. An HCI Research Agenda for Online Science Communication. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–22. https://doi.org/10.1145/3555591
  68. Large Language Models are Diverse Role-Players for Summarization Evaluation. arXiv preprint arXiv:2303.15078 (2023). https://doi.org/10.48550/arXiv.2303.15078
  69. Exploring Antecedents and Consequences of Toxicity in Online Discussions: A Case Study on Reddit. Proceedings of the ACM on Human-computer Interaction 4, CSCW2 (2020), 1–23. https://doi.org/10.1145/3415179
  70. Sheng Xu and Xiaojun Wan. 2022. PosterBot: A System for Generating Posters of Scientific Papers with Neural Models. In AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v36i11.21738
  71. Developing Usage Guidelines for a Card-Based Design Tool: A Case of the Positive Emotional Granularity Cards. Archives of Design Research 29, 4 (2016), 5–18. https://doi.org/10.15187/adr.2016.11.29.4.5
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free