2000 character limit reached
Towards Intent-based User Interfaces: Charting the Design Space of Intent-AI Interactions Across Task Types (2404.18196v2)
Published 28 Apr 2024 in cs.HC
Abstract: Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI interaction across a diverse set of tasks: fixed-scope content curation task, atomic creative tasks, and complex and interdependent tasks. This exploration aims to inform and contribute to the development of Intent-based User Interface (IUI). The study is structured in three phases: examining fixed-scope tasks through news headline generation, exploring atomic creative tasks via analogy generation, and delving into complex tasks through exploratory visual data analysis. Future work will focus on improving IUIs to better provide suggestions to encourage experienced users to express broad and exploratory intents, and detailed and structured guidance for novice users to iterate on analysis intents for high quality outputs.
- Formulating or Fixating: Effects of Examples on Problem Solving Vary as a Function of Example Presentation Interface Design. http://arxiv.org/abs/2401.11022 arXiv:2401.11022 [cs].
- Semantically Far Inspirations Considered Harmful?: Accounting for Cognitive States in Collaborative Ideation. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C ’17). ACM, New York, NY, USA, 93–105. https://doi.org/10.1145/3059454.3059455
- All That’s ’Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text. arXiv:2107.00061 [cs] (July 2021). http://arxiv.org/abs/2107.00061 00008 arXiv: 2107.00061.
- Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces. ACM, Tokyo Japan, 329–340. https://doi.org/10.1145/3172944.3172983
- Zijian Ding and Joel Chan. 2024. Intelligent Canvas: Enabling Design-Like Exploratory Visual Data Analysis with Generative AI through Rapid Prototyping, Iteration and Curation. https://doi.org/10.48550/arXiv.2402.08812 arXiv:2402.08812 [cs].
- TalkTive: A Conversational Agent Using Backchannels to Engage Older Adults in Neurocognitive Disorders Screening. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1–19. https://doi.org/10.1145/3491102.3502005
- Harnessing the Power of LLMs: Evaluating Human-AI Text Co-Creation through the Lens of News Headline Generation. http://arxiv.org/abs/2310.10706 arXiv:2310.10706 [cs].
- Fluid Transformers and Creative Analogies: Exploring Large Language Models’ Capacity for Augmenting Cross-Domain Analogical Creativity. arXiv preprint arXiv:2302.12832 (2023).
- Karl Duncker. 1945. On problem-solving. Psychological Monographs 58, 5 (1945), i–113. https://doi.org/10.1037/h0093599
- Sparks: Inspiration for Science Writing using Language Models. In Designing Interactive Systems Conference. ACM, Virtual Event Australia, 1002–1019. https://doi.org/10.1145/3532106.3533533
- News Summarization and Evaluation in the Era of GPT-3. http://arxiv.org/abs/2209.12356 arXiv:2209.12356 [cs].
- An exploratory study of how abundant display space may support data analysis. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, Copenhagen Denmark, 558–567. https://doi.org/10.1145/2399016.2399102
- Evaluating Human-Language Model Interaction. http://arxiv.org/abs/2212.09746 arXiv:2212.09746 [cs] version: 2.
- Zhicheng Lin. 2023. Why and how to embrace AI such as ChatGPT in your academic life. preprint. PsyArXiv. https://doi.org/10.31234/osf.io/sdx3j
- Finding Place in a Design Space: Challenges for Supporting Community Design Efforts at Scale. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 1–30. https://doi.org/10.1145/3449246
- ProbMap: Automatically constructing design galleries through feature extraction and semantic clustering. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. ACM, Virtual Event USA, 134–136. https://doi.org/10.1145/3474349.3480203
- Framing Creative Work: Helping Novices Frame Better Problems through Interactive Scaffolding. In Creativity and Cognition (C&C ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3450741.3465261
- The ”Active Search” Hypothesis: How Search Strategies Relate to Creative Learning. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. ACM, Canberra ACT Australia, 325–329. https://doi.org/10.1145/3406522.3446046
- CoNotate: Suggesting Queries Based on Notes Promotes Knowledge Discovery. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3411764.3445618
- R. Keith Sawyer. 2012. Explaining creativity: the science of human innovation (2nd ed.). Oxford University Press, New York.
- Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence. ACM Transactions on Computer-Human Interaction (Feb. 2022), 3511599. https://doi.org/10.1145/3511599
- DynaVis: Dynamically Synthesized UI Widgets for Visualization Editing. http://arxiv.org/abs/2401.10880 arXiv:2401.10880 [cs].
- LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing. In Proceedings of the 29th International Conference on Intelligent User Interfaces. ACM, Greenville SC USA, 699–714. https://doi.org/10.1145/3640543.3645143
- Ivie: Lightweight Anchored Explanations of Just-Generated Code. https://doi.org/10.1145/3613904.3642239 arXiv:2403.02491 [cs].
- XCreation: A Graph-based Crossmodal Generative Creativity Support Tool. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. ACM, San Francisco CA USA, 1–15. https://doi.org/10.1145/3586183.3606826
- Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. ACM, Helsinki Finland, 841–852. https://doi.org/10.1145/3490099.3511105
- Q. Zhu and J. Luo. 2022. Generative Pre-Trained Transformer for Design Concept Generation: An Exploration. Proceedings of the Design Society 2 (May 2022), 1825–1834. https://doi.org/10.1017/pds.2022.185 Publisher: Cambridge University Press.