Exploring the Impact of AI Value Alignment in Collaborative Ideation: Effects on Perception, Ownership, and Output (2402.12814v3)
Abstract: AI-based virtual assistants are increasingly used to support daily ideation tasks. The values or bias present in these agents can influence output in hidden ways. They may also affect how people perceive the ideas produced with these AI agents and lead to implications for the design of AI-based tools. We explored the effects of AI agents with different values on the ideation process and user perception of idea quality, ownership, agent competence, and values present in the output. Our study tasked 180 participants with brainstorming practical solutions to a set of problems with AI agents of different values. Results show no significant difference in self-evaluation of idea quality and perception of the agent based on value alignment; however, ideas generated reflected the AI's values and feeling of ownership is affected. This highlights an intricate interplay between AI values and human ideation, suggesting careful design considerations for future AI-supported brainstorming tools.
- 8values [n. d.]. 8values. https://8values.github.io/. https://8values.github.io/
- Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT. arXiv:2303.03186 [cs.CL]
- Min Basadur and Carl T. Finkbeiner. 1983. Measuring Preference for Ideation in Creative Problem-Solving Training. The Journal of Applied Behavioral Science 21 (1983), 37 – 49. https://api.semanticscholar.org/CorpusID:141873181
- Training in creative problem solving: Effects on ideation and problem finding and solving in an industrial research organization. Organizational Behavior and Human Performance 30 (1982), 41–70. https://api.semanticscholar.org/CorpusID:145656215
- Amy Baylor and Jeeheon Ryu. 2003. The API (Agent Persona Instrument) for Assessing Pedagogical Agent Persona. (01 2003).
- Language Models are Few-Shot Learners. arXiv:2005.14165 [cs.CL]
- Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems. https://doi.org/10.48550/arXiv.2104.00358 arXiv:2104.00358 [cs].
- Effects of anonymity and evaluative tone on idea generation in computer-mediated groups. Management Science 36 (1990), 689–703. https://api.semanticscholar.org/CorpusID:154981884
- Bringing automated support to large groups: The Burr-Brown experience. Information & Management 18, 3 (1990), 111–121. https://doi.org/10.1016/0378-7206(90)90065-P
- J. W. Getzels. 1975. Problem‐Finding and the Inventiveness of Solutions. Journal of Creative Behavior 9 (1975), 12–18. https://api.semanticscholar.org/CorpusID:143324806
- Designing for collaborative creative problem solving. In Creativity & Cognition. https://api.semanticscholar.org/CorpusID:321990
- Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers. ArXiv abs/2211.05030 (2022). https://api.semanticscholar.org/CorpusID:253420678
- Mikhail Jacob and Brian Magerko. 2015. Viewpoints AI. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (Glasgow, United Kingdom) (C&C ’15). Association for Computing Machinery, New York, NY, USA, 361–362. https://doi.org/10.1145/2757226.2757400
- Robert Joyner and Kenneth Tunstall. 1970. Computer Augmented Organizational Problem Solving. Management Science 17, 4 (1970), B212–B225. http://www.jstor.org/stable/2629371
- Jingoog Kim and Mary Lou Maher. 2023. The effect of AI-based inspiration on human design ideation. International Journal of Design Creativity and Innovation 11 (2023), 81 – 98. https://api.semanticscholar.org/CorpusID:256213310
- May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300863
- Agency in Co-Creativity: Towards a Structured Analysis of a Concept. https://www.semanticscholar.org/paper/Agency-in-Co-Creativity%3A-Towards-a-Structured-of-a-Koch-Ravikumar/46bd05136805aae23bd2cd0015bb1f6398e9cbe8
- Barry M. Kudrowitz and David R. Wallace. 2013. Assessing the quality of ideas from prolific, early-stage product ideation. Journal of Engineering Design 24 (2013), 120 – 139. https://api.semanticscholar.org/CorpusID:55480854
- Competition-level code generation with AlphaCode. Science 378 (2022), 1092 – 1097. https://api.semanticscholar.org/CorpusID:246527904
- It is your turn: Collaborative ideation with a co-creative robot through sketch. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–14.
- AI-Based Digital Assistants. Business & Information Systems Engineering 61 (2019), 535–544. https://api.semanticscholar.org/CorpusID:195220585
- I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
- A. F. Osborn. 1953. Applied Imagination: Principles and Procedures of Creative Thinking. Scribner.
- The Effects of Creating Psychological Ownership on Physicians’ Acceptance of Clinical Information Systems. Journal of the American Medical Informatics Association : JAMIA 13 (03 2006), 197–205. https://doi.org/10.1197/jamia.M1930
- Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
- ”It Felt Like Having a Second Mind”: Investigating Human-AI Co-creativity in Prewriting with Large Language Models. arXiv:2307.10811 [cs.HC]
- Chun-Hsiang Wang and Tsai-Yen Li. 2018. Design of an Intelligent Agent for Stimulating Brainstorming. Proceedings of the 2018 10th International Conference on Machine Learning and Computing (2018). https://api.semanticscholar.org/CorpusID:44092835
- Perfection Not Required? Human-AI Partnerships in Code Translation. CoRR abs/2104.03820 (2021). arXiv:2104.03820 https://arxiv.org/abs/2104.03820
- Alicia Guo (4 papers)
- Pat Pataranutaporn (17 papers)
- Pattie Maes (46 papers)