Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
38 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Exploring the Impact of AI Value Alignment in Collaborative Ideation: Effects on Perception, Ownership, and Output (2402.12814v3)

Published 20 Feb 2024 in cs.HC

Abstract: AI-based virtual assistants are increasingly used to support daily ideation tasks. The values or bias present in these agents can influence output in hidden ways. They may also affect how people perceive the ideas produced with these AI agents and lead to implications for the design of AI-based tools. We explored the effects of AI agents with different values on the ideation process and user perception of idea quality, ownership, agent competence, and values present in the output. Our study tasked 180 participants with brainstorming practical solutions to a set of problems with AI agents of different values. Results show no significant difference in self-evaluation of idea quality and perception of the agent based on value alignment; however, ideas generated reflected the AI's values and feeling of ownership is affected. This highlights an intricate interplay between AI values and human ideation, suggesting careful design considerations for future AI-supported brainstorming tools.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. 8values [n. d.]. 8values. https://8values.github.io/. https://8values.github.io/
  2. Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT. arXiv:2303.03186 [cs.CL]
  3. Min Basadur and Carl T. Finkbeiner. 1983. Measuring Preference for Ideation in Creative Problem-Solving Training. The Journal of Applied Behavioral Science 21 (1983), 37 – 49. https://api.semanticscholar.org/CorpusID:141873181
  4. Training in creative problem solving: Effects on ideation and problem finding and solving in an industrial research organization. Organizational Behavior and Human Performance 30 (1982), 41–70. https://api.semanticscholar.org/CorpusID:145656215
  5. Amy Baylor and Jeeheon Ryu. 2003. The API (Agent Persona Instrument) for Assessing Pedagogical Agent Persona. (01 2003).
  6. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs.CL]
  7. Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems. https://doi.org/10.48550/arXiv.2104.00358 arXiv:2104.00358 [cs].
  8. Effects of anonymity and evaluative tone on idea generation in computer-mediated groups. Management Science 36 (1990), 689–703. https://api.semanticscholar.org/CorpusID:154981884
  9. Bringing automated support to large groups: The Burr-Brown experience. Information & Management 18, 3 (1990), 111–121. https://doi.org/10.1016/0378-7206(90)90065-P
  10. J. W. Getzels. 1975. Problem‐Finding and the Inventiveness of Solutions. Journal of Creative Behavior 9 (1975), 12–18. https://api.semanticscholar.org/CorpusID:143324806
  11. Designing for collaborative creative problem solving. In Creativity & Cognition. https://api.semanticscholar.org/CorpusID:321990
  12. Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers. ArXiv abs/2211.05030 (2022). https://api.semanticscholar.org/CorpusID:253420678
  13. Mikhail Jacob and Brian Magerko. 2015. Viewpoints AI. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (Glasgow, United Kingdom) (C&C ’15). Association for Computing Machinery, New York, NY, USA, 361–362. https://doi.org/10.1145/2757226.2757400
  14. Robert Joyner and Kenneth Tunstall. 1970. Computer Augmented Organizational Problem Solving. Management Science 17, 4 (1970), B212–B225. http://www.jstor.org/stable/2629371
  15. Jingoog Kim and Mary Lou Maher. 2023. The effect of AI-based inspiration on human design ideation. International Journal of Design Creativity and Innovation 11 (2023), 81 – 98. https://api.semanticscholar.org/CorpusID:256213310
  16. May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300863
  17. Agency in Co-Creativity: Towards a Structured Analysis of a Concept. https://www.semanticscholar.org/paper/Agency-in-Co-Creativity%3A-Towards-a-Structured-of-a-Koch-Ravikumar/46bd05136805aae23bd2cd0015bb1f6398e9cbe8
  18. Barry M. Kudrowitz and David R. Wallace. 2013. Assessing the quality of ideas from prolific, early-stage product ideation. Journal of Engineering Design 24 (2013), 120 – 139. https://api.semanticscholar.org/CorpusID:55480854
  19. Competition-level code generation with AlphaCode. Science 378 (2022), 1092 – 1097. https://api.semanticscholar.org/CorpusID:246527904
  20. It is your turn: Collaborative ideation with a co-creative robot through sketch. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–14.
  21. AI-Based Digital Assistants. Business & Information Systems Engineering 61 (2019), 535–544. https://api.semanticscholar.org/CorpusID:195220585
  22. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
  23. A. F. Osborn. 1953. Applied Imagination: Principles and Procedures of Creative Thinking. Scribner.
  24. The Effects of Creating Psychological Ownership on Physicians’ Acceptance of Clinical Information Systems. Journal of the American Medical Informatics Association : JAMIA 13 (03 2006), 197–205. https://doi.org/10.1197/jamia.M1930
  25. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
  26. ”It Felt Like Having a Second Mind”: Investigating Human-AI Co-creativity in Prewriting with Large Language Models. arXiv:2307.10811 [cs.HC]
  27. Chun-Hsiang Wang and Tsai-Yen Li. 2018. Design of an Intelligent Agent for Stimulating Brainstorming. Proceedings of the 2018 10th International Conference on Machine Learning and Computing (2018). https://api.semanticscholar.org/CorpusID:44092835
  28. Perfection Not Required? Human-AI Partnerships in Code Translation. CoRR abs/2104.03820 (2021). arXiv:2104.03820 https://arxiv.org/abs/2104.03820
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Alicia Guo (4 papers)
  2. Pat Pataranutaporn (17 papers)
  3. Pattie Maes (46 papers)
Citations (2)
X Twitter Logo Streamline Icon: https://streamlinehq.com