Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

GOLF: Goal-Oriented Long-term liFe tasks supported by human-AI collaboration (2403.17089v2)

Published 25 Mar 2024 in cs.HC, cs.AI, and cs.IR

Abstract: The advent of ChatGPT and similar LLMs has revolutionized the human-AI interaction and information-seeking process. Leveraging LLMs as an alternative to search engines, users can now access summarized information tailored to their queries, significantly reducing the cognitive load associated with navigating vast information resources. This shift underscores the potential of LLMs in redefining information access paradigms. Drawing on the foundation of task-focused information retrieval and LLMs' task planning ability, this research extends the scope of LLM capabilities beyond routine task automation to support users in navigating long-term and significant life tasks. It introduces the GOLF framework (Goal-Oriented Long-term liFe tasks), which focuses on enhancing LLMs' ability to assist in significant life decisions through goal orientation and long-term planning. The methodology encompasses a comprehensive simulation study to test the framework's efficacy, followed by model and human evaluations to develop a dataset benchmark for long-term life tasks, and experiments across different models and settings. By shifting the focus from short-term tasks to the broader spectrum of long-term life goals, this research underscores the transformative potential of LLMs in enhancing human decision-making processes and task management, marking a significant step forward in the evolution of human-AI collaboration.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. David Allen. 2015. Getting things done: The art of stress-free productivity. Penguin.
  2. Leif Azzopardi. 2021. Cognitive biases in search: a review and reflection of cognitive biases in Information Retrieval. In Proceedings of the 2021 conference on human information interaction and retrieval. 27–37.
  3. ChatGPT: Applications, opportunities, and threats. In 2023 Systems and Information Engineering Design Symposium (SIEDS). IEEE, 274–279.
  4. Marcia J Bates. 1989. The design of browsing and berrypicking techniques for the online search interface. Online review 13, 5 (1989), 407–424.
  5. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877–1901.
  6. Katriina Byström and Preben Hansen. 2005. Conceptual framework for tasks in information studies. Journal of the American Society for Information science and Technology 56, 10 (2005), 1050–1061.
  7. Ahmed Hassan and Ryen W White. 2012. Task tours: helping users tackle complex search tasks. In Proceedings of the 21st ACM international conference on Information and knowledge management. 1885–1889.
  8. Supporting complex search tasks. In Proceedings of the 23rd ACM international conference on conference on information and knowledge management. 829–838.
  9. Understanding the planning of LLM agents: A survey. arXiv preprint arXiv:2402.02716 (2024).
  10. Task-based information interaction evaluation: The viewpoint of program theory. ACM Transactions on Information Systems (TOIS) 33, 1 (2015), 1–30.
  11. Retrieve, Summarize, and Verify: How will ChatGPT impact information seeking from the medical literature? Journal of the American Society of Nephrology (2023), 10–1681.
  12. Carol C Kuhlthau. 1991. Inside the search process: Information seeking from the user’s perspective. Journal of the American society for information science 42, 5 (1991), 361–371.
  13. Camel: Communicative agents for” mind” exploration of large scale language model society. arXiv preprint arXiv:2303.17760 (2023).
  14. Identifying and predicting the states of complex search tasks. In Proceedings of the 2020 conference on human information interaction and retrieval. 193–202.
  15. Jiqun Liu and Chirag Shah. 2022. Leveraging user interaction signals and task state information in adaptively optimizing usefulness-oriented search sessions. In Proceedings of the 22nd ACM/IEEE joint conference on digital libraries. 1–11.
  16. Ronald Moen and Clifford Norman. 2006. Evolution of the PDCA cycle.
  17. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730–27744.
  18. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–22.
  19. Peter Pirolli and Stuart Card. 1999. Information foraging. Psychological review 106, 4 (1999), 643.
  20. Markus Schlosser. 2015. Agency. (2015).
  21. Chirag Shah and Emily M. Bender. 2024. Envisioning Information Access Systems: What Makes for Good Tools and a Healthy Web? ACM Transactions on the Web (Feb. 2024), 3649468. https://doi.org/10.1145/3649468
  22. Taking search to task. In Proceedings of the 2023 Conference on Human Information Interaction and Retrieval. 1–13.
  23. The user experience of ChatGPT: Findings from a questionnaire study of early users. In Proceedings of the 5th International Conference on Conversational User Interfaces. 1–10.
  24. Yang Song and Qi Guo. 2016. Query-less: Predicting task repetition for nextgen proactive search and recommendation engines. In Proceedings of the 25th International Conference on World Wide Web. 543–553.
  25. Untangling the concept of task in information seeking and retrieval. In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval. 73–81.
  26. Elaine G Toms. 2019. Information activities and tasks. Information at work: information management in the workplace. London: Facet Publishing (2019), 33–62.
  27. Pertti Vakkari. 2003. Task-based information searching. Annual Review of Information Science and Technology (ARIST) 37 (2003), 413–64.
  28. Ben Wang. 2024. A Proactive System for Supporting Users in Interactions with Large Language Models. In Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval. 441–444.
  29. Task Supportive and Personalized Human-Large Language Model Interaction: A User Study. In Proceedings of the 2024 Conference on Human Information Interaction and Retrieval. 370–375.
  30. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824–24837.
  31. Task completion detection: A study in the context of intelligent systems. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 405–414.
  32. Autogen: Enabling next-gen llm applications via multi-agent conversation framework. arXiv preprint arXiv:2308.08155 (2023).
  33. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864 (2023).
  34. Iris Xie. 2009. Dimensions of tasks: influences on information-seeking and retrieving process. Journal of Documentation 65, 3 (2009), 339–366.
  35. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629 (2022).
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (1)
  1. Ben Wang (42 papers)
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube