From User Surveys to Telemetry-Driven AI Agents: Exploring the Potential of Personalized Productivity Solutions
Abstract: Information workers increasingly struggle with productivity challenges in modern workplaces, facing difficulties in managing time and effectively utilizing workplace analytics data for behavioral improvement. Despite the availability of productivity metrics through enterprise tools, workers often fail to translate this data into actionable insights. We present a comprehensive, user-centric approach to address these challenges through AI-based productivity agents tailored to users' needs. Utilizing a two-phase method, we first conducted a survey with 363 participants, exploring various aspects of productivity, communication style, agent approach, personality traits, personalization, and privacy. Drawing on the survey insights, we developed a GPT-4 powered personalized productivity agent that utilizes telemetry data gathered via Viva Insights from information workers to provide tailored assistance. We compared its performance with alternative productivity-assistive tools, such as dashboard and narrative, in a study involving 40 participants. Our findings highlight the importance of user-centric design, adaptability, and the balance between personalization and privacy in AI-assisted productivity tools. By building on these insights, our work provides important guidance for developing more effective productivity solutions, ultimately leading to optimized efficiency and user experiences for information workers.
- Ubiquitous Work Assistant: Synchronizing a Stationary and a Wearable Conversational Agent to Assist Knowledge Work. In 2022 Symposium on Human-Computer Interaction for Work. ACM. https://doi.org/10.1145/3533406.3533420
- Optimizing AI for Teamwork. ArXiv abs/2004.13102 (2020). https://api.semanticscholar.org/CorpusID:216562809
- Perceptions of chatbots in therapy. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–6.
- A literature review on chatbots in healthcare domain. International journal of scientific & technology research 8, 7 (2019), 225–231.
- Siri, Alexa, and other digital assistants: a study of customer satisfaction with artificial intelligence applications. Journal of Marketing Management 35, 15-16 (Oct. 2019), 1401–1436. https://doi.org/10.1080/0267257x.2019.1687571
- Calendar.help. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3025453.3025780
- Superagent: A customer service chatbot for e-commerce websites. In Proceedings of ACL 2017, system demonstrations. 97–102.
- Towards Effective AI-Powered Agile Project Management. In 2019 IEEE/ACM 41st International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). IEEE. https://doi.org/10.1109/icse-nier.2019.00019
- Intelligent personal assistants: A systematic literature review. Expert Systems with Applications 147 (June 2020), 113193. https://doi.org/10.1016/j.eswa.2020.113193
- On the design of and interaction with conversational agents: An organizing and assessing review of human-computer interaction research. Journal of the Association for Information Systems 23, 1 (2022), 96–138.
- Measuring Service Encounter Satisfaction with Customer Service Chatbots using Sentiment Analysis. In Wirtschaftsinformatik. https://api.semanticscholar.org/CorpusID:198119093
- My Virtual Colleague: A State-of-the-Art Analysis of Conversational Agents for the Workplace.. In HICSS. 1–10.
- Yolanda Gil and Varun Ratnakar. 2008. Towards intelligent assistance for to-do lists. In Proceedings of the 13th international conference on Intelligent user interfaces. ACM. https://doi.org/10.1145/1378773.1378822
- Design and evaluation of intelligent agent prototypes for assistance with focus and productivity at work. In Proceedings of the 25th international conference on intelligent user interfaces. 390–400.
- Yugo Hayashi. 2013. Pedagogical conversational agents for supporting collaborative learning: effects of communication channels. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. 655–660.
- Mohammad Hossein Jarrahi. 2018. Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Business Horizons 61, 4 (July 2018), 577–586. https://doi.org/10.1016/j.bushor.2018.03.007
- Imagining future digital assistants at work: A study of task management needs. International Journal of Human-Computer Studies 168 (Dec. 2022), 102905. https://doi.org/10.1016/j.ijhcs.2022.102905
- A conversational agent in support of productivity and wellbeing at work. In 2019 8th international conference on affective computing and intelligent interaction (ACII). IEEE, 1–7.
- Understanding User Satisfaction with Intelligent Assistants. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. ACM. https://doi.org/10.1145/2854946.2854961
- Designing for Workplace Reflection. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM. https://doi.org/10.1145/3196709.3196784
- Carol Collier Kuhlthau. 1999. The Role of Experience in the Information Search Process of an Early Career Information Worker: Perceptions of Uncertainty, Complexity, Construction, and Sources. J. Am. Soc. Inf. Sci. 50, 5 (apr 1999), 399–412.
- Effects of Individual Differences in Blocking Workplace Distractions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3173574.3173666
- AffectAura: an intelligent system for emotional memory. In Proceedings of the SIGCHI conference on human factors in computing systems. 849–858.
- A Comprehensive Overview of Large Language Models. arXiv preprint arXiv:2307.06435 (2023).
- Jakob Nielsen. 2023. Progressive Disclosure. https://www.nngroup.com/articles/progressive-disclosure/
- OpenAI. 2023a. GPT-4 Technical Report. arXiv:2303.08774Â [cs.CL]
- OpenAI. 2023b. OpenAI. https://openai.com
- Selenium. 2023. Selenium. https://www.selenium.dev/documentation/
- Face Value? Exploring the Effects of Embodiment for a Group Facilitation Agent. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (2018). https://api.semanticscholar.org/CorpusID:5051503
- B. Shneiderman. [n. d.]. The eyes have it: a task by data type taxonomy for information visualizations. In Proceedings 1996 IEEE Symposium on Visual Languages. IEEE Comput. Soc. Press. https://doi.org/10.1109/vl.1996.545307
- FacetMap: A Scalable Search and Browse Visualization. IEEE Transactions on Visualization and Computer Graphics 12, 5 (2006), 797–804.
- Artificial Intelligence Enabled Project Management: A Systematic Literature Review. Applied Sciences 13, 8 (April 2023), 5014. https://doi.org/10.3390/app13085014
- Understanding chatbot-mediated task management. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–6.
- Overcoming Distractions during Transitions from Break to Work using a Conversational Website-Blocking System. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019). https://api.semanticscholar.org/CorpusID:140225289
- Designing the Future of Personal Fashion. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3173574.3174201
- Chatbot advertising effectiveness: When does the message get through? Computers in Human Behavior 98 (2019), 150–157.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.