Papers
Topics
Authors
Recent
Search
2000 character limit reached

Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfaces

Published 9 Apr 2024 in cs.CL | (2404.06659v1)

Abstract: Conversational Task Assistants (CTAs) guide users in performing a multitude of activities, such as making recipes. However, ensuring that interactions remain engaging, interesting, and enjoyable for CTA users is not trivial, especially for time-consuming or challenging tasks. Grounded in psychological theories of human interest, we propose to engage users with contextual and interesting statements or facts during interactions with a multi-modal CTA, to reduce fatigue and task abandonment before a task is complete. To operationalize this idea, we train a high-performing classifier (82% F1-score) to automatically identify relevant and interesting facts for users. We use it to create an annotated dataset of task-specific interesting facts for the domain of cooking. Finally, we design and validate a dialogue policy to incorporate the identified relevant and interesting facts into a conversation, to improve user engagement and task completion. Live testing on a leading multi-modal voice assistant shows that 66% of the presented facts were received positively, leading to a 40% gain in the user satisfaction rating, and a 37% increase in conversation length. These findings emphasize that strategically incorporating interesting facts into the CTA experience can promote real-world user participation for guided task interactions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. Advancing conversational task assistance: the second alexa prize taskbot challenge.
  2. Daniel E Berlyne. 1949. Interest as a psychological concept. British Journal of Psychology, 39(4):184.
  3. Daniel E Berlyne. 1966. Curiosity and exploration: Animals spend much of their time seeking stimuli whose significance raises problems for psychology. Science, 153(3731):25–33.
  4. Daniel E Berlyne. 1970. Novelty, complexity, and hedonic value. Perception & psychophysics, 8(5):279–286.
  5. Evaluating the correlation between objective rule interestingness measures and real human interest. In Knowledge Discovery in Databases: PKDD 2005: 9th European Conference on Principles and Practice of Knowledge Discovery in Databases, Porto, Portugal, October 3-7, 2005. Proceedings 9, pages 453–461. Springer.
  6. Can a humorous conversational agent enhance learning experience and outcomes? In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pages 1–14.
  7. Wizard of tasks: A novel conversational dataset for solving real-world tasks in conversational settings. In Proceedings of the 29th International Conference on Computational Linguistics, pages 3514–3529.
  8. What makes a good conversation? challenges in designing truly conversational agents. In Proceedings of the 2019 CHI conference on human factors in computing systems, pages 1–12.
  9. Computational understanding of visual interestingness beyond semantics: literature survey and analysis of covariates. ACM Computing Surveys (CSUR), 52(2):1–37.
  10. Alexa teacher model: Pretraining and distilling multi-billion-parameter encoders for natural language understanding systems. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2893–2902.
  11. Asbjørn Følstad and Petter Bae Brandtzaeg. 2020. Users’ experiences with chatbots: findings from a questionnaire study. Quality and User Experience, 5(1):3.
  12. Liqiang Geng and Howard J Hamilton. 2006. Interestingness measures for data mining: A survey. ACM Computing Surveys (CSUR), 38(3):9–es.
  13. Understanding how task dimensions impact automation preferences with a conversational task assistant. In ACM CHI Conference on Human Factors in Computing Systems.
  14. Celeste Kidd and Benjamin Y Hayden. 2015. The psychology and neuroscience of curiosity. Neuron, 88(3):449–460.
  15. Predicting user satisfaction with intelligent assistants. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pages 45–54.
  16. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692.
  17. Ranking clarifying questions based on predicted user engagement. arXiv preprint arXiv:2103.06192.
  18. SemEval-2022 task 11: Multilingual complex named entity recognition (MultiCoNER). In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 1412–1437, Seattle, United States. Association for Computational Linguistics.
  19. OpenAI. 2023a. Chatgpt. https://openai.com/chatgpt.
  20. OpenAI. 2023b. Gpt-4 technical report. arXiv preprint arXiv: 2303.08774. https://openai.com/gpt4.
  21. Large-scale hybrid approach for predicting user satisfaction with conversational agents. arXiv preprint arXiv:2006.07113.
  22. Reinhard Pekrun. 2019. The murky distinction between curiosity and interest: State of the art and future prospects. Educational Psychology Review, 31(4):905–914.
  23. Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084.
  24. User engagement prediction for clarification in search. In Advances in Information Retrieval: 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28–April 1, 2021, Proceedings, Part I 43, pages 619–633. Springer.
  25. Paul J Silvia. 2005. What is interesting? exploring the appraisal structure of interest. Emotion, 5(1):89.
  26. Understanding user satisfaction with task-oriented dialogue systems. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2018–2023.
  27. Carl Strathearn and Dimitra Gkatzia. 2022. Task2dial: A novel task and dataset for commonsense enhanced task-based dialogue grounded in documents. arXiv preprint arXiv:2204.01061.
  28. Silvan Tomkins. 1962. Affect imagery consciousness: Volume I: The positive affects. Springer publishing company.
  29. The wizard of curiosities: Enriching dialogues with fun facts. In Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue, pages 149–155.
  30. Alexandra Vtyurina and Adam Fourney. 2018. Exploring the role of conversational cues in guided task support with virtual assistants. In Proceedings of the 2018 CHI conference on human factors in computing systems, pages 1–7.
  31. Exploring conversational search with humans, assistants, and wizards. In Proceedings of the 2017 chi conference extended abstracts on human factors in computing systems, pages 2187–2193.
  32. Qiong Wu and Chunyan Miao. 2013. Curiosity: From psychology to computation. ACM Computing Surveys (CSUR), 46(2):1–26.
  33. Recent advances and challenges in task-oriented dialog systems. Science China Technological Sciences, 63(10):2011–2027.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.