Searching for Snippets of Open-Domain Dialogue in Task-Oriented Dialogue Datasets (2311.14076v1)
Abstract: Most existing dialogue corpora and models have been designed to fit into 2 predominant categories : task-oriented dialogues portray functional goals, such as making a restaurant reservation or booking a plane ticket, while chit-chat/open-domain dialogues focus on holding a socially engaging talk with a user. However, humans tend to seamlessly switch between modes and even use chitchat to enhance task-oriented conversations. To bridge this gap, new datasets have recently been created, blending both communication modes into conversation examples. The approaches used tend to rely on adding chit-chat snippets to pre-existing, human-generated task-oriented datasets. Given the tendencies observed in humans, we wonder however if the latter do not \textit{already} hold chit-chat sequences. By using topic modeling and searching for topics which are most similar to a set of keywords related to social talk, we explore the training sets of Schema-Guided Dialogues and MultiWOZ. Our study shows that sequences related to social talk are indeed naturally present, motivating further research on ways chitchat is combined into task-oriented dialogues.
- Towards a human-like open-domain chatbot.
- Timothy Bickmore and Justine Cassell. 2001. Relational agents: A model and implementation of building user trust. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’01, page 396–403, New York, NY, USA. Association for Computing Machinery.
- Learning end-to-end goal-oriented dialog.
- MultiWOZ - a large-scale multi-domain Wizard-of-Oz dataset for task-oriented dialogue modelling. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 5016–5026, Brussels, Belgium. Association for Computational Linguistics.
- Survey on evaluation methods for dialogue systems. Artif. Intell. Rev., 54(1):755–810.
- Human conversational behavior. Human nature, 8(3):231–246.
- Maarten Grootendorst. 2022. Bertopic: Neural topic modeling with a class-based tf-idf procedure.
- Event-driven emotion cause extraction with corpus construction. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1639–1649, Austin, Texas. Association for Computational Linguistics.
- End-to-end neural pipeline for goal-oriented dialogue systems using GPT-2. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 583–592, Online. Association for Computational Linguistics.
- A simple language model for task-oriented dialogue.
- J. F. Kelley. 1984. An iterative design methodology for user-friendly natural language office information applications. ACM Trans. Inf. Syst., 2:26–41.
- Paul R Kroeger. 2005. Analyzing grammar: An introduction. Cambridge University Press.
- A study of patient clues and physician responses in primary care and surgical settings. JAMA : the journal of the American Medical Association, 284:1021–7.
- hdbscan: Hierarchical density based clustering. The Journal of Open Source Software, 2.
- Umap: Uniform manifold approximation and projection for dimension reduction.
- David Mimno and Andrew McCallum. 2007. Organizing the oca: Learning faceted subjects from a library of digital books. In Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries, JCDL ’07, page 376–385, New York, NY, USA. Association for Computing Machinery.
- Recent advances in deep learning based dialogue systems: A systematic survey.
- Laura Ana Maria Oberländer and Roman Klinger. 2020. Token sequence labeling vs. clause classification for English emotion stimulus detection. In Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics, pages 58–70, Barcelona, Spain (Online). Association for Computational Linguistics.
- Soloist: Building task bots at scale with transfer learning and machine teaching.
- Towards scalable multi-domain conversational agents: The schema-guided dialogue dataset.
- Byron Reeves and Clifford Nass. 1996. The media equation - how people treat computers, television, and new media like real people and places.
- Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks.
- Nils Reimers and Iryna Gurevych. 2020. Making monolingual sentence embeddings multilingual using knowledge distillation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 4512–4525, Online. Association for Computational Linguistics.
- Open-domain conversational agents: Current progress, open problems, and future directions.
- Recipes for building an open-domain chatbot.
- Adding chit-chats to enhance task-oriented dialogues.
- Augmented SBERT: Data augmentation method for improving bi-encoders for pairwise sentence scoring tasks. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 296–310, Online. Association for Computational Linguistics.
- Kathryn R. Wentzel. 1997. Student motivation in middle school: The role of perceived pedagogical caring. Journal of Educational Psychology, 89:411–419.
- Fusing task-oriented and open-domain dialogues in conversational agents.
- Dialogpt: Large-scale generative pre-training for conversational response generation.
- Armand Stricker (5 papers)
- Patrick Paroubek (8 papers)