Papers
Topics
Authors
Recent
Search
2000 character limit reached

Talking to Machines: do you read me?

Published 2 Jul 2024 in cs.CL, cs.AI, and cs.HC | (2407.02354v1)

Abstract: In this dissertation I would like to guide the reader to the research on dialogue but more precisely the research I have conducted during my career since my PhD thesis. Starting from modular architectures with machine learning/deep learning and reinforcement learning to end-to-end deep neural networks. Besides my work as research associate, I also present the work I have supervised in the last years. I review briefly the state of the art and highlight the open research problems on conversational agents. Afterwards, I present my contribution to Task-Oriented Dialogues (TOD), both as research associate and as the industrial supervisor of CIFRE theses. I discuss conversational QA. Particularly, I present the work of two PhD candidates Thibault Cordier and Sebastien Montella; as well as the work of the young researcher Quentin Brabant. Finally, I present the scientific project, where I discuss about LLMs for Task-Oriented Dialogue and Multimodal Task-Oriented Dialogue.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (230)
  1. Pieter Abbeel and Andrew Y Ng. 2004. Apprenticeship learning via inverse reinforcement learning. In Proceedings of the twenty-first international conference on Machine learning, page 1. ACM.
  2. Emotion recognition in speech using cross-modal transfer in the wild. In Proceedings of the 26th ACM international conference on Multimedia, pages 292–301.
  3. Towards conversational human-computer interaction.
  4. Vqa: Visual question answering. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
  5. Evidentiality-guided generation for knowledge-intensive NLP tasks. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2226–2243, Seattle, United States. Association for Computational Linguistics.
  6. J. Austin. 1975a. How to Do Things With Words (William James Lectures). Harvard University Press.
  7. John Langshaw Austin. 1975b. How to do things with words: (william james lectures). Harvard University Press.
  8. Unsupervised supervised learning II: Margin-based classification without labels. Journal of Machine Learning Research, 12:3119–3145.
  9. Multi-relational poincaré graph embeddings. In Advances in Neural Information Processing Systems.
  10. Andrew G Barto and Sridhar Mahadevan. 2003. Recent advances in hierarchical reinforcement learning. Discrete event dynamic systems, 13(1-2):41–77.
  11. Calor-quest: generating a training corpus for machine reading comprehension models from shallow semantic annotations. In MRQA: Machine Reading for Question Answering-Workshop at EMNLP-IJCNLP 2019-2019 Conference on Empirical Methods in Natural Language Processing.
  12. CALOR-Frame : un corpus de textes encyclopédiques annoté en cadres sémantiques. In ACor4French – Les corpus annotés du français - Atelier TALN, Orléans, France.
  13. Calor-dial: a corpus for conversational question answering on french encyclopedic documents. In CIRCLE (Joint Conference of the Information Retrieval Communities in Europe).
  14. A.T. Beck. 1976. Cognitive Therapy and the Emotional Disorders. New York, International Universities Press.
  15. Cognitive Therapy of Depression. New York, Guildford Press.
  16. Silvère Bonnabel. 2013. Stochastic gradient descent on riemannian manifolds. IEEE Transactions on Automatic Control, 58:2217–2229.
  17. Media: a semantically annotated corpus of task oriented dialogs in french: Results of the french media evaluation campaign. Language Resources and Evaluation, 43:329–354.
  18. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2, NIPS’13, page 2787–2795, Red Hook, NY, USA. Curran Associates Inc.
  19. ICEWS Weekly Event Data. Harvard Dataverse.
  20. Learning the reward model of dialogue pomdps from data. In NIPS Workshop on Machine Learning for Assistive Techniques. Citeseer.
  21. CoQAR: Question rewriting on CoQA. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 119–126, Marseille, France. European Language Resources Association.
  22. Active Learning and Multi-label Classification for Ellipsis and Coreference Detection in Conversational Question-Answering. In 12th International Workshop on Spoken Dialog System Technology (IWSDS 2021), Singapour/Virtual, Singapore.
  23. M. E. Bratman. 1987. Intention, Plans, and Practical Reason. Harvard University Press, Cambridge, MA.
  24. Sub-domain modelling for dialogue management with hierarchical reinforcement learning. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, pages 86–92, Saarbrücken, Germany. Association for Computational Linguistics.
  25. MultiWOZ - a large-scale multi-domain Wizard-of-Oz dataset for task-oriented dialogue modelling. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 5016–5026, Brussels, Belgium. Association for Computational Linguistics.
  26. Towards an iso standard for dialogue act annotation. In Proceedings of LREC 2010, the Seventh International Conference on Language Resources and Evaluation, Malta.
  27. Dialogue complexity with portability? research directions for the information state approach. In Proceedings of the HLT-NAACL 2003 workshop on Research directions in dialogue processing, pages 13–15.
  28. A database of german emotional speech. In Interspeech, volume 5, pages 1517–1520.
  29. Interpreting vision and language generative models with semantic visual priors. Frontiers in Artificial Intelligence, 6.
  30. A benchmarking environment for reinforcement learning based task oriented dialogue management. arXiv preprint arXiv:1711.11023.
  31. A benchmarking environment for reinforcement learning based task oriented dialogue management. Deep Reinforcement Learning Symposium, NIPS.
  32. A Benchmarking Environment for Reinforcement Learning Based Task Oriented Dialogue Management. arXiv:1711.11023 [cs, stat]. ArXiv: 1711.11023.
  33. Low-dimensional hyperbolic knowledge graph embeddings. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6901–6914, Online. Association for Computational Linguistics.
  34. User simulation in dialogue systems using inverse reinforcement learning. In Interspeech 2011, pages 1025–1028.
  35. Grounding answers for visual questions asked by visually impaired people. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 19098–19107.
  36. Structured hierarchical dialogue policy with graph neural networks. arXiv preprint arXiv:2009.10355.
  37. Adam Cheyer and David Martin. 2001. The open agent architecture. Autonomous Agents and Multi-Agent Systems, 4(1-2):143–148.
  38. Learning phrase representations using RNN encoder–decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1724–1734, Doha, Qatar. Association for Computational Linguistics.
  39. QuAC: Question Answering in Context. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2174–2184, Brussels, Belgium. Association for Computational Linguistics.
  40. QuAC: Question answering in context. In Proceedings of EMNLP 2018, pages 2174–2184, Brussels, Belgium.
  41. Look before you Hop: Conversational Question Answering over Knowledge Graphs Using Judicious Context Expansion. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM ’19, pages 729–738, New York, NY, USA. Association for Computing Machinery.
  42. G. Churcher. 1997. Dialogue management systems: a survey and overview.
  43. Herbert H Clark and Susan E Brennan. 1991. Grounding in communication. American Psychological Association.
  44. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12(Aug):2493–2537.
  45. Graph neural network policies and imitation learning for multi-domain task-oriented dialogues. In Proceedings of the 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 91–100, Edinburgh, UK. Association for Computational Linguistics.
  46. Few-shot structured policy learning for multi-domain and multi-task dialogues. The 17th Conference of the European Chapter of the Association for Computational Linguistics. Findings EACL2023.
  47. Diluted near-optimal expert demonstrations for guiding dialogue stochastic policy optimisation. In Human in the loop dialogue systems Workshop at 34th Conference on Neural Information Processing Systems.
  48. Heriberto Cuayáhuitl. 2009. Hierarchical reinforcement learning for spoken dialogue systems.
  49. Strategic dialogue management via deep reinforcement learning. arXiv preprint arXiv:1511.08099.
  50. Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860.
  51. Model-free pomdp optimisation of tutoring systems with echo-state networks. In Proceedings of the SIGDIAL 2013 Conference, pages 102–106.
  52. Anoop Deoras and Ruhi Sarikaya. 2013. Deep belief network based semantic taggers for spoken language understanding. In INTERSPEECH, pages 2713–2717.
  53. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
  54. Collecting large, richly annotated facial-expression databases from movies. IEEE multimedia, 19(3):34.
  55. Deep learning for aspect-based sentiment analysis: a comparative review. Expert Systems with Applications, 118:272–299.
  56. Benchmarking deep reinforcement learning for continuous control.
  57. Reward function learning for dialogue management. In STAIRS 2012, pages 95–106. IOS Press.
  58. Can You Unpack That? Learning to Rewrite Questions-in-Context. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5918–5924, Hong Kong, China. Association for Computational Linguistics.
  59. Entity-based semantic adequacy for data-to-text generation. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 1530–1540, Punta Cana, Dominican Republic. Association for Computational Linguistics.
  60. Hierarchical neural story generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 889–898, Melbourne, Australia. Association for Computational Linguistics.
  61. Neural Approaches to Conversational AI. arXiv:1809.08267 [cs]. ArXiv: 1809.08267.
  62. Reinforcement Learning from Imperfect Demonstrations. arXiv:1802.05313 [cs, stat]. ArXiv: 1802.05313.
  63. Learning sequence encoders for temporal knowledge graph completion. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4816–4821, Brussels, Belgium. Association for Computational Linguistics.
  64. Claire Gardent and Lina Maria Rojas-Barahona. 2013. Using Paraphrases and Lexical Semantics to Improve the Accuracy and the Robustness of Supervised Models in Situated Dialogue Systems. In Conference on Empirical Methods in Natural Language Processing, pages 808–813, Seattle, United States. SIGDAT, the Association for Computational Linguistics special interest group on linguistic data and corpus-based approaches to NLP.
  65. Milica Gašić and Steve Young. 2013. Gaussian processes for pomdp-based dialogue manager optimization. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 22(1):28–40.
  66. Hafez: an interactive poetry generation system. In Proceedings of ACL 2017, System Demonstrations, pages 43–48, Vancouver, Canada. Association for Computational Linguistics.
  67. Diachronic embedding for temporal knowledge graph completion. In AAAI.
  68. Chih-Wen Goo and Yun-Nung Chen. 2018. Abstractive dialogue summarization with sentence-gated modeling optimized by dialogue acts.
  69. Bias correction of learned generative models using likelihood-free importance weighting. Advances in neural information processing systems, 32.
  70. Reinforcement Learning with Deep Energy-Based Policies. arXiv:1702.08165 [cs]. ArXiv: 1702.08165.
  71. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. arXiv:1801.01290 [cs, stat]. ArXiv: 1801.01290.
  72. Regulating chatgpt and other large generative ai models. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, pages 1112–1123.
  73. DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7301–7316, Online. Association for Computational Linguistics.
  74. The Thirteen Books of Euclid’s Elements, Books 1 and 2. Dover Publications, Inc., USA.
  75. Word-based Dialog State Tracking with Recurrent Neural Networks. In Proceedings of SIGdial.
  76. Discriminative Spoken Language Understanding Using Word Confusion Networks. In Spoken Language Technology Workshop, 2012. IEEE.
  77. The second dialog state tracking challenge. In 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, volume 263.
  78. The third dialog state tracking challenge. In Proceedings IEEE Spoken Language Technology Workshop (SLT). IEEE Institute of Electrical and Electronics Engineers.
  79. Deep Q-learning from Demonstrations. arXiv:1704.03732 [cs]. ArXiv: 1704.03732.
  80. Deep q-learning from demonstrations. In Thirty-second AAAI conference on artificial intelligence.
  81. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8):1735–1780.
  82. The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751.
  83. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685.
  84. Olisia: a cascade system for spoken dialogue state tracking.
  85. Technical report on conversational question answering. arXiv preprint arXiv:1909.10772.
  86. Ctrl: A conditional transformer language model for controllable generation. arXiv preprint arXiv:1909.05858.
  87. Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882.
  88. S. Larsson and D. Traum. 2000. Information state and dialogue management in the trindi dialogue move engine toolkit. Natural Language Engineering, 6:323–340.
  89. In-context reinforcement learning with algorithm distillation. arXiv preprint arXiv:2210.14215.
  90. Scalable sentiment for sequence-to-sequence chatbot response with performance analysis. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6164–6168. IEEE.
  91. DialPort, gone live: An update after a year of development. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, pages 170–173, Saarbrücken, Germany. Association for Computational Linguistics.
  92. An assessment framework for dialport. In Advanced Social Interaction with Agents: 8th International Workshop on Spoken Dialog Systems, pages 79–85. Springer.
  93. The power of scale for parameter-efficient prompt tuning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3045–3059, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
  94. A stochastic model of human-machine interaction for learning dialog strategies. IEEE Transactions on speech and audio processing, 8(1):11–23.
  95. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461.
  96. Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4582–4597, Online. Association for Computational Linguistics.
  97. Yuxi Li. 2018. Deep Reinforcement Learning. arXiv:1810.06339 [cs, stat]. ArXiv: 1810.06339.
  98. NJFun- a reinforcement learning spoken dialogue system. In ANLP-NAACL 2000 Workshop: Conversational Systems.
  99. Chain of hindsight aligns language models with feedback.
  100. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692.
  101. Unsupervised structured semantic inference for spoken dialog reservation tasks. In Proceedings of the SIGDIAL 2013 Conference, pages 12–20, Metz, France. Association for Computational Linguistics.
  102. The ubuntu dialogue corpus: A large dataset for research in unstructured multi-turn dialogue systems. arXiv preprint arXiv:1506.08909.
  103. A survey on empathetic dialogue systems. Information Fusion.
  104. Reader-guided passage reranking for open-domain question answering. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 344–350, Online. Association for Computational Linguistics.
  105. Semantic frame parsing for information extraction : the calor corpus. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018). European Language Resource Association.
  106. Andrew Kachites McCallum. 2002. Mallet: A machine learning for language toolkit. Http://mallet.cs.umass.edu.
  107. Michael F. McTear. 2002. Spoken dialogue technology: enabling the conversational user interface. ACM Comput. Surv., 34(1):90–169.
  108. Using recurrent neural networks for slot filling in spoken language understanding. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 23(3):530–539.
  109. Bernard Michini and Jonathan P How. 2012. Improving the efficiency of bayesian inverse reinforcement learning. In 2012 IEEE International Conference on Robotics and Automation, pages 3651–3656. IEEE.
  110. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602.
  111. Transfer learning and masked generation for answer verbalization. In Proceedings of the Workshop on Structured and Unstructured Knowledge Integration (SUKI), pages 47–54.
  112. Investigating the effect of relative positional embeddings on amr-to-text generation with structural adapters. arXiv preprint arXiv:2302.05900.
  113. Hyperbolic temporal knowledge graph embeddings with relational and time curvatures. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 3296–3308, Online. Association for Computational Linguistics.
  114. Efficacy of a Web-Based, Crowdsourced Peer-To-Peer Cognitive Reappraisal Platform for Depression: Randomized Controlled Trial. J Med Internet Res, 17(3).
  115. Neural belief tracker: Data-driven dialogue state tracking. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1777–1788, Vancouver, Canada. Association for Computational Linguistics.
  116. Safe and Efficient Off-Policy Reinforcement Learning. arXiv:1606.02647 [cs, stat]. ArXiv: 1606.02647.
  117. A well-composed text is half done! composition sampling for diverse conditional generation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1319–1339, Dublin, Ireland. Association for Computational Linguistics.
  118. Algorithms for inverse reinforcement learning. In ICML, volume 1, page 2.
  119. Recent advances in deep learning based dialogue systems: A systematic survey. Artificial Intelligence Review, pages 1–101.
  120. A simple recipe towards reducing hallucination in neural surface realisation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 2673–2679.
  121. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155.
  122. Tim Paek and Roberto Pieraccini. 2008. Automating spoken dialogue management design using machine learning: An industry perspective. Speech communication, 50(8-9):716–729.
  123. Ronald Parr and Stuart J Russell. 1998. Reinforcement learning with hierarchies of machines. In Advances in neural information processing systems, pages 1043–1049.
  124. The refinedweb dataset for falcon llm: Outperforming curated corpora with web data, and web data only.
  125. Emotion Recognition from Speech Using wav2vec 2.0 Embeddings. In Proc. Interspeech 2021, pages 3400–3404.
  126. A speech understanding system based on statistical representation of semantics. In Acoustics, Speech, and Signal Processing, 1992. ICASSP-92., 1992 IEEE International Conference on, volume 1, pages 193–196. IEEE.
  127. Matt Post. 2018. A call for clarity in reporting BLEU scores. In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186–191, Brussels, Belgium. Association for Computational Linguistics.
  128. GECOR: An End-to-End Generative Ellipsis and Co-reference Resolution Model for Task-Oriented Dialogue. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 4547–4557, Hong Kong, China. Association for Computational Linguistics.
  129. Robust speech recognition via large-scale weak supervision. arXiv preprint arXiv:2212.04356.
  130. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research, 21(1):5485–5551.
  131. Know What You Don’t Know: Unanswerable Questions for SQuAD. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 784–789, Melbourne, Australia. Association for Computational Linguistics.
  132. Squad: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2383–2392.
  133. Deepak Ramachandran and Eyal Amir. 2007. Bayesian inverse reinforcement learning. In IJCAI, volume 7, pages 2586–2591.
  134. Let’s go public! taking a spoken dialog system to the real world. In Ninth European conference on speech communication and technology.
  135. CoQA: A Conversational Question Answering Challenge. Transactions of the Association for Computational Linguistics, 7:249–266.
  136. Coqa: A conversational question answering challenge. arXiv preprint arXiv:1808.07042.
  137. Verena Rieser and Oliver Lemon. 2011. Reinforcement learning for adaptive dialogue systems: a data-driven methodology for dialogue management and natural language generation. Springer Science & Business Media.
  138. Lina M Rojas-Barahona. 2020. Is the user enjoying the conversation? a case study on the impact on the reward function. 34st Conference on Neural Information Processing Systems (NeurIPS 2020).
  139. Spoken conversational search for general knowledge. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue, pages 110–113.
  140. Lina M Rojas-Barahona and Christophe Cerisara. 2014. Bayesian inverse reinforcement learning for modeling conversational agents in a virtual environment. In International Conference on Intelligent Text Processing and Computational Linguistics, pages 503–514. Springer.
  141. Exploiting sentence and context representations in deep neural models for spoken language understanding. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 258–267, Osaka, Japan.
  142. Building and Exploiting a Corpus of Dialog Interactions between French Speaking Virtual and Human Agents. In Proceedings of the 8th International Conference on Language Resources and Evaluation.
  143. Lina M Rojas-Barahona and Matthieu Quignard. 2011. An incremental architecture for the semantic annotation of dialogue corpora with high-level structures. a case of study for the media corpus. In Proceedings of the SIGDIAL 2011 Conference, pages 332–334.
  144. Deep learning for language understanding of mental health concepts derived from cognitive behavioural therapy. In Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis, pages 44–54, Brussels, Belgium. Association for Computational Linguistics.
  145. Lina Maria Rojas-Barahona. 2016. Deep learning for sentiment analysis. Language and Linguistics Compass, 10(12):701–719.
  146. Using mmil for the high level semantic annotation of the french media dialogue corpus. In Ninth International Conference on Computational Semantics-IWCS 2011.
  147. Lina Maria Rojas Barahona and Christophe Cerisara. 2015. Weakly supervised discriminative training of linear models for Natural Language Processing. In 3rd International Conference on Statistical Language and Speech Processing (SLSP), Budapest, Hungary.
  148. Lina Maria Rojas-Barahona and Claire Gardent. 2012. What should i do now? supporting conversations in a serious game. In SeineDial 2012-16th Workshop on the Semantics and Pragmatics of Dialogue.
  149. Lina Maria Rojas-Barahona and Toni Giorgino. 2009. Adaptable dialog architecture and runtime engine (adarte): a framework for rapid prototyping of health dialog systems. international journal of medical informatics, 78:S56–S68.
  150. Building and exploiting a corpus of dialog interactions between french speaking virtual and human agents. In The eighth international conference on Language Resources and Evaluation (LREC), pages 1428–1435.
  151. An end-to-end evaluation of two situated dialog systems. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 10–19.
  152. A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning. Proceedings of the Workshop on Artificial Intelligence and Statistics, AISTATS, page 9.
  153. Spoken dialogue management using probabilistic reasoning. In Proceedings of the 38th annual meeting of the association for computational linguistics, pages 93–100.
  154. Benoît Sagot. 2010. The Lefff, a freely available and large-coverage morphological and syntactic lexicon for French. In 7th international conference on Language Resources and Evaluation (LREC 2010), Valletta, Malta.
  155. Complex sequential question answering: Towards learning to converse over linked question answer pairs with a knowledge graph. arXiv preprint arXiv:1801.10314.
  156. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv:1910.01108 [cs]. ArXiv: 1910.01108.
  157. Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108.
  158. Chinnadhurai Sankar and Sujith Ravi. 2019. Deep reinforcement learning for modeling chit-chat dialog with discrete attributes. Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue.
  159. Representation learning for conversational data using discourse mutual information maximization. arXiv preprint arXiv:2112.05787.
  160. Deep belief nets for natural language call-routing. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 5680–5683.
  161. Application of deep belief networks for natural language understanding. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 22(4):778–784.
  162. Agenda-based user simulation for bootstrapping a POMDP dialogue system. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers on XX - NAACL ’07, pages 149–152, Rochester, New York. Association for Computational Linguistics.
  163. A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies. Knowledge Engineering Review, 21(2):97–126.
  164. Serab: A multi-lingual benchmark for speech emotion recognition. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 7697–7701. IEEE.
  165. Modeling and predicting quality in spoken human-computer interaction. In Proceedings of the SIGDIAL 2011 Conference, pages 173–184. Association for Computational Linguistics.
  166. A parameterized and annotated spoken dialog corpus of the CMU let’s go bus information system. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), pages 3369–3373, Istanbul, Turkey. European Language Resources Association (ELRA).
  167. What should a generic emotion markup language be able to represent? In Affective Computing and Intelligent Interaction: Second International Conference, ACII 2007 Lisbon, Portugal, September 12-14, 2007 Proceedings 2, pages 440–451. Springer.
  168. Trust region policy optimization. In Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 1889–1897, Lille, France. PMLR.
  169. Bidirectional attention flow for machine comprehension. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net.
  170. A hierarchical latent variable encoder-decoder model for generating dialogues. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 31.
  171. Building end-to-end dialogue systems using generative hierarchical neural network models. In Thirtieth AAAI Conference on Artificial Intelligence.
  172. Blenderbot 3: a deployed conversational agent that continually learns to responsibly engage. arXiv preprint arXiv:2208.03188.
  173. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pages 553–562. ACM.
  174. Visual question answering using deep learning: A survey and performance analysis. In Computer Vision and Image Processing: 5th International Conference, CVIP 2020, Prayagraj, India, December 4-6, 2020, Revised Selected Papers, Part II 5, pages 75–86. Springer.
  175. Sample-efficient actor-critic reinforcement learning with supervised data for dialogue management. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, pages 147–157, Saarbrücken, Germany. Association for Computational Linguistics.
  176. On-line active reward learning for policy optimisation in spoken dialogue systems. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2431–2441, Berlin, Germany. Association for Computational Linguistics.
  177. Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press.
  178. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial intelligence, 112(1-2):181–211.
  179. Subgoal discovery for hierarchical dialogue policy learning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2298–2309, Brussels, Belgium. Association for Computational Linguistics.
  180. Evaluating semantic-level confidence scores with multiple hypotheses. In INTERSPEECH, pages 1153–1156.
  181. FEVER: a large-scale dataset for fact extraction and VERification. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 809–819, New Orleans, Louisiana. Association for Computational Linguistics.
  182. Tijmen Tieleman and Geoffrey Hinton. 2012. Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural networks for machine learning, 4(2):26–31.
  183. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971.
  184. David R. Traum and Staffan Larsson. 2003. The information state approach to dialogue management. In Jan Kuppevelt, Ronnie W. Smith, and Nancy Ide, editors, Current and New Directions in Discourse and Dialogue, volume 22 of Text, Speech and Language Technology, pages 325–353. Springer Netherlands. 10.1007/978-94-010-0019-2_15.
  185. Adieu features? end-to-end speech emotion recognition using a deep convolutional recurrent network. In 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP), pages 5200–5204. IEEE.
  186. Statistical methods for building robust spoken dialogue systems in an automobile. Proceedings of the 4th applied human factors and ergonomics.
  187. Semantic parsing using word confusion networks with conditional random fields. In INTERSPEECH, pages 2579–2583.
  188. PyDial: A Multi-domain Statistical Dialogue System Toolkit. In Proceedings of ACL 2017, System Demonstrations, pages 73–78, Vancouver, Canada. Association for Computational Linguistics.
  189. Stefan Ultes. 2019. Improving interaction quality estimation with BiLSTMs and the impact on dialogue policy learning. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue, pages 11–20, Stockholm, Sweden. Association for Computational Linguistics.
  190. Quality-adaptive spoken dialogue initiative selection and implications on reward modelling. In Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 374–383, Prague, Czech Republic. Association for Computational Linguistics.
  191. Question rewriting for conversational question answering. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pages 355–363.
  192. Deep Reinforcement Learning with Double Q-learning. arXiv:1509.06461 [cs]. ArXiv: 1509.06461.
  193. Attention is all you need. In Advances in neural information processing systems, pages 5998–6008.
  194. Oriol Vinyals and Quoc Le. 2015. A neural conversational model. arXiv preprint arXiv:1506.05869.
  195. Piek Vossen, editor. 1998. EuroWordNet: a multilingual database with lexical semantic networks. Kluwer Academic Publishers, Norwell, MA, USA.
  196. PARADISE: A framework for evaluating spoken dialogue agents. In 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, pages 271–280, Madrid, Spain. Association for Computational Linguistics.
  197. Paradise: A framework for evaluating spoken dialogue agents. arXiv preprint cmp-lg/9704004.
  198. Ofa: Unifying architectures, tasks, and modalities through a simple sequence-to-sequence learning framework. In International Conference on Machine Learning, pages 23318–23340. PMLR.
  199. Learning domain-independent dialogue policies via ontology parameterisation. In Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 412–416.
  200. Sample efficient actor-critic with experience replay. arXiv preprint arXiv:1611.01224.
  201. Sample Efficient Actor-Critic with Experience Replay. arXiv:1611.01224 [cs]. ArXiv: 1611.01224.
  202. Dueling Network Architectures for Deep Reinforcement Learning. International conference on machine learning, pages 1995–2003.
  203. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824–24837.
  204. Sample efficient deep reinforcement learning for dialogue systems with large action spaces. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26(11):2083–2097.
  205. Sample Efficient Deep Reinforcement Learning for Dialogue Systems with Large Action Spaces. arXiv:1802.03753 [cs, stat]. ArXiv: 1802.03753.
  206. Joseph Weizenbaum. 1966. Eliza: A computer program for the study of natural language communication between man and machine. Communciations of the ACM, 9(1).
  207. Semantically conditioned lstm-based natural language generation for spoken dialogue systems. arXiv preprint arXiv:1508.01745.
  208. Latent intention dialogue models. In International Conference on Machine Learning, pages 3732–3741. PMLR.
  209. A network-based end-to-end trainable task-oriented dialogue system. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 438–449, Valencia, Spain. Association for Computational Linguistics.
  210. Memory networks. CoRR, abs/1410.3916.
  211. Jason D Williams. 2014. Web-style ranking and slu combination for dialog state tracking. In Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), pages 282–291.
  212. Jason D Williams and Steve Young. 2007. Partially observable markov decision processes for spoken dialog systems. Computer Speech & Language, 21(2):393–422.
  213. Response selection with topic clues for retrieval-based chatbots. Neurocomputing, 316:251–261.
  214. TeRo: A time-aware knowledge graph embedding via temporal rotation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 1583–1593, Barcelona, Spain (Online). International Committee on Computational Linguistics.
  215. Beyond goldfish memory: Long-term open-domain conversation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5180–5197, Dublin, Ireland. Association for Computational Linguistics.
  216. Recurrent neural networks for language understanding. In INTERSPEECH, pages 2524–2528.
  217. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601.
  218. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629.
  219. Retrieval-augmented multimodal language modeling. In Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 39755–39769. PMLR.
  220. The hidden information state model: a practical framework for pomdp-based spoken dialogue management. Computer Speech & Language, 24(2):150–174.
  221. Pomdp-based statistical spoken dialog systems: A review. Proceedings of the IEEE, 101(5):1160–1179.
  222. POMDP-Based Statistical Spoken Dialog Systems: A Review. Proceedings of the IEEE, 101(5):1160–1179.
  223. Steve J Young. 2002. Talking to machines (statistically speaking). In INTERSPEECH. Citeseer.
  224. Cmu-moseas: A multimodal language dataset for spanish, portuguese, german and french. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing, volume 2020, page 1801. NIH Public Access.
  225. Multimodal language analysis in the wild: Cmu-mosei dataset and interpretable dynamic fusion graph. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2236–2246.
  226. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations.
  227. DIALOGPT : Large-scale generative pre-training for conversational response generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 270–278, Online. Association for Computational Linguistics.
  228. Deyu Zhou and Yulan He. 2011. Learning conditional random fields from unaligned data for natural language understanding. In European Conference on Information Retrieval, pages 283–288. Springer.
  229. Convlab-2: An open-source toolkit for building, evaluating, and diagnosing dialogue systems. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 142–149.
  230. Visual7w: Grounded question answering in images.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up