Error correction and extraction in request dialogs
Abstract: We propose a dialog system utility component that gets the last two utterances of a user and can detect whether the last utterance is an error correction of the second last utterance. If yes, it corrects the second last utterance according to the error correction in the last utterance and outputs the extracted pairs of reparandum and repair entity. This component offers two advantages, learning the concept of corrections to avoid collecting corrections for every new domain and extracting reparandum and repair pairs, which offers the possibility to learn out of it. For the error correction one sequence labeling and two sequence to sequence approaches are presented. For the error correction detection these three error correction approaches can also be used and in addition, we present a sequence classification approach. One error correction detection and one error correction approach can be combined to a pipeline or the error correction approaches can be trained and used end-to-end to avoid two components. We modified the EPIC-KITCHENS-100 dataset to evaluate the approaches for correcting entity phrases in request dialogs. For error correction detection and correction, we got an accuracy of 96.40 % on synthetic validation data and an accuracy of 77.81 % on human-created real-world test data.
- Cloze-driven pretraining of self-attention networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP).
- Frédéric Béchet and Benoit Favre. 2013. Asr error segment localization for spoken recovery strategy. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 6837–6841.
- Machine translation of multi-party meetings: Segmentation and disfluency removal strategies. In Proceedings of the 11th International Workshop on Spoken Language Translation (IWSLT).
- The EPIC-KITCHENS dataset: Collection, challenges and baselines. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
- Rescaling egocentric vision: Collection, pipeline and challenges for EPIC-KITCHENS-100. International Journal of Computer Vision (IJCV), 130(1):33–55.
- BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NACL).
- Adapting translation models for transcript disfluency detection. In Proceedings of the Thirty-Third Conference on Artificial Intelligence (AAAI).
- Petra Gieselmann. 2006. Comparing error-handling strategies in human-human and human-robot dialogues. In Proceedings of the 8th Conference on Natural Language Processing (Konferenz zur Verarbeitung natürlicher Sprache, KONVENS).
- David Griol and José Manuel Molina. 2016. A framework for improving error detection and correction in spoken dialog systems. Soft Computing, 20:4229–4241.
- Disfluency detection using auto-correlational neural networks. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP).
- Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations (ICLR), Conference Track Proceedings.
- Ivan Kraljevski and Diane Hirschfeld. 2017. Hyperarticulation of corrections in multilingual dialogue systems. In Proceedings of the 18th Annual Meeting of the International Speech Communication Association (Interspeech).
- Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In 7th International Conference on Learning Representations (ICLR).
- Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035. Curran Associates, Inc.
- Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67.
- Correction grammars for error handling in a speech dialog system. In Proceedings of HLT-NAACL 2004: Short Papers.
- Elizabeth Ellen Shriberg. 1994. Preliminaries to a Theory of Speech Disfluencies. Ph.D. thesis, University of California.
- Interactive recovery from speech recognition errors in speech user interfaces. In The 4th International Conference on Spoken Language Processing (ICSLP).
- Model-based and empirical evaluation of multimodal interactive error correction. In Proceeding of the CHI ’99 Conference on Human Factors in Computing Systems: The CHI is the Limit.
- Multimodal error correction for speech user interfaces. ACM Transactions on Computer-Human Interaction, 8(1):60–98.
- Bernhard Suhm and Alex Waibel. 1997. Exploiting repair context in interactive error recovery. In Fifth European Conference on Speech Communication and Technology (EUROSPEECH).
- Attention is all you need. In Advances in Neural Information Processing Systems 30, pages 5998–6008. Curran Associates, Inc.
- Pointer networks. In Advances in Neural Information Processing Systems 28, pages 2692–2700. Curran Associates, Inc.
- A neural attention model for disfluency detection. In Proceedings of the 26th International Conference on Computational Linguistic (COLING).
- Joint contextual modeling for ASR correction and language understanding. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
- Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP): System Demonstrations.
- Neural language correction with character-based attention. CoRR, abs/1603.09727.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
