Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs (2403.19936v1)

Published 29 Mar 2024 in cs.CL

Abstract: Building natural language interfaces typically uses a semantic parser to parse the user's natural language and convert it into structured \textbf{S}emantic \textbf{L}ogic \textbf{F}orms (SLFs). The mainstream approach is to adopt a sequence-to-sequence framework, which requires that natural language commands and SLFs must be represented serially. Since a single natural language may have multiple SLFs or multiple natural language commands may have the same SLF, training a sequence-to-sequence model is sensitive to the choice among them, a phenomenon recorded as "order matters". To solve this problem, we propose a novel neural network, SLFNet, which firstly incorporates dependent syntactic information as prior knowledge and can capture the long-range interactions between contextual information and words. Secondly construct semantic probability graphs to obtain local dependencies between predictor variables. Finally we propose the Multi-Head SLF Attention mechanism to synthesize SLFs from natural language commands based on Sequence-to-Slots. Experiments show that SLFNet achieves state-of-the-art performance on the ChineseQCI-TS and Okapi datasets, and competitive performance on the ATIS dataset.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (48)
  1. Conversational semantic parsing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5026–5035, Online. Association for Computational Linguistics.
  2. James Allen. 1988. Natural language understanding. Benjamin-Cummings Publishing Co., Inc.
  3. Jerome R. Bellegarda. 2014. Spoken language understanding for natural interaction: The siri experience. In Natural Interaction with Robots, Knowbots and Smartphones, pages 3–14, New York, NY. Springer New York.
  4. Semantic parsing on freebase from question-answer pairs. In EMNLP.
  5. Geoqa: A geometric question answering benchmark towards multimodal numerical reasoning. ArXiv, abs/2105.14517.
  6. Enhanced LSTM for natural language inference. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1657–1668, Vancouver, Canada. Association for Computational Linguistics.
  7. Learning structured natural language representations for semantic parsing. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 44–55, Vancouver, Canada. Association for Computational Linguistics.
  8. Learning phrase representations using RNN encoder–decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1724–1734, Doha, Qatar. Association for Computational Linguistics.
  9. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics.
  10. Unified language model pre-training for natural language understanding and generation. Advances in Neural Information Processing Systems, 32.
  11. Susan Feldman. 1999. Nlp meets the jabberwocky: Natural language processing in information retrieval. ONLINE-WESTON THEN WILTON-, 23:62–73.
  12. Incorporating copying mechanism in sequence-to-sequence learning. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1631–1640, Berlin, Germany. Association for Computational Linguistics.
  13. Compositional generalization for natural language interfaces to web apis. ArXiv, abs/2112.05209.
  14. Compositional generalization for natural language interfaces to web apis.
  15. Zhanming Jie and Wei Lu. 2014. Multilingual semantic parsing : Parsing multiple languages into semantic representations. In COLING.
  16. The rise of bots: A survey of conversational interfaces, patterns, and paradigms. In Proceedings of the 2017 conference on designing interactive systems, pages 555–565.
  17. Graph-based meaning representations: Design and processing. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, pages 6–11, Florence, Italy. Association for Computational Linguistics.
  18. Learning dependency-based compositional semantics. Computational Linguistics, 39(2):389–446.
  19. Bill Manaris. 1998. Natural language processing: A human-computer interaction perspective. In Advances in Computers, volume 47, pages 1–66. Elsevier.
  20. William C Ogden and Philip Bernick. 1997. Using natural language interfaces. In Handbook of human-computer interaction, pages 137–161. Elsevier.
  21. Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP), pages 1532–1543.
  22. Generating English from Abstract Meaning Representations. In Proceedings of the 9th International Natural Language Generation conference, pages 21–25, Edinburgh, UK. Association for Computational Linguistics.
  23. Transforming dependency structures to logical forms for semantic parsing. Transactions of the Association for Computational Linguistics, 4:127–140.
  24. An overview of end-to-end language understanding and dialog management for personal digital assistants. In 2016 IEEE Spoken Language Technology Workshop (SLT), pages 391–397.
  25. Alan F Smeaton. 1999. Using nlp or nlp resources for information retrieval tasks. In Natural language information retrieval, pages 99–111. Springer.
  26. Building natural language interfaces to web apis. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM ’17, page 177–186, New York, NY, USA. Association for Computing Machinery.
  27. Natural language interfaces with fine-grained user interaction: A case study on web apis. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR ’18, page 855–864, New York, NY, USA. Association for Computing Machinery.
  28. Adam Summerville. 2018. Expanding expressive range: Evaluation methodologies for procedural content generation. In Fourteenth artificial intelligence and interactive digital entertainment conference.
  29. Sequence to sequence learning with neural networks. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2, NIPS’14, page 3104–3112, Cambridge, MA, USA. MIT Press.
  30. Attention is all you need. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc.
  31. Pointer networks. In Advances in Neural Information Processing Systems, volume 28. Curran Associates, Inc.
  32. Nuwadynamics: Discovering and updating in causal spatio-temporal modeling.
  33. Modeling spatio-temporal dynamical systems with neural discrete learning and levels-of-experts. IEEE Transactions on Knowledge and Data Engineering.
  34. Earthfarsser: Versatile spatio-temporal dynamical systems modeling in one model. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 15906–15914.
  35. Scada-nli: A natural language query and control interface for distributed systems. IEEE Access, 9:78108–78127.
  36. Spatio-temporal twins with a cache for modeling long-term system dynamics.
  37. Dynst: Dynamic sparse training for resource-constrained spatio-temporal forecasting. arXiv preprint arXiv:2403.02914.
  38. Pastnet: Introducing physical inductive biases for spatio-temporal video prediction. arXiv preprint arXiv:2305.11421.
  39. Spatio-temporal fluid dynamics modeling via physical-awareness and parameter diffusion guidance. arXiv preprint arXiv:2403.13850.
  40. Few-shot message-enhanced contrastive learning for graph anomaly detection. arXiv preprint arXiv:2311.10370.
  41. Revisiting graph-based fraud detection in sight of heterophily and spectrum. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 9214–9222.
  42. Exploring global and local information for anomaly detection with normal samples. In 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 3422–3427. IEEE.
  43. Sqlnet: Generating structured queries from natural language without reinforcement learning. ArXiv, abs/1711.04436.
  44. Qa-gnn: Reasoning with language models and knowledge graphs for question answering.
  45. Luke S. Zettlemoyer and Michael Collins. 2005. Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars. In Proceedings of the Twenty-First Conference on Uncertainty in Artificial Intelligence, UAI’05, page 658–666, Arlington, Virginia, USA. AUAI Press.
  46. A practical chinese dependency parser based on a large-scale dataset.
  47. Seq2sql: Generating structured queries from natural language using reinforcement learning. CoRR, abs/1709.00103.
  48. Attention-based bidirectional long short-term memory networks for relation classification. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 207–212, Berlin, Germany. Association for Computational Linguistics.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now