Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphs (2310.04598v2)

Published 6 Oct 2023 in cs.LG, cs.AI, and cs.DB

Abstract: The challenge of answering graph queries over incomplete knowledge graphs is gaining significant attention in the machine learning community. Neuro-symbolic models have emerged as a promising approach, combining good performance with high interpretability. These models utilize trained architectures to execute atomic queries and integrate modules that mimic symbolic query operators. However, most neuro-symbolic query processors are constrained to tree-like graph pattern queries. These queries admit a bottom-up execution with constant values or anchors at the leaves and the target variable at the root. While expressive, tree-like queries fail to capture critical properties in knowledge graphs, such as the existence of multiple edges between entities or the presence of triangles. We introduce a framework for answering arbitrary graph pattern queries over incomplete knowledge graphs, encompassing both cyclic queries and tree-like queries with existentially quantified leaves. These classes of queries are vital for practical applications but are beyond the scope of most current neuro-symbolic models. Our approach employs an approximation scheme that facilitates acyclic traversals for cyclic patterns, thereby embedding additional symbolic bias into the query execution process. Our experimental evaluation demonstrates that our framework performs competitively on three datasets, effectively handling cyclic queries through our approximation strategy. Additionally, it maintains the performance of existing neuro-symbolic models on anchored tree-like queries and extends their capabilities to queries with existentially quantified variables.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. A survey of RDF stores & SPARQL engines for querying knowledge graphs. The VLDB Journal, 31, 2022. URL https://doi.org/10.1007/s00778-021-00711-3.
  2. Foundations of modern query languages for graph databases. ACM Comput. Surv., 50(5), 2017. URL https://doi.org/10.1145/3104031.
  3. Answering complex logical queries on knowledge graphs via query computation tree optimization. In International Conference on Machine Learning (ICML), volume 202 of Proceedings of Machine Learning Research, pp. 1472–1491, 2023. URL https://proceedings.mlr.press/v202/bai23b.html.
  4. Efficient approximations of conjunctive queries. SIAM J. Comput., 43(3):1085–1130, 2014. URL https://doi.org/10.1137/1309117.
  5. A more general theory of static approximations for conjunctive queries. Theory of Computing Systems, 64(5):916–964, 2020. URL https://doi.org/10.1007/s00224-019-09924-0.
  6. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems (NEURIPS), volume 26, 2013. URL https://proceedings.neurips.cc/paper_files/paper/2013/file/1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf.
  7. Optimal implementation of conjunctive queries in relational data bases. In Proceedings of the ACM Symposium on Theory of Computing (STOC), pp.  77–90, 1977. URL https://doi.org/10.1145/800105.803397.
  8. Fuzzy logic based logical query answering on knowledge graphs. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 36(4):3939–3948, 2022. URL https://doi.org/10.1609/aaai.v36i4.20310.
  9. Knowledge Graphs - Methodology, Tools and Selected Use Cases. Springer, 2020. URL https://doi.org/10.1007/978-3-030-37439-6.
  10. Embedding logical queries on knowledge graphs. In Advances in Neural Information Processing Systems (NEURIPS), volume 31, pp.  2030–2041, 2018. URL https://proceedings.neurips.cc/paper/2018/hash/ef50c335cca9f340bde656363ebd02fd-Abstract.html.
  11. Knowledge Graphs. Synthesis Lectures on Data, Semantics, and Knowledge. Morgan & Claypool Publishers, 2021. URL https://doi.org/10.2200/S01125ED1V01Y202109DSK022.
  12. Answering complex queries in knowledge graphs with bidirectional sequence encoders. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 35(6):4968–4977, 2021. URL https://doi.org/10.1609/aaai.v35i6.16630.
  13. Mask and reason: Pre-training knowledge graph transformers for complex logical queries. In Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp.  1120–1130, 2022. URL https://doi.org/10.1145/3534678.3539472.
  14. NQE: N-ary query embedding for complex query answering over hyper-relational knowledge graphs. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 37(4):4543–4551, 2023. URL https://doi.org/10.1609/aaai.v37i4.25576.
  15. Skew strikes back: new developments in the theory of join algorithms. SIGMOD Rec., 42(4):5–16, 2013. URL https://doi.org/10.1145/2590989.2590991.
  16. A review of relational machine learning for knowledge graphs. Proceedings of the IEEE, 104(1):11–33, 2015. URL https://doi.org/10.1109/JPROC.2015.2483592.
  17. GNNQ: A neuro-symbolic approach to query answering over incomplete knowledge graphs. In International Semantic Web Conference (ISWC), pp. 481–497, 2022. URL https://doi.org/10.1007/978-3-031-19433-7_28.
  18. Beta embeddings for multi-hop logical reasoning in knowledge graphs. In Advances in Neural Information Processing Systems (NEURIPS), volume 33, pp.  19716–19726, 2020. URL https://proceedings.neurips.cc/paper/2020/hash/e43739bba7cdb577e9e3e4e42447f5a5-Abstract.html.
  19. Query2box: Reasoning over knowledge graphs in vector space using box embeddings. In International Conference on Learning Representations (ICLR), 2019. URL https://openreview.net/forum?id=BJgr4kSFDS.
  20. Neural graph reasoning: Complex logical query answering meets graph databases. CoRR, abs/2303.14617, 2023. URL https://doi.org/10.48550/arXiv.2303.14617.
  21. Modeling relational data with graph convolutional networks. In European Semantic Web Conference (ESWC), volume 10843 of Lecture Notes in Computer Science, pp.  593–607. Springer, 2018. URL https://doi.org/10.1007/978-3-319-93417-4_38.
  22. Probabilistic Databases. Synthesis Lectures on Data Management. Morgan & Claypool Publishers, 2011. URL https://doi.org/10.2200/S00362ED1V01Y201105DTM016.
  23. Rotate: Knowledge graph embedding by relational rotation in complex space. In International Conference on Learning Representations (ICLR), 2019. URL https://openreview.net/forum?id=HkgEQnRqYQ.
  24. Inductive relation prediction by subgraph reasoning. In Proceedings of the International Conference on Machine Learning (ICML), volume 119 of Proceedings of Machine Learning Research, pp.  9448–9457, 2020. URL http://proceedings.mlr.press/v119/teru20a.html.
  25. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd workshop on continuous vector space models and their compositionality (CVSC), pp.  57–66, 2015. URL https://doi.org/10.18653/v1/W15-4007.
  26. Complex embeddings for simple link prediction. In Proceedings of the International Conference on International Conference on Machine Learning (ICML), volume 48 of Proceedings of Machine Learning Research, pp.  2071–2080, 2016. URL http://proceedings.mlr.press/v48/trouillon16.html.
  27. Composition-based multi-relational graph convolutional networks. In International Conference on Learning Representations (ICLR), 2020. URL https://openreview.net/forum?id=BylA_C4tPr.
  28. DeepPath: A reinforcement learning method for knowledge graph reasoning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.  564–573, 2017. URL https://doi.org/10.18653/v1/d17-1060.
  29. Embedding entities and relations for learning and inference in knowledge bases. In International Conference on Learning Representations (ICLR), 2015. URL http://arxiv.org/abs/1412.6575.
  30. Rethinking existential first order queries and their inference on knowledge graphs, 2023. URL https://arxiv.org/abs/2304.07063.
  31. Cone: Cone embeddings for multi-hop reasoning over knowledge graphs. In Advances in Neural Information Processing Systems (NEURIPS), volume 34, pp.  19172–19183, 2021. URL https://proceedings.neurips.cc/paper/2021/hash/a0160709701140704575d499c997b6ca-Abstract.html.
  32. Neural Bellman-Ford Networks: A general graph neural network framework for link prediction. Advances in Neural Information Processing Systems (NEURIPS), 34:29476–29490, 2021. URL https://proceedings.neurips.cc/paper/2021/hash/f6a673f09493afcd8b129a0bcf1cd5bc-Abstract.html.
  33. Neural-symbolic models for logical queries on knowledge graphs. In International Conference on Machine Learning (ICML), PMLR, pp.  27454–27478, 2022. URL https://proceedings.mlr.press/v162/zhu22c.html.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com