Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

3D Rotation and Translation for Hyperbolic Knowledge Graph Embedding (2305.13015v2)

Published 22 May 2023 in cs.CL

Abstract: The main objective of Knowledge Graph (KG) embeddings is to learn low-dimensional representations of entities and relations, enabling the prediction of missing facts. A significant challenge in achieving better KG embeddings lies in capturing relation patterns, including symmetry, antisymmetry, inversion, commutative composition, non-commutative composition, hierarchy, and multiplicity. This study introduces a novel model called 3H-TH (3D Rotation and Translation in Hyperbolic space) that captures these relation patterns simultaneously. In contrast, previous attempts have not achieved satisfactory performance across all the mentioned properties at the same time. The experimental results demonstrate that the new model outperforms existing state-of-the-art models in terms of accuracy, hierarchy property, and other relation patterns in low-dimensional space, meanwhile performing similarly in high-dimensional space.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Multi-relational poincaré graph embeddings. Advances in Neural Information Processing Systems, 32.
  2. Freebase: a collaboratively created graph database for structuring human knowledge. In Proceedings of the 2008 ACM SIGMOD international conference on Management of data, pages 1247–1250.
  3. Silvere Bonnabel. 2013. Stochastic gradient descent on riemannian manifolds. IEEE Transactions on Automatic Control, 58(9):2217–2229.
  4. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems, 26.
  5. Dual quaternion knowledge graph embeddings. Proceedings of the AAAI conference on artificial intelligence, 35(8):6894–6902.
  6. Low-dimensional hyperbolic knowledge graph embeddings. arXiv preprint arXiv:2005.00545.
  7. Hyperbolic graph convolutional neural networks. Advances in neural information processing systems, 32.
  8. Pairre: Knowledge graph embeddings via paired relation vectors. arXiv preprint arXiv:2011.03798.
  9. Hitter: Hierarchical transformers for knowledge graph embeddings. arXiv preprint arXiv:2008.12813.
  10. Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI conference on artificial intelligence, 32(1).
  11. Adaptive subgradient methods for online learning and stochastic optimization. Journal of machine learning research, 12(7).
  12. Hyperbolic neural networks. Advances in neural information processing systems, 31.
  13. Compounding geometric operations for knowledge graph completion. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6947–6965, Toronto, Canada. Association for Computational Linguistics.
  14. Jia Guo and Stanley Kok. 2021. Bique: Biquaternionic embeddings of knowledge graphs. arXiv preprint arXiv:2109.14401.
  15. Logical entity representation in knowledge-graphs for differentiable rule learning. arXiv preprint arXiv:2305.12738.
  16. An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 221–231.
  17. Mocosa: Momentum contrast for knowledge graph completion with structure-augmented pre-trained language models. arXiv preprint arXiv:2308.08204.
  18. Knowledge graph embedding via dynamic mapping matrix. In Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 1: Long papers), pages 687–696.
  19. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
  20. David Krackhardt. 2014. Graph theoretical dimensions of informal organizations. In Computational organization theory, pages 107–130. Psychology Press.
  21. Learning entity and relation embeddings for knowledge graph completion. Proceedings of the AAAI conference on artificial intelligence, 29(1).
  22. Yago3: A knowledge base from multilingual wikipedias. In CIDR.
  23. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
  24. George A Miller. 1995. Wordnet: a lexical database for english. Communications of the ACM, 38(11):39–41.
  25. Yanhui Peng and Jing Zhang. 2020. Lineare: Simple but powerful knowledge graph embedding for link prediction. In 2020 IEEE international conference on data mining (ICDM), pages 422–431. IEEE.
  26. Relational pattern benchmarking on the knowledge graph link prediction task. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2).
  27. Yago: a core of semantic knowledge. In Proceedings of the 16th international conference on World Wide Web, pages 697–706.
  28. Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197.
  29. Poincar\\\backslash\’e glove: Hyperbolic word embeddings. arXiv preprint arXiv:1810.06546.
  30. Kristina Toutanova and Danqi Chen. 2015. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd workshop on continuous vector space models and their compositionality, pages 57–66.
  31. Complex embeddings for simple link prediction. In International conference on machine learning, pages 2071–2080. PMLR.
  32. Abraham Albert Ungar. 2008. Analytic hyperbolic geometry and Albert Einstein’s special theory of relativity. World Scientific.
  33. Simkgc: Simple contrastive knowledge graph completion with pre-trained language models. arXiv preprint arXiv:2203.02167.
  34. Language models as knowledge embeddings. arXiv preprint arXiv:2206.12617.
  35. Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI conference on artificial intelligence, 28(1).
  36. Explicit semantic ranking for academic search via knowledge graph embedding. In Proceedings of the 26th international conference on world wide web, pages 1271–1279.
  37. Bishan Yang and Tom Mitchell. 2019. Leveraging knowledge bases in lstms for improving machine reading. arXiv preprint arXiv:1902.09091.
  38. Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pages 353–362.
  39. Reasoning through memorization: Nearest neighbor knowledge graph embeddings. arXiv preprint arXiv:2201.05575.
  40. Quaternion knowledge graph embeddings. Advances in neural information processing systems, 32.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets