Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

IME: Integrating Multi-curvature Shared and Specific Embedding for Temporal Knowledge Graph Completion (2403.19881v1)

Published 28 Mar 2024 in cs.AI

Abstract: Temporal Knowledge Graphs (TKGs) incorporate a temporal dimension, allowing for a precise capture of the evolution of knowledge and reflecting the dynamic nature of the real world. Typically, TKGs contain complex geometric structures, with various geometric structures interwoven. However, existing Temporal Knowledge Graph Completion (TKGC) methods either model TKGs in a single space or neglect the heterogeneity of different curvature spaces, thus constraining their capacity to capture these intricate geometric structures. In this paper, we propose a novel Integrating Multi-curvature shared and specific Embedding (IME) model for TKGC tasks. Concretely, IME models TKGs into multi-curvature spaces, including hyperspherical, hyperbolic, and Euclidean spaces. Subsequently, IME incorporates two key properties, namely space-shared property and space-specific property. The space-shared property facilitates the learning of commonalities across different curvature spaces and alleviates the spatial gap caused by the heterogeneous nature of multi-curvature spaces, while the space-specific property captures characteristic features. Meanwhile, IME proposes an Adjustable Multi-curvature Pooling (AMP) approach to effectively retain important information. Furthermore, IME innovatively designs similarity, difference, and structure loss functions to attain the stated objective. Experimental results clearly demonstrate the superior performance of IME over existing state-of-the-art TKGC models.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. BoxE: A box embedding model for knowledge base completion. In Neural Information Processing Systems. 9649–9661.
  2. Tucker: Tensor factorization for knowledge graph completion. In Empirical Methods in Natural Language Processing. 5185–5194.
  3. Translating embeddings for modeling multi-relational data. In Neural Information Processing Systems. 2787–2795.
  4. ICEWS Coded Event Data. In Harvard Dataverse.
  5. Geometry interaction knowledge graph embeddings. In AAAI Conference on Artificial Intelligence.
  6. Low-dimensional hyperbolic knowledge graph embeddings. In Annual Meeting of the Association for Computational Linguistics. 6901–6914.
  7. Learning the best pooling strategy for visual semantic embedding. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 15789–15798.
  8. Entity query feature expansion using knowledge base links. In ACM SIGIR Conference on Research & Development in Information Retrieval. 365–374.
  9. HyTE: Hyperplane-based temporally aware knowledge graph embedding. In Empirical Methods in Natural Language Processing. 2001–2011.
  10. Convolutional 2D knowledge graph embeddings. In AAAI Conference on Artificial Intelligence. 1811–1818.
  11. R-DFCIL: Relation-guided representation learning for data-free class incremental learning. In European Conference on Computer Vision. 423–439.
  12. Learning sequence encoders for temporal knowledge graph completion. In Empirical Methods in Natural Language Processing. 4816–4821.
  13. Diachronic embedding for temporal knowledge graph completion. In AAAI Conference on Artificial Intelligence. 3988–3995.
  14. Semantic search. In Proceedings of the 12th international conference on World Wide Web. 700–709.
  15. Jia Guo and Stanley Kok. 2021. BiQUE: Biquaternionic Embeddings of Knowledge Graphs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 8338–8351.
  16. DyERNIE: Dynamic evolution of riemannian manifold embeddings for temporal knowledge graph completion. In Empirical Methods in Natural Language Processing. 7301–7316.
  17. Frank L Hitchcock. 1927. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematics and Physics 6, 1-4 (1927), 164–189.
  18. Seyed Mehran Kazemi and David Poole. 2018. SimplE embedding for link prediction in knowledge graphs. In Neural Information Processing Systems. 4284–4295.
  19. A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics 11, 1 (2022), 141.
  20. Tensor decompositions for temporal knowledge base completion. In International Conference on Learning Representations. 1–12.
  21. Julien Leblay and Melisachew Wudage Chekol. 2018. Deriving validity time in knowledge graph. In International Conference on World Wide Web. 1771–1776.
  22. Kalev Leetaru and Philip A Schrodt. 2013. GDELT: Global data on events, location, and tone. In ISA Annual Convention. 1–49.
  23. Learning entity and relation embeddings for knowledge graph completion. In AAAI Conference on Artificial Intelligence. 2181–2187.
  24. Sphereface: Deep hypersphere embedding for face recognition. In the Conference on Computer Vision and Pattern Recognition. 212–220.
  25. Temporal knowledge graph completion using box embeddings. In AAAI Conference on Artificial Intelligence. 7779–7787.
  26. Maximillian Nickel and Douwe Kiela. 2017. Poincaré embeddings for learning hierarchical representations. In Advances in Neural Information Processing Systems.
  27. Unifying Large Language Models and Knowledge Graphs: A Roadmap. IEEE Transactions on Knowledge and Data Engineering (2024), 1–20.
  28. ChronoR: rotation based temporal knowledge graph embedding. In AAAI Conference on Artificial Intelligence. 6471–6479.
  29. Representation tradeoffs for hyperbolic embeddings. In International Conference on Machine Learning. 4460–4469.
  30. Modeling relational data with graph convolutional networks. In European Semantic Web Conference. Springer, 593–607.
  31. Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional recurrent neural networks. IEEE transactions on Signal Processing 45, 11 (1997), 2673–2681.
  32. Tucker decomposition-based temporal knowledge graph completion. Knowledge-Based Systems 238 (2022), 107841.
  33. RotatE: Knowledge graph embedding by relational rotation in complex space. In International Conference on Learning Representations. 1–18.
  34. Complex embeddings for simple link prediction. In International Conference on Machine Learning. 2071–2080.
  35. Attention is all you need. Advances in neural information processing systems 30 (2017).
  36. A capsule network-based embedding model for knowledge graph completion and search personalization. In Proceedings of the Conference of the Association for Computational Linguistics: Human Language Technologies. 2180–2189.
  37. Multi-Level Interaction Based Knowledge Graph Completion. IEEE/ACM Transactions on Audio, Speech, and Language Processing 32 (2024), 386–396.
  38. Multi-concept Representation Learning for Knowledge Graph Completion. ACM Transactions on Knowledge Discovery from Data (2022).
  39. QDN: A Quadruplet Distributor Network for Temporal Knowledge Graph Completion. IEEE Transactions on Neural Networks and Learning Systems (2023).
  40. TDN: Triplet Distributor Network for Knowledge Graph Completion. IEEE Transactions on Knowledge and Data Engineering (2023).
  41. A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospects. arXiv preprint arXiv:2308.02457 (2023).
  42. Mixed-curvature multi-relational graph neural network for knowledge graph completion. In International Conference on World Wide Web. 1761–1771.
  43. Spherical and hyperbolic embeddings of data. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 11 (2014), 2255–2269.
  44. Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings. In Annual Meeting of the Association for Computational Linguistics. 2569–2578.
  45. Temporal knowledge graph completion based on time series gaussian embedding. In International Semantic Web Conference. 654–671.
  46. TeRo: A time-aware knowledge graph embedding via temporal rotation. In International Conference on Computational Linguistics. 1583–1593.
  47. Embedding entities and relations for learning and inference in knowledge bases. In International Conference on Learning Representations. 1–13.
  48. Block Decomposition with Multi-granularity Embedding for Temporal Knowledge Graph Completion. In International Conference on Database Systems for Advanced Applications. 706–715.
  49. Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learning. In International Conference on Learning Representations. 1–13.
  50. Temporal knowledge graph representation learning with local and global evolutions. Knowledge-Based Systems 251 (2022), 109234.
  51. BiQCap: A Biquaternion and Capsule Network-Based Embedding Model for Temporal Knowledge Graph Completion. In International Conference on Database Systems for Advanced Applications. 673–688.
Citations (4)

Summary

We haven't generated a summary for this paper yet.