Papers
Topics
Authors
Recent
2000 character limit reached

RicciKGE: Adaptive Geometry for Graph Embeddings

Updated 15 December 2025
  • RicciKGE is a knowledge graph embedding framework that dynamically adapts entity representations via extended Ricci flow and local discrete curvature adjustment.
  • It iteratively updates both metric structure and distances, ensuring exponential curvature flattening and linear convergence for enhanced embedding fidelity.
  • Empirical results demonstrate improved link prediction and node classification, validating the method’s ability to regularize heterogeneous graph geometries.

RicciKGE is a knowledge graph embedding framework that couples embedding optimization with local discrete Ricci curvature adjustment via an extended Ricci flow. Its central innovation is the dynamic co-evolution of entity representations and underlying geometry, enabling the embedding manifold to adapt continuously to the sharply heterogeneous curvature exhibited by real-world graph data. Unlike conventional approaches where all entities are projected onto a fixed homogeneous manifold (e.g., Rd\mathbb{R}^d, Hd\mathbb{H}^d, Sd\mathbb{S}^d, or product spaces), RicciKGE modifies both distances and metric structure iteratively, regularized by local curvature and embedding loss gradients. Rigorous analysis establishes exponential flattening of curvature, linear convergence of distances, and improved predictive accuracy across benchmark link prediction and node classification tasks (Luo et al., 8 Dec 2025).

1. Motivation and Limitations of Homogeneous Embedding Geometries

Conventional knowledge graph embedding (KGE) models (e.g., TransE, RotatE, DistMult, AttH, GoldE) select a global host manifold in which all entity and relation vectors reside. Variants employing multi-curvature or product manifolds can represent certain complex patterns, but still lack fine-grained spatial adaptation. Empirical discrete Ricci curvature K(i,j)K(i,j) in knowledge graphs varies sharply by region: dense clusters, bottleneck chains, and hierarchical motifs each induce distinct local curvature. Overly rigid embedding geometries force positive curvature regions to be under-expanded in hyperbolic models, and negative curvature zones to be over-stretched in spherical or Euclidean embeddings. This mismatch perturbs true relational distances, diminishing KGE expressiveness for link prediction and classification (Luo et al., 8 Dec 2025).

2. Extended Ricci Flow Formulation

RicciKGE augments classical Ricci flow with explicit coupling to the KGE loss gradient, yielding the following continuous formulation for the manifold metric gijg_{ij}: sgij=2Ricij+βij\partial_s g_{ij} = -2\,\mathrm{Ric}_{ij} + \beta\,\nabla_i\ell\,\nabla_j\ell where Ricij\mathrm{Ric}_{ij} is the Ricci tensor, \ell is the instantaneous KGE loss (function of Riemannian distance dd), and β>0\beta > 0 is the coupling coefficient. In discrete graph settings, the metric is represented by edge weights wijw_{ij} with update: wijk+1=wijk(12Kijk)+β,ijw^{k+1}_{ij} = w^k_{ij} \, (1-2K^k_{ij}) + \beta\,\langle\nabla\ell,\nabla\ell\rangle_{ij} where KijkK^k_{ij} is discrete Ricci curvature of edge (i,j)(i,j), and ,ij\langle\nabla\ell,\nabla\ell\rangle_{ij} is the product of loss gradients at endpoints. The coupled update jointly contracts/expands edges based on curvature signs and loss gradients, directly steering spatial regularity and relational fidelity (Luo et al., 8 Dec 2025).

3. Joint Update Dynamics for Embeddings and Geometry

Central to RicciKGE is the tightly linked evolution of entity embeddings and inter-entity distances. For triple (h,r,t)(h,r,t):

  • The distance dht=d(fr(E(h)),E(t))d_{ht} = d(f_r(E(h)),\,E(t)) is mapped to edge weight wht=exp(dht)w_{ht} = \exp(-d_{ht}).
  • Ricci flow steps adjust whtw_{ht} via local KhtkK^k_{ht} and loss gradients, inducing a targeted distance change Δdht=2Khtkβwhtk,ht\Delta d_{ht}=2K^k_{ht} - \frac{\beta}{w^k_{ht}}\langle\nabla\ell,\nabla\ell\rangle_{ht}.
  • Rather than explicit distance adjustment, endpoint embeddings E(h)E(h) and E(t)E(t) are perturbed minimally (δh,δt\delta_{h},\delta_{t}) subject to the prescribed Δdht\Delta d_{ht}, yielding closed-form updates via Lagrange multipliers:

δh=λht2h,δt=λht2t\delta_h = -\frac{\lambda_{ht}}{2}\nabla_h\ell,\quad \delta_t = -\frac{\lambda_{ht}}{2}\nabla_t\ell

with λht\lambda_{ht} determined to enforce cumulative Δdht\Delta d_{ht}. Entity updates are aggregated over all triples containing that entity (Luo et al., 8 Dec 2025).

4. Theoretical Guarantees: Curvature Flattening and Distance Convergence

The extended Ricci flow with loss coupling confers two main analytical guarantees under standard regularity conditions (volume, diameter, Sobolev/Poincaré bounds, Lipschitz control on loss gradients):

  1. Exponential decay of curvature: The Ricci energy R(s)=MRic(g(s))2dVg(s)R(s) = \int_M |\mathrm{Ric}(g(s))|^2\,dV_{g(s)} decays exponentially provided β\beta respects a sharp upper bound, with Grönwall-type inequality ensuring Kht0K_{ht}\rightarrow 0 for all edges. This drives the embedding manifold toward local Euclidean flatness (Luo et al., 8 Dec 2025).
  2. Linear convergence of embedding distances: When (d)\ell(d) is pp-strongly convex, induced distance updates are equivalent to a perturbed gradient descent, with analytic contraction factor q<1q<1 and summable perturbation, yielding dhtdhtd_{ht}\rightarrow d^*_{ht} at a linear rate to the unique global KGE objective minimizer (Luo et al., 8 Dec 2025).

5. Algorithmic Implementation

A RicciKGE epoch proceeds by iterating over triples:

  • Compute current distances dhtd_{ht}, edge weights whtkw^k_{ht}, and discrete Ricci curvatures KhtkK^k_{ht} (using Wasserstein-1 between neighborhood measures).
  • Evaluate loss gradients and derive optimal perturbations for entity embeddings.
  • Aggregate updates across triples per entity; update all entity vectors.
  • Recompute edge curvatures on the augmented graph.
  • Optionally adapt β\beta and learning rates based on validation metrics.

Typical hyperparameter ranges: β[103,101]\beta\in[10^{-3},10^{-1}] (bounded by theory), KGE learning rate [104,102]\in[10^{-4},10^{-2}], negative samples per positive 256–1024, early stopping patience of 10 epochs (Luo et al., 8 Dec 2025).

Representative Algorithmic Steps

Step Description Mathematical Object
Distance Compute dht=d(fr(E(h)),E(t))d_{ht}=d(f_r(E(h)),E(t)) Riemannian metric
Curvature Compute KhtkK^k_{ht} via Wasserstein-1 Ollivier-Ricci curvature
Update δh\delta_h, δt\delta_t by minimal perturbation Loss gradient, Lagrange multipliers

6. Empirical Performance and Parameter Sensitivity

RicciKGE consistently improves link prediction (e.g. TransE on WN18RR: MRR 0.700 → 0.705; DistMult on FB15K-237: 0.285 → 0.289) and node classification (e.g. PubMed: accuracy 89.97% → 90.57%) when injected as a regularization into multiple base KGE models and GNNs. Curvature-variance empirically decays faster than total loss, generally stabilizing within 50–75 epochs. The coupling coefficient β\beta is highly sensitive: too small underutilizes curvature information, while too large degrades convergence and accuracy; optimal β\beta correlates with theory-derived bounds. Ablation studies confirm both the utility and necessity of curvature-aware updates for expressive representation of local geometry (Luo et al., 8 Dec 2025).

7. Context, Significance, and Connections

RicciKGE provides a synthetic analytic mechanism for embedding adaptation to local heterogeneity, drawing foundational inspiration from Ricci flow in Riemannian geometry. Unlike approaches predicated on synthetic Ricci curvature bounds in metric measure spaces (Han, 2017), RicciKGE leverages a tight feedback loop between spatial regularization and relational loss optimization, and directly conditions metric evolution on predictive utility. A plausible implication is that data-driven extended Ricci flows may generalize to other relational learning domains displaying variable local curvature, such as dynamic graphs or sequence modeling evolutions. Theoretical analysis unambiguously establishes the dual flattening/convergence property: (i) exponential reduction of local curvature, (ii) strict linear contraction of embedding errors, ensuring robust global optima and geometric regularity (Luo et al., 8 Dec 2025).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Whiteboard

Follow Topic

Get notified by email when new papers are published related to RicciKGE.