---
title: Symmetric Representation Topology Divergence
url: https://www.emergentmind.com/topics/symmetric-representation-topology-divergence-srtd
type: topic
---

# Symmetric Representation Topology Divergence

Searching arXiv for the specified SRTD and related RTD papers.
Symmetric Representation Topology Divergence (SRTD) is a topological divergence for comparing two paired representations of the same inputs by measuring discrepancies between the induced Vietoris–Rips filtrations. It was introduced as a symmetric completion of the Representation Topology Divergence (RTD) framework, addressing the directional asymmetry of earlier variants while retaining a barcode-based diagnostic interpretation for structural differences between representations [2606.06342]. In the representation-analysis setting, SRTD operates on two point clouds with one-to-one correspondence, constructs a single auxiliary complex encoding both intersection and union structure, computes persistent homology on that complex, and aggregates persistence interval lengths into a nonnegative scalar score [2302.00136] [2606.06342].

## 1. Origins within topology-preserving representation learning

RTD was introduced in work on learning topology-preserving data representations, where the objective was to preserve topological similarity between a data manifold and a latent representation by enforcing similarity in topological features and their localization [2302.00136]. In that setting, the core construction compared pairwise distance structures in the original space and the latent space through a cross-barcode derived from an auxiliary graph, and the resulting RTD was used as a loss term for an autoencoder. The method "RTD-AE" was reported to better preserve the global structure and topology of the data manifold than state-of-the-art competitors as measured by linear correlation, triplet distance ranking accuracy, and Wasserstein distance between persistence barcodes [2302.00136].

The original RTD formulation was directional. For point clouds
\[
X=\{x_i\}_{i=1}^N\subset\mathbb R^d,\qquad Z=\{z_i\}_{i=1}^N\subset\mathbb R^p,
\]
with one-to-one correspondence \(x_i\leftrightarrow z_i\), RTD was defined from persistent homology on a doubled-vertex construction involving the pairwise distance matrices \(w_{ij}=\|x_i-x_j\|\) and \(\tilde w_{ij}=\|z_i-z_j\|\) [2302.00136]. A common symmetric loss in that work was
\[
\RTD(X,Z):=\frac12\bigl[\RTD_1(X,Z)+\RTD_1(Z,X)\bigr],
\]
and a fully symmetric divergence was stated as
\[
\SRTD(X,Z):=\RTD(X,Z)+\RTD(Z,X),
\]
equivalently \(\SRTD=\RTD_1(X,Z)+\RTD_1(Z,X)\), with an optional averaging factor \(1/2\) [2302.00136].

Subsequent work reformulated this symmetrization more fundamentally. Rather than summing two directional computations, it introduced a single symmetric auxiliary graph whose filtration tracks the union and intersection of the two Vietoris–Rips complexes simultaneously, thereby defining SRTD as a one-pass symmetric cross-barcode divergence [2606.06342]. This suggests a conceptual shift from “symmetrized RTD” as an arithmetic combination of directional terms to SRTD as its own homological construction.

## 2. Formal construction

In the unified topological framework for representation analysis, SRTD is defined for two representations
\[
P=\{x_1,\dots,x_n\}\subset\mathbb R^d,\qquad P'=\{x'_1,\dots,x'_n\}\subset\mathbb R^{d'},
\]
of the same \(n\) inputs, with pairwise dissimilarity matrices
\[
w,\;\tilde w\in\mathbb R^{n\times n},\quad w_{ii}=\tilde w_{ii}=0,\;w_{ij}=w_{ji}\ge0,\;\tilde w_{ij}=\tilde w_{ji}\ge0
\]
[2606.06342]. The construction first forms the element-wise minimum and maximum,
\[
w_{\min}:=\min(w,\tilde w),\qquad w_{\max}:=\max(w,\tilde w).
\]

A single symmetric auxiliary graph is then encoded by the \((2n+1)\times(2n+1)\) distance matrix
\[
M_{\rm sym}
=\begin{pmatrix}
w_{\max}^+        &  (w_{\min}^+)^T  &  0\\
w_{\min}^+        &  w_{\max}^+      & \infty\\
0                 &  \infty          & 0
\end{pmatrix},
\]
where \(w^+\) means “replace the strict upper triangle of \(w\) by \(+\infty\)” so that the lower-block and upper-block together encode precisely the intersection and union filtrations [2606.06342]. Ordinary persistent homology is then computed on the Vietoris–Rips filtration induced by \(M_{\rm sym}\).

If
\[
B_i^{\rm sym}=\bigl\{[\,b_{ij},\,d_{ij}\,]\bigr\}_{j}
\]
denotes the multiset of \(i\)-dimensional persistence intervals, then the dimension-\(i\) SRTD is
\[
\mathrm{SRTD}_i(P,P')
=
\sum_{[b,d]\in B_i^{\rm sym}} (d-b),
\]
and the total divergence is
\[
\mathrm{SRTD}(P,P')
=
\sum_{i\ge0}\mathrm{SRTD}_i(P,P').
\]
In practice, only \(i=0,1\) are often used [2606.06342].

Algorithmically, the procedure is concise: after optionally normalizing \(w,\tilde w\) by their \(0.9\)-quantiles, one builds \(M_{\rm sym}\), feeds it to a Vietoris–Rips persistent homology engine, and sums all interval lengths [2606.06342]. In the earlier RTD-based formulation, the corresponding directional pipeline was batch-wise: compute two distance matrices, build the doubled-graph weight matrix, feed it to a Rips-persistence solver such as GPU-Ripser++, extract the first-degree cross-barcode, and return the sum of interval lengths [2302.00136].

## 3. Relation to RTD and the resolution of asymmetry

The central motivation for SRTD is that RTD is directional. In the 2026 formulation, directional RTD uses auxiliary matrices \(M_{\min}\) and \(M_{\max}\), producing two scalar divergences \(\mathrm{RTD}(w,\tilde w)\) and \(\mathrm{RTD}(\tilde w,w)\); in general,
\[
\mathrm{RTD}(w,\tilde w)\neq\mathrm{RTD}(\tilde w,w)
\]
[2606.06342]. The stated source of this asymmetry is that new features can appear earlier in one filtration than in the other, producing “private” topological features unique to each direction [2606.06342].

SRTD resolves this by collapsing union-and-intersection into one mapping-cone complex \(M_{\rm sym}\) [2606.06342]. The precise homological relation is given as
\[
\mathrm{Max\text{-}RTD}_i+\mathrm{RTD}_i-\mathrm{SRTD}_i
=\int_0^\infty
\bigl[\dim\ker(\gamma_i(\alpha))+\dim\ker(\gamma_{i-1}(\alpha))\bigr]
\,d\alpha
\ge0,
\]
showing that SRTD is the large, shared symmetric core, while directional RTD and Max-RTD add private components [2606.06342].

This relation is especially explicit in the \(0\)-dimensional lightweight setting. Corollary statements reported for the lite version are
\[
\mathrm{SRTD\_lite}(w,\tilde w)
=
\mathrm{MST}\bigl(\max(w,\tilde w)\bigr)-\mathrm{MST}\bigl(\min(w,\tilde w)\bigr),
\]
together with
\[
\mathrm{Max\text{-}RTD\_lite}\ge\mathrm{SRTD\_lite}\ge\mathrm{RTD\_lite}.
\]
These inequalities place SRTD-lite between the directional extremes and remove directional asymmetry by construction [2606.06342].

A common misconception is to treat SRTD merely as the arithmetic average of two RTD directions. The literature supports two distinct usages. In the original topology-preserving representation-learning work, a “fully symmetric divergence” was defined as the sum of directional RTD terms, optionally averaged [2302.00136]. In the later unified framework, SRTD is instead a single symmetric construction based on one auxiliary complex and one cross-barcode computation [2606.06342]. The second formulation is the one specifically designed to “complete the RTD framework” and eliminate heuristic asymmetry.

## 4. Barcode interpretation and diagnostic role

SRTD is not only a scalar divergence but also a barcode-based diagnostic object. In the 2026 framework, each interval \([b,d]\) in the cross-barcode identifies one connected component that is born in the \(\min\)-filtration at time \(b\) but does not die until time \(d\) in the \(\max\)-filtration [2606.06342]. By lifting the responsible edge back to the original point pair \((i,j)\), one can identify which sample pair contributes most strongly to the divergence. In language-model experiments, this enabled tracing a few anomalous question–answer pairs that drove large SRTD-lite divergences [2606.06342].

This diagnostic interpretation is continuous with the earlier RTD program, which emphasized not only topological features such as clusters, loops, and \(2\)D voids, but also their localization [2302.00136]. The 2026 paper states that SRTD consolidates diagnostic information into a single, comprehensive cross-barcode signature and allows precise localization of structural discrepancies [2606.06342]. A plausible implication is that SRTD is particularly useful when scalar similarity scores alone are insufficient and one needs localized structural attribution.

The same work also positions SRTD as an optimization objective. Because SRTD and SRTD-lite are single symmetric functions of \((w,\tilde w)\), they can be inserted directly into gradient-based training, for example as regularizers in an autoencoder [2606.06342]. The paper reports that replacing the usual RTD-AE loss with SRTD yields the same quality but roughly half the runtime because there is no need to compute two directional RTDs [2606.06342].

## 5. Efficient variant: SRTD-lite

SRTD-lite is the \(0\)-dimensional, computationally efficient variant. It exploits the classical equivalence between the \(0\)D Vietoris–Rips barcode and the Minimum Spanning Tree (MST) [2606.06342]. The procedure is summarized as follows: compute
\[
E_{\min}=\mathrm{MST\_edges}(\min(w,\tilde w)),\qquad
E_{\max}=\mathrm{MST\_edges}(\max(w,\tilde w)),
\]
sort both in nondecreasing order of edge weight, interpret each edge in \(E_{\min}\) with weight \(b\) as a birth event, then scan through \(E_{\max}\) to find the smallest weight \(d\) that reconnects the same two components; the pair \((b,d)\) defines a barcode interval, and the final score is the sum of all \((d-b)\) [2606.06342].

The paper gives the following complexity characterizations for SRTD-lite [2606.06342]:

| Component | Complexity |
|---|---|
| Building pairwise distances | \(O(n^2)\) |
| Two MSTs by Kruskal/Prim | \(O(n^2\alpha(n))\) or \(O(n^2\log n)\) |
| Nested loop over birth and death edges | \(O(n^2\alpha(n))\) |

It is reported to run in under a second for \(n\) up to tens of thousands, making it highly scalable [2606.06342]. The paper recommends deterministic tie-breaking in MST/Kruskal and mid-rank ties in Spearman’s ranks to ensure reproducibility [2606.06342].

The authors also recommend \(0.9\)-quantile pre-normalization before computing RTD or SRTD, rescaling all distances so that the \(0.9\) quantile equals \(1\), in order to reduce extreme scale effects [2606.06342]. They further recommend using SRTD-lite for quick diagnostics, local anomaly detection, and as a drop-in loss [2606.06342]. Because the underlying score remains unbounded and scale-dependent, they suggest switching to Normalized Topological Similarity (NTS) for cross-scenario benchmarking [2606.06342].

## 6. Theoretical properties

Several formal properties are explicitly stated for SRTD and the surrounding RTD framework. First, symmetry is built in:
\[
\mathrm{SRTD}(w,\tilde w)=\mathrm{SRTD}(\tilde w,w)
\]
by construction [2606.06342]. Second, SRTD is nonnegative, and if \(w=\tilde w\), then \(\min=\max\), the mapping cone is trivial, and \(\mathrm{SRTD}=0\) [2606.06342].

The key homological interpretation is that the chain complex on \(M_{\rm sym}\) is homotopy equivalent to the mapping cone of the inclusion
\[
C_*\bigl(R_\alpha(G)\cap R_\alpha(G')\bigr)
\longhookrightarrow
C_*\bigl(R_\alpha(G)\cup R_\alpha(G')\bigr),
\]
which underpins the exact sequence relating RTD, Max-RTD, and SRTD [2606.06342]. This establishes SRTD as a genuinely topological comparison functional rather than a heuristic graph statistic.

From the RTD literature inherited by SRTD, there are also continuity and barcode-matching guarantees. For any two weight-pairs \((w,\tilde w)\), \((w',\tilde w')\) on the same vertex set,
\[
d_B\bigl(\mathrm{R\!-\!Cross\!-\!Barcode}_k(w,\tilde w),
\mathrm{R\!-\!Cross\!-\!Barcode}_k(w',\tilde w')\bigr)
\le
\max\bigl\{\|w-w'\|_\infty,\|\tilde w-\tilde w'\|_\infty\bigr\},
\]
so \(\RTD_k\) is Lipschitz-continuous in the maximum norm on edge weights, and by chaining through pairwise distances, continuous in coordinates [2302.00136]. The earlier work also states a zero-measure identity: if \(\RTD_k(X,Z)=\RTD_k(Z,X)=0\) for all \(k\ge1\), then the persistent barcodes of \(\mathcal G^w\) and \(\mathcal G^{\tilde w}\) coincide in every degree, and the corresponding classes are matched at identical filtration values [2302.00136]. This suggests that the symmetrized divergence inherits a strong “zero implies topological coincidence” interpretation, although the exact zero-iff-identical statement for the 2026 SRTD is phrased at the level of equality of pairwise dissimilarities [2606.06342].

An important limitation is also explicit: like RTD, SRTD is not intrinsically bounded or scale-invariant and grows with \(n\) and the distance scale [2606.06342]. The 2026 framework introduces NTS precisely to overcome this scale and sample dependence for benchmarking across heterogeneous settings [2606.06342].

## 7. Empirical behavior, usage, and scope

The 2026 study reports that SRTD and SRTD-lite increase monotonically in a synthetic task comparing a single Gaussian cluster to \(k\) subclusters on a circle, whereas RTD-lite inverts the trend and CKA is nearly flat [2606.06342]. In UMAP embedding experiments, the SRTD family and NTS are reported to track smooth structural evolution as \(n\_\text{neighbors}\) varies, while CKA does not [2606.06342]. In autoencoder experiments on F-MNIST and COIL-20, training a \(16\)-dimensional autoencoder with SRTD loss is reported to match or beat RTD while reducing runtime by approximately \(2\times\) [2606.06342].

For CNN layer analysis, SRTD-lite heatmaps on an \(8\)-layer TinyCNN are reported to reveal a strong structural break at the final pooling layer and a clear near-diagonal decay, while RTD and RTD-lite show counter-intuitive inversions under standard \(0.9\)-quantile normalization [2606.06342]. For LLM genealogy mapping, CKA is reported to saturate with most pairwise scores greater than \(0.8\), whereas NTS and, to a lesser extent, SRTD-lite barcodes uncover family-wise hierarchical fingerprints; the study further reports that NTS correctly identifies Qwen2.5-Math and its distilled DeepSeek child as highly similar where CKA fails [2606.06342]. SRTD-lite barcodes also allow query-level diagnosis of representation shifts, though the final sum is sensitive to a few outlier intervals, which motivated NTS for robustness [2606.06342].

These results place SRTD within a broader TDA-based representation-analysis toolkit rather than as a universal replacement for all similarity measures. The paper explicitly frames SRTD as serving fine-grained structural diagnosis, while NTS is recommended for robust, standardized evaluation across layers, models, and datasets [2606.06342]. A plausible implication is that SRTD is best suited to paired, topology-aware inspection where localizable discrepancies matter, whereas normalized statistics are preferable for large-scale comparative studies.

The acronym “SRTD” also appears in an unrelated finite-element literature as “Selective Replacement of Tensor Divergence” for Oldroyd viscoelastic flow models [2501.12517]. That usage concerns a three-stage variational reformulation of a constitutive PDE system and is not related to Symmetric Representation Topology Divergence in representation analysis. Distinguishing these two expansions is important because both are current arXiv terms but belong to entirely different technical domains [2501.12517].

Source: https://www.emergentmind.com/topics/symmetric-representation-topology-divergence-srtd