---
title: 'Block-SSTS: Block-Wise Causal Discovery'
url: https://www.emergentmind.com/topics/block-ssts
type: topic
---

# Block-SSTS: Block-Wise Causal Discovery

Searching arXiv for Block-SSTS and the associated SSTS paper.
Block-SSTS is a block-wise variant of the Score-Schur Topological Sort (SSTS) introduced for causal discovery in additive-noise causal models (ANMs) over directed acyclic graphs (DAGs). It operates on the Score-Jacobian Information Matrix (SJIM), estimated from an unconstrained score model, and replaces sequential single-node Schur-complement eliminations with simultaneous elimination of a “leaf block” whose diagonal energies are within a relative tolerance of the minimum. In the formulation of "Optimization-Free Topological Sort for Causal Discovery via the Schur Complement of Score Jacobians" [2604.25295], this modification is motivated by non-linear expectation-gap effects and by the presence of parallel leaves in sparse DAGs; it is designed to reduce extraction depth, average out estimation noise, and bound structural error.

## 1. Position within score-based causal discovery

Block-SSTS is part of a decoupled causal-discovery paradigm that shifts the principal difficulty from constrained structural optimization to statistical score estimation. The underlying SSTS procedure separates density estimation from structure extraction: one first trains an unconstrained score model $s_\theta(x)$ so that $s_\theta \approx \nabla \log p$, then forms an empirical SJIM, and finally extracts a topological order by repeated Schur-complement elimination of leaf variables [2604.25295].

The central object is the Score-Jacobian Information Matrix. For a continuous random vector $X \in \mathbb{R}^d$ generated by an ANM with structural equations
$$
x_i = f_i(x_{pa(i)}) + \epsilon_i, \qquad \epsilon_i \sim N(0,\sigma^2),
$$
the score is $s(x)=\nabla_x \log p(x)$, the sample Hessian is $H(x)=-\nabla_x^2 \log p(x)$, and the SJIM is the population Fisher information with respect to $x$,
$$
I \coloneqq E_{p(x)}[H(x)] \in \mathbb{R}^{d \times d}.
$$
Under the ANM,
$$
I_{ii} = (1/\sigma^2) + (1/\sigma^2)\sum_{j \in ch(i)} E\!\left[\left(\partial f_j/\partial x_i\right)^2\right].
$$
A topological sink, equivalently a leaf node, satisfies $ch(\ell)=\varnothing$, and therefore $I_{\ell\ell}=1/\sigma^2$, which is minimal among all diagonals (Theorem 1) [2604.25295].

This diagonal-minimum property is what makes Schur-based topological sorting possible. A plausible implication is that Block-SSTS should be read not as a separate estimator of causal score geometry, but as a structural extraction rule layered on top of the SJIM estimated by the score model.

## 2. Schur-complement marginalization and the origin of block elimination

In the linear Gaussian ANM, with strictly upper-triangular adjacency matrix $B$ and $x=(I-B)^{-1}\epsilon$, the joint precision matrix equals
$$
I=(1/\sigma^2)(I-B)^\top(I-B).
$$
Eliminating a leaf node $\ell$ is exactly equivalent to taking the Schur complement of $I$ with respect to row and column $\ell$:
$$
I_{marginal}=I_{S,S}-I_{S,\ell}\cdot (I_{\ell,\ell})^{-1}\cdot I_{\ell,S},
$$
where $S=V\setminus\{\ell\}$. In block form, if
$$
I=
\begin{bmatrix}
I_{[i]} & I_{[i],[\bar i]}\\
I_{[\bar i],[i]} & I_{[\bar i]}
\end{bmatrix},
$$
then eliminating block $[\bar i]$ yields
$$
S_{[i]}=I_{[i]}-I_{[i],[\bar i]}I_{[\bar i]}^{-1}I_{[\bar i],[i]}.
$$
Under linear ANMs, recursive application of this Schur complement exactly mimics sequential leaf removal without retraining (Theorem 2) [2604.25295].

Block-SSTS arises when this exact equivalence is perturbed by non-linearity. In non-linear ANMs, $H(x)$ varies with $x$, so
$$
E[\mathrm{Schur}(H(x))]\neq \mathrm{Schur}(E[H(x)]).
$$
For elimination of leaf $\ell$, the expectation gap is
$$
\Delta = E[\mathrm{Schur}(H(x))]-\mathrm{Schur}(I)=-(1/\sigma^2)\,\mathrm{Cov}_{p(x)}[\nabla f_\ell(x_{pa(\ell)})].
$$
By Remark 3, this gap is localized to the parent-block of $\ell$ but cascades through $d$ sequential eliminations, degrading structural fidelity [2604.25295].

The motivation for block-wise elimination is therefore twofold. First, sparse DAGs may contain multiple true leaves in parallel, and their theoretical $I_{ii}$ values are identical. Second, empirical noise perturbs those diagonals, so eliminating them one-by-one both overreacts to sampling fluctuations and preserves the full depth-$d$ cascade through which $\Delta$ accumulates.

## 3. Algorithmic specification of Block-SSTS

Block-SSTS groups together variables whose diagonal energies are sufficiently close to the minimum and eliminates them in a single block Schur complement. The required inputs are a score model $s_\theta(x)$, data $D$, a ridge parameter $\lambda>0$, and a block tolerance $\gamma \in (0,1)$ [2604.25295].

The empirical construction begins with
$$
\hat J = |D|^{-1}\sum_{x\in D}\nabla_x s_\theta(x),
$$
followed by symmetrization,
$$
\hat I = \tfrac12(\hat J + \hat J^\top).
$$
The active set is initialized as $S \leftarrow \{1,\dots,d\}$ and the order as $\pi \leftarrow [\,]$. At each iteration one computes
$$
m=\min_{i\in S}\hat I_{ii},
$$
forms the block
$$
B=\{i\in S \mid \hat I_{ii}\le m+\gamma |m|\},
$$
prepends $B$ (sorted internally) to $\pi$, and, if $S\setminus B\neq \varnothing$, updates the reduced information matrix by
$$
\hat I_{S',S'} \leftarrow \hat I_{S',S'}-\hat I_{S',B}(\hat I_{B,B}+\lambda I)^{-1}\hat I_{B,S'},
$$
where $S' = S\setminus B$. The process repeats until $S=\varnothing$, after which $\pi$ is returned [2604.25295].

The paper attributes two effects to this block rule. It “averages out estimation noise among parallel leaves,” and it “reduces the number of sequential steps from $d$ to roughly $d/|B|$, truncating the accumulation of $\Delta$” [2604.25295]. This suggests that the method is best understood as a compression of the elimination trajectory rather than merely a batching heuristic.

A common misunderstanding is to read the term “optimization-free” as applying to the entire learning pipeline. The stated procedure is narrower: it bypasses constrained structure optimization, while retaining unconstrained score-model training as Step A of the overall workflow [2604.25295].

## 4. Block-wise expectation gap and structural guarantees

For a block $B$ of simultaneous leaves, the paper defines the block-Schur expectation gap
$$
\Delta_B = E[\mathrm{Schur}_B(H(x))]-\mathrm{Schur}_B(I),
$$
and states that it decomposes into a sum of covariances among the gradients of $f_\ell$ for $\ell \in B$ [2604.25295]. By aggregating nodes, the norm $\|\Delta_B\|$ shrinks, and the total number of Schur steps falls from $d$ to approximately $d/|B|$.

The formal guarantees are given under an assumption that the entries of $H(x)$ are sub-Gaussian and the noise is homoscedastic. Let $n=|D|$, let $b$ denote the minimal block size, and let $d$ denote the dimension. The SJIM concentration lemma states that, with probability at least $1-\delta$,
$$
\|\hat I-I\|_{max}\le C_1\sqrt{\log(d/\delta)/n}.
$$
The block-Schur perturbation proposition states that if $\|\hat I-I\|_{max}\le \epsilon$ and every block Schur complement is on at most a $b\times b$ submatrix, then each block elimination incurs a perturbation in the reduced matrix bounded by $O(b\,\epsilon)$, and over at most $d/b$ blocks the total deviation from the population sequence is $O(d\,\epsilon)$ [2604.25295].

The structural error theorem then states that there exists $C>0$ such that, with probability at least $1-\delta$, the recovered adjacency $\hat G$ after Block-SSTS plus downstream pruning satisfies
$$
\|\hat G-G^*\|_F \le C\cdot \left[d\sqrt{\log(d/\delta)/n}+d\|\Delta\|_{max}\right],
$$
where
$$
\Delta = -(1/\sigma^2)\,\mathrm{Cov}[\nabla f_\ell]
$$
is the per-leaf expectation gap [2604.25295]. In regimes where $n \gg d\log d$ and nonlinearities are mild, so that $\|\Delta\|$ is small, exact recovery is ensured.

The decomposition of error into a statistical estimation term and a non-linear expectation-gap term is central. The paper identifies these as two irreducible terms: the statistical estimation error $O(d\sqrt{\log d/n})$ and the non-linear expectation gap $O(d\|\Delta\|)$ [2604.25295].

## 5. Complexity, empirical scaling, and parameterization

The computational motivation for Block-SSTS is explicit. Full SSTS, which eliminates one node at a time, requires $O(d)$ Schur complements, each costing $O(d^2)$, for total complexity $O(d^3)$. Block-SSTS reduces this to roughly $(d/b)$ Schur complements times $O(d^2)$, giving $O(d^3/b)$ [2604.25295]. For block size $b \approx O(1)$ in sparse graphs, the paper states that one obtains an $O(d^3/b)$ speedup.

The empirical SJIM construction requires $O(n\,d^2)$ time to accumulate Hessians, while streaming mini-batches bound memory to $O(d^2)$. In experiments up to $d=1000$ and sample size $N=5000$, Block-SSTS required less than $1\,\mathrm{s}$ for the structural extraction phase, with $T_{disc}\approx 0.6\,\mathrm{s}$ for $d=1000$ on a single GPU; this is contrasted with $O(1000\,\mathrm{s})$ for repeated acyclicity-penalty evaluations in NOTEARS-style methods [2604.25295].

The two principal tuning quantities are the block tolerance $\gamma$ and the effective block size $b$. The paper states that $\gamma$ should be small enough to avoid grouping non-parallel nodes, which induces structural error, but large enough to merge true parallel leaves and suppress estimation noise; empirically, $\gamma \approx 0.05$–$0.1$ works well [2604.25295]. The effective block size is adaptive: in early strata of very disconnected DAGs, blocks can be large, whereas in dense graphs $b$ may shrink to $1$.

The sample-size discussion is similarly concrete. To ensure concentration $\|\hat I-I\| \lesssim \epsilon$, one needs $n \gtrsim O((\log d)/\epsilon^2)$, and in practice $n$ on the order of a few times $d$ suffices for moderate $d \le 100$ [2604.25295].

## 6. Exactness domain, failure modes, and open problems

Block-SSTS is exact for linear ANMs and robust to moderate nonlinearity, specifically “tanh, sigmoidal” nonlinearities [2604.25295]. Its formal derivation depends on the homoscedastic Gaussian ANM framework and on the algebraic relation between graph marginalization and the Schur complement of the SJIM. In this sense, its strongest claims concern settings where the score geometry is well estimated and the expectation gap remains small.

The paper also states explicit limitations. In purely multiplicative noise models or post-nonlinear transforms, the ANM assumptions break, and the method may fail. To reduce $\|\Delta\|$, it suggests the exact “covariance patching” of Appendix C.2, but at the cost of $O(n\,d^3)$ complexity [2604.25295]. This frames a basic trade-off between algebraic correction of the non-linear gap and computational efficiency.

Several open questions are stated. These include whether block-wise covariance patching can be combined with low-rank updates to retain $O(d^2)$ memory while compensating $\Delta$; what the minimax rates are for score-based SJIM estimation in high dimensions under general ANMs; and how to extend exact algebraic marginalization to post-nonlinear or heteroscedastic noise families beyond the homoscedastic Gaussian ANM [2604.25295].

A broader interpretive point follows from the paper’s closing summary. By replacing the $O(d)$ sequential Schur complementarities of SSTS with blockwise eliminations, Block-SSTS is presented as both an acceleration mechanism and an error-control device in non-linear settings. This suggests a reframing of continuous causal discovery in which the principal obstacle is no longer non-convex acyclicity enforcement, but the finite-sample estimation variance of the global score geometry [2604.25295].

Source: https://www.emergentmind.com/topics/block-ssts