---
title: Clustering via Diffusion (CLUDI) Overview
url: https://www.emergentmind.com/topics/clustering-via-diffusion-cludi
type: topic
---

# Clustering via Diffusion (CLUDI) Overview

Searching arXiv for the most relevant CLUDI papers and closely related diffusion-clustering work.
First search: specific CLUDI framework paper.
Searching arXiv for "Clustering via Self-Supervised Diffusion".
Clustering via Diffusion (CLUDI) denotes a family of unsupervised methods in which cluster structure is extracted from a diffusion process defined on data. In its classical form, CLUDI constructs a similarity graph, forms a Markov operator \(P=D^{-1}W\), and uses diffusion distances, diffusion kernels, or diffusion embeddings to recover the intrinsic geometry of the data manifold; in more recent work, the term also covers denoising diffusion models that generate, complete, or regularize cluster-friendly latent representations. The name is additionally used by the 2025 framework "Clustering via Self-Supervised Diffusion" [2507.04283], but the broader literature spans diffusion maps, density-mode clustering, subspace affinity diffusion, multiscale diffusion, directed-graph kernels, hyperspectral image clustering, and latent diffusion completion [1411.5737].

## 1. Scope, usage, and historical development

The broad CLUDI paradigm predates the specific 2025 method of the same name. Early representatives include FARDiff, which combined diffusion maps with Fuzzy Adaptive Resonance Theory for high-dimensional clustering [1411.5737], and diffusion fingerprints, which embedded subsets of nodes through personalized PageRank-style random walks on directed graphs [1408.4966]. Diffusion then became a recurrent device for repairing weak affinities or revealing connectivity structure: DSSC applied a diffusion process to sparse subspace affinity graphs [1608.01793], DLSS used diffusion distance to estimate modes and propagate labels in hyperspectral images [1704.07961], MELD and M-LUND formalized a multiscale family of clusterings parameterized by diffusion time [2102.00500], and P-RWDKC generalized diffusion-kernel clustering to directed graphs through a parametrized random walk operator [2210.00310].

Later work diversified both the data domains and the meaning of “diffusion.” In hyperspectral imaging, DSIRC and DS\(^2\)DL used diffusion geometry together with spatial reconstruction, purity estimation, superpixels, and learned latent features [2204.13497], [2604.13307]. In incomplete multi-view clustering, diffusion models were used to complete missing latent views before contrastive clustering [2305.11489]. Fine-grained image clustering inverted conditional diffusion models to recover textual conditions that were then clustered [2412.18838]. The specific CLUDI framework of 2025 introduced a teacher-student system in which stochastic diffusion-based sampling produces diverse cluster assignments from frozen Vision Transformer features [2507.04283]. This dual usage creates a persistent terminological ambiguity: in one lineage, diffusion means Markov propagation on a graph; in the other, it means score-based or DDPM-style denoising dynamics.

## 2. Mathematical foundations of diffusion geometry

In the graph-diffusion formulation, one starts from data points \(X=\{x_i\}_{i=1}^N\), constructs a weighted graph with affinity matrix \(W\), defines the degree matrix \(D\), and row-normalizes to obtain a Markov transition matrix
\[
P = D^{-1}W.
\]
FARDiff uses a Gaussian kernel
\[
w(x_i,x_j)=\exp\!\left(-\frac{\|x_i-x_j\|^2}{\sigma^2}\right),
\]
with \(D_{ii}=d(x_i)=\sum_j w(x_i,x_j)\), and interprets \(P^t\) as a \(t\)-step random walk [1411.5737]. The associated diffusion distance compares endpoint distributions after \(t\) steps:
\[
D_t(x_i,x_j)^2 = \sum_{x\in X} \big|p^t(x_i,x)-p^t(x_j,x)\big|^2.
\]
Spectrally, if \((\lambda_j,\Phi_j)\) are eigenpairs of \(P\), diffusion maps use
\[
\Psi_t(x_i)=\big(\lambda_1^t\Phi_1(x_i),\dots,\lambda_L^t\Phi_L(x_i)\big),
\]
so Euclidean distance in diffusion coordinates approximates diffusion distance [1411.5737].

Several later CLUDI variants use the stationary-distribution-weighted form
\[
D_t(x_i,x_j)=\sqrt{\sum_{m=1}^{N}\frac{\big[(P^t)_{im}-(P^t)_{jm}\big]^2}{\pi_m}}
=\sqrt{\sum_{m=1}^{N}|\lambda_m|^{2t}\big[(\psi_m)_i-(\psi_m)_j\big]^2},
\]
which makes explicit that diffusion time \(t\) acts as a scale parameter: small \(t\) preserves local geometry, while larger \(t\) suppresses high-frequency structure and emphasizes coarse connectivity [1704.07961], [2604.13307].

For directed graphs, the natural random walk \(P=D_{\mathrm{out}}^{-1}W\) is generally non-reversible and may fail to be irreducible. P-RWDKC addresses this by defining a parametrized random walk
\[
P_{(\nu)} = (I + D_{\xi/\nu})^{-1}\big(P + D_\nu^{-1}P^\top D_\nu\big),
\]
where \(\nu\) is a positive vertex measure and \(\xi=\nu^\top P\). The resulting operator is self-adjoint in a weighted space and supports a diffusion kernel
\[
K_{t,\nu}=P_{(\nu)}^t D_{\nu+\xi}^{-1},
\]
so diffusion distance again becomes a Mahalanobis distance induced by a kernel, but now without discarding edge directionality [2210.00310].

## 3. Core algorithmic families

The CLUDI literature does not implement a single clustering rule. Instead, diffusion supplies a geometry or a propagator, and the downstream clustering mechanism varies substantially.

The earliest and most direct family uses diffusion embeddings followed by a conventional clustering module. FARDiff computes diffusion coordinates and then applies Fuzzy ART, replacing the more common choice of \(k\)-means with an adaptive resonance network governed by choice, vigilance, and learning-rate parameters [1411.5737]. Diffusion fingerprints take a related but seed-centered view: a personalized PageRank vector becomes the embedding of a subset or object, after which any standard clustering method can operate in fingerprint space [1408.4966].

A second family uses diffusion distance for mode seeking and density-based propagation rather than explicit embedding-then-\(k\)-means. DLSS estimates a density \(p(x)\), defines the diffusion-distance-to-higher-density quantity \(\rho_t(x)\), and scores modes by
\[
\mathcal{D}_t(x)=p(x)\rho_t(x).
\]
The top \(K\) maximizers become cluster modes, and the remaining points inherit the label of their diffusion-distance nearest labeled neighbor of higher density [1704.07961]. DSIRC retains this structure but augments density with purity, using a harmonic-mean quality score \(\zeta(x)\) and the mode criterion \(\mathcal{D}_t(\tilde x)=\zeta(x)d_t(\tilde x)\) on shape-adaptively reconstructed hyperspectral pixels [2204.13497]. DS\(^2\)DL continues the same pipeline in a learned latent space, with
\[
\Delta_t(x)=\zeta(x)d_t(x),
\]
mode selection on superpixel representatives, and diffusion-based label propagation back to all pixels [2604.13307].

A third family diffuses the affinity itself. DSSC begins with the sparse subspace affinity \(W=|C|+|C^T|\) obtained by \(\ell_1\)-SSC and then iterates
\[
A_{t+1}=WA_tW^T+I.
\]
This realizes diffusion on a tensor-product graph and converges to a refined affinity that preserves the approximate block structure of SSC while strengthening within-subspace connectivity [1608.01793].

A fourth family is explicitly multiscale. MELD treats clustering as a family \(\{\mathcal C_t\}\) indexed by diffusion time, and M-LUND runs diffusion-based clustering over a range of \(t\) values before selecting a representative partition by minimizing total variation of information across nontrivial clusterings [2102.00500].

| Family | Core diffusion object | Representative papers |
|---|---|---|
| Embedding then cluster | \(P^t\), diffusion maps \(\Psi_t\) | FARDiff [1411.5737] |
| Density-mode diffusion | \(D_t\), \(\mathcal D_t(x)\), \(\Delta_t(x)\) | DLSS [1704.07961], DSIRC [2204.13497], DS\(^2\)DL [2604.13307] |
| Affinity diffusion | \(A_{t+1}=WA_tW^T+I\) | DSSC [1608.01793] |
| Multiscale diffusion | time-indexed family \(\mathcal C_t\) | MELD, M-LUND [2102.00500] |
| Directed-graph diffusion kernels | \(P_{(\nu)}\), \(K_{t,\nu}\) | P-RWDKC [2210.00310] |
| Generative diffusion for clustering | latent DDPMs, conditional denoising | IMVCDC [2305.11489], CLUDI [2507.04283], DiFiC [2412.18838] |

## 4. Spatial, hyperspectral, and graph-structured variants

Hyperspectral image analysis has become one of the most technically developed application areas for CLUDI. DLSS builds a \(k\)-nearest-neighbor graph in spectral space, computes diffusion distances, estimates density modes, and then applies a two-stage spectral-spatial labeling procedure [1704.07961]. DSIRC inserts a shape-adaptive reconstruction stage before diffusion and combines density with spectral unmixing purity; on Indian Pines it reported \( \mathrm{OA}=0.6195 \) and \( \kappa=0.6123 \), compared with DLSS at \( \mathrm{OA}=0.4886 \) and \( \kappa=0.4074 \) [2204.13497]. DS\(^2\)DL then replaced raw spectra by a masked-autoencoder latent space, used entropy rate superpixels and representative selection, and kept the diffusion pipeline of S\(^2\)DL essentially unchanged except for operating in the latent manifold. It reported higher OA, AA, \(\kappa\), purity, and NMI than S\(^2\)DL on Botswana and KSC, and reduced runtime from \(2805.71\) to \(934.03\) seconds on KSC and from \(2782.62\) to \(947.83\) seconds on Botswana [2604.13307].

Directed and structured graphs required a distinct set of modifications. P-RWDKC addresses the non-reversibility and non-ergodicity of digraph random walks by constructing a parametrized reversible walk, then clustering rows of the diffusion kernel \(K_{t,\nu}\); it was reported to outperform existing directed-graph baselines on K-NN graphs from real-world datasets and on real-world graphs in most tested cases [2210.00310]. Outside graph-spectral settings, ClusTEK applies Laplacian-kernel diffusion imputation on a uniform spatial grid and then performs origin-constrained connected-component analysis; its fixed-resolution spatial indexing yields scaling of \(O(n\log n)\), and the reported polymer benchmarks range from \(9\)k to \(989\)k atoms [2512.16110]. These variants show that CLUDI is not restricted to one graph construction or one notion of node: points, superpixel representatives, grid cells, and directed-network vertices have all been used.

## 5. Generative diffusion and the modern meaning of CLUDI

In recent work, “diffusion” increasingly refers to denoising diffusion probabilistic models rather than Markov diffusion geometry. IMVCDC is an early clustering example in this sense: it trains autoencoders for each view, performs conditional latent-space diffusion completion of missing views, and then applies contrastive clustering. On Multi-Coil20 with missing rate \(\eta=0.5\), the ablation \(L_{\mathrm{rec}}+L_{\mathrm{dm}}\) reached \(74.49\) ACC, \(82.13\) NMI, and \(70.01\) ARI, while the full model \(L_{\mathrm{rec}}+L_{\mathrm{dm}}+L_{\mathrm{clu}}\) reached \(98.26\) ACC, \(97.35\) NMI, and \(96.42\) ARI [2305.11489].

DiFiC uses a pretrained text-to-image diffusion model differently: it infers a proxy word \(S^*=f(z_{\hat t}^b)\) that acts as the textual condition explaining an image under the frozen diffusion model, regularizes the diffusion target with an attention-derived object mask, and applies neighborhood-similarity guidance in the proxy-word space [2412.18838]. On Stanford Cars, the full method reported \(47.2\%\) ACC and \(0.68\) NMI, substantially above its raw Stable Diffusion feature baseline [2412.18838]. DiEC pursues a related but distinct route by searching over diffusion U-Net layer and timestep, fixing a clustering-friendly middle layer and then selecting an optimal timestep before DEC-style KL self-training with graph and entropy regularization [2512.20905].

The framework specifically named CLUDI introduced in 2025 combines frozen DINO Vision Transformer features with a conditional diffusion model over assignment embeddings \(\mathbf z_0\), trained in a teacher-student configuration [2507.04283]. The teacher uses stochastic DDIM-style backward sampling to produce diverse soft cluster assignments, and the student learns to denoise noisy assignment embeddings while matching non-collapsing cluster probabilities. At inference, multiple samples are averaged,
\[
p_\theta(k\mid x)\approx \frac{1}{B}\sum_{i=1}^{B} p(k\mid \mathbf z_0^i),
\]
which turns diffusion stochasticity into a cluster-space augmentation mechanism. On ImageNet-50 with ViT-B/16, it reported \(91.2\) NMI, \(82.1\) ACC, and \(76.2\) ARI [2507.04283]. In this lineage, diffusion is no longer merely a geometry on an externally defined graph; it is the generator of the clustering representation itself.

## 6. Limitations, misconceptions, and emerging directions

A common misconception is that CLUDI simply means \(k\)-means after diffusion maps. The literature is broader. FARDiff uses Fuzzy ART rather than \(k\)-means [1411.5737]; DLSS, DSIRC, and DS\(^2\)DL perform density-mode discovery and diffusion-based label propagation [1704.07961], [2204.13497], [2604.13307]; DSSC diffuses affinities before spectral clustering [1608.01793]; and the 2025 CLUDI framework performs stochastic assignment generation in latent space [2507.04283]. Another misconception is that diffusion removes the need for model selection. In practice, performance depends on graph construction, kernel bandwidth, neighbor counts, diffusion time, spatial radius, masking strategy, noise scale, and the assumed number of clusters [1704.07961], [2210.00310], [2412.18838].

The limitations are correspondingly method-specific. In random-walk CLUDI, incorrect affinities or weakly connected graphs can distort diffusion geometry; directed graphs require special constructions precisely because the natural walk is often non-reversible or non-ergodic [2210.00310]. In hyperspectral variants, DS\(^2\)DL explicitly assumes that ERS superpixels align reasonably with semantic classes; over-segmentation or under-segmentation weakens spatial regularization [2604.13307]. In generative variants, raw diffusion features may be poorly clusterable unless additional objectives are imposed, as DiFiC’s ablations make clear [2412.18838]. In plug-and-play latent diffusion for single-cell data, large \(\rho\) can over-weight the prior and map genuinely novel structure into previously learned modes, while repeated sampling exposes meaningful uncertainty near cluster boundaries [2510.22835].

Current directions indicate a widening role for diffusion beyond classical partitioning. DS\(^2\)DL proposes fine-tuning its masked autoencoder with unsupervised contrastive learning and extending the framework to semi-supervised and active settings [2604.13307]. MELD suggests that diffusion time can be treated as a coordinate on a family of valid clusterings rather than a nuisance hyperparameter [2102.00500]. Work on latent group sparsity via heat-flow penalties shows that diffusion on networks can interpolate between lasso and group lasso without explicit pre-clustering, which suggests a broader interpretation of CLUDI as soft group-structure discovery rather than only hard partition recovery [2507.15097]. Taken together, these developments indicate that diffusion now functions both as a metric geometry and as a probabilistic prior, and that the boundary between clustering, denoising, completion, and representation learning is becoming increasingly porous.

Source: https://www.emergentmind.com/topics/clustering-via-diffusion-cludi