Papers
Topics
Authors
Recent
Search
2000 character limit reached

Cluster Paths in Data Analysis

Updated 15 July 2026
  • Cluster paths are path-centered representations that encode structural continuity and multi-scale evolution used in diverse clustering frameworks.
  • They are applied in graph-based, manifold, and convex clustering to enhance partitioning accuracy and robustness, impacting fields like trajectory analysis and neural interpretability.
  • Key methodologies include shortest-path formulations, angle constraints, and regularization paths, achieving improvements such as F1-scores up to 0.99 on benchmark datasets.

Cluster paths are path-centered representations used to organize cluster structure in several distinct senses. In graph-based clustering, a path is a sequence of edges whose cumulative, minimax, or learned cost determines assignment to density peaks; in manifold clustering, it may be an angle-constrained graph path, a maximum-density path between mixture components, or a bottleneck path on a simplex graph; in convex clustering and local graph diffusion, it is a regularization path indexed by a control parameter; in temporal analysis, it is an inferred evolution path through a learned cluster-transition graph; and in neural-network interpretability, it is the sequence of cluster IDs traversed by an input across layers (Pizzagalli et al., 2018, Babaeian, 2018, Ritzert et al., 19 Mar 2025, Wu et al., 27 Jan 2025, Kloster et al., 2015, Rizoiu et al., 2015, Kroeger et al., 8 Oct 2025).

1. Meanings of the term

The term is not standardized across fields. In some literatures it denotes a path used to define clusters; in others, a path of clusterings generated as a parameter changes; in still others, a path through clusters that summarizes evolution or representation learning.

Setting Path object Representative formulation
Graph-based assignment Node path Γ\Gamma from a super-source to a sample Non-decreasing shortest-path cost (Pizzagalli et al., 2018)
Intersecting manifolds α\alpha-constrained neighborhood-graph path Turning-angle threshold (Babaeian, 2018)
Density hierarchy Continuous path between mixture centers Maximum-density bottleneck path (Ritzert et al., 19 Mar 2025)
Simplex geometry Path on a weighted simplex graph LAPD bottleneck metric (Chen et al., 14 Jul 2025)
Regularization Sequence {U(λt)}\{U^*(\lambda_t)\} or {x(δ)}\{x(\delta)\} Convex clustering and seeded PageRank paths (Wu et al., 27 Jan 2025, Kloster et al., 2015)
Neural interpretability Layer-wise sequence γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)}) Activation-cluster path (Kroeger et al., 8 Oct 2025)

A temporal-data usage is explicit in ClusPath, where observations are partitioned into clusters C1,,CkC_1,\dots,C_k while simultaneously learning a directed weighted graph A=(apq)A=(a_{pq}) that models transitions between successive phases under a “slow changing world” assumption (Rizoiu et al., 2015). A separate combinatorial-optimization usage studies clustering directly on a path graph with arbitrary pairwise correlation costs; in that setting the problem is polynomial-time solvable by dynamic programming, and the associated lifted multicut polytope for paths has a complete totally dual integral description (Lange et al., 2017).

This suggests a common design pattern: replacing purely local point-to-point similarity with an object that encodes continuity, bottlenecks, admissibility, or multiscale evolution.

2. Shortest-path formulations for clustering on graphs

A canonical path-based clustering construction appears in the shortest-path method for joint human-machine analysis of complex datasets. Given a point cloud, a weighted graph is built with vertices V={v1,,vN}V=\{v_1,\dots,v_N\} and nonnegative edge costs wijw_{ij}. Local point-density and distance-to-higher-density are defined as

ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,

and density peaks are selected as

α\alpha0

A fictitious source α\alpha1 is connected to each density peak with negligible cost α\alpha2, and a single-source shortest-path problem is solved from α\alpha3 to all nodes (Pizzagalli et al., 2018).

The crucial constraint is that the path-cost functional must satisfy Bellman’s optimality, i.e. it must be non-decreasing on path extension. The paper gives three standard forms:

α\alpha4

and a learned local-window cost

α\alpha5

Because these costs are non-decreasing under extension, Dijkstra-style search remains valid. This directly addresses a failure mode of local association rules: on the “dendrites + blob” benchmark, CDP mis-assigns tips of long thin projections and DBSCAN cannot separate two touching high-density blobs, whereas minimax-path clustering corrects both artifacts. The reported F1-score is CDP α\alpha6, DBSCAN α\alpha7, minimax-path α\alpha8, SVM-enhanced α\alpha9; the corresponding Jaccard scores are CDP {U(λt)}\{U^*(\lambda_t)\}0, DBSCAN {U(λt)}\{U^*(\lambda_t)\}1, minimax-path {U(λt)}\{U^*(\lambda_t)\}2, SVM-enhanced {U(λt)}\{U^*(\lambda_t)\}3 (Pizzagalli et al., 2018).

The same work extends path costs with a trainable path classifier. Features are extracted from the last {U(λt)}\{U^*(\lambda_t)\}4 edges of a candidate extension, including densities, gap sizes, and

{U(λt)}\{U^*(\lambda_t)\}5

A binary SVM with RBF kernel is trained on admissible versus forbidden fragments, and the classifier score is converted into a pseudo-cost. In 4D centroid tracking of T-cells, CDP gives F1 {U(λt)}\{U^*(\lambda_t)\}6, minimax only gives F1 {U(λt)}\{U^*(\lambda_t)\}7, and the SVM path-classifier reaches F1 {U(λt)}\{U^*(\lambda_t)\}8 with Jaccard {U(λt)}\{U^*(\lambda_t)\}9 (Pizzagalli et al., 2018).

A related high-dimensional scheme first bins the data into occupied partitions, builds a nearest-neighbor partition graph, and computes shortest-path matrices such as {x(δ)}\{x(\delta)\}0. The resulting path-length features support MAXPATHL clustering around local maxima and a Line-Of-Sight criterion based on convex-hull connectivity, corner-turn tests, and variance tests. The dominant cost is all-pairs shortest paths on the reduced partition graph, nominally {x(δ)}\{x(\delta)\}1, but the method is designed for the regime {x(δ)}\{x(\delta)\}2 (McIlhany et al., 2017).

3. Path admissibility, bottlenecks, and manifold separation

For multi-manifold clustering, path admissibility can be imposed geometrically. In the angle-constrained method, a symmetric {x(δ)}\{x(\delta)\}3-nearest-neighbor graph is built on {x(δ)}\{x(\delta)\}4, and a path {x(δ)}\{x(\delta)\}5 is called {x(δ)}\{x(\delta)\}6-constrained when every turning angle satisfies

{x(δ)}\{x(\delta)\}7

Several landmarks are chosen at random, and for each landmark a modified Dijkstra algorithm marks which nodes are reachable by an {x(δ)}\{x(\delta)\}8-constrained path. Each sample then receives a binary signature

{x(δ)}\{x(\delta)\}9

and hierarchical clustering with complete linkage is applied to these signatures (Babaeian, 2018). Reported synthetic accuracies exceed γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})0 on all eight benchmark cases, including TP γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})1, TSI γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})2, FS γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})3, DSPR γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})4, and RCC γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})5. On COIL-20, clustering the objects γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})6 yields γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})7 accuracy and clustering all 20 objects yields γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})8 (Babaeian, 2018).

A density-landscape variant appears in t-NEB. Let γ(x)=(c(1),,c(L))\gamma(x)=(c^{(1)},\dots,c^{(L)})9 be a smooth density estimated by a Gaussian or Student’s-C1,,CkC_1,\dots,C_k0 mixture. For two cluster centers C1,,CkC_1,\dots,C_k1, the maximum-density path is

C1,,CkC_1,\dots,C_k2

equivalently

C1,,CkC_1,\dots,C_k3

After overclustering, nudged elastic band optimization estimates the bottleneck density C1,,CkC_1,\dots,C_k4 on edges of a C1,,CkC_1,\dots,C_k5-NN graph, an MST is computed on weights C1,,CkC_1,\dots,C_k6, and bottom-up merging yields a dendrogram (Ritzert et al., 19 Mar 2025). On 16D MNIST-Nd, NEB-based merging achieves C1,,CkC_1,\dots,C_k7, whereas Euclidean and dip-statistic merging are both around C1,,CkC_1,\dots,C_k8; stability across random EM seeds is pairwise ARI C1,,CkC_1,\dots,C_k9 in A=(apq)A=(a_{pq})0 (Ritzert et al., 19 Mar 2025).

A simplex-graph construction generalizes bottleneck paths to intersecting manifolds. Candidate A=(apq)A=(a_{pq})1-simplices are built from an annular graph, adjacent simplices share a A=(apq)A=(a_{pq})2-face, and edge weights are defined from the dihedral angle. The largest-angle path distance is

A=(apq)A=(a_{pq})3

Denoising removes simplices with large A=(apq)A=(a_{pq})4-nearest-neighbor LAPD, and single-linkage on the denoised simplex graph recovers manifold components (Chen et al., 14 Jul 2025). The theory gives

A=(apq)A=(a_{pq})5

under the stated sampling, curvature, and noise conditions, and the scalable implementation reaches overall complexity A=(apq)A=(a_{pq})6 when A=(apq)A=(a_{pq})7. Empirically, LAPD is reported as robust to noise, curvature, and small intersection angle, with runtime for A=(apq)A=(a_{pq})8 up to A=(apq)A=(a_{pq})9 remaining V={v1,,vN}V=\{v_1,\dots,v_N\}0–V={v1,,vN}V=\{v_1,\dots,v_N\}1 (Chen et al., 14 Jul 2025).

4. Trajectory and flight-path clustering

Path-based clustering is particularly natural for trajectory data. Song et al. use the U.S. Federal Aviation Administration’s Traffic Flow Management System dataset together with DV8 to categorize flight paths by agglomerative hierarchical clustering under two distance models: a spatial-based geographic distance model and a vector-based cosine similarity model (Song et al., 2023). For trajectories sampled to V={v1,,vN}V=\{v_1,\dots,v_N\}2 points, the geographic model averages great-circle distances,

V={v1,,vN}V=\{v_1,\dots,v_N\}3

while the directional model computes

V={v1,,vN}V=\{v_1,\dots,v_N\}4

A silhouette-score cutoff selects the dendrogram cut, and point extraction uniformly subsamples trajectories for speed (Song et al., 2023).

The reported behavior is phase-dependent. For enroute segments, the geographic-distance model yields silhouette scores in the V={v1,,vN}V=\{v_1,\dots,v_N\}5 range, including V={v1,,vN}V=\{v_1,\dots,v_N\}6 for CMHV={v1,,vN}V=\{v_1,\dots,v_N\}7ATL. For CMHV={v1,,vN}V=\{v_1,\dots,v_N\}8PHL arrival patterns, cosine-based clustering gives a silhouette of V={v1,,vN}V=\{v_1,\dots,v_N\}9 versus wijw_{ij}0 for geographic distance. On SFOwijw_{ij}1PIT enroute data, geographic distance gives score wijw_{ij}2, while cosine similarity gives wijw_{ij}3 (Song et al., 2023). Point extraction with wijw_{ij}4 shows that for long-haul queries, wijw_{ij}5 up to wijw_{ij}6 or wijw_{ij}7 incurs negligible silhouette loss wijw_{ij}8 while reducing runtime by wijw_{ij}9–ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,0; for short-haul or highly curved approaches, smaller ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,1 values preserve cluster quality. The practitioner recommendation is to segment flights into departure, enroute, and arrival portions; use cosine for departure/arrival and geographic for enroute; and expose a human-in-the-loop threshold override (Song et al., 2023).

A related trajectory hierarchy appears in scan-path generation. HPCGen decomposes raw gaze data into a multi-level tree by hierarchical K-Means, reclustering shift vectors relative to parent centroids and computing a PCA model within each cluster. New scan paths are generated by traversing the tree top-down and sampling principal-component perturbations (Fuhl, 2022). This is not a path-cost clustering algorithm, but it uses cluster hierarchies explicitly as a path-generating mechanism.

5. Regularization paths and clustering paths

In convex clustering, the path is a sequence of optimization solutions indexed by a fusion parameter. PyClustrPath formulates convex clustering as

ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,2

For a sequence ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,3, the clustering path is

ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,4

which evolves from ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,5 to the fully fused solution as ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,6 (Wu et al., 27 Jan 2025). PyClustrPath implements ADMM, fast AMA, and semismooth-Newton augmented Lagrangian, with warm-starting across the ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,7 sequence and GPU acceleration through PyTorch. Reported timings for ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,8 ρv=uV1(xuxvr),δv=minu:ρu>ρvxuxv,\rho_v = \sum_{u\in V}\mathbf{1}(\|x_u-x_v\|\le r), \qquad \delta_v = \min_{u:\rho_u>\rho_v}\|x_u-x_v\|,9 values at α\alpha00 include SSNAL-GPU at α\alpha01 on LIBRAS-6 versus α\alpha02 for SSNAL-CPU, α\alpha03 on COIL-20 versus α\alpha04, and α\alpha05 on MNIST versus α\alpha06 (Wu et al., 27 Jan 2025).

A graph-diffusion analogue is the seeded PageRank solution path. The seeded PageRank vector solves

α\alpha07

and the approximate solution is controlled by a residual threshold α\alpha08 satisfying

α\alpha09

The same parameter acts both as an accuracy parameter and as a regularization weight in a strongly convex, α\alpha10-norm-regularized problem (Kloster et al., 2015). The ppr-path algorithm tracks approximate solutions for all α\alpha11 in an interval in one pass, performs a sweep-cut at each scale, and records the conductance-minimizing cluster α\alpha12. Its runtime bound is

α\alpha13

independent of network size (Kloster et al., 2015). On networks with up to α\alpha14 billion edges, ppr-path visits hundreds-to-thousands of distinct α\alpha15 values in α\alpha16–α\alpha17 sec, ppr-grid with α\alpha18 grid points runs α\alpha19–α\alpha20 faster than α\alpha21 independent PPR computations, and selecting the best conductance along the path yields improvements up to α\alpha22 over a single PPR at α\alpha23 (Kloster et al., 2015).

These regularization-path constructions differ from shortest-path clustering in mechanism, but they preserve the central idea that cluster structure is best interpreted as a trajectory across scales rather than a single flat partition.

6. Temporal evolution paths and dynamical clusters

ClusPath treats cluster paths as typical evolution paths in longitudinal data. Each observation is a triple

α\alpha24

where α\alpha25 is the entity, α\alpha26 a timestamp, and α\alpha27 a descriptive vector. The temporal-aware dissimilarity is

α\alpha28

with weights α\alpha29 chosen by a slider α\alpha30 (Rizoiu et al., 2015). Clustering is semi-supervised through a soft must-link penalty between observations of the same entity, and a directed weighted cluster graph α\alpha31 is learned simultaneously. The global objective

α\alpha32

balances prototype fit and contiguous segments, smoothness between successive phases, and frequently observed transitions (Rizoiu et al., 2015).

The learned graph operationalizes the “slow changing world” assumption: entities should pass through slowly evolving phases, so high-inertia paths receive high weight. ClusPath also includes Pareto-based evolutionary tuning of α\alpha33 against four antagonistic criteria: MDvar, Tvar, ShaP, and SPass. One ClusPath iteration has complexity α\alpha34, and the evolutionary tuning cost is α\alpha35 but is parallelizable across the population (Rizoiu et al., 2015).

A different disciplinary meaning of cluster paths appears in stellar dynamics. O’Leary, Stahler, and Ma distinguish a global expansion path and a core collapse path for gravitationally bound clusters. The collapse line in α\alpha36 space separates the two, with the dividing α\alpha37-value ranging “from α\alpha38 to over α\alpha39” for realistic starting radii. At the Sun’s Galactocentric radius, α\alpha40, the minimum population for core collapse is α\alpha41, and α\alpha42 scales as α\alpha43 (O'Leary et al., 2014). Here “path” refers to physical evolution rather than a clustering algorithm, but it illustrates that path language can describe trajectories of clusters themselves.

7. Interpretability, path graphs, and algebraic formulations

In neural-network interpretability, cluster paths are post-hoc activation summaries. Selected layers are clustered by k-means++, and a new input is encoded as

α\alpha44

The paper defines four metrics: path complexity

α\alpha45

weighted-path purity, decision-alignment faithfulness, and path agreement (Kroeger et al., 8 Oct 2025). On a spurious-cue CIFAR-10 task, normal-set weighted purity is α\alpha46 and corrupted-set weighted purity is α\alpha47, while decision-alignment faithfulness is approximately α\alpha48 with α\alpha49 layers and α\alpha50. On a five-class CelebA hair-color task, path complexity is approximately α\alpha51, faithfulness plateaus at α\alpha52 with α\alpha53, weighted purity is approximately α\alpha54, and path agreement is approximately α\alpha55 under mild noise with no drop in classification accuracy (approximately α\alpha56) (Kroeger et al., 8 Oct 2025). On a ViT-Base/16 pretrained on ImageNet, α\alpha57 gives theoretical α\alpha58, but only α\alpha59 unique paths are observed. The same work uses path rarity for OOD detection and reports AUROC α\alpha60 on CelebA, SVHN, and CIFAR-10, with FPR@95%TPR of α\alpha61, α\alpha62, and α\alpha63 respectively (Kroeger et al., 8 Oct 2025).

Path structure also appears in exact optimization and algebra. For clustering a path graph with arbitrary pairwise correlation costs, the optimum can be computed by

α\alpha64

in total time α\alpha65 (Lange et al., 2017). Peterson–Serhiyenko establish a bijection between tame α\alpha66-tilings and pairs of bi-infinite paths in α\alpha67 via

α\alpha68

connecting path representations with Plücker friezes and Grassmannian cluster algebras (Peterson et al., 2 Apr 2025). Di Francesco–Kedem represent α\alpha69 α\alpha70-system cluster variables as path partition functions on weighted graphs and as boundary measurements of totally positive planar networks, yielding explicit Laurent-positivity statements for the cluster variables (0906.3421). In these settings, “cluster” refers to cluster algebras or combinatorial partitions rather than statistical clustering, but the recurrent device is the same: encode global structure through constrained paths on a graph or network.

Across these literatures, cluster paths are best understood not as a single algorithm but as a family of path-centric constructions. The invariant idea is that cluster structure is often revealed more faithfully by continuity constraints, bottleneck densities, transition graphs, or regularization trajectories than by a single local similarity rule.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Cluster Paths.