---
title: Correlation Dimension Rate
url: https://www.emergentmind.com/topics/correlation-dimension-rate
type: topic
---

# Correlation Dimension Rate

Searching arXiv for recent and foundational papers on correlation dimension and related “rate” interpretations.
arxiv_search(query="correlation dimension Grassberger Procaccia correlation dimension rate graphs random walk statistical manifold causal networks", max_results=10)
Correlation dimension rate is the scaling exponent that governs how a correlation integral or correlation sum grows with resolution scale in a metric space. In the Grassberger–Procaccia framework, for a point set or trajectory, the basic object is the fraction of pairs closer than a threshold \(r\), and the rate is the log–log slope in the small-\(r\) scaling regime,
\[
C(r) \propto r^{D_2}, \qquad 
\beta \equiv D_2 = \frac{\mathrm{d}\,\log C(r)}{\mathrm{d}\,\log r}.
\]
In this sense, “rate” usually denotes the scaling rate itself rather than a temporal derivative. Across later extensions to graphs, statistical manifolds, causal-network inference, binary data, and large language models, the same core object persists: a slope of \(\log C\) versus \(\log r\), estimated on an appropriate scaling window and interpreted as an intrinsic geometric or effective dimensional quantity [1407.1639].

## 1. Formal definition and classical framework

In the standard Grassberger–Procaccia setting, for a point set \(\{x_1,\dots,x_N\}\) in a metric space with norm \(\|\cdot\|\), the correlation integral counts the fraction of pairs within radius \(r\):
\[
C(r) = \lim_{N\to\infty} \frac{2}{N(N-1)} \sum_{i<j} \Theta\big(r - \|\mathbf{x}_i - \mathbf{x}_j\|\big) \propto r^{D_2}.
\]
The correlation dimension is the corresponding scaling exponent,
\[
D_2 = \lim_{r\to 0}\frac{\mathrm{d}\log C(r)}{\mathrm{d}\log r},
\]
or, equivalently, the slope of the linear part of the \(\log C(r)\) versus \(\log r\) curve in a scaling regime [1407.1639].

This usage of “rate” is explicit in several later formulations. In complex networks, the correlation dimension rate at scale \(r\) is written as
\[
D_2(r)=\frac{\mathrm{d}\ln C_m(r)}{\mathrm{d}\ln r},
\]
with a constant plateau indicating a well-defined dimension [1211.2651]. In causal-network inference, the correlation dimension itself is described as the scaling rate of the correlation sum,
\[
\mathcal{D}_2=\frac{\partial\ln C(\epsilon,T)}{\partial\ln\epsilon},
\]
estimated by linear regression over a scale range where \(\ln \hat C(\epsilon)\) versus \(\ln \epsilon\) is approximately linear [2411.19284]. In measure-theoretic treatments, the same quantity appears as
\[
D_2(\mu)=\lim_{r\downarrow 0}\frac{\log C_\mu(r)}{\log r},
\]
with \(C_\mu(r)=\int_X \mu(B(x,r))\,d\mu(x)\), or equivalently through \(s\)-energy thresholds and cylinder-sum formulas on suitable filtrations [1511.08191].

A recurring theme is that the “rate” is not restricted to Euclidean point clouds. What changes across applications is the representation of states, the metric, and the finite-sample estimator; what remains fixed is the asymptotic slope interpretation.

## 2. Delay embeddings, trajectories, and graph-based generalizations

A major extension replaces a static point cloud by a trajectory. For a scalar or vector time series, delay-embedding constructs
\[
\mathbf{V}^{(m)}(i)=\big[v_i,\,v_{i+\tau},\,\dots,\,v_{i+(m-1)\tau}\big],
\]
and the embedded correlation sum is
\[
C_m(r)=\frac{2}{(n-m\tau)(n-m\tau+1)}\sum_{i<j}\Theta\!\Big(r-\big\|\mathbf{V}^{(m)}(i)-\mathbf{V}^{(m)}(j)\big\|\Big).
\]
The embedded exponent
\[
\beta_m=\lim_{r\to 0}\lim_{n\to\infty}\frac{\log C_m(r)}{\log r},
\qquad
\beta=\lim_{m\to\infty}\beta_m,
\]
is then estimated from the log–log slope in a scaling window [1407.1639].

For graphs, Lacasa and Gómez-Gardeñes adapt Grassberger–Procaccia by generating a node-coordinate time series from an ergodic random walk on a spatially embedded graph. Each node \(i\) carries a coordinate vector \(v_i\), and an unbiased walker generates \(\{v_1,v_2,\dots,v_n\}\). Delay vectors are built from this sequence, and the same pair-counting logic yields a graph-based correlation sum [1211.2651]. The method relies only on local information provided by the walker and does not require global topology or box coverings.

The analytically clean case is the integer lattice \(\mathbb{Z}^d\). For \(\mathbb{Z}^d\), the paper proves that, up to first order in \(r\), the correlation dimension equals the Euclidean or Hausdorff/topological dimension,
\[
\beta=d.
\]
The underlying argument uses lattice homogeneity and isotropy, independence of Cartesian displacements, and the small-\(r\) behavior of folded-normal coordinate differences under the \(L^\infty\) norm. For \(\mathbb{Z}^1\), \(C_m(r)\propto r+\text{h.o.t.}\), so \(\beta=1\); for \(\mathbb{Z}^2\), \(C_m(r)\propto r^2+\text{h.o.t.}\), so \(\beta=2\); in general \(\mathbb{Z}^d\), \(C_m(r)\propto r^d+\text{h.o.t.}\) for all \(m\ge 1\) [1407.1639].

The contrast case is a fully connected graph. There, \(\beta_m=m\) increases without saturation, which is interpreted as an “infinite-dimensional” object [1407.1639]. This establishes a central distinction in the literature: on regular spatial networks the rate recovers geometric dimension, whereas on highly nonlocal graphs it can reflect effective infinite-dimensionality.

## 3. Metrics, manifolds, and generalized state spaces

The correlation dimension rate is metric-dependent in representation, but not arbitrary in meaning. In LLM-state analyses based on next-token log-probabilities, the state vector is
\[
x_t(\omega)=\log \mathrm{P}_\theta(\omega_t=\omega\mid \omega_{t-c},\dots,\omega_{t-1}),
\]
and the correlation integral is computed with Euclidean distances in FP32 over these vectors [2510.21258]. In “Correlation Dimension of Natural Language in a Statistical Manifold,” the same logic is reformulated on the statistical manifold of multinoulli distributions, with Fisher–Rao distance
\[
d_{\mathrm{FR}}(p,q)=2\,\arccos\!\left(\sum_{k\in V}\sqrt{p_kq_k}\right).
\]
The empirical estimator is again
\[
C(r)=\frac{2}{N(N-1)}\sum_{1\le i<j\le N}\mathbf{1}\big(d_{\mathrm{FR}}(p_i,p_j)<r\big),
\qquad
D_2\approx \frac{\mathrm{d}\ln C(r)}{\mathrm{d}\ln r},
\]
with \(m=1\) in the reported analyses [2405.06321].

The same structural generalization appears in abstract multivariable spaces. “Multivariable-based correlation dimension analysis for generalized space” defines a generalized space by choosing a distance \(d(i,j)\) over multivariable observations, including Euclidean, Minkowski, Chebychev, precisely weighted, and Mahalanobis distances. The global correlation function is
\[
C(r)=\frac{1}{N^2}\sum_{i=1}^N\sum_{j=1}^N H(r-d_{ij}),
\]
or equivalently \(N(r)\propto r^{D_2}\), with \(D_2\) estimated as the slope of \(\ln N(r)\) versus \(\ln r\) in a scaling range [2212.01813].

Binary data require a different metric geometry. For \(0/1\) datasets, the relevant distance is Hamming \(L^1\), and the correlation function is
\[
f(r)=P\{Z_D<r\},
\]
where \(Z_D\) is the Hamming distance between two randomly chosen points. The corresponding dimension is the least-squares slope of \((\log r,\log f(r))\) over a chosen interval. Because the unnormalized values are difficult to interpret, the paper introduces normalized fractal dimension: the number of independent Bernoulli columns required to match the observed unnormalized fractal dimension [1902.01480].

These constructions suggest a broad but coherent notion of correlation dimension rate: it is the scaling exponent of pairwise proximity in a chosen metric representation, whether the underlying states are points in \(\mathbb{R}^d\), random-walk embeddings of graphs, categorical distributions on a Fisher–Rao manifold, or binary vectors under Hamming distance.

## 4. Relations to dynamical rates, fluctuations, and conditional information flow

In dynamical-systems theory, correlation dimension rate interacts with genuinely temporal rates. “Fluctuations of separation of trajectories in chaos and correlation dimension” introduces the scaled cumulant generating function
\[
\gamma(k)=\lim_{t\to\infty}\frac{1}{t}\ln\Big\langle \Big(\frac{r(t)}{r(0)}\Big)^k\Big\rangle,
\]
and identifies the only non-trivial zero of \(\gamma(k)\) at
\[
\gamma(-D_2)=0.
\]
For incompressible flows, \(D_2=d\), so \(\gamma(-d)=0\). This links the pair-correlation scaling exponent to the exponential growth rates of separation moments and to large deviations of finite-time stretching [1904.12923].

A different link appears in inertial-particle dynamics. There, the logarithmic separation \(Y(t)=\ln \delta r(t)\) acquires a stationary tail \(\rho_Y(Y)\propto e^{\alpha Y}\), and matching this to \(\langle N(\delta r)\rangle\sim (\delta r)^{D_2}\) gives
\[
D_2=\alpha.
\]
In the tilted-generator formulation, \(\alpha\) is the spectral parameter in a solvability condition \([\,\hat F-\alpha \hat Z_1\,]\rho=0\), so the dimension plays the role of an eigenvalue-like rate [1502.05694].

Extreme-value theory produces another rate interpretation. For the observable \(\psi(x,y)=-\log d(x,y)\) on product dynamics, block maxima obey a Gumbel law whose scale parameter yields \(D_2\approx 1/\sigma\), while the Dynamical Extremal Index \(\theta\) captures clustering of extremes and is related to contraction or instability rates such as positive Lyapunov exponents or \(h_{KS}\) under suitable assumptions [1711.03021]. Here the geometric scaling exponent and temporal instability rates are extracted from the same extreme-value construction but remain conceptually distinct.

Conditional variants shift the emphasis from intrinsic geometry to information flow. In the oGeoC framework, one defines
\[
\mathrm{Geo}\big(X^{\prime(I)}\mid \mathbf{X}^{(K)}\big)
=
\mathcal{D}_2\big(\mathcal{M}_{(X^{\prime(I)},X^{(K)})}\big)
-
\mathcal{D}_2\big(\mathcal{M}_{X^{(K)}}\big),
\]
and then
\[
\mathrm{GeoC}_{J\rightarrow I\mid K}
=
\mathrm{Geo}\big(X^{\prime(I)}\mid \mathbf{X}^{(K)}\big)
-
\mathrm{Geo}\big(X^{\prime(I)}\mid \mathbf{X}^{(J)},\mathbf{X}^{(K)}\big).
\]
In this setting, conditional differences of correlation-dimension rates quantify geometric information flow and distinguish direct from indirect couplings [2411.19284].

## 5. Empirical interpretations across domains

In spatial networks, the rate recovers effective geometry. For synthetic and real-world networks, the original network paper reported \(\beta \approx 1.92 \pm 0.1\) for a 2D lattice at \(m=4\), \(\beta \approx 2.95 \pm 0.1\) for the world air-transportation network at \(m=4\), \(\beta \approx 1.83 \pm 0.1\) for San Joaquin at \(m=3\), and no clear scaling regime for Oldenburg [1211.2651]. The lattice results align with the analytic proof that \(\mathbb{Z}^d\) has \(\beta=d\) to first order [1407.1639].

In natural-language modeling on the Fisher–Rao statistical manifold, the reported global correlation dimension is around \(6.5\). The paper gives language-wise values of English \(6.39\pm 0.40\), Chinese \(6.81\pm 0.58\), Japanese \(7.30\pm 0.41\), and German \(5.84\pm 0.70\), with SEP texts concentrated around \(6.57\pm 0.32\) and \(R^2>0.99\) for over \(90\%\) of samples [2405.06321]. Long memory is identified as key: as context length decreases from \(512\) to \(1\), the scaling region shrinks and the dimension decreases to about \(4\).

In autoregressive large language models, the same exponent is computed from sequences of next-token log-probability vectors. The paper reports that natural-language documents across multiple models show \(D_2\approx 6\)–\(7\), that context length produces a two-stage curve in which \(D_2\) rises from about \(3\) to about \(8\) up to \(L\approx 32\) and then declines to about \(6.5\), and that training produces a three-stage trajectory: decrease, increase, decline [2510.21258]. That paper also introduces a distinct but related use of “Correlation Dimension Rate”:
\[
D_{\mathrm{rate}}(s)=\frac{\mathrm{d}D_2}{\mathrm{d}s},\qquad
D_{\mathrm{rate}}(L)=\frac{\mathrm{d}D_2}{\mathrm{d}L},\qquad
D_{\mathrm{rate}}(t)=\frac{\mathrm{d}D_2}{\mathrm{d}t}.
\]
These are derivatives of the correlation dimension with respect to training step, context length, or generation index rather than the original log–log scaling slope.

The same paper reports several diagnostic associations. Across SEP articles for Qwen2.5-32B, Pearson’s correlation between \(D_2\) and perplexity is about \(-0.01\). In degeneration detection for Falcon3-10B, \(D_2\) decreases across repetitive \(3.80\), incoherent \(3.96\), and bland \(4.51\) outputs versus normal \(5.04\), all \(p<0.01\). On a knowledge-intensive list, models with \(D_2<5.0\) hallucinated, while Falcon3-7B \(6.68\) and Falcon3-10B \(8.49\) aligned with accurate recall. In a long-text stress test, Spearman’s \(\rho=0.952\) between \(D_2\) and HelloEval long-text scores [2510.21258].

In causal-network inference, the empirical interpretation is structural rather than semantic. On coupled logistic networks, the oGeoC algorithms recover direct links with TPR approaching \(1\) and FPR approaching \(0\) as \(T\) grows in the directed \(N=7\) case; for \(N=20\) Erdős–Rényi networks, mean TPR increases toward \(1\) and FPR decreases with \(T\), while larger significance threshold \(\theta\) degrades performance [2411.19284]. Here the correlation dimension rate functions as a geometric signature whose conditional changes reveal direct and indirect influence.

## 6. Estimation, finite-size effects, and common pitfalls

All formulations depend on scaling-window selection. In classical GP estimation, one fits the slope where \(\log C_m(r)\) versus \(\log r\) is approximately linear, excluding very small \(r\) where counts are poor and very large \(r\) where saturation dominates [1407.1639]. For graph trajectories and lattice walks, finite-size effects arise from discreteness, saturation near system diameter, and bias when trajectories are too short for central-limit approximations to hold [1407.1639]. In complex-network practice, the recommended procedure is to compute \(C_m(r)\) over log-spaced radii, identify an intermediate scaling regime, fit \(\beta_m\), and verify saturation in \(m\) [1211.2651].

The literature repeatedly emphasizes that the rate is asymptotic. In causal-network inference, increasing \(T\) stabilizes slopes, while noise and high dimensionality can obscure the linear region [2411.19284]. In language-model applications, finite \(N\) constrains the usable range of \(C(r)\), and the estimator is standardized by fitting only scales with \(C(r)\in[20/(N(N-1)),\eta/N]\), with \(\eta=1.0\) by default [2510.21258]. In Fisher–Rao language analysis, the scaling region is selected by maximizing linear-fit \(R^2\) and ensuring several decades of scale [2405.06321].

A standard misconception is to treat any apparent slope as intrinsic dimension. The binary-data literature shows that unnormalized fractal dimension is hard to interpret and is strongly shaped by sparsity; normalized fractal dimension was introduced precisely because raw slopes can be misleading in sparse \(0/1\) settings [1902.01480]. Another misconception is that a single global exponent captures heterogeneous data. “On the Estimation of Pointwise Dimension” calls this “dimension blindness”: for mixtures, correlation dimension collapses to the minimum local dimension, so the global rate can miss heterogeneity [1312.2298].

Data corruption can also manufacture or destroy scaling. In gappy time series, the estimated \(D_2\) is strongly biased when the mean gap size \(m_s\) is near the delay \(\tau\), and no clean saturation may appear; cubic spline interpolation can spuriously produce finite saturated \(D_2\) even for Gaussian noise or a non-chaotic light curve [1410.4454]. The reported example is SS Cygni, a known non-chaotic light curve whose 5-day binned series yields a spurious \(D_2^{sat}=4.139\pm 0.05\) after cubic-spline interpolation [1410.4454].

A broader synthesis is therefore warranted. The correlation dimension rate is best regarded as a scale-local geometric exponent that requires a demonstrable scaling regime, an appropriate metric representation, and careful separation from other notions of “rate.” In most of the literature, it is the slope \(\mathrm{d}\log C/\mathrm{d}\log r\). In some recent work, especially on LLMs, derivatives such as \(\mathrm{d}D_2/\mathrm{d}s\) or \(\mathrm{d}D_2/\mathrm{d}L\) are introduced as secondary rates. The two notions are related but not identical [2510.21258].

Source: https://www.emergentmind.com/topics/correlation-dimension-rate