Angular Distribution of Pairwise Distances

• The study defines the angular distribution of pairwise distances using an exact density function based on the uniform sampling of points on a unit sphere.
• It demonstrates that in high-dimensional regimes, normalized pairwise angles converge to a normal distribution, explaining the near-orthogonality of high-dimensional vectors.
• Extreme value statistics, with Weibull-type limits, quantify the behavior of the smallest and largest angles, underpinning applications in compressed sensing and random projections.

The angular distribution of pairwise distances describes the statistical properties of the Euclidean angles between pairs of points $(X_i, X_j)$, where each point is independently and uniformly distributed on the unit sphere $\mathbb{S}^{p-1} \subset \mathbb{R}^p$. Central to the analysis is how these distributions behave as both the number of points $n$ and the ambient dimension $p$ vary, including finite and high-dimensional regimes. The subject provides a rigorous underpinning for phenomena such as the near-orthogonality of high-dimensional random vectors, with applications in statistics, machine learning, physics, and mathematics (Cai et al., 2013).

1. Mathematical Definition and Density Characterization

Let $$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$. The pairwise Euclidean angle $\Theta_{ij}$ is defined by

$$\cos \Theta_{ij} = \frac{X_i^\top X_j}{\|X_i\|\|X_j\|},$$

with $\|X_i\| = \|X_j\| = 1$ and $\Theta_{ij} \in [0, \pi]$. The exact probability density function for $\Theta_{ij}$, for fixed dimension $\mathbb{S}^{p-1} \subset \mathbb{R}^p$0, takes the form

$\mathbb{S}^{p-1} \subset \mathbb{R}^p$1

where

$\mathbb{S}^{p-1} \subset \mathbb{R}^p$2

Equivalently,

$\mathbb{S}^{p-1} \subset \mathbb{R}^p$3

This exact form is derived by considering the distribution of i.i.d. Gaussian directions projected onto the sphere.

2. Empirical Distribution of Pairwise Angles

The empirical law of all pairwise angles among $\mathbb{S}^{p-1} \subset \mathbb{R}^p$4 points, denoted

$\mathbb{S}^{p-1} \subset \mathbb{R}^p$5

exhibits distinct limiting behaviors depending on the underlying regime:

• Fixed $\mathbb{S}^{p-1} \subset \mathbb{R}^p$6, $\mathbb{S}^{p-1} \subset \mathbb{R}^p$7: By exchangeability and the law of large numbers for U-statistics, $\mathbb{S}^{p-1} \subset \mathbb{R}^p$8 converges weakly almost surely to the measure with density $\mathbb{S}^{p-1} \subset \mathbb{R}^p$9. For any bounded continuous function $n$0,

$n$1

• High-dimensional regime $n$2: Defining the normalized angles

$n$3

the empirical law

$n$4

converges weakly almost surely to the standard normal distribution, $n$5. That is,

$n$6

This provides the formal basis for “nearly orthogonal” behavior among high-dimensional vectors.

3. Extreme Angle Statistics

The study of the extremal behavior focuses on the smallest and largest angles,

$n$7

Fixed $n$8:

• Weibull-type limits: With scale $n$9, the rescaled extreme angles converge in distribution: $p$0

$p$1

where $p$2. In particular, $p$3 and $p$4 as $p$5.

• Joint limit: $p$6 converges to the difference of two independent Weibull($p$7)-distributed variables, resulting in a symmetric distribution over $p$8.

High-dimensional regime ($p$9):

Behavior depends on the asymptotic regime defined by $$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$0:

Regime	Extreme angle behavior	Limiting law
Sub-exponential	$$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$1 in probability	$$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$2
Exponential	$$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$3	Centered/log-scaled EV law, $$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$4 as above
Super-exponential	$$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$5	$$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$6

Here, $$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$7, with specific constants ($$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$8) given for each regime.

4. Quantitative Rates and Concentration

• Density normalization: The factor $$X_i, X_j \sim_{\mathrm{i.i.d.}} \mathrm{Unif}(\mathbb{S}^{p-1})$$9 governs the exact density normalization.
• Empirical law scaling: In high dimension, the Gaussian fluctuation scale is $\Theta_{ij}$0.
• Extreme-angle scaling: For fixed $\Theta_{ij}$1, the extreme scaling $\Theta_{ij}$2 and Weibull shape parameter $\Theta_{ij}$3 are operative.
• Exponentially accurate concentration: For any $\Theta_{ij}$4, the normal approximation yields

$\Theta_{ij}$5

Hence, with overwhelming probability, each pair of vectors is within $\Theta_{ij}$6 of orthogonality. More precisely, for $\Theta_{ij}$7,

$\Theta_{ij}$8

Empirically, the $\Theta_{ij}$9 angles concentrate in a vanishing neighborhood around $$\cos \Theta_{ij} = \frac{X_i^\top X_j}{\|X_i\|\|X_j\|},$$0 as $$\cos \Theta_{ij} = \frac{X_i^\top X_j}{\|X_i\|\|X_j\|},$$1 grows.

5. Applications and Interpretations

The rigorous analysis of the angular distribution of pairwise distances substantiates the commonly cited intuition that “all high-dimensional random vectors are almost always nearly orthogonal to each other.” Quantitative results, such as the normal approximation and extreme value statistics, provide theoretical guarantees for sample and design matrix behavior frequently leveraged in statistics and machine learning. For instance, this underpins the performance guarantees of random projections, compressed sensing, and high-dimensional geometric algorithms. Applications extend to open problems in physics and mathematics concerning random packing and geometric probability (Cai et al., 2013).

6. Connections and Extensions

The distributional behavior detailed here forms the foundation for further studies in random matrix theory, geometric functional analysis, and random geometric graphs. The probabilistic structure of angles informs theoretical investigations in high-dimensional statistics and learning theory, especially where independence and isotropy assumptions are critical. The methods and scaling analyses provided in Cai, Fan, and Jiang (2013) serve as models for understanding concentration phenomena, limit theorems, and their applications well beyond the original context (Cai et al., 2013).