Ensemble Variance of Weak Actual Value

• Ensemble variance of weak actual value is a measure of the statistical spread in weakly obtained outcomes across quantum, classical, and ensemble learning frameworks.
• It decomposes variance into classical and non-classical components using rigorous mathematical formulations, enhancing the interpretation of measurement uncertainties.
• Practical applications in quantum optics, Bohmian mechanics, and ensemble learning validate its operational significance and drive improvements in inference and optimization.

Ensemble variance of weak actual value refers, in its most rigorous sense, to the statistical spread or variability of “weak actual values” (or their analogs) over an ensemble—either of classical random fields as in Bohmian mechanics, of weak-value outcomes via weak quantum measurement, or of margins in ensemble learning. This concept captures the inhomogeneity of actual system properties or inferable “pointer” outcomes that are only accessible using weak or gently disturbing probes, and whose variance often carries distinct operational, theoretical, or practical significance. The sections below delineate its formal definitions and computation across quantum, statistical, and learning-theoretic contexts.

1. Formal Definition across Domains

The ensemble variance of weak actual value arises in several disparate, yet mathematically aligned frameworks:

• Bohmian Mechanics: For an observable $O$, the weak actual value field is $$O_w(q) = \Re \left[ \psi^*(q) (O \psi)(q) \right] / |\psi(q)|^2$$. The ensemble variance is then

$$\mathrm{Var}_{\rm ens}[O_w] = \int dq\,|\psi(q)|^2\,(O_w(q) - \langle O \rangle_\psi)^2$$

This measures the spread in actual values $O_w$ assigned to equivalent systems, with probabilities given by the Born rule (Ye, 31 Dec 2025).

• Weak-Value Quantum Measurements: When performing weak measurements with pre- and post-selection, the variance of the weak value

$$\sigma_w^2(\hat{A}) = \langle \hat{A}^2 \rangle_w - (A_w)^2$$

with $$\langle \hat{A}^2 \rangle_w = \langle f|\hat{A}^2|i\rangle/\langle f|i\rangle$$ and $A_w$ the usual weak value, quantifies the second central moment over the sub-ensemble of successful runs (Ogawa et al., 2021, Pati et al., 2014).

• Statistical Ensembles in Margin-Based Learning: For a collection of weak learners, define per-example ensemble margin $m_i$. Its variance is

$$\mathrm{Var}(m) = \frac{1}{n} \sum_{i=1}^n m_i^2 - \left( \frac{1}{n} \sum_{i=1}^n m_i \right)^2$$

This “ensemble variance of weak actual value” indexes model confidence consistency (Jin, 12 Sep 2025).

Across all settings, the key unifying principle is the use of ensemble (i.e., statistical or configuration-space) averaging over the weak actual or weakly-measured property, rather than restricting attention to mean values alone.

2. Variance Decomposition and Physical Meaning

A core advance is the rigorous splitting of standard variance into ensemble and “quantum” or “non-classical” components:

• In Bohmian mechanics, the variance decomposition theorem states:

$$\mathrm{Var}_\psi(O) = \underbrace{\int dq\,|\psi|^2[O_w(q) - \langle O \rangle_\psi]^2}_{\mathrm{Var}_{\rm ens}[O_w]} + \underbrace{\int dq\,\frac{\left[ \Im\,\psi^*(O\psi) \right]^2}{|\psi|^2}}_{Q_O[\psi]}$$

(Ye, 31 Dec 2025). The first term expresses purely classical uncertainty from positional randomness, while the second captures phase–amplitude coupling irreducibly quantum in origin.

• In weak measurement theory, the ensemble variance can acquire both real and imaginary parts, depending on the measurement protocol and post-selection (Ogawa et al., 2021, Pati et al., 2014). Its physical interpretation spans operational outcomes (pointer-variance), statistical spread in weak-valued probability distributions, and quantum state geometry.

3. Computation in Representative Frameworks

Bohmian Mechanics

Given wavefunction $\psi(q) = R(q) e^{iS(q)/\hbar}$, the weak actual value for momentum is $p_w(q) = \nabla S (q)$ and

$$\mathrm{Var}_{\mathrm{ens}}[p_w] = \int dq\,|\psi(q)|^2\,\left[p_w(q) - \langle p \rangle_\psi \right]^2$$

The quantum term is $2m\,\langle Q(q) \rangle_\psi$, where $Q(q)$ is the quantum potential $Q(q) = -\hbar^2/(2m)\,\nabla^2 R / R$ (Ye, 31 Dec 2025).

Weak Measurements with Pre-/Post-selection

For a non-Hermitian weak measurement operator $M_A$, the variance is

$$\mathrm{Var}(M_A) = \langle \psi_i | M_A M_A^\dagger | \psi_i \rangle - |\langle \psi_i | M_A | \psi_i \rangle|^2$$

In canonical cases, for observables with discrete spectra, this reduces to

$$\sigma_w^2(\hat{A}) = \langle \hat{A}^2 \rangle_w - (A_w)^2$$

with the ensemble variance representing the spread of weak-value outcomes among runs that both pre- and post-select (Pati et al., 2014, Ogawa et al., 2021).

Ensemble Learning

If $g_j$ are base classifiers, $w$ are ensemble weights, and the margin is $m_i$, the variance is computed by

$$\mathrm{Var}(m) = \frac{1}{n} \sum_i (m_i - \bar{m})^2$$

where $\bar{m} = \frac{1}{n} \sum m_i$. This is minimized jointly with the negative mean margin as part of the overall loss (Jin, 12 Sep 2025).

4. Operational and Theoretical Implications

• Classical-Quantum Distinction: In Bohmian mechanics, the ensemble variance would exhaust the full quantum variance if all trajectories had identical $O_w$, i.e., for position and for eigenstates of $O$ (Ye, 31 Dec 2025).
• Negativity and Nonclassicality: The ensemble variance of weak actual value can be negative in quantum systems when the relevant quasiprobabilities (Wigner function, weak-valued probability) are nonpositive, a hallmark of quantum coherence and contextuality (Feyereisen, 2015, Ogawa et al., 2021).
• Variance as a Generalization Bound: In ensemble learning, reducing the margin variance, not just maximizing the mean, leads to sharper data-dependent generalization bounds and less overfitting, especially under label noise or imbalance (Jin, 12 Sep 2025).
• Measurement Sensitivities: In weak measurement protocols, the variance and its control directly determine the achievable precision in estimating weak values from empirical pointer distributions, with explicit error propagation formulas linking post-interaction variance to uncertainties in inferred weak values (Parks et al., 2011, Lorenzo, 2011).

5. Optimization and Practical Computation

Efficient computation and minimization of ensemble variance are central in practical applications:

• Sphere-Based Optimization for Ensembles: The Hadamard–Riemannian approach reparameterizes simplex-constrained weights as squared coordinates on the unit sphere, allowing for efficient Riemannian gradient descent updates. This sidesteps computational bottlenecks from projection steps typical in conventional ensemble optimization (Jin, 12 Sep 2025).
• Explicit Variance Formulas for Weak Measurements: In the von Neumann model, the variance of pointer observables incorporates not only intrinsic spread but also terms controlled by the third central moment (skewness) and the imaginary part of the weak value, enabling direct variance reduction via state-engineering or parameter tuning (Parks et al., 2011).

6. Experimental Realizations and Limits

• Quantum Optical Demonstrations: Experimental studies confirm both the operational and statistical interpretations of ensemble variance. Real and imaginary parts of weak variance manifest as expansion or contraction of probe width in orthogonal quadratures, directly accessible via high-resolution measurements on optical probe states (Ogawa et al., 2021).
• Limits and Breakdown: Variance decompositions rooted in weak actual value fields fail to provide a consistent or physically meaningful account of non-position observables such as spin in Bohmian mechanics, reinforcing the ontological primacy of position and classical-like variabilities in quantum foundations (Ye, 31 Dec 2025).
• Classical Deterministic Limit: In the $\hbar \to 0$ limit, or for coherent states with vanishing quantum potential, the ensemble variance of weak actual value vanishes, recovering the classical deterministic scenario where all system copies agree and quantum fluctuations subside (Feyereisen, 2015, Ye, 31 Dec 2025).

7. Cross-Disciplinary Synthesis

Although developed within distinct communities—quantum foundations, measurement theory, and machine learning—the ensemble variance of weak actual value constitutes a mathematically robust tool for quantifying spread due to classical, quantum, or model-architecture-induced inhomogeneities across ensembles of trajectories, measurement outcomes, or classifier responses. In each context, its minimization or operational control yields measurable performance increases, theoretical insights into uncertainty and nonclassicality, and practical algorithms or experimental protocols for enhanced robustness and inference precision (Jin, 12 Sep 2025, Ye, 31 Dec 2025, Ogawa et al., 2021, Pati et al., 2014).