---
title: Classical Shadows Protocol
url: https://www.emergentmind.com/topics/classical-shadows-protocol
type: topic
---

# Classical Shadows Protocol

Classical shadows protocol is a randomized measurement-and-post-processing framework for predicting many properties of an unknown quantum state from a comparatively small measurement record. In its standard form, one samples a unitary \(U\) from a chosen ensemble, measures \(U\rho U^\dagger\) in a fixed basis, stores a classical description of the outcome, and reconstructs expectation values by inverting the associated average measurement channel. In the notation used for general basis measurements, the dephasing channel is
\[
A_W(-)=\sum_w \langle w|(-)|w\rangle\,|w\rangle\langle w|,
\]
and the measurement channel is
\[
M=\mathbb E_{U\sim E}\,{\rm Ad}_{U^\dagger}\circ A_W\circ {\rm Ad}_U,
\qquad
{\rm Ad}_U(-)=U(-)U^\dagger,
\]
so that a single-shot shadow state can be written as
\[
\hat\rho=M^{-1}\!\left(U^\dagger \Pi_w U\right),
\qquad
\Pi_w=|w\rangle\langle w|.
\]
The protocol is organized around unbiased single-shot estimators, concentration bounds for many observables, and a choice of measurement ensemble matched to the observable class of interest [2604.01429][2412.03381].

## 1. Core formulation

The standard task is to estimate many linear functionals \(o_i(\rho)=\operatorname{tr}(O_i\rho)\) of an unknown state \(\rho\). In the measurement model emphasized across the literature, one samples a random unitary \(U\), performs a computational-basis measurement, obtains an outcome \(\ket{\hat b}\), and forms a classical snapshot
\[
\hat\rho=\mathcal M^{-1}\!\left(U^\dagger \ket{\hat b}\!\bra{\hat b}U\right),
\]
where \(\mathcal M\) is the shadow channel induced by the measurement ensemble. Repeating this \(N\) times yields a classical shadow \(S(\rho;N)=\{\hat\rho_1,\ldots,\hat\rho_N\}\), from which observable estimates are obtained through scalar random variables \(X_j^{(i)}=\operatorname{tr}(O_i\hat\rho_j)\) [2412.03381].

A central structural notion is the measurement channel itself. In the noiseless formulation,
\[
\mathcal M(\rho)=\mathbb E_{U}\sum_b \langle b|U\rho U^\dagger|b\rangle\,U^\dagger|b\rangle\!\langle b|U,
\]
and unbiasedness is the identity \(\mathbb E[\hat\rho]=\rho\). More generally, for group-representation-based protocols, the image of the channel,
\[
L^V:=\operatorname{Im}(M_W),
\]
is the visible space. Only observables in \(L^V\) can be estimated unbiasedly. This visible-space formulation is essential once the measurement ensemble is not tomographically complete on the full operator space [2011.11580][2604.01429].

## 2. Statistical guarantees and estimation theory

The protocol’s basic sample-complexity guarantee is controlled by a shadow norm or an equivalent variance proxy. In the representation-theoretic formulation, the standard bound reviewed in the literature is
\[
N_{\rm shad}=\mathcal O\!\left(\frac{\log(M/\delta)}{\epsilon^2}\max_{1\le i\le M}\|O_i\|_{\rm shadow}^2\right),
\]
for estimating \(M\) observables to additive error \(\epsilon\) with failure probability \(\delta\) [2604.01429]. In the Pauli-invariant setting, this structure becomes especially explicit: if \(P_{\vec a}\) is a Pauli observable, then its squared shadow norm is exactly \(W_{\mathcal E}[\vec a]^{-1}\), where \(W_{\mathcal E}[\vec a]\) is the corresponding channel eigenvalue in the Pauli basis [2202.03272].

The original Huang–Kueng–Preskill analysis used a median-of-means estimator to convert variance control into logarithmic dependence on \(M/\delta\). The standard construction partitions the \(N\) snapshots into \(k\) groups, averages within each group, and returns the median of those group means. Subsequent work showed that the asymptotic constants in this post-processing layer matter operationally: the loose HKP constant \(8e^2\) can be replaced by \(\sqrt{\pi}+o(1)\) for the standard median-of-means estimator, and by \(\sqrt{2}+o(1)\) for a modified combination-based estimator due to Minsker [2412.03381].

These refinements do not produce a uniform dominance relation. In finite-shot studies, the plain mean often had the smallest average error in benign regimes; the original median-of-means performed better than the modified estimators for Pauli measurements on Pauli-type observables; and the modified estimators performed better than standard median-of-means for global Clifford measurements of linear functions such as GHZ fidelity. The estimation layer is therefore ensemble-dependent rather than protocol-universal [2412.03381].

## 3. Measurement ensembles, channel structure, and visible-space geometry

The choice of unitary ensemble determines whether the shadow channel is analytically invertible, how large its eigenvalue spread is, and which observables remain visible. A broad structural result is that for any Pauli-invariant unitary ensemble,
\[
\mathcal M[P_{\vec a}]=W_{\mathcal E}[\vec a]\,P_{\vec a},
\]
so the channel is diagonal in the Pauli basis and inversion is immediate whenever all eigenvalues are positive [2202.03272]. This framework subsumes global Clifford, local Clifford, and locally scrambled ensembles, and it expresses sample complexity directly in terms of the inverse channel spectrum.

A complementary generalization uses arbitrary compact-group representations. For a basis \(W\), the key notion is a centralizing basis, for which the measurement channel acts as a scalar on each visible isotypic component. A non-degenerate commuting subgroup eigenbasis yields
\[
M=\sum_{\lambda\in\widehat V} a_\lambda^H P_\lambda^V,
\qquad
a_\lambda^H=\frac{d_\lambda^H}{d_\lambda},
\]
with \(d_\lambda^H\) the dimension of the \(H\)-invariant subspace in the \(\lambda\)-irrep. This extends analytic inversion beyond multiplicity-free settings and reduces classical post-processing to sectorwise rescaling [2604.01429].

The same visible-space logic explains why some protocols deliberately trade universality for improved variance. In locally entangled shadows, Bell-basis measurements on qubit pairs give
\[
\|P\|_{\mathrm{sh}}^2=3^{k/2}
\]
for dimer-compatible Pauli strings of weight \(k\), improving the Pauli-shadow scaling \(3^k\), but incompatible Pauli operators become unlearnable because the corresponding channel eigenvalues vanish. For \(n\)-qubit GHZ-basis measurements on blocks, the best-case compatible-operator scaling approaches \((3/2)^k\), again on a progressively smaller observable class [2305.10723].

## 4. Symmetry-adapted and hardware-specific protocols

A major direction in the literature is to tailor the randomized measurement ensemble to symmetry sectors or to a hardware-native transformation group. Real classical shadows replace unitary Cliffords by orthogonal Cliffords and use a real measurement basis. In the global orthogonal case,
\[
M_{\mathrm O(d),W}(A)=\frac{\operatorname{Tr}[A]\mathds 1+A+A^\mathsf T}{d+2},
\]
so the visible space is the real-symmetric operator sector. For arbitrary real-valued observables this reduces the required number of samples by a factor of about \(2\) asymptotically, while in the local orthogonal case a weight-\(k\) Pauli string over \(I,X,Z\) has variance bounded by \(2^k\), improving on the \(3^k\) local-unitary bound [2410.23481].

Fermionic and matchgate shadows adapt the protocol to Majorana observables and fermionic Gaussian unitaries. The unified matchgate framework proved that the continuous \(SO(2n)\) ensemble, its Clifford intersection, the \(O(2n)\)-based constructions, and perfect-matching-based sub-ensembles are equivalent at the level of the first three moments relevant for classical shadows. It then derived a smaller sub-ensemble of matchgate circuits that is optimal in terms of number of gates while inheriting the same performance guarantees [2409.03836].

For lattice gauge theories, symmetry-aware protocols exploit the physical Hilbert space rather than the full unconstrained link Hilbert space. In a \(\mathbb Z_2\) lattice gauge theory, the Global Dual Pairs, Local Dual Pairs, and Dual Product protocols estimate gauge-invariant observables in the dual variables and can offer exponential improvements in sample complexity over symmetry-agnostic product shadows, at the cost of increased circuit depth and string-like mapped operations [2511.02904]. In photonic systems, randomized passive linear optical transformations combined with photon-number measurements define a sectorwise shadow protocol on fixed total photon-number spaces. The resulting estimator is efficient for low-degree observables of interest, but the protocol does not access coherences between different photon-number sectors [2510.07240].

## 5. Robustness and task-specific generalizations

A substantial body of work modifies the protocol to handle nonideal devices or to target quantities other than \(\operatorname{Tr}(O\rho)\) for a fixed mixed state. For known noise channels \(\mathcal E\), the correct estimator is obtained by inverting the noisy shadow channel
\[
\mathcal M_{\mathcal U,\mathcal E},
\]
not the noiseless one. This preserves unbiasedness under noise and yields sample-complexity bounds in terms of a noisy shadow seminorm. For unitary 2-designs, the noisy channel collapses to an effective depolarizing channel, making the correction explicit for depolarizing noise and amplitude damping [2011.11580]. For noisy readout with crosstalk, \(X\)-twirling symmetrizes the readout channel into a translation-invariant form on bit strings, diagonal in the Boolean Fourier basis, so mitigation reduces to scalar corrections by Fourier coefficients \(g(\mathbf w)\) rather than inversion of a full confusion matrix [2310.17328].

The i.i.d. assumption can also be removed. For adaptive or history-dependent sequences of states \(\rho_t\), one can keep the usual single-shot shadow values \(X_t=\operatorname{tr}(O\hat\rho_{k_t})\) but replace empirical averaging by a truncated mean
\[
Y_t=\mathrm{clip}(X_t,[-T,T]).
\]
Using conditional unbiasedness and Freedman’s inequality for martingales, this yields the same shadow-norm scaling for estimating the time-averaged observable \(\frac1N\sum_t \operatorname{tr}(O\rho_t)\) even under arbitrary temporal correlations [2603.05137].

The target of the protocol can also be changed. Principal eigenstate classical shadows assume \(\rho\) has a dominant eigenstate \(\phi\) with eigenvalue \(\lambda>1/2\) and use a collective symmetric measurement on \(n\) copies, together with the affine estimator
\[
\hat\phi=\frac{(d+n)\Psi-I}{n},
\]
to estimate \(\operatorname{Tr}(O\phi)\) rather than \(\operatorname{Tr}(O\rho)\). In the regime \(\eta=1-\lambda\le 1/s^\*\), the sample complexity matches the optimal pure-state rate [2405.13939]. Classical shadows have also been used to prove \(O(\log n)\)-copy approximation guarantees in a local quantum Wasserstein-1 distance [2309.08426] and to build hypothesis-testing verification protocols such as DPSO, whose sample complexity is
\[
N=2^{2r+1}\frac{\ln \delta^{-1}}{\nu(\Omega)^2\epsilon^2}
\]
for a level-\(r\) verification strategy operator \(\Omega\) [2410.15870].

## 6. Limitations, verification complexity, and conceptual scope

A recurring misconception is that classical shadows are universally tomographically complete. In fact, completeness depends on the ensemble and basis. Bell shadows lose all operators that cut a dimer; local orthogonal shadows restrict visibility to \(\mathrm{span}_{\mathbb C}\{I,X,Z\}^{\otimes n}\); photonic passive-linear-optics shadows lose inter-photon-number coherences; fermionic matchgate shadows are naturally tied to parity-preserving fermionic sectors; and in the compact-group framework invisibility occurs exactly when an irrep has no subgroup-invariant component, \(a_\lambda^H=0\) [2305.10723][2410.23481][2510.07240][2604.01429].

A second limitation is computational rather than statistical. The existence of a concise shadow does not imply that arbitrary purported shadow data are easy to certify. The computational problem of classical shadow validity—whether a reported shadow is consistent with some physical quantum state—is QMA-complete even for the standard local-Clifford protocol of Huang, Kueng, and Preskill, and for exponentially many observables the corresponding consistency problem is complete for the class \(qc\), a quantum-classical analogue of the second level of the polynomial hierarchy [2510.08515]. Efficient prediction from trusted shadow data and efficient verification of arbitrary shadow reports are therefore distinct tasks.

Taken together, these developments define classical shadows less as a single protocol than as a design paradigm. The common backbone is randomized measurement, inversion of an average measurement channel, and reuse of one measurement record for many later queries. The modern literature extends that backbone to arbitrary group representations, symmetry-reduced sectors, noisy and non-i.i.d. experiments, collective measurements, and hardware-specific settings, while repeatedly emphasizing the same structural principle: sample efficiency depends on matching the measurement ensemble to the observable sector one actually needs to predict [2604.01429].

Source: https://www.emergentmind.com/topics/classical-shadows-protocol