Regularized Quantum Hoeffding Divergence
- Regularized quantum Hoeffding divergence is the asymptotic rate function governing worst-case type-I error decay in composite, correlated quantum hypothesis testing.
- It extends traditional i.i.d. analysis to composite settings by utilizing convex, compact state sets and variational Petz-based formulations.
- The framework characterizes the full trade-off between type-I and type-II errors, with implications for quantum channel discrimination and optimal test designs.
Searching arXiv for the cited papers to ground the article in current arXiv records. Regularized quantum Hoeffding divergence is the asymptotic rate function governing asymmetric binary quantum hypothesis testing under an exponential constraint on the type-II error. In the composite, possibly correlated setting, each blocklength is associated with convex, compact sets of states , and the central result is that, for stable sequences of such sets, the optimal worst-case type-I error exponent is exactly the regularized quantum Hoeffding divergence (Fang, 18 Aug 2025). This extends the Hoeffding theory of i.i.d. singleton hypotheses to composite correlated hypotheses, introduces parallel set-based Hoeffding and anti-divergence formalisms, and refines the generalized quantum Stein’s lemma by identifying the full trade-off between type-I and type-II errors (Fang, 18 Aug 2025).
1. Asymmetric testing for composite correlated quantum hypotheses
Let be a finite-dimensional Hilbert space. For each , the null hypothesis is a convex, compact set , and the alternative is a convex, compact set . A two-outcome POVM with is used in a worst-case manner. The error probabilities are
Given a rate 0, the optimal type-I error under the exponential constraint 1 is
2
The associated exponent is
3
This formulation departs from the standard singleton i.i.d. setting in two ways. First, the hypotheses are composite: one tests between sets rather than fixed states. Second, the sequences may be correlated and need not be i.i.d. The operational question is therefore a worst-case large-deviation problem over state sets whose geometry changes with blocklength (Fang, 18 Aug 2025).
A key reduction used in the analysis is that composite correlated hypotheses can be transformed into a worst-case pair: 4 This brings the problem into contact with single-pair asymmetric hypothesis testing while preserving the minimax character of the composite setting (Fang, 18 Aug 2025).
2. Set-based Hoeffding divergences and their regularization
For single states 5, the finite-6 Hoeffding divergence is
7
where the Petz Rényi divergence is
8
For sets 9, two natural extensions are introduced. The first is the min-divergence extension
0
The second is the Petz-based extension
1
with
2
For convex, compact sets 3, these two extensions coincide at finite blocklength: 4 This finite-5 equality is structurally important because it identifies a variational Petz-based expression with the worst-case single-state Hoeffding rate (Fang, 18 Aug 2025).
The asymptotic notion arises for stable sequences 6 and 7 satisfying
8
Under this stability, subadditivity of 9 yields the regularized quantity
0
Likewise,
1
where
2
The proven asymptotic relation is
3
By contrast, on the strong-converse side the corresponding regularized quantities do coincide exactly. This asymmetry is one of the conceptual distinctions between the direct and strong-converse regimes (Fang, 18 Aug 2025).
3. Generalized Hoeffding bound for stable sequences of sets
The main theorem states that for stable sequences of convex, compact sets in 4,
5
Thus the regularized quantum Hoeffding divergence is not merely a variational quantity; it is the exact optimal exponent for worst-case type-I decay under a prescribed type-II exponential constraint (Fang, 18 Aug 2025).
The proof uses two complementary directions. The converse proceeds via Audenaert’s inequality and the Petz quasi-entropy 6, yielding the lower bound on achievable exponents by constructing feasible tests. The achievability direction fixes a blocklength 7, chooses worst-case states 8, invokes the i.i.d. singleton Hoeffding bound for 9, and then lets 0. Convexity and compactness ensure existence of optimizers and justify minimax exchanges, while tensor-product stability supplies the subadditivity needed for regularized limits (Fang, 18 Aug 2025).
In the singleton i.i.d. case 1 and 2, the theorem reduces to the standard quantum Hoeffding exponent
3
with
4
The same quantity admits the standard Legendre-transform form after the reparametrization 5, 6 (Fang, 18 Aug 2025).
Earlier work by Mosonyi and Ogawa had already established, for general sequences of single hypotheses, that the strong converse exponent can be obtained from a regularized Hoeffding anti-divergence under either a factorization property or differentiability of a regularized Rényi divergence; typical examples include temperature states of translation-invariant finite-range interactions on a spin chain, temperature states of non-interacting fermionic lattice systems, and classical irreducible Markov chains (Mosonyi et al., 2014). The 2025 development extends the scope from single correlated sequences to composite correlated sets.
4. Strong converse, anti-divergence, and the Stein threshold
For single states, the Hoeffding anti-divergence is defined by
7
where the sandwiched Rényi divergence is
8
For sets,
9
and
0
For convex, compact 1 these coincide for each 2, and for stable sequences the regularizations also coincide: 3
The strong-converse lower bound is
4
Hence, if the type-II exponent is forced above the relevant threshold, the type-I error approaches one at least exponentially fast (Fang, 18 Aug 2025).
This threshold is furnished by the generalized quantum Stein’s lemma for sets: 5 The Hoeffding theory refines this statement into a full trade-off curve. For 6,
7
with equality
8
For 9,
0
Under the polar assumption used in the proof of the generalized Stein’s lemma, one further has continuity of the regularized Petz Rényi family at 1: 2 This identifies the Stein exponent as the sharp threshold separating the direct and strong-converse regimes (Fang, 18 Aug 2025).
5. Variational structure, special cases, and computation
On the direct side,
3
Because this is a supremum of affine functions of 4 with negative slopes, the trade-off function 5 is non-increasing and convex in 6. On the strong-converse side,
7
which is again a supremum of affine functions in 8 and is non-decreasing in 9. Differentiability is not generally guaranteed for composite sets, but the convexity structure yields continuity except at possible kinks corresponding to changes of the maximizing 0 (Fang, 18 Aug 2025).
Several special cases are explicitly identified. For i.i.d. singleton hypotheses, the generalized bounds reduce to the Hayashi–Nagaoka/Audenaert quantum Hoeffding exponent and the Mosonyi–Ogawa strong-converse exponent. In the classical or commuting case, 1 reduces to classical log-moment generating functions, and the bounds coincide with classical Hoeffding bounds extended to sets. For composite sets such as energy-constrained sets, convex hulls of finite ensembles, and adversarially generated c–q families, semidefinite representations are available; since 2 is jointly concave for 3, one can compute 4 and hence 5 by convex optimization, for example using QICS (Fang, 18 Aug 2025).
These exponents have direct implications for adversarial quantum channel discrimination, composite testing in many-body systems, and the design of asymptotically optimal tests under constraints. A plausible implication is that the passage from single hypotheses to stable convex-compact sets preserves enough variational structure to keep the asymptotic trade-off analyzable and, in important examples, computationally tractable (Fang, 18 Aug 2025).
6. Related developments, misconceptions, and open questions
A recurrent misconception is that asymptotic binary tests should suffice in the same way on both sides of the error-exponent trade-off. That is correct for the strong-converse regime but not for the Hoeffding regime. For 6, the regularized measured Rényi divergence and the regularized test-measured Rényi divergence coincide with the sandwiched Rényi divergence, so asymptotically two-outcome tests suffice. For 7, however, even for commuting states the regularized quantity attainable using two-outcome measurements is in general strictly smaller than the Rényi divergence, and the operationally correct Hoeffding exponent is the Petz-generated
8
rather than a test-measured regularization (Mosonyi et al., 2022).
This direct/strong-converse separation is mirrored in the broader literature on correlated states. Mosonyi and Ogawa showed that for general sequences of quantum states the strong converse exponent is equal to the Hoeffding anti-divergence under either a factorization-property approach or a differentiability-based approach (Mosonyi et al., 2014). In a different direction, the divergence 9, defined via a convex optimization program for 0, has the property that its regularization equals the sandwiched Rényi divergence. This yields converging upper bounds on regularized sandwiched Rényi divergences for channels, a chain rule, an amortization-collapse statement, and a characterization of strong converse exponents for channel discrimination in which adaptive strategies offer no advantage (Fawzi et al., 2020).
Within the composite-set framework itself, two limitations are explicit. First, although
1
the full equality in the regularized direct regime remains open; establishing it would require a minimax theorem in the regularized setting. Second, on the strong-converse side, the available result is a lower bound on the exponent of 2, and obtaining matching upper bounds remains an important challenge (Fang, 18 Aug 2025).
The resulting picture is structurally sharp. The regularized relative entropy 3 is the threshold, the regularized quantum Hoeffding divergence 4 governs the subthreshold direct regime, and the regularized Hoeffding anti-divergence 5 controls the superthreshold blow-up of type-I error. This suggests a unified large-deviation description of asymmetric quantum state discrimination that accommodates convex uncertainty, long-range block structure, and non-i.i.d. correlations without abandoning the Rényi-variational framework (Fang, 18 Aug 2025).