Umegaki Relative Entropy in Quantum Information

• Umegaki relative entropy is the quantum analogue of Kullback–Leibler divergence, defined as Tr[ρ(logρ − logσ)] when the support of ρ is contained within that of σ.
• It plays a key role in applications like channel coding, thermodynamic irreversibility, and hypothesis testing, where noncommutativity creates a strict gap with measurement-optimized classical divergences.
• Its operational characterizations and variational formulas uniquely identify it among divergence measures, underpinning extensions to Rényi entropies, modular theory, and many-body correlation models.

Searching arXiv for recent and foundational papers on Umegaki relative entropy to ground the article in cited literature. Umegaki relative entropy is the standard quantum analogue of Kullback–Leibler divergence. For density operators $\rho$ and positive semidefinite $\sigma$, it is defined by

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$

when $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$, and as $+\infty$ otherwise. In finite dimensions it governs channel coding converses, asymptotic hypothesis testing, thermodynamic irreversibility, resource conversion, and free-energy differences; in operator-algebraic language it is the type I instance of Araki relative entropy (Gour, 2 Jul 2026, Longo et al., 2017).

1. Definition, finiteness, and basic operator-algebraic form

A standard formulation writes

$$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$

with $D(\rho\|\sigma)=+\infty$ if $\sigma\not\gg\rho$, where $\sigma\gg\rho$ means

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$

Equivalent formulations in the cited literature use $\sigma$0, or $\sigma$1, to express the same support condition (Berta et al., 2015, Bluhm et al., 2023).

In finite-dimensional uniqueness results, the same quantity is written as

$\sigma$2

with $\sigma$3 taken in base $\sigma$4, so the divergence is measured in bits (Gour, 2 Jul 2026). In type I operator-algebraic settings, Araki relative entropy reduces to the same Umegaki formula,

$\sigma$5

which is the finite-dimensional prototype for the general von Neumann algebraic notion (Chatterjee, 18 May 2026, Longo et al., 2017).

The finiteness condition is structural rather than cosmetic. It is what allows the logarithm of $\sigma$6 to be evaluated on the support of $\sigma$7, and it is also the point at which many continuity, variational, and extension theorems bifurcate into faithful and non-faithful regimes. A recurring theme in recent work is that weakening support assumptions often remains technically delicate or explicitly open (Berta et al., 2015).

2. Variational formulas and the gap to measured relative entropy

A defining feature of Umegaki relative entropy is that, unlike trace distance or fidelity, it is not generally recovered by optimizing a classical divergence over measurements. For a POVM $\sigma$8 with outcome set $\sigma$9, the induced distributions are

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$0

and the measured relative entropy is

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$1

The projectively measured version is

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$2

A key theorem shows

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$3

so optimizing over all finite-outcome POVMs gives no advantage over projective measurements. More importantly,

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$4

and under $$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$5 equality holds if and only if $$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$6. Thus noncommutativity produces a strict gap: $$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$7 This sharpens Petz’s original conclusion by showing that even arbitrary POVMs do not recover the full Umegaki entropy (Berta et al., 2015).

The proof is organized around parallel variational formulas. For measured relative entropy,

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$8

while for Umegaki relative entropy,

$$D(\rho\|\sigma):=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big]$$9

The distinction lies in

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$0

If $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$1 and $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$2 commute, the terms coincide; in general, Golden–Thompson gives

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$3

which makes the Umegaki objective at least as large as the measured one. The strict gap is therefore an operator-theoretic manifestation of noncommutativity, and it formalizes the statement that some quantum distinguishability is lost under measurement (Berta et al., 2015).

3. Operational characterizations and uniqueness

The data-processing inequality does not single out Umegaki relative entropy: many divergences satisfy DPI, including Petz Rényi, sandwiched Rényi, max-relative entropy, and hypothesis-testing divergence. A stronger criterion is provided by optimal binary discrimination. For priors $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$4, the optimal guessing probability is

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$5

This induces the quantum Lorenz preorder $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$6, meaning that $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$7 performs at least as well in every such binary game. A quantum Lorenz divergence is any scalar $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$8 monotone under this preorder. The central uniqueness theorem states: if $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma)$$9 is a normalized additive QLD whose classical restriction is Lorenz continuous, then for every finite-dimensional pair with $+\infty$0,

$+\infty$1

In this sense, Umegaki relative entropy is the unique normalized additive distinguishability measure compatible with the odds revealed by optimal binary measurements. The collapse to $+\infty$2 is explicitly described as a purely quantum consequence of noncommutativity: classically, additive monotones remain a continuum of Rényi mixtures (Gour, 2 Jul 2026).

This operational viewpoint complements more traditional asymptotic statements. Umegaki relative entropy is described as having “operational significance as the threshold rate for asymmetric binary quantum hypothesis testing” (Berta et al., 2015). A recent additivity criterion goes further by studying optimization problems of the form

$+\infty$3

Under tensor-stability and multiplicative-polar assumptions on $+\infty$4, regularization is unnecessary if and only if a single-copy optimizer $+\infty$5 satisfies

$+\infty$6

When this holds,

$+\infty$7

so the asymptotic Umegaki quantity is decided at the single-copy level (Beigi et al., 8 Jul 2025).

4. Rényi connections, geometric extensions, and continuity theory

The Umegaki entropy sits at $+\infty$8 in several Rényi families. In particular,

$+\infty$9

The comparison between measured and fully quantum relative entropies extends to Rényi divergences: for noncommuting full-support states, the sandwiched Rényi relative entropy is strictly larger than the measured Rényi relative entropy for $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$0, and strictly smaller for $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$1. Thus the Umegaki case belongs to a larger strict-gap phenomenon driven by noncommutativity (Berta et al., 2015).

A different extension starts from Umegaki as a seed. Using Kubo–Ando weighted geometric means, one defines

$$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$2

For full-rank $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$3, this family is monotone increasing in $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$4, satisfies

$$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$5

and

$$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$6

In the barycentric Rényi construction, choosing Umegaki in all slots reproduces the log-Euclidean Rényi divergence in the two-variable case (Mosonyi et al., 2022).

Continuity theory for $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$7 is necessarily support-sensitive. For strictly positive finite-dimensional states, one upper bound is

$$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$8

where $$D(\rho\|\sigma):= \operatorname{Tr}\!\big[\rho(\log \rho-\log \sigma)\big] \quad\text{if}\quad \sigma\gg \rho,$$9 is the largest eigenvalue of $D(\rho\|\sigma)=+\infty$0, $D(\rho\|\sigma)=+\infty$1 are the smallest eigenvalues, and $D(\rho\|\sigma)=+\infty$2 (Vershynina, 2019). A more systematic ALAFF-based theory proves almost concavity for Umegaki relative entropy, recovers almost-tight Alicki–Fannes–Winter type bounds for conditional entropy, mutual information, and conditional mutual information, and yields direct continuity estimates for $D(\rho\|\sigma)=+\infty$3 in the first input, the second input under lower domination assumptions, and jointly in both inputs on appropriate support-compatible sets (Bluhm et al., 2022, Bluhm et al., 2023).

5. Relative entropy to subalgebras, models, and constrained structures

One important generalization replaces the second state by a structured set. For a finite von Neumann algebra $D(\rho\|\sigma)=+\infty$4 and a subalgebra $D(\rho\|\sigma)=+\infty$5 with trace-preserving conditional expectation $D(\rho\|\sigma)=+\infty$6, the relative entropy to the subalgebra is

$D(\rho\|\sigma)=+\infty$7

At $D(\rho\|\sigma)=+\infty$8, the minimizer is exactly the conditional expectation: $D(\rho\|\sigma)=+\infty$9 This is special to the Umegaki case; for general sandwiched Rényi parameters $\sigma\not\gg\rho$0, the minimizer need not be $\sigma\not\gg\rho$1. In finite-dimensional or II$\sigma\not\gg\rho$2-factor settings,

$\sigma\not\gg\rho$3

and for II$\sigma\not\gg\rho$4 subfactors this becomes

$\sigma\not\gg\rho$5

identifying Jones index with maximal Umegaki relative entropy to the subalgebra (Gao et al., 2019).

A parallel role appears in many-body correlation theory. For a Gibbs family $\sigma\not\gg\rho$6,

$\sigma\not\gg\rho$7

The projection theorem gives

$\sigma\not\gg\rho$8

where $\sigma\not\gg\rho$9 is the maximum-entropy state compatible with the relevant constraints. For $\sigma\gg\rho$0-local Gibbs families $\sigma\gg\rho$1, the many-body correlation quantity $\sigma\gg\rho$2 is exactly $\sigma\gg\rho$3, and irreducible $\sigma\gg\rho$4-party correlation becomes

$\sigma\gg\rho$5

This makes Umegaki relative entropy the geometric backbone of hierarchical-model correlation measures (Weis et al., 2014).

These constrained formulations connect to several broader programs. One preliminary categorical approach shows that, when the relevant relative entropies are finite, finite-dimensional quantum relative entropy behaves as an affine functor on a category of noncommutative statistical hypotheses, satisfying a chain-rule identity under composition (Parzygnat, 2021). A distinct inferential program derives minus Umegaki relative entropy as the entropy functional for rationally updating density matrices from a prior $\sigma\gg\rho$6, leading to posteriors of the form

$\sigma\gg\rho$7

under expectation-value constraints (Vanslette, 2017).

6. Operator-algebraic, field-theoretic, and geometric developments

In operator-algebraic and field-theoretic settings, Umegaki relative entropy reappears through Araki’s modular formulation. In type I one has

$\sigma\gg\rho$8

while in general von Neumann algebras

$\sigma\gg\rho$9

For chiral conformal field theory, this framework makes mutual information a relative entropy: $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$0 For free fermions the mutual information of two disjoint intervals has an explicit cross-ratio form, and for finite-index subnets the singular adjacent-interval limit acquires a correction involving $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$1, linking entropy duality to global dimension and subfactor index (Longo et al., 2017).

A complementary CFT approach computes Rényi relative entropies by replica methods and then takes the $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$2 limit to obtain Umegaki relative entropy. In that setting the relative entropy is ultraviolet finite, is written as

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$3

and provides an upper bound on trace distance via Pinsker’s inequality. Explicit formulas were obtained for one-dimensional CFTs at zero and finite temperature using correlation functions and twist operators (Lashkari, 2014). In holography, the same identity underlies the first-law relation

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$4

for infinitesimally nearby states, while positivity and monotonicity of relative entropy become nontrivial tests of the RT/HRT prescription (Blanco et al., 2013).

Recent operator-theoretic work also reexpresses Umegaki relative entropy through the distribution of observables. For spectral decompositions of $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$5 and $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$6, the associated Nussbaum–Szkola distributions $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$7 satisfy

$$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$8

and, under $$\operatorname{supp}(\rho)\subseteq \operatorname{supp}(\sigma).$$9,

$\sigma$00

This gives a finite- and infinite-dimensional realization of Umegaki entropy as a difference of first moments of the distributions of $\sigma$01 and $\sigma$02 under the state $\sigma$03 (Androulakis et al., 2022).

A further geometric development arises from modular self-duality. For an antiunitary involution $\sigma$04 and a one-parameter family $\sigma$05, the natural comparison functional at a modularly self-dual point is the symmetrized Umegaki relative entropy

$\sigma$06

At the self-dual point $\sigma$07,

$\sigma$08

and the Hessian is governed by Bogoliubov–Kubo–Mori geometry: $\sigma$09 This identifies the symmetrized Umegaki entropy as the finite-dimensional prototype of a broader modular comparison principle extending to type III algebras via symmetrized Araki relative entropy (Chatterjee, 18 May 2026).

Umegaki relative entropy therefore occupies several simultaneously active roles: it is the canonical noncommutative extension of classical relative entropy, the unique additive scalar compatible with full binary-testing geometry, the quantity that remains strictly larger than any measurement-optimized classical KL divergence on noncommuting pairs, and the analytic core of a wide range of constructions involving subalgebras, hierarchical models, additivity problems, conformal field theory, and modular geometry (Berta et al., 2015, Gour, 2 Jul 2026).