Monotonicity of Relative Entropy
- Monotonicity of relative entropy is a principle demonstrating that quantum operations do not increase the distinguishability between states, forming the basis of the data-processing inequality.
- Theoretical proofs by Petz use operator algebra and recovery maps while Uhlmann’s approach employs quadratic interpolation, contrasting practical methodologies in quantum information theory.
- This property impacts quantum thermodynamics, resource theories, and communication by bounding error rates and guiding the design of reversible quantum channels.
The monotonicity of relative entropy is a principle asserting that physical or information-processing transformations cannot increase the distinguishability between quantum states. This property underpins a vast portion of quantum information theory and statistical physics, and possesses deep mathematical foundations and operational consequences. In particular, it equates to the data-processing inequality, ensures the validity of major entropy inequalities, governs information loss under quantum channels, and connects reversibility to recoverability of quantum states.
1. Formal Definition and General Statement
Consider two quantum states (density operators) and on a Hilbert space. The quantum relative entropy is
For any completely positive, trace-preserving (CPTP) map (quantum channel), the monotonicity states: This inequality is known as the data-processing inequality (DPI) and forms the mathematical backbone for the impossibility of increasing information by local, physical transformations (1105.4865, Sagawa, 2012, Pérez-Pardo, 2022, Matheus et al., 14 Sep 2025).
2. Proof Methodologies: Petz vs Uhlmann
There are two principal, structurally distinct proof strategies: Petz's direct operator-algebraic approach and Uhlmann's quadratic form interpolation.
Petz's Operator-Algebraic Approach
Petz's approach reformulates relative entropy in terms of the modular operator on the Hilbert-Schmidt space: Upon coarse-graining (e.g., partial trace), Petz introduces an auxiliary isometric lifting operator that intertwines the reduced and original modular structures. The initial attempt erroneously applied the contractive Jensen operator inequality, but the correct proof recognizes as an isometry in the relevant cases. This enables valid use of the operator-convexity of for isometries, leading to
with equality if and only if there is a recovery map—the Petz recovery map—restoring from (Matheus et al., 14 Sep 2025).
Uhlmann's Interpolation of Sesquilinear Forms
Uhlmann's route is based on Pusz-Woronowicz interpolation of positive sesquilinear forms. Given states and on a unital -algebra, Uhlmann constructs an interpolating quadratic form: with commuting positive operators arising from GNS representations. The relative entropy is then defined as a Dini derivative at : for the identity. Under a positive, unital (Schwarz) map , Uhlmann's argument shows the pull-back of quadratic forms preserves the ordering, yielding
and, in the operator algebra context, generalizes effortlessly to type III von Neumann algebras and non-invertible states (Pérez-Pardo, 2022, Reible, 8 Jan 2025).
Comparative Analysis
Feature | Petz | Uhlmann |
---|---|---|
Conceptual Basis | Modular operator, lifting isometries | Positive form interpolation |
Scope | Intuitive, explicit when full rank | Fully general, abstract |
Recovery Map Link | Direct to Petz recovery map | General monotonicity |
Applicability | Finite-dimensional, invertible states | All normal states |
Technical Demand | Operator algebra, isometric lifts | Quadratic form calculus |
(Matheus et al., 14 Sep 2025, Reible, 8 Jan 2025)
3. Operational Consequences in Quantum Information
a) Data-Processing and Entropic Uncertainty
Monotonicity clarifies that quantum measurements or noise invariably reduce the distinguishability of states—a fact harnessed for entropic uncertainty relations with quantum side information. It explains the trade-off in knowledge about complementary observables upon sequential or simultaneous measurement, leading to the formal uncertainty relation with quantum side information (UPQSI), where the monotonicity is explicitly used to derive lower bounds on joint conditional entropies (1105.4865): with .
b) Thermodynamics and the Second Law
Monotonicity under CPTP maps underlies second law-like statements such as the Clausius inequality (), and the quantum Hatano–Sasa inequality for nonequilibrium steady states, by ensuring non-increase of quantum relative entropy between state sequences under physical evolutions (Sagawa, 2012): is used to show that the change in entropy is bounded below by excess contributions in driven thermodynamic processes.
c) Resource Theories and Channel Capacities
Monotonicity is essential for the characterization of monotones in resource theories, for error exponents in channel discrimination, and for bounding quantum capacities via sandwiched Rényi divergences. For the sandwiched Rényi divergence , monotonicity is proved for all , confirming its operational legitimacy in contexts like quantum hypothesis testing and one-shot channel coding (Frank et al., 2013).
d) Recovery Maps and Approximate Reversibility
The tightness of monotonicity is realized when the channel action is reversible. Petz's theorem asserts that equality occurs if and only if a Petz recovery map reconstructs from . Quantitative refinements, relating the decrease in relative entropy to the fidelity between and its recovered version, have been established (Berta et al., 2014, Sutter et al., 2015): where denotes the quantum fidelity and is the Petz recovery map.
4. Extensions: Positive Maps, Infinite Dimensions, and Further Generalizations
a) Positive vs Completely Positive
Monotonicity holds under positive trace-preserving maps, not only CPTP (completely positive trace-preserving) maps. This broader validity exposes limitations in the use of relative entropy for detecting non-Markovianity; certain measures become blind if only positivity, not complete positivity, is checked (Müller-Hermes et al., 2015, Sargolzahi et al., 2019).
b) Infinite-Dimensional Operator Algebras
The relative entropy extends to infinite-dimensional von Neumann algebras via modular theory and vector representatives in standard forms. Uhlmann's monotonicity theorem (proven in the Araki–Uhlmann setting) guarantees monotonicity for normal positive functionals under unital Schwarz maps and, hence, covers all physical transformations in algebraic quantum field theory and statistical mechanics (Reible, 8 Jan 2025). Monotonicity is also crucial for defining the two-sided Bogoliubov inequality for KMS (thermal equilibrium) states, governing perturbations and free energy changes in the general setting.
c) Continuity and Stability Aspects
Monotonicity persists for "discontinuity jumps"—infinite sequences of states converging towards a limit. Under quantum operations, the local discontinuity jump of relative entropy cannot increase, implying further stability for limits and approximations in information-theoretic and thermodynamic settings (Shirokov, 2022).
5. Generalized and Axiomatic Contexts
Beyond the quantum case, the monotonicity of relative entropy arises axiomatically from the postulate that distinguishability cannot increase under noise (data-processing). For any operationally meaningful divergence , this property and additivity force to interpolate between minimal and maximal divergences (min- and max-relative entropies), and to possess continuity in the interior of the probability simplex. This establishes a bijection between entropy and relative entropy, and operationalizes why quantities like the quantum (or classical) relative entropy and Rényi divergences occupy their central role (Gour et al., 2020).
6. Geometric and Physical Analogues
In geometric contexts, such as the paper of hypersurfaces in hyperbolic space, a notion of “relative entropy” defined via renormalized areas satisfies a monotonicity property along mean curvature flow: the difference in renormalized area (relative entropy) between two hypersurfaces is non-increasing in time, quantifying geometric “closeness” in analogy with information theory (Yao, 2022).
Key Formulas and Conceptual Summary
- Umegaki quantum relative entropy:
- Monotonicity / Data Processing Inequality: for CPTP
- Petz recovery map:
- Characterization of equality: if and only if a Petz map recovers from .
- Bounds via divergence families: Any data-processing and additive divergence satisfies , with and (Gour et al., 2020).
- Von Neumann algebra generalization: For a unital Schwarz map and positive normal functionals , satisfying and ,
References (arXiv ids)
- (1105.4865)
- (Sagawa, 2012)
- (Frank et al., 2013)
- (Lewin et al., 2013)
- (Berta et al., 2014)
- (Deuchert et al., 2015)
- (Sutter et al., 2015)
- (Müller-Hermes et al., 2015)
- (Lin et al., 2016)
- (Casini et al., 2016)
- (Zhao et al., 2017)
- (Sargolzahi et al., 2019)
- (Gour et al., 2020)
- (Carlen et al., 2022)
- (Yao, 2022)
- (Pérez-Pardo, 2022)
- (Shirokov, 2022)
- (Reible, 8 Jan 2025)
- (Matheus et al., 14 Sep 2025)
These results collectively place the monotonicity of relative entropy at the heart of quantum information theory, statistical mechanics, and mathematical physics, providing an essential constraint on physical, information-theoretic, and even geometric processes.