Reverse Data-Processing Theorems and Computational Second Laws

Abstract: Drawing on an analogy with the second law of thermodynamics for adiabatically isolated systems, Cover argued that data-processing inequalities may be seen as second laws for "computationally isolated systems," namely, systems evolving without an external memory. Here we develop Cover's idea in two ways: on the one hand, we clarify its meaning and formulate it in a general framework able to describe both classical and quantum systems. On the other hand, we prove that also the reverse holds: the validity of data-processing inequalities is not only necessary, but also sufficient to conclude that a system is computationally isolated. This constitutes an information-theoretic analogue of Lieb's and Yngvason's entropy principle. We finally speculate about the possibility of employing Maxwell's demon to show that adiabaticity and memorylessness are in fact connected in a deeper way than what the formal analogy proposed here prima facie seems to suggest.