Thermodynamics of Learning: A Typed Four-Component Accounting of Memory, Fit, and Value
Abstract: What a finite learning device has recorded and what will hold value for it on future tasks are not the same quantity. We develop a typed accounting for finite-state learning devices that separates four components: a training-side fit functional , the record-correlation stock , an update-side search ledger , and an operational capital value . This value is the work gap between an informed protocol class and a blind class obtained by deleting the memory-read port and re-optimizing from scratch. (I) Separation: for every , there is a device family on which record correlation and world correlation grow by while the capital gain is exactly zero. In the regime, data-free updates never increase . (II) Capitalization ledger: an exact extraction identity and a universal ledger identity give, for (F5$'$)-stable -local updates under a no-discarded-record-correlation condition (f), the bound for the capitalization efficiency , together with necessary and sufficient conditions for equality. (III) Value retention: for the retention gap and retention ratio (the former carries no sign constraint; the latter is defined for positive training-side value and is not confined to ) we give a two-layer alignment domain: an exact exchange rate between value and the side-information-adjusted record fit $I(M';D\mid Y)$ without any record-side-information independence assumption, and a raw record-stock exchange rate under a joint side-information neutrality condition , whose boundary is marked by an explicit one-time-pad witness. These are statements about finite-device value retention under task-distribution shift, not a theory of statistical generalization.
Paper Prompts
Sign up for free to create and run prompts on this paper.