Papers
Topics
Authors
Recent
Search
2000 character limit reached

Thermodynamics of Learning: A Typed Four-Component Accounting of Memory, Fit, and Value

Published 13 Aug 2026 in cond-mat.stat-mech, cs.IT, and cs.LG | (2608.12791v1)

Abstract: What a finite learning device has recorded and what will hold value for it on future tasks are not the same quantity. We develop a typed accounting for finite-state learning devices that separates four components: a training-side fit functional Φ<em>fitΦ<em>{\mathrm{fit}}, the record-correlation stock J</em>D=I(M;D)J</em>{D}=I(M;D), an update-side search ledger σ<em>Mσ<em>{M}, and an operational capital value V(M;T,b)V(M;T,b). This value is the work gap between an informed protocol class and a blind class obtained by deleting the memory-read port and re-optimizing from scratch. (I) Separation: for every nn, there is a device family on which record correlation and world correlation grow by nln2n\ln 2 while the capital gain is exactly zero. In the flat<sup>\mathrm{flat}<sup>{*} regime, data-free updates never increase VV. (II) Capitalization ledger: an exact flat<sup>\mathrm{flat}<sup>{*} extraction identity and a universal ledger identity give, for (F5$&#39;$)-stable MM-local updates under a no-discarded-record-correlation condition (f), the bound η</em>cap1η</em>{\mathrm{cap}}\le 1 for the capitalization efficiency η<em>cap=ΔV/(kTσ</em>M)η<em>{\mathrm{cap}}=ΔV/(k T\,σ</em>{M}), together with necessary and sufficient conditions for equality. (III) Value retention: for the retention gap LgenL_{\mathrm{gen}} and retention ratio ρgenρ_{\mathrm{gen}} (the former carries no sign constraint; the latter is defined for positive training-side value and is not confined to [0,1][0,1]) we give a two-layer alignment domain: an exact exchange rate between value and the side-information-adjusted record fit $I(M&#39;;D\mid Y)$ without any record-side-information independence assumption, and a raw record-stock exchange rate under a joint side-information neutrality condition (M,D)Y(M,D)\perp Y, whose boundary is marked by an explicit one-time-pad witness. These are statements about finite-device value retention under task-distribution shift, not a theory of statistical generalization.

Authors (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.