Phase Ic proof for 0 < α < 1/4
Prove the Phase Ic loss-curve characterization for the PLRF model—that P(r) \asymp Fpp(r) + F0(r) and the associated compute-optimal tradeoff—in the regime 2β > 1 and 0 < α < 1/4 by developing sharp bounds on the kernel function in this region.
References
We can not prove this statement as we do not have sharp bounds on the kernel function in this region.
— 4+3 Phases of Compute-Optimal Neural Scaling Laws
(2405.15074 - Paquette et al., 23 May 2024) in Proposition “Phase Ic: 2 β > 1, 0 < α < 1/4” within Section “Below the high-dimensional line (Phases IVa, IVb, Ib, Ic)”