Papers
Topics
Authors
Recent
Search
2000 character limit reached

No-Repetition Scaling Law in ML Training

Updated 5 July 2026
  • No-Repetition Scaling Law is a framework of scaling relations that describes how model loss decays when each training example is seen only once.
  • It unifies several formulations—such as compute frontier, InfoLaw, additive-overfitting, and one-pass SGD linear regression—to serve as a reference for repetition damage.
  • The law functions both as a predictive model and a control surface for optimizing compute allocation and training strategies by quantifying the gap from repeated-data runs.

Searching arXiv for the cited papers and closely related scaling-law work. I’ll look up the specified arXiv records to ground the article in the current literature. No-Repetition Scaling Law denotes a class of reference scaling relations for model loss or test error in regimes where each training example is seen once, or where repetition variables are fixed to their no-repetition value. In recent work, the term appears in several closely related forms: as a fitted no-repetition compute frontier for LLMs, as the zero-repetition specialization of an information-based law for quality-weighted mixtures, as the RD=0R_D=0 limit of an additive overfitting law for data-constrained training, and as a one-pass SGD theorem in linear regression (Chudnovsky et al., 23 Jun 2026, Liu et al., 4 May 2026, Lovelace et al., 2 May 2026, Lin et al., 2024). Across these formulations, the no-repetition law functions both as a predictive model of baseline performance and as the reference curve against which the damage from repeated data is quantified.

1. Terminology and formal scope

The phrase “no repetition” is not tied to a single notation. In the exact-document repetition setting of Chudnovsky et al., the no-repetition baseline is

L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),

where RR is the number of times each document in a small “repeated pool” is replayed during training, and pfp\equiv f is the fraction of all training tokens drawn from that pool (Chudnovsky et al., 23 Jun 2026). In InfoLaw, the no-repetition regime is the specialization r=0r=0 in the sense of “effectively unlimited source data,” SKS\gg K, so that Rd1R_d\to1 for every quality bucket dd and no bucket is ever repeated (Liu et al., 4 May 2026). In the data-constrained law of Ivgi et al., repetition is parameterized by RDR_D, the number of extra epochs beyond the first, so the no-repetition case is RD=0R_D=0 (Lovelace et al., 2 May 2026). In the linear-regression theory of Lin et al., no repetition is implemented by one-pass SGD, where each example is seen once (Lin et al., 2024).

These notational differences matter because each formulation isolates a different object. The Chudnovsky law is a compute-indexed empirical frontier. InfoLaw is a data-aware model in which information density and diminishing returns under repetition enter explicitly. The additive-overfitting law starts from a Chinchilla-style decomposition and adds a repetition penalty. The linear-regression result is a theorem on reducible risk under one-pass SGD. A plausible implication is that “no repetition” should be understood as a boundary condition shared by several scaling frameworks, rather than as a single universal equation.

2. Canonical formulations

Several no-repetition laws now coexist in the literature.

Setting No-repetition condition Resulting law
Exact-document repetition baseline L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),0 L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),1
InfoLaw specialization L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),2 L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),3
Additive-overfitting law L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),4 L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),5
One-pass SGD linear regression one pass over data L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),6

In the fitted no-repetition frontier of Chudnovsky et al., compute is written as

L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),7

with L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),8 the overtraining multiplier relative to Chinchilla-optimal. The fitted constants are L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),9 nats, RR0, and RR1 (Chudnovsky et al., 23 Jun 2026).

In InfoLaw, the full information model is

RR2

with

RR3

Under no repetition, RR4 and RR5, so

RR6

For large RR7, the paper Taylor-expands RR8, giving

RR9

and hence the zero-repetition law

pfp\equiv f0

The fitted coefficients are pfp\equiv f1, pfp\equiv f2, pfp\equiv f3, and pfp\equiv f4 (Liu et al., 4 May 2026).

In the additive-overfitting framework,

pfp\equiv f5

Setting pfp\equiv f6 recovers the no-repetition form

pfp\equiv f7

which is precisely the Chinchilla-style law without a repetition penalty (Lovelace et al., 2 May 2026).

The linear-regression result gives a no-repetition theorem rather than a fitted empirical curve. Under a Gaussian sketch of size pfp\equiv f8, one-pass SGD on pfp\equiv f9 data, an isotropic Gaussian prior on the teacher, and a covariance spectrum r=0r=00 with r=0r=01, the reducible part of the test error is

r=0r=02

with the variance term dominated by the other errors due to the implicit regularization of SGD (Lin et al., 2024).

3. Reference frontier for repetition damage

A central use of the no-repetition law is to provide the reference frontier against which repeated-data runs are evaluated. Chudnovsky et al. define Compute-Equivalent Gain (CEG) and Compute-Equivalent Loss (CEL) by inverting the fitted no-repetition curve: r=0r=03 Here r=0r=04 iff the repeated-data run matches the no-repetition frontier, and r=0r=05 indicates wasted compute (Chudnovsky et al., 23 Jun 2026).

In that controlled exact-document repetition setting, the repeated-token fraction is fixed to r=0r=06, and the eval loss r=0r=07 at fixed r=0r=08 peaks at an intermediate repeat count r=0r=09. The peak repeat count is fit as

SKS\gg K0

while the corresponding repeated-pool size scales as

SKS\gg K1

At SKS\gg K2, the peak compute-equivalent losses are

SKS\gg K3

For the Qwen3-style SKS\gg K4M-parameter model on FineWeb-Edu-Dedup at SKS\gg K5, the worst-case SKS\gg K6 gives SKS\gg K7 and SKS\gg K8, meaning the run only “buys” two-thirds of the compute it spent. The paper notes that a raw eval-loss bump of SKS\gg K9–Rd1R_d\to10 maps to an Rd1R_d\to11 compute gap because the fitted no-repetition law is shallow, with Rd1R_d\to12 (Chudnovsky et al., 23 Jun 2026).

This use of a no-repetition frontier changes the interpretation of repetition damage. Rather than treating loss deltas in isolation, the loss increase is translated into the amount of no-repetition compute that would have been required to reach the same loss. This suggests that no-repetition laws are as important diagnostically as they are predictively.

4. Relation to data mixture and data quality

In repetition-aware mixture scaling, the no-repetition regime is a special case rather than the full problem. The mixture law of Mhammedi et al. defines the target-pool repetition factor

Rd1R_d\to13

the utility-decay factor

Rd1R_d\to14

the effective target contribution

Rd1R_d\to15

and the effective total data

Rd1R_d\to16

Under no repetition, Rd1R_d\to17, hence Rd1R_d\to18, Rd1R_d\to19, and

dd0

The paper states that in this limit the law drops back to data-mixture-only scaling (Sedova et al., 12 May 2026).

The same boundary-case structure appears in InfoLaw. When dd1, no bucket is ever repeated, dd2, and the total information reduces to dd3. Under this zero-repetition specialization, InfoLaw differs sharply from a “Kaplan-style” two-term law

dd4

The paper emphasizes three consequences: the dd5-exponent is dd6, “roughly half the usual dd7–dd8”; dd9 enters only inside a logarithm rather than as a direct power; and the prefactor RDR_D0 is correspondingly larger to match overall loss levels. Figures 3(a)–(f) are reported to show that under zero or low repetition the InfoLaw curve collapses all training configurations, including extrapolations to larger RDR_D1 and RDR_D2, onto a single straight line in log–log space, whereas the standard two-term fit mis-extrapolates once repetition or data-mixture effects become non-trivial (Liu et al., 4 May 2026).

Mixture pretraining under data constraints also changes the operational meaning of “safe” repetition. Mhammedi et al. report that mixture training tolerates much higher repetition than single-source training: scarce target corpora can be reused RDR_D3–RDR_D4 times, with the optimal number of repetitions depending on the target data size, compute budget, and model scale (Sedova et al., 12 May 2026). A plausible implication is that the no-repetition law is often best viewed as the lower-order limit of a broader repetition-aware law, not as the compute-optimal prescription in scarce-data settings.

5. Statistical interpretation and theoretical mechanisms

The no-repetition law in linear regression is derived under a specific set of assumptions: Gaussian covariates RDR_D5, a well-specified linear teacher, isotropic Gaussian prior on RDR_D6, covariance eigenvalues RDR_D7 with RDR_D8, a random Gaussian sketch RDR_D9, and one-pass SGD with a geometrically decaying step-size (Lin et al., 2024). In that setting, the population risk decomposes into irreducible risk, approximation error, and excess risk. The approximation error scales as RD=0R_D=00, the leading bias term scales as RD=0R_D=01, and the variance term is of strictly higher order. The paper attributes the suppression of the variance bump to the implicit regularization of SGD: one-pass SGD with small or decaying step size cuts off the effective spectrum at RD=0R_D=02, so the classical growing-variance term becomes empirically unobservable.

This theorem provides one account of why a no-repetition law can exhibit monotonic improvement with model size. In the notation of Lin et al., the expected risk is

RD=0R_D=03

with no visible U-shaped variance term (Lin et al., 2024).

The complementary question is why repetition breaks that behavior. Chudnovsky et al. analyze a toy misspecified linear-regression model with RD=0R_D=04 unique samples and RD=0R_D=05 repeatable samples each duplicated RD=0R_D=06 times, giving RD=0R_D=07 total training examples. The block-diagonal covariance of duplicated noise is

RD=0R_D=08

and the conditional train and test risks have closed forms involving RD=0R_D=09 and L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),00. The reported simulations confirm a non-monotonic test loss in L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),01 at fixed L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),02 and show that the location of maximal generalization error moves to larger L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),03 as L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),04 grows, qualitatively matching the empirical trend L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),05 (Chudnovsky et al., 23 Jun 2026).

Taken together, these two lines of analysis place no-repetition and repetition in direct theoretical opposition: one-pass SGD yields a clean two-term power law, while duplicated data introduces a memorization–generalization tradeoff that can generate an intermediate-L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),06 loss peak.

6. Assumptions, limitations, and prescriptive use

The no-repetition laws in current use are fitted or derived under narrow assumptions. InfoLaw assumes a fixed bucketing L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),07 of data by a heuristic quality score, with a simple exponential quality-density L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),08; the number and boundaries of the buckets were not jointly optimized. Its normalization by L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),09 is empirical, because alternative forms failed to collapse or extrapolate. The “overtrain degree” L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),10 empirically shifts the intercept of the scaling curve but is not yet derived from first principles. The logarithmic form L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),11 was chosen for smooth extrapolation beyond L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),12B, and no attempt was made to re-fit L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),13 on very large models (Liu et al., 4 May 2026).

The repetition-aware mixture law of Mhammedi et al. is likewise bounded by its training setup. All runs use GPT-2-style decoder-only Transformers and constant LR schedules. The largest scale is L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),14M parameters, so extrapolation to L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),15B+ remains an open question. Quality-filtered data yielded slightly lower L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),16 than language-domain splits, which the paper interprets as evidence that the “distance” of generic versus target data is not fully captured by the effective-data formula (Sedova et al., 12 May 2026).

The additive-overfitting law makes a different simplification. Its one-parameter form isolates repetition damage in a single coefficient L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),17,

L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),18

This yields L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),19 on the FineWeb sweep, compared with L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),20 for Chinchilla plus effective-data and L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),21 for the four-parameter variant. The fitted one-parameter coefficient under standard weight decay is L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),22. The same framework is used prescriptively: with L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),23M and L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),24 FLOPs, the law prescribes L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),25B and L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),26, achieving perplexity L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),27 versus L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),28 for the prior effective-data law. In a weight-decay case study, strong weight decay L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),29 reduces the fitted penalty from L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),30 to L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),31, approximately a L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),32 reduction, while increasing the single-epoch floor by L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),33 nats (Lovelace et al., 2 May 2026).

Across these papers, the recommended use is consistent. One first fits a no-repetition or low-repetition reference law on a manageable suite of experiments, then uses that law to search over compute allocations, repetition levels, or mixture weights before running large-scale training. InfoLaw recommends fitting L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),34 and L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),35 on a small suite of experiments and then computing L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),36 to predict loss for large candidate recipes, enabling search over hundreds of thousands of mixture weights (Liu et al., 4 May 2026). Chudnovsky et al. recommend quantifying repetition damage via L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),37, fixing the repeated-token fraction to match the corpus, and sweeping L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),38 to locate worst-case structures (Chudnovsky et al., 23 Jun 2026). Ivgi et al. recommend solving

L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),39

and scanning small integers L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),40 to minimize the loss, with the explicit guideline that if the optimum is L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),41–L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),42, additional compute should be allocated to increasing L0(F,N)=L(F,p ⁣= ⁣0,R ⁣= ⁣1,N),L_0(F,N)=L(F,p\!=\!0,R\!=\!1,N),43 rather than repeating data (Lovelace et al., 2 May 2026).

In that sense, the no-repetition scaling law has become both a baseline and a control surface: a baseline because it defines the frontier absent duplication, and a control surface because repetition-aware optimization procedures are constructed by measuring departures from it.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to No-Repetition Scaling Law.