Papers
Topics
Authors
Recent
Search
2000 character limit reached

Double Smoothly Broken Power Law

Updated 6 July 2026
  • Double smoothly broken power law is a parameterization that smoothly links three power-law regimes using two continuous breakpoints.
  • It is applied in astrophysical spectra, gravitational-wave background analyses, and neural scaling laws to capture multi-regime behaviors.
  • The model balances flexible interpolation with challenges such as parameter proliferation and sensitivity in extrapolating unseen regimes.

Searching arXiv for the cited works to ground the article in the current literature. A double smoothly broken power law is a family of parameterizations in which a quantity follows one approximate power-law regime, then passes through two continuous transitions into later regimes, yielding three asymptotic segments on log-log axes without hard piecewise breaks. In the literature, the same modeling role appears in several closely related forms: an explicit multi-break product formula with two smooth breakpoints; a sum of two smooth single-break spectra; and rank-size constructions in which two power-law-like factors or two Lavalette-like terms generate a smooth bend, an intermediate shoulder, or an inflection point on a log-log plot (Caballero et al., 2022, Ausloos, 2014, Yu et al., 2022).

1. Formal structure and parameterization

An explicit multi-break smoothly broken power law is given by the Broken Neural Scaling Law family,

y=a+bxc0i=1n(1+(xdi)fi)ci/fi.y = a + b x^{-c_0}\prod_{i=1}^{n}\left(1+\left(\frac{x}{d_i}\right)^{f_i}\right)^{-c_i/f_i}.

In this parameterization, nn is the number of smooth breaks or transitions, aa is the limiting asymptote as xx\to\infty, bb is an offset or normalization, c0c_0 is the slope of the first segment on a log-log plot, cic_i is the change in slope between segment ii and i+1i+1, did_i is the breakpoint location on the nn0-axis, and nn1 is the smoothness or sharpness of the nn2-th transition. Smaller nonnegative nn3 gives a sharper break, while larger nn4 gives a smoother or wider transition (Caballero et al., 2022).

For a double smoothly broken power law in the strict sense, one sets nn5: nn6 On log-log axes, this corresponds to a curve that is nearly linear in three regions, with smooth transitions around nn7 and nn8. The appendix decomposition in the same work makes the slope accumulation explicit: successive breaks add the slope changes nn9, so later segments inherit all earlier transitions (Caballero et al., 2022).

A related one-break building block appears in stochastic gravitational-wave searches as the smooth broken power law

aa0

with aa1. Here aa2 is the peak amplitude at aa3, aa4 is the peak frequency, aa5 and aa6 are the low- and high-frequency slopes, and aa7 is the transition width. This single-break form becomes a component from which more complex spectra can be built, either by summation or by embedding it in a larger doubly broken ansatz (Yu et al., 2022).

2. Rank-size and generalized Lavalette constructions

A precursor to double smoothly broken behavior appears in rank-size modeling through the Lavalette family. The basic 2-parameter Lavalette law is

aa8

or equivalently

aa9

This is a power-law decay multiplied by a power-law cut-off. On a log-log plot it looks like a descending scaling law at low rank, but it bends down near the upper end because of the xx\to\infty0 factor. The parameter xx\to\infty1 controls the common steepness, and the finite-size factor xx\to\infty2 sets where the cut-off happens; in practice, xx\to\infty3 is often just a convenient scale factor rather than a physically meaningful fitted quantity. This already plays the role of a smoothly broken power law because the transition between regimes is continuous rather than piecewise (Ausloos, 2014).

The generalized 3-parameter Lavalette form,

xx\to\infty4

separates the two tails. Here xx\to\infty5 governs the low-rank behavior and xx\to\infty6 governs the high-rank behavior, so the low and high tails can have distinct slopes. If xx\to\infty7, it reduces to a Zipf or pure power-law-like behavior; if xx\to\infty8 and xx\to\infty9, one gets a Feller-Pareto-type form; if bb0 and bb1, one recovers the Verhulst or logistic structure. Additional 3- and 4-parameter variants introduce a free high-rank range parameter bb2 and low-rank Mandelbrot shifts bb3, explicitly to handle flattening at the low-rank end and or high-rank end (Ausloos, 2014).

The closest analogue in that paper to a double smoothly broken power law is the proposal to generate an inflection point on a log-log plot by summing two decreasing power-law-like terms and then imposing a high-bb4 cut-off: bb5 or, with an exponential cut-off,

bb6

The stated intent is that the sum of two decreasing power-law terms gives an intermediate curvature change, while the multiplicative cut-off handles the final high-bb7 suppression. The author explicitly says that such a law can produce the needed inflection point on a log-log plot. Hyper-generalized forms with nonlinear powers of bb8 and bb9 are also written down, but the paper repeatedly states that extra parameters should be considered only if simpler models fail and judged empirically rather than by aesthetic preference (Ausloos, 2014).

3. Physical realizations in energetic particles and gravitational waves

In numerical modeling of energetic particles accelerated at coronal shocks, event-integrated energy spectra over the whole simulation domain are reported to be well described by a double power law for all ion species. The study solves the Parker transport equation in a streamer-like coronal magnetic field, includes protons and the heavier ions He, O, Mg, and Fe, and fits the integrated spectra with the Band function, i.e. a smoothly joined broken power law. In the Kolmogorov case, the fitted low-energy indices are around c0c_00, the high-energy indices are around c0c_01, and the break energy follows

c0c_02

with c0c_03 for Kolmogorov turbulence and spanning roughly c0c_04 to c0c_05 across different turbulence spectral indices. The low-energy slope is consistent with the DSA expectation for a shock compression ratio c0c_06, while the second power-law segment is attributed to spatially inhomogeneous acceleration and transport (Yu et al., 2022).

The proposed mechanism in that context is superposition of particle populations from different source regions along the shock front. In the streamer and nonstreamer regions individually, spectra are best fit by a power law with an exponential rollover, but in the transition region the spectrum becomes double-power-law-like because it contains a mix of locally accelerated particles and higher-energy particles that have diffused or escaped from the more efficient streamer region. The paper explicitly demonstrates that combining two rollover spectra with different characteristic energies can produce a composite spectrum that resembles a double power law, and that mixing a small fraction of high-energy streamer particles with a locally accelerated spectrum can reproduce the transition-region spectrum. A plausible implication is that a double smoothly broken power law can emerge from spatial superposition rather than from a single local acceleration law (Yu et al., 2022).

In stochastic gravitational-wave background searches, the distinction between related constructions is made explicit. A double-peak spectrum is modeled as the sum of two separate broken power laws,

c0c_07

whereas the doubly broken spectrum is one spectrum with three power-law segments and two break frequencies c0c_08 and c0c_09. Its asymptotic behavior is written as

cic_i0

Using Advanced LIGO-Virgo O1-O3 data, the analysis finds strong negative evidence for the double-peak case and weak negative evidence for the doubly broken case, placing cic_i1 C.L. upper limits cic_i2, cic_i3, and cic_i4 relative to unresolved compact binary coalescence backgrounds. In that literature, the doubly broken template is closely related in spirit to a double smoothly broken power law, but it is not parameterized as two explicit smooth breaks of the same type as the single-BPL formula (Yu et al., 2022).

4. Multi-break scaling laws in machine learning

Broken Neural Scaling Laws provide the most explicit general-purpose multi-break formulation among the cited works. They are introduced to model how the evaluation metric of interest varies with amount of compute used for training or inference, number of model parameters, training dataset size, model input size, number of training steps, or upstream performance, across various architectures and tasks in zero-shot, prompted, and finetuned settings. The same functional family is stated to model behaviors that simpler laws cannot express, including delayed sharp inflection points, multiple regime changes, and nonmonotonic transitions such as double descent (Caballero et al., 2022).

The paper is explicit about the hierarchy of special cases. When cic_i5,

cic_i6

which is a plain power law. When cic_i7, the model is a single smoothly broken power law. In general, cic_i8 can be any nonnegative integer, giving cic_i9 breaks and therefore ii0 approximately linear segments on a log-log plot. A double smoothly broken power law is therefore not a special construction added afterward; it is the ii1 member of the family (Caballero et al., 2022).

The same work emphasizes expressivity beyond monotone scaling. It states that M1, M2, and M3 are monotonic and cannot model double-descent-like behavior, while M4 can model an inflection point but still cannot represent nonmonotonicity. BNSL can do both. Specific examples include delayed sharp inflection points in 4-digit arithmetic addition, temporary worsening followed by improvement in transformer double descent, and late transitions from near-random to strong performance on some downstream tasks (Caballero et al., 2022).

Empirically, BNSL is reported to be best on ii2 of tasks on the scaling laws benchmark for downstream vision tasks and on ii3 of tasks on the language benchmark. The paper also states that extrapolations can extend beyond the largest training point by more than an order of magnitude and, in some GPT-4-related plots, by over ii4 the largest fitted scale. The associated conceptual point is not only that multi-break smoothly broken power laws are expressive, but also that they expose intrinsic limits to predictability when a sharp break lies beyond the observed range (Caballero et al., 2022).

Several adjacent model classes resemble double smoothly broken power laws but are not equivalent to a two-break smooth interpolation. The distinctions matter because the same qualitative language—double power law, doubly broken, double-sided power law, broken peak—can refer to different mathematical objects (Fontanelli et al., 2019, Li et al., 2024, Yu et al., 2022).

Construction Break structure Representative source
BNSL with ii5 One formula, two smooth breaks, three segments (Caballero et al., 2022)
Double-peak spectrum Sum of two smooth single-BPL spectra (Yu et al., 2022)
Doubly broken SGWB spectrum One spectrum with three asymptotic power-law regimes and two break frequencies (Yu et al., 2022)
Lavalette-based inflection model Sum of two power-law-like terms times a cut-off (Ausloos, 2014)
Beta Rank Function Smooth double-sided power law in log-space, single rounded peak (Fontanelli et al., 2019)
Broken power-law peak for SIGWs One smooth peak with IR and UV power-law tails (Li et al., 2024)

The Beta Rank Function,

ii6

is a continuous-rank analogue of the discrete generalized beta distribution. Its induced density is approximately a unimodal skewed and asymmetric two-sided power law or double Pareto or log-Laplacian distribution, but after the log transform it makes a smooth turn at the peak and does not diverge, lacking the sharp angle observed in the double Pareto or Laplace distribution. The left and right log-space tails are approximately exponential, with the left slope controlled by ii7 and the right slope by ii8. When ii9, the BRF becomes the Lavalette distribution and is closely related to a lognormal-like shape. This is therefore a smooth double-sided power law, not a double smoothly broken power law with two distinct break locations (Fontanelli et al., 2019).

A similar terminological caution applies to scalar-induced gravitational waves from a broken power-law curvature spectrum. The spectrum

i+1i+10

has a peak at i+1i+11, an infrared branch i+1i+12, and an ultraviolet branch i+1i+13. The paper explicitly states that this is not a double-break spectrum in the strict sense of two independent break scales; it is a single smooth broken power law with one peak and two asymptotic branches. Its utility lies in near-peak approximation and in the induced SIGW spectrum, whose IR tail, central peak, and UV tail carry distinct signatures of i+1i+14, i+1i+15, and peak width (Li et al., 2024).

6. Estimation, interpretability, and structural constraints

Across the cited literature, increasing the number of parameters improves flexibility but weakens interpretability. In the Lavalette study, the added parameters are said to be “understood” in a pragmatic fit sense, but their theoretical meaning is often unclear; the paper cautions that such parameters should not be added indiscriminately. It also warns against reporting parameter values too precisely, since these are nonlinear fits and the regression coefficient i+1i+16 can be misleadingly high even when the visual fit is unsatisfactory in one tail. The Levenberg–Marquardt algorithm is mentioned for nonlinear fitting, and the recommendation is to use low-rank and high-rank parameters to target visible deviations where the simple power law fails (Ausloos, 2014).

In neural scaling, the limitation is epistemic rather than merely statistical. The BNSL analysis states three implications: very sharp breaks impose a lower bound on how far one can extrapolate from pre-break data; breaks beyond the fitted range may be impossible to predict reliably; and points before a sharp early break can sometimes be unhelpful or even insufficient, but in other settings they are crucial for identifying the right post-break behavior. This makes a double smoothly broken power law not only a descriptive fit family but also a statement about the difficulty of inferring unseen regimes from small-scale observations (Caballero et al., 2022).

A further limitation arises in network theory. For degree sequences distributed as a double power law with a size-dependent crossover, graphicality is governed by the Erdős–Gallai theorem and related scaling arguments. The cited work derives the graphicality of infinite sequences for all possible values of the degree exponents i+1i+17 and i+1i+18, finds five qualitatively distinct ways graphicality can be violated, and emphasizes that finite-size convergence toward the asymptotic phase diagram is logarithmically slow. It also states that smoothly broken or double power-law network models are subject to the same structural feasibility constraints as sharp double power laws because the asymptotic issue is governed by the scaling of the tail exponents and the crossover scale. This suggests that functional smoothness alone does not guarantee realizability: a plausible fit can still correspond to no simple graph (Valigi et al., 31 Dec 2025).

Taken together, these results define the double smoothly broken power law less as a single universal equation than as a modeling class for multi-regime scaling. Its essential features are continuous transitions between asymptotic slopes, the possibility of distinct low-, intermediate-, and high-range behavior, and the capacity—when formulated by superposition or multi-break interpolation—to represent shoulders, delayed inflection points, nonmonotonic transitions, and species- or scale-dependent cut-offs. Its main difficulties are equally consistent across fields: parameter proliferation, ambiguity of interpretation, sensitivity of extrapolation to unseen breaks, and, in some applications, structural constraints external to the fit itself.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Double Smoothly Broken Power Law.