---
title: 'CERO: Adaptive RL, Collider, and Zero Isotherm'
url: https://www.emergentmind.com/topics/cero
type: topic
---

# CERO: Adaptive RL, Collider, and Zero Isotherm

In the cited works, **CERO** denotes three distinct technical objects: **Cross-Epoch Adaptive Rollout Optimization**, a rollout-budgeting method for reinforcement-learning post-training of large language models; the **Circular Energy-Recovery Option/Collider**, a generic concept for an \(e^+e^-\) collider based on energy-recovery linacs in a large circular tunnel; and, in a thermodynamic context, **absolute zero**, the **zero isotherm** \(T=0\). The term therefore spans machine learning, accelerator physics, and thermodynamics, with each usage carrying a different formal structure, set of assumptions, and research agenda.

## 1. Scope and principal meanings

The cited literature uses the same label for an RL resource-allocation framework, a collider architecture, and the thermodynamic zero isotherm. These meanings are defined respectively in [2606.05606], [2203.07358], and [2401.04069].

| Meaning of CERO | Research area | Core definition |
|---|---|---|
| Cross-Epoch Adaptive Rollout Optimization | RL post-training | A rollout budgeting framework that adaptively allocates rollouts across prompts and epochs under a fixed global budget |
| Circular Energy-Recovery Option/Collider | Accelerator physics | A generic concept of an \(e^+e^-\) collider in a large circular tunnel using energy-recovery linacs instead of storage rings, with both energy and particle recycling |
| Absolute zero / zero isotherm | Thermodynamics | The isotherm \(T=0\), used in a Carnot-based proof of the Nernst heat theorem |

The first usage is algorithmic and concerns adaptive data collection for GRPO-style training. The second is architectural and concerns luminosity, synchrotron-radiation power, and polarized beams in a \(\sim 100\) km machine. The third is conceptual and concerns the low-temperature structure of entropy derived from the second law.

## 2. CERO as Cross-Epoch Adaptive Rollout Optimization

In RL post-training, CERO is formulated as an online resource-allocation problem over prompts \(i \in \{1,\dots,M\}\) and epochs \(k \in \{1,\dots,K\}\). Each prompt receives an integer number of rollouts \(N_{i,k}\), with cumulative allocation
\[
N_i=\sum_{k=1}^K N_{i,k},
\]
subject to the global budget constraint
\[
\sum_{i=1}^M \sum_{k=1}^K N_{i,k}\le B.
\]
Its motivation is that GRPO and similar methods often use a fixed rollout budget per prompt even though prompt difficulty is heterogeneous: some prompts are too easy or too hard and therefore provide little learning signal, whereas medium-difficulty prompts produce both successes and failures and thus stronger gradients. CERO addresses this by explicitly modeling prompt-level diminishing returns through a concave increasing utility \(U_i\) over cumulative allocation [2606.05606].

For verifiable reasoning tasks, each rollout produces a binary success indicator \(Y \in \{0,1\}\) with unknown pass probability \(p_i\). CERO places a Beta prior on \(p_i\),
\[
p_i \sim \mathrm{Beta}(\alpha_i,\beta_i),
\]
and after \(r_i\) rollouts with \(s_i\) successes updates
\[
\alpha_i \leftarrow \alpha_i+s_i,\qquad \beta_i \leftarrow \beta_i+(r_i-s_i).
\]
The posterior mean and variance are
\[
E[p_i]=\frac{\alpha_i}{\alpha_i+\beta_i},\qquad
\mathrm{Var}(p_i)=\frac{\alpha_i\beta_i}{(\alpha_i+\beta_i)^2(\alpha_i+\beta_i+1)}.
\]
The key informativeness score is the posterior expected Bernoulli variance,
\[
q_i:=E[p_i(1-p_i)]
=\frac{\alpha_i\beta_i}{(\alpha_i+\beta_i)(\alpha_i+\beta_i+1)}.
\]
Because \(p(1-p)\) is maximized at \(p=1/2\) and vanishes at \(p\in\{0,1\}\), this score prioritizes medium-difficulty prompts; as evidence accumulates, \(q_i\) decreases, thereby encoding diminishing returns.

With temperature \(\eta>0\), CERO constructs the prompt utility
\[
U_i(n)=1-\exp(-\eta q_i n)=1-\exp(-c_i n),\qquad c_i:=\eta q_i,
\]
whose marginal utility is
\[
U_i'(n)=c_i\exp(-c_i n).
\]
In implementation, \(q_i\) is replaced by an epoch-wise posterior estimate \(q_{k,i}\). The resulting global problem is
\[
\max \sum_{i=1}^M \left[1-\exp\!\left(-\eta q_i \sum_{k=1}^K N_{i,k}\right)\right]
\]
subject to
\[
\sum_{i=1}^M \sum_{k=1}^K N_{i,k}\le B,\qquad 0\le N_{i,k}\le \bar N.
\]
Because utility depends on cumulative allocations across epochs, the objective is temporally nonseparable.

CERO handles this nonseparability through a Fenchel-dual reformulation. For
\[
U_i(n)=1-\exp(-c_i n),
\]
the concave conjugate is
\[
U_i^*(\theta)=\inf_{s\ge 0}\{s\theta-U_i(s)\}
\]
with closed form, for \(\theta\in[0,c_i]\),
\[
U_i^*(\theta)=\frac{\theta}{c_i}\log\!\left(\frac{c_i}{\theta}\right)+\frac{\theta}{c_i}-1,
\qquad
\nabla U_i^*(\theta)=\frac{1}{c_i}\log\!\left(\frac{c_i}{\theta}\right).
\]
Introducing prompt-level dual variables \(\theta_i\) and a budget dual variable \(\mu\), the dual objective decomposes into identical per-epoch subproblems,
\[
L(\theta,\mu)=\frac{B}{K}\mu+\max_{n_i\in[0,\bar N]}\sum_i(\theta_i-\mu)n_i-\frac{1}{K}\sum_i U_i^*(\theta_i).
\]
The allocation rule is a threshold policy:
\[
N_{i,k}=\bar N \text{ if } \theta_i^k>\mu^k,\quad \text{and } 0 \text{ otherwise,}
\]
clipped by the remaining budget. CERO thus acts as a drop-in data-collection layer on top of GRPO-style policy optimization rather than changing the GRPO objective itself.

## 3. Theory, implementation, and empirical behavior in RL post-training

Under fixed prompt utilities, CERO proves regret against the offline allocation benchmark. If \(\mathrm{OPT}\) denotes the offline optimum and \(\mathrm{ALG}\) the achieved utility, the regret is
\[
\mathrm{Reg}=\mathrm{OPT}-\mathrm{ALG}.
\]
With projected online gradient descent on compact domains and bounded gradients,
\[
\mathrm{Reg}\le \mathrm{Reg}_\theta(K)+\mathrm{Reg}_\mu(K)=O(\sqrt{K}).
\]
The prompt-level update is
\[
\theta_i^{k+1}=\left[\theta_i^k-\eta_\theta\left(N_{i,k}-\frac{1}{K}\nabla U_i^*(\theta_i^k)\right)\right]_+,
\]
and the budget-level update is
\[
\mu^{k+1}=\left[\mu^k-\eta_\mu\left(\frac{B_k}{K}-\sum_i N_{i,k}\right)\right]_+.
\]
The analysis assumes fixed \(q_i\), closed and concave \(U_i\), compact projection domains, and bounded supergradients.

The implementation uses Beta\((1,1)\) priors, maintains \(\theta_i^k \in [\epsilon,c_{k,i}]\) and \(\mu^k\in[0,\bar\mu]\), and triggers a GRPO policy update when the rollout buffer reaches size \(B_{\text{batch}}\). Per epoch, allocation and dual updates cost \(O(M)\), posterior maintenance costs \(O(1)\) sufficient statistics per prompt, and total memory is \(O(M)\). The reported practical overhead is less than \(1\) second per allocation update.

The empirical study uses DeepSeek-R1-Distill-Qwen-1.5B, Qwen3-4B-Base, Qwen3-4B-Instruct, and Qwen2.5-Math-7B, trained on DAPO-Math-17K with \(17{,}917\) training prompts in the `verl` framework for \(500\) optimization steps. The average rollout count is \(N=8\), the per-epoch cap is \(\bar N=16\), and hardware is H800 GPUs: the 1.5B and 4B models use 4 GPUs, the 7B model uses 8 GPUs, with approximate GPU hours of \(90\), \(170\), and \(200\), respectively. Evaluation is on AIME24, AIME25, AIME26, and AMC23 using accuracy as pass rate. Against vanilla GRPO with fixed per-prompt rollout budget, CERO improves the average across all four benchmarks for every model–benchmark pair [2606.05606].

| Model | Avg accuracy GRPO \(\rightarrow\) CERO | Improvement |
|---|---|---|
| R1-Distill-1.5B | \(0.2200 \rightarrow 0.2684\) | \(+4.84\) points |
| Qwen3-4B-Base | \(0.2241 \rightarrow 0.2845\) | \(+6.04\) points |
| Qwen3-4B-Instruct | \(0.4683 \rightarrow 0.5011\) | \(+3.28\) points |
| Qwen2.5-Math-7B | \(0.2913 \rightarrow 0.3066\) | \(+1.53\) points |

A central diagnostic is the **effective prompt ratio**, defined as the fraction of prompts whose rollout groups contain both successes and failures, yielding nonzero within-group reward variance and hence nonzero GRPO gradients. The reported observation is that GRPO’s effective prompt ratio collapses later in training, whereas CERO maintains a higher ratio by reallocating budget away from exhausted or hopeless prompts. This is presented as the mechanism sustaining useful training signal and explaining the performance gains.

## 4. CERO as the Circular Energy-Recovery Option/Collider

In accelerator physics, CERO is the generic concept of an \(e^+e^-\) collider built in a large circular tunnel that uses energy-recovery linacs instead of storage rings. The paper on the **Circular Energy Recovery Collider** treats CERC as a concrete realization of this generic CERO idea in a \(\sim 100\) km tunnel. Its defining features are simultaneous energy recovery and particle recycling, very high luminosity at moderate wall-plug power, and extension of center-of-mass energy to \(500\)–\(600\) GeV with polarized \(e^\pm\) beams [2203.07358].

The topology places two superconducting ERLs in the same \(\sim 100\) km tunnel used for recirculation arcs. Beams make four passes through the linacs and arcs, accelerating to collision energy, colliding at the interaction region, then being phase-shifted by half an RF period and decelerated through the same linacs. After deceleration, both electrons and positrons are reinjected into damping rings for particle recycling and emittance cooling. Lost particles are replenished from compact injectors, so most particles are recycled cycle-to-cycle. To fit the damping rings’ momentum acceptance and minimize IBS, bunches are compressed during low-energy passes and decompressed at the end of the deceleration cycle before ring reinjection; decompression factors up to \(\sim 15\) at top energies reduce accumulated energy spread to the \(\pm 5\%\) damping-ring acceptance. Damping-ring energies are \(2\) GeV for top beam energies \(\le 120\) GeV, \(3\) GeV at \(182.5\) GeV, \(4.5\) GeV at \(250\) GeV, and \(8\) GeV at \(300\) GeV.

The synchrotron-radiation energy loss per turn is written as
\[
U_0=\frac{C_\gamma}{2\pi}\frac{E^4}{\rho},
\qquad C_\gamma=8.846\times 10^{-5}\ \mathrm{m/GeV^3},
\]
and the corresponding storage-ring SR power is
\[
P_{\mathrm{SR}}=U_0 \times I/e.
\]
In CERC, SR losses are summed over recirculation passes through the arcs. The design caps total SR at about \(30\) MW for both beams, approximately \(15\)–\(17\) MW per beam depending on energy; SR energy is not recovered, but acceleration energy is recovered in the linacs. The claimed consequence is a large reduction in site AC power relative to storage rings, with CERC AC power lower by about \(100\) MW across the energy range. The paper lists total RF-to-beam, magnet, and cryogenic AC powers at several operating points: at Z (\(45.6\) GeV per beam), approximately \(31.7\) MW RF-to-beam, \(2.0\) MW magnets, and \(6.25\) MW cryo AC; at \(t\bar t\) (\(182.5\) GeV), \(37.2\) MW RF-to-beam, \(32.0\) MW magnets, and \(28.75\) MW cryo AC; at HH (\(250\) GeV), \(40.2\) MW RF-to-beam, \(60.1\) MW magnets, and \(42.5\) MW cryo AC; and at \(ttH\) (\(300\) GeV), \(43.4\) MW RF-to-beam, \(86.6\) MW magnets, and \(56.25\) MW cryo AC. The RF system assumes \(703\) MHz BNL-3 five-cell cavities, \(Q_0 \approx 1\times 10^{10}\), \(16\)-m cryomodules with \(10\) cavities each, a \(58.8\%\) accelerating-field filling factor, and HOM loss factors of \(0.16\) V/pC for \(\sigma_z=30\) mm and \(0.12\) V/pC for \(\sigma_z=50\) mm. The total HOM power is reported as \(\le 250\) kW and \(\le 160\) W per absorber.

The \(100\)-km arcs use a regular FODO lattice with combined-function magnets, zero-chromaticity cells, strong sextupole components, and small magnet gaps of about \(15\) mm. The cell period is about \(16\) m, with two \(\sim 7.6\) m combined-function magnets and \(\sim 0.4\) m drifts. At top energy, the dipole field is about \(0.0551\) T, quadrupole gradients are \(\pm 32.24\) T/m, and sextupole components are \(SF \approx +267\) T/m and \(SD \approx -418\) T/m. The small gaps are used to reduce magnet power; for the \(16\) beam lines, the paper states that magnet consumption is about half that of storage-ring magnets in FCC-ee.

Luminosity is expressed as
\[
L=\frac{N_b f_{\mathrm{coll}} N_e N_p}{4\pi \sigma_x \sigma_y}\,H_D,
\]
or, at fixed beam current, as \(L \propto I \times \xi_y/\beta_y^*\). The machine design employs very small \(\beta^*\) values and micron-scale vertical beam sizes, together with large disruption parameters and beam pinch. Reported disruption parameters span approximately \(D_h \approx 0.3\)–\(2.2\) horizontally and \(D_v \approx 459\)–\(584\) vertically, with strong–strong collision simulations indicating acceptable emittance growth, limited to about \(4\times\) in the vertical plane for selected \(D\) values. Predicted luminosities, in units of \(10^{35}\ \mathrm{cm^{-2}\ s^{-1}}\), are approximately \(6.7\) at Z, \(8.7\) at W, \(7.8\) at HZ, \(2.8\) at \(t\bar t\), \(1.3\) at HH, and \(0.9\) at \(ttH\). Corresponding bunch charges are \(13\)–\(25\) nC, bunch frequencies range from \(297\) kHz at Z to \(16\) kHz at HH, and beam current per beam decreases from about \(3.71\) mA at Z to \(0.16\) mA at \(ttH\).

A major design claim is the combination of energy reach and polarization. The machine is presented as extending practical operation to \(500\) GeV for \(e^+e^- \to ZHH\) and to \(600\) GeV for \(e^+e^- \to ttH\). The paper states that at \(500\) GeV CERC can deliver integrated luminosity of about \(1.5\ \mathrm{ab}^{-1}/\mathrm{year}\) even at about \(30\%\) of the power of a conventional SR-based collider. Polarization is tied to continuous production and recycling of particles through damping rings; ZGOUBI simulations on the proposed lattice report depolarization below \(0.1\%\) per full path. MadGraph estimates in the paper give cross-section enhancement factors relative to the unpolarized case: for \(P_{e^-}=-70\%\), \(P_{e^+}=+70\%\), \(ZH\) scales by \(1.78\), \(ZHH\) by \(1.79\), and \(ttH\) by \(2.07\); for \(P_{e^-}=-70\%\), \(P_{e^+}=+50\%\), the factors are \(1.61\), \(1.61\), and \(1.87\); and for \(P_{e^-}=-70\%\), \(P_{e^+}=0\%\), they are \(1.15\), \(1.15\), and \(1.23\).

## 5. CERO as absolute zero and the zero isotherm

In the thermodynamic paper, “CERO” is read as **absolute zero**, the **zero isotherm** \(T=0\). The central result is a purely thermodynamic proof of the Nernst heat theorem derived from the second law, without assuming vanishing specific heats or unattainability of \(T=0\) as a premise [2401.04069].

The formal statement is that for any two equilibrium states \(1\) and \(2\) of a chemically homogeneous finite-density system that are isothermal at temperature \(T\),
\[
\lim_{T\to 0}\,[S_2(T)-S_1(T)]=0.
\]
Equivalently, for mechanical variables \(x\),
\[
\lim_{T\to 0} S(T,x)=S_0,
\]
where \(S_0\) is a constant independent of \(x\). The proof starts from the second law in Planck form and uses the Carnot theorem as the constructive bridge to temperature:
\[
\frac{T_c}{T_h}=-\frac{\mathsf Q_c}{\mathsf Q_h},
\qquad
\mathsf W=(\Delta S)_T\,(T_h-T_c),
\qquad
(\Delta S)_T=\frac{\mathsf Q_h}{T_h}=-\frac{\mathsf Q_c}{T_c}.
\]
The Clausius inequality is
\[
\oint \frac{\delta Q}{T}\le 0,
\]
with equality for reversible cycles.

The key logical step is that \(T_c=0\) in the Carnot relation implies \(\mathsf Q_c=0\). If a reversible engine operating with a \(T_c=0\) cooler had any nonzero heat intake from the hot reservoir, then it would raise a weight while cooling only the hot reservoir, contradicting the second law. Consistency therefore requires
\[
T_c=0 \Longrightarrow \mathsf Q_c=0 \ \text{and}\ \mathsf Q_h=0,
\]
and hence the isothermal entropy change at zero temperature must vanish:
\[
(\Delta S)_{T=0}=0.
\]
By universality of the Carnot theorem, this conclusion does not depend on the working substance or on its mechanical or chemical configuration.

Standard thermodynamic continuity then yields
\[
\lim_{T\to 0}\left[S(T,x_2)-S(T,x_1)\right]=0,
\]
and therefore
\[
\lim_{T\to 0}\left(\frac{\partial S}{\partial x}\right)_T=0.
\]
At \(T=0\), entropy is thus independent of mechanical coordinates,
\[
S(0,x)\equiv S_0.
\]
Using Maxwell relations,
\[
\left(\frac{\partial S}{\partial V}\right)_T=\left(\frac{\partial p}{\partial T}\right)_V,
\qquad
\left(\frac{\partial S}{\partial p}\right)_T=-\left(\frac{\partial V}{\partial T}\right)_p,
\]
the proof implies, as \(T\to 0\),
\[
\left(\frac{\partial p}{\partial T}\right)_V \to 0,
\qquad
\left(\frac{\partial V}{\partial T}\right)_p \to 0,
\]
and similarly for other generalized variables. This is the usual differential form of the Nernst theorem.

The paper explicitly states that the argument does **not** assume \(C_x(T)\to 0\), and does **not** assume unattainability of \(T=0\). Instead, unattainability is obtained as a corollary: since for any \(T>0\),
\[
S(T,x)>S(0,x)=S_0,
\]
adiabatic entropy cannot decrease, so adiabatic cooling cannot reach \(T=0\). The remaining independent content of the third law is narrowed to the assertion that the entropy of a finite-density, chemically homogeneous body must not be negative. One may then choose the absolute entropy scale so that
\[
S_0\equiv \lim_{T\to 0}S(T,x)=0,
\]
which yields the common third-law convention.

The conditions of validity are explicit: the proof assumes internal equilibrium, chemical homogeneity, finite density, and existence of the usual thermodynamic derivatives in the low-temperature limit. It excludes cases such as phase coexistence, metastability, or frozen-in disorder at \(T\to 0\), since these would invalidate reversibility or uniqueness of the equilibrium state. On this basis, residual entropy is not treated as a counterexample within the theorem’s scope; rather, it is associated with systems outside the proof’s assumptions.

## 6. Conditions, limitations, and domain-specific significance

For RL post-training, CERO’s theoretical guarantee is proved for fixed prompt utilities, meaning fixed \(q_i\), whereas the implementation updates \(q_{k,i}\) online. The paper therefore states that the regret bound does not fully capture the nonstationarity introduced by policy changes. It also notes that misspecified priors or rapidly drifting task difficulty can transiently misallocate budget, and that very large \(M\) increases dual-memory linearly. At the same time, the framework is situated within a broader literature on rollout optimization, including sample selection, within-batch reallocation, and post-generation filtering, and is linked conceptually to bandits with knapsacks and online convex optimization with long-term constraints [2606.05606].

For collider design, the cited work states that no show-stoppers have been identified for a next-generation polarized \(e^+e^-\) collider based on ERLs and particle recycling, but it also makes the dependence on R&D explicit. The outstanding items include SRF cavity performance at \(703\) MHz, realistic multi-pass BBU studies, damping-ring optics with \(\pm 5\%\) momentum acceptance, polarized positron source and ring injection, full beam-beam and beamstrahlung simulations, small-gap combined-function magnet prototyping, and refined system-level power integration. The proposed staging path runs from Z/W/Higgs energies through \(t\bar t\) and then to HH and \(ttH\), while keeping total SR at about \(30\) MW [2203.07358].

For thermodynamics, the proof’s significance lies in relocating the Nernst heat theorem from a postulate about unattainability or low-temperature heat capacities to a consequence of second-law consistency plus the Carnot theorem. Its limitations are exactly those stated in the paper: internal equilibrium, chemical homogeneity, finite density, and regular low-temperature thermodynamic derivatives. Statistical and quantum proofs instead appeal to spectral properties such as ground-state structure; this thermodynamic proof does not. Residual entropy, where present, is interpreted as a sign of frozen-in disorder, metastability, or broken homogeneity rather than as a failure of the theorem within its domain of validity [2401.04069].

Taken together, the cited literature uses **CERO** for three technically unrelated but individually precise constructs: an adaptive rollout-budgeting method with a Fenchel-dual online primal–dual algorithm and \(O(\sqrt{K})\) regret under fixed utilities; a circular ERL-based \(e^+e^-\) collider concept with simultaneous energy and particle recovery, polarized beams, and operation up to \(500\)–\(600\) GeV; and the zero isotherm \(T=0\), through which the Nernst heat theorem is derived from the second law.

Source: https://www.emergentmind.com/topics/cero