---
title: 'QuasiMoTTo: QMC Test-Time Scaling'
url: https://www.emergentmind.com/topics/quasimotto
type: topic
---

# QuasiMoTTo: QMC Test-Time Scaling

Searching arXiv for the specified paper and closely related references.
Tool call: arxiv_search(query="2607.01179", max_results=5)
QuasiMoTTo, short for **Quasi-Monte Carlo Test-Time Scaling**, is a sampling method for autoregressive language models that replaces i.i.d. rollouts with **correlated but exact samples entirely in parallel**. The method is motivated by the observation that default test-time scaling and policy-gradient RL generate many parallel attempts per problem, yet independent sampling often wastes inference compute on redundant solutions because the model distribution is highly peaked. QuasiMoTTo addresses this inefficiency by reparameterizing autoregressive sampling as inverse-CDF sampling and drawing the underlying uniforms with quasi-Monte Carlo (QMC), so that the resulting samples cover the output space with far less redundancy while preserving the correct marginal distribution under the language model [2607.01179].

## 1. Problem setting and redundancy under i.i.d. sampling

In both **test-time scaling** and **policy-gradient RL**, the default procedure is to draw $k$ i.i.d. rollouts from the model $\pi_\theta$. The central problem identified for this regime is that independent samples can **“clump” on the same high-probability modes**. When $\pi_\theta$ places substantial mass on a few regions, many of the $k$ samples repeat closely related solution paths, so the batch covers the output space inefficiently.

The standard intuition is expressed by the i.i.d. pass@k relation
$$
\mathrm{pass@}k = 1-(1-p)^k,
$$
where $p=\mathrm{pass@}1$. For small $p$, this grows slowly. The same setting admits a general upper bound for any sampler that preserves the single-sample marginals:
$$
P(k)\equiv \Pr[\ge 1\ \mathrm{success\ in}\ k\ \mathrm{rolls}] \le \min\{1,kp\}.
$$
The paper describes this as a **union-bound ceiling** and argues that i.i.d. sampling generally falls strictly below that linear ceiling, leaving room for improvement by introducing dependence across samples [2607.01179].

This framing is significant because it treats **correlation** not as a liability but as a degree of freedom. The usual reason to insist on independence is that it makes parallel sampling trivial to scale. QuasiMoTTo instead explores samplers that remain embarrassingly parallel while deliberately reducing within-batch redundancy.

## 2. Autoregressive sampling as inverse-CDF sampling

QuasiMoTTo relies on a reparameterization of autoregressive generation in which a full sequence $x=(x_1,\dots,x_T)$ corresponds to a sub-interval
$$
I(x)\subset [0,1),\qquad |I(x)|=\pi_\theta(x)=\prod_{t=1}^T \pi_\theta(x_t\mid x_{<t}).
$$
Under this view, sampling $x\sim \pi_\theta$ is equivalent to drawing $u\sim \mathrm{Unif}[0,1]$ and identifying the unique interval $I(x)$ that contains $u$.

At token level, the decoding step is written as
$$
x_t = F_t^{-1}(u_t \mid x_{<t}),
$$
where
$$
F_t(v\mid x_{<t})=\sum_{v'\le v}\pi_\theta(v'\mid x_{<t}).
$$
After selecting the token, the uniform is rescaled according to
$$
u_{t+1} = \frac{u_t-\ell_t}{p_t},
\qquad
\ell_t=\text{lower endpoint of the chosen bin},
\qquad
p_t=\pi_\theta(x_t\mid x_{<t}).
$$
At the end, $u_{T+1}\in [0,1)$ is discarded.

The key structural claim is that each $u_1\mapsto x$ is a **one-to-one, measure-preserving map**, so if $u_1\sim \mathrm{Unif}[0,1]$ then $x\sim \pi_\theta$ exactly [2607.01179]. This is what allows QuasiMoTTo to modify the joint law of a batch of uniforms without changing the marginal law of each decoded sample.

## 3. QMC construction and the QuasiMoTTo sampler

Rather than draw $k$ independent uniforms, QuasiMoTTo uses QMC to construct dependent $\{u_i\}$ whose empirical distribution remains uniform but which **“repel” one another** and cover $[0,1]$ more evenly. The paper highlights three examples.

| Sampler | Construction | Property emphasized |
|---|---|---|
| Lattice | $u_i = (\Delta + (i-1)/k)\ \mathrm{mod}\ 1,\ \Delta\sim \mathrm{Unif}[0,1]$ | Random shift of a regular grid |
| Stratified | One uniform per stratum $[(i-1)/k,i/k]$ plus a random permutation | Uniform marginals with stratification |
| Sobol (token-level) | $d$-dimensional points $u_i\in[0,1]^d$ with low star-discrepancy | Low-discrepancy coverage across coordinates |

For Sobol, the discrepancy notion is
$$
D^*(\{u_i\}) = \sup_{\text{rectangles }R\text{ anchored at }0}
\left|\frac{\#\text{ points in }R}{k} - \mathrm{volume}(R)\right|.
$$
The paper states that $d$ can be the max sequence length, and coordinate $t$ is decoded with the $t$th inverse-CDF.

Once the QMC uniforms are obtained, each rollout decodes independently in $O(T)$ time and **never communicates again**. The procedure is therefore still parallel at the rollout level. The essential substitution is simple: QMC generates a low-discrepancy batch of uniforms, and the inverse-CDF autoregressive decoder pushes those uniforms through the language model to produce a batch of **exact $\pi_\theta$-samples** with higher coverage than i.i.d. sampling [2607.01179].

A plausible implication is that QuasiMoTTo occupies a middle ground between two objectives that are often treated as incompatible: exactness of the marginal distribution and deliberate diversification of the batch.

## 4. Estimation, upper bounds, and coverage diagnostics

A technical complication of correlated sampling is that dependence breaks the standard i.i.d. pass@k estimator. For i.i.d. sampling, if $N\ge k$ samples contain $c$ successes, the unbiased estimator due to Chen et al. (2021) is
$$
\widehat{\mathrm{pass@}k}
=
1-\frac{C(N-c,k)}{C(N,k)}.
$$
The paper states directly that **this formula breaks under dependent samples**.

For lattice QMC with $k=2^L$, the paper develops a **dyadic bootstrap** estimator. If
$$
u_i=(\Delta+i/k)\ \mathrm{mod}\ 1,\qquad i=0,\dots,k-1,
$$
then for any $x\le L$ and any $r\in\{0,\dots,2^x-1\}$, the stride-$2^x$ subsequence
$$
\{u_{r+j2^x}\}_{j=0}^{m-1},\qquad m=k/2^x,
$$
is distributed as a fresh $m$-point lattice. This allows pass@$m$ to be estimated on the same batch by splitting into disjoint subsequences, computing pass@$m$ on each, and averaging. The result is described as an **unbiased estimator of pass@$m$ under the lattice QMC joint law** [2607.01179].

The paper also formalizes the best possible success rate for any marginal-preserving sampler:
$$
\mathrm{pass@}k \le \min\{1,kp\}.
$$
No marginal-preserving sampler can exceed that linear-in-$k$ ceiling.

Coverage and redundancy are assessed through several diagnostics rather than a single scalar metric:

- **pass@k relative to the linear ceiling**;
- **count of “distinct solution chains”**;
- in RL, the **fraction of “zero-variance groups”**, meaning groups where all $k$ rollouts have identical reward.

The paper additionally notes that one can quantify average pairwise mutual information $I(U_i;U_j)$: i.i.d. gives $0$, stratified gives $\log(k/(k-1))$, and lattice gives $\infty$ because of full determinism given one point. In the exposition, **higher $I$ means stronger repulsion and higher coverage in $[0,1]$**. This suggests that dependence is being used as an explicit resource for coverage optimization rather than merely tolerated as an implementation artifact.

## 5. Empirical performance on reasoning benchmarks

The empirical study evaluates QuasiMoTTo on four reasoning benchmarks:

| Benchmark | Task description |
|---|---|
| Countdown | Arithmetic target from numbers |
| Maze | 2D grid, output a path U/D/L/R |
| Sudoku | 9×9 fill-in |
| 1D-ARC | Abstract sequence transformations |

Across all four tasks, **lattice-based QuasiMoTTo** is reported to lie above i.i.d. pass@k and to **nearly saturate the linear ceiling**. The reported averages over problems include two explicit operating points:

- **At $k=16$**: i.i.d. pass@16 $\approx 0.45$, QuasiMoTTo $\approx 0.60$, ceiling $\approx 0.62$.
- **At $k=32$**: i.i.d. $\approx 0.60$, QuasiMoTTo $\approx 0.80$, ceiling $\approx 0.88$.

The central sample-efficiency claim is that, to achieve the same pass@k as i.i.d. at a given target level such as $0.60$, **QuasiMoTTo requires 25–47% fewer samples** on these tasks [2607.01179].

These results are presented as evidence that the method does not merely diversify outputs in a superficial sense. The gain is tied specifically to **higher coverage with lower redundancy**, and the comparison to the union-bound ceiling gives a concrete sense of how much of the theoretically available improvement is being realized.

## 6. Integration into policy-gradient RL and compute savings

The same correlated-sampling idea is applied to **policy-gradient RL (GRPO)**. In that setting, for each prompt one collects $G$ rollouts $\{y_i\}$, computes rewards $r_i$, and uses the group-baseline policy gradient
$$
g
=
\frac{1}{G}\sum_{i=1}^G
\left(
r_i-\frac{1}{G-1}\sum_{j\ne i} r_j
\right)
\nabla_\theta \log \pi_\theta(y_i).
$$
Because QuasiMoTTo preserves the marginal $\pi_\theta(y_i)$, the paper states that this estimator **remains unbiased in expectation**, since **any linear-in-marginals estimator is fine**. The within-group rollouts are correlated, but that correlation is reported to produce **higher variance in $\{r_i\}$ and thus stronger learning signal** [2607.01179].

The empirical RL evaluation is conducted on **Maze and Sudoku**, filtered to **“hard but solvable” problems**. The headline result is that QuasiMoTTo trains to the same pass@1 in **roughly 50% fewer gradient steps** than i.i.d. sampling. The paper gives two associated observations:

- **Zero-variance groups** drop from approximately **30% to 10%**.
- Learning curves, plotted as pass@1 versus steps, show the QuasiMoTTo curve rising **twice as fast** as i.i.d.

Within the paper’s framing, the RL benefit and the inference-time benefit share the same mechanism: reducing redundancy within a batch yields either a better chance of encountering a correct solution or a stronger reward contrast for policy-gradient updates.

## 7. Scope, exactness, and terminological boundaries

A defining property of QuasiMoTTo is that it uses correlated samples as a **drop-in replacement for i.i.d. samples** while preserving the correct marginal law of each sample. This is why the same batch can be used for both pass@k-style evaluation and policy-gradient training. The method does not alter $\pi_\theta$ itself; it changes how a finite batch of uniforms is coupled before inverse-CDF decoding. The paper’s **key takeaway** is explicit: **by replacing independent sampling with low-discrepancy QMC sampling plus inverse-CDF decoding, QuasiMoTTo reduces redundancy, boosts coverage, and translates those improvements into both inference compute savings and RL compute savings** [2607.01179].

A possible source of confusion is terminological. The arXiv paper **“Quasi-morphisms on cotangent bundles and symplectic homogenization”** [1104.4928] concerns homogeneous quasi-morphisms on Hamiltonian diffeomorphism groups and symplectic homogenization, not quasi-Monte Carlo test-time scaling. That work belongs to symplectic topology rather than language-model inference. Accordingly, **QuasiMoTTo** in current ML usage refers to the 2026 sampling method, whereas the cotangent-bundle paper is an unrelated mathematical work [1104.4928].

Source: https://www.emergentmind.com/topics/quasimotto