---
title: 'CART-ROSA: Random Opportunity-Set Allocation'
url: https://www.emergentmind.com/topics/cart-random-opportunity-set-allocation-cart-rosa
type: topic
---

# CART-ROSA: Random Opportunity-Set Allocation

Searching arXiv for the cited papers and closely related work to ground the article.
arxiv_search(query="2605.26675", max_results=5)
CART Random Opportunity-Set Allocation (CART-ROSA) is a stochastic-control recasting of feature-subsampled CART random forests in which the random subset of features exposed at each node is treated as a random feasible action set and the CART split rule is treated as a masked-action allocation policy [2605.26675]. In this formulation, tree growth is represented as a finite-horizon controlled stochastic process over split-count states, and the terminal law of that process determines both single-tree error and cross-tree interaction terms in forest mean squared error (MSE). The framework separates two design levers—the informative-opportunity rate induced by feature subsampling and the contraction strength induced by the within-mask split policy—and uses that separation to analyze when local CART behavior aligns, or fails to align, with forest-level risk minimization [2605.26675].

## 1. Formal definition as a masked-action control problem

At tree depth \(t\), CART-ROSA samples a random subset of coordinates
\[
U_t \subseteq [d], \qquad |U_t| = m = \lceil \gamma d \rceil,
\]
uniformly without replacement and independently across depths. The set \(U_t\) is the random opportunity set, or action mask; it specifies which split coordinates are feasible at that node. The chosen split coordinate is the action \(J_t \in U_t\), and the split-count state is
\[
N_t = (N_{t,1},\dots,N_{t,d})^\top, \qquad
N_{t,j} = \sum_{r=1}^t \mathbf 1\{J_r = j\},
\]
with transition
\[
N_t = N_{t-1} + e_{J_t}.
\]
The local CART score is the impurity decrease
\[
\mathcal G(C_{t-1},j)
:=
\sup_{c \in (a_{t-1,j}, b_{t-1,j})}
\mathrm{IMD}_{j,c}(C_{t-1}),
\]
where
\[
\mathrm{IMD}_{j,c}(C)
=
\operatorname{Var}(Y \mid X \in C)
-
\operatorname{Var}(Y \mid X \in C_{j,c;L}) P(X \in C_{j,c;L} \mid X \in C)
-
\operatorname{Var}(Y \mid X \in C_{j,c;R}) P(X \in C_{j,c;R} \mid X \in C).
\]
The greedy CART rule is the masked-action policy
\[
J_t \in A_{gr}(C_{t-1}, U_t) := \arg\max_{j \in U_t} \mathcal G(C_{t-1}, j),
\]
with random tie-breaking [2605.26675].

This representation changes the interpretive unit of analysis. Rather than describing a forest only as a collection of recursively grown trees, it treats each split as a feasible-action choice under a random mask. A plausible implication is that feature subsampling is not merely a regularization device; within CART-ROSA it becomes an explicit source of environmental randomization that shapes the reachable state distribution.

## 2. Opportunity sets, informative time, and state reduction

The paper focuses on informative-respecting policies that prefer informative variables whenever available:
\[
\pi(j \mid C_{t-1}, U_t) = 0, \qquad j \in U_t \cap S^c,
\]
whenever \(U_t \cap S \neq \varnothing\). This is presented as a modeling restriction used to isolate the allocation and stabilization mechanism, not as an exact finite-sample statement about CART [2605.26675].

Under midpoint splits, each split halves the side length along the chosen coordinate, so the branch geometry is determined by the counts \(N_{t,j}\). The count-state reduction is encoded through two assumptions. Assumption 1 states that
\[
\mathcal G(C_{t-1}, j) = g_j(N_{t-1})
\]
for measurable \(g_j\). Assumption 2 states that there exist constants \(\theta_j\) such that, when informative coordinates are available,
\[
A_{gr}(\mathbf n, u)
=
\arg\min_{j \in u^{\inf}} (n_j - \theta_j),
\]
and if no informative coordinate is available, \(A_{gr}(u) = u\). In this reduction, CART becomes a masked-action allocation rule that selects the exposed informative coordinate with the smallest shifted count [2605.26675].

The paper then separates raw time from informative time. It defines
\[
K_t := |U_t \cap S|, \qquad
I_t := \mathbf 1\{K_t \ge 1\}, \qquad
M_t := \sum_{r=1}^t I_r.
\]
Here \(K_t\) is the number of informative coordinates in the mask, \(I_t\) is the indicator of an informative opportunity, and \(M_t\) is the cumulative number of informative opportunities. Since \(U_t\) is a uniform \(m\)-subset,
\[
K_t \sim \mathrm{Hypergeometric}(d,s,m),
\]
and
\[
q := \mathbb P(I_t = 1)
= 1 - \frac{\binom{d-s}{m}}{\binom{d}{m}}.
\]
Thus \(M_t \sim \mathrm{Binomial}(t,q)\) and \(M_t/t \to q\) almost surely [2605.26675].

Informative time is indexed by
\[
T_n := \inf\{t \ge 1 : M_t = n\}, \qquad
J_n^{\inf} := J_{T_n} \in S.
\]
The informative-time count process is
\[
Z_n = (Z_{n,j})_{j \in S}, \qquad
Z_{n,j} = \sum_{u=1}^n \mathbf 1\{J_u^{\inf} = j\},
\]
with dynamics
\[
Z_{n+1} = Z_n + e_{J_{n+1}^{\inf}}.
\]
The connection between raw time and informative time is
\[
N_{t,j} = Z_{M_t,j}, \qquad j \in S.
\]
To quantify imbalance, the paper defines
\[
\Delta_n := Z_n - \frac{n}{s} \mathbf 1_s, \qquad
V_n := \|\Delta_n\|_2^2, \qquad
W_n := \sqrt{V_n}.
\]
For a tree of depth \(\ell\), the terminal raw count vector \(N_\ell\) has law
\[
\nu_{\pi,\ell} := \mathcal L_\pi(N_\ell),
\]
and for a \(B\)-tree ensemble the terminal states are i.i.d. from \(\nu_{\pi,\ell}\) [2605.26675].

## 3. Risk representation and the two design levers

A central contribution of CART-ROSA is an MSE decomposition expressed in terms of terminal split counts. Under the sparse linear midpoint model
\[
Y = X_1\beta_1 + \cdots + X_d\beta_d + \varepsilon, \qquad
X_j \stackrel{i.i.d.}{\sim} \mathrm{Unif}[0,1], \qquad
\varepsilon \perp X, \quad \mathbb E \varepsilon = 0, \quad \operatorname{Var}(\varepsilon) = \sigma_0^2,
\]
with sparsity set \(S = \{j : \beta_j \neq 0\}\), the depth-\(\ell\) single-tree MSE is written in terms of \(N_\ell\), and the forest MSE is written in terms of \(N_\ell\) and an independent copy \(N_\ell'\) [2605.26675].

The paper identifies three terminal-law functionals that govern the decomposition. The single-tree bias term is
\[
\mathbb E[2^{-2N_{\ell,j}}],
\]
the cross-tree bias term is
\[
\mathbb E[2^{-2\max\{N_{\ell,j}, N'_{\ell,j}\}}],
\]
and the cross-tree variance or overlap term is
\[
\mathbb E\!\left[2^{-\|N_\ell - N'_\ell\|_1/2}\right].
\]
This state-to-risk map makes the forest objective depend not only on one-tree terminal geometry but also on the interaction law of two independent terminal states [2605.26675].

The framework isolates two design levers. The first is the informative-opportunity rate
\[
q = \mathbb P(U_t \cap S \neq \varnothing)
= 1 - \frac{\binom{d-s}{m}}{\binom{d}{m}},
\]
which depends only on feature subsampling and governs how often the policy can split on an informative coordinate. At raw time, for \(j \in S\),
\[
\frac{N_{t,j}}{t} \to \frac{q}{s}.
\]
The second is the within-mask contraction strength
\[
\kappa(\pi)
:=
\sup\Bigl\{
\kappa \ge 0 :
\mathbb E_\pi[\Delta_{n,J_{n+1}} \mid \mathcal F_n] \le -\kappa W_n
\ \text{a.s. for all } n
\Bigr\}.
\]
If \(\kappa(\pi) > 0\), the policy is contractive on the informative block. Population CART satisfies \(\kappa(\pi_{gr}) \ge c_* > 0\) under the stated nondegeneracy condition, whereas the exploratory benchmark satisfies \(\kappa(\pi_{ex}) = 0\) [2605.26675].

The separation between \(q\) and \(\kappa\) is structurally important. The paper’s formulation makes \(q\) the parameter controlling how often informative actions are feasible, while \(\kappa\) controls how those opportunities are allocated once they appear. This suggests that feature subsampling and split greediness enter the theory through distinct channels rather than through a single undifferentiated regularization effect.

## 4. Local stabilization and concentration of terminal geometry

The local dynamics of informative imbalance are described exactly. At informative time \(n\),
\[
V_{n+1}
=
V_n + 2\Delta_{n,J_{n+1}} + \Bigl(1 - \frac{1}{s}\Bigr),
\]
and
\[
|W_{n+1} - W_n| \le a, \qquad a = \sqrt{1 - \frac{1}{s}}.
\]
Under the shifted-canonical structure and the nondegeneracy condition
\[
\mathbb P(|U_t \cap S| \ge 2 \mid |U_t \cap S| \ge 1) > 0,
\]
the paper proves a negative-drift lemma: there exists \(c_* > 0\) such that
\[
\mathbb E[\Delta_{n,J_{n+1}} \mid \mathcal F_n] \le -c_* W_n
\quad \text{a.s.}
\]
An admissible choice is
\[
c_* =
s^{-1}(s-1)^{-3/2}
\mathbb E[(K-1)_+ \mid K \ge 1],
\]
where \(K \sim \mathrm{Hypergeometric}(d,s,m)\). Combining the quadratic increment identity with the drift bound yields
\[
\mathbb E[V_{n+1} - V_n \mid \mathcal F_n]
\le -2c_* W_n + a^2
\]
[2605.26675].

Two stabilization results follow. Theorem 1 gives first-order equalization:
\[
\frac{Z_n}{n} \to \frac{1}{s}\mathbf 1_s
\quad \text{a.s.},
\]
and therefore
\[
\frac{N_{t,j}}{t} \to \frac{q}{s}, \qquad j \in S.
\]
Theorem 2 gives exponential compression: for each \(0 < \eta < (4c_*)/a^2\),
\[
\sup_{n \ge 0} \mathbb E e^{\eta W_n} < \infty.
\]
In the paper’s terms, the greedy CART policy is locally stabilizing: it contracts imbalance and concentrates the terminal tree geometry around balanced informative allocations [2605.26675].

The local characterization is sharpened through a Schur-convexity result. Among feasible informative actions, CART minimizes every symmetric strictly Schur-convex function of the post-decision state. In particular, with
\[
\mathfrak L_n(j)
=
\left\|
\widetilde\Delta_n + e_j - \frac{1}{s}\mathbf 1_s
\right\|_2^2,
\]
the greedy rule chooses the action minimizing this local potential. The interpretation offered by the paper is that greedy CART is not only a rule that maximizes one-step impurity decrease; on the informative block it is also a balancing policy [2605.26675].

## 5. Terminal-law optimization and global nonoptimality

CART-ROSA distinguishes sharply between local stabilization and global forest optimality. The paper’s argument is that the forest MSE depends on the entire terminal law \(\nu_{\pi,\ell}\), including two-tree interaction terms, whereas greedy CART is defined by one-step impurity maximization. Consequently, a locally stabilizing action can still be globally suboptimal for the ensemble objective [2605.26675].

To formalize this distinction, the paper introduces the terminal-law objective
\[
\mathcal J_{\ell,B}^{\Phi,\Psi}(\pi)
=
\frac{1}{B}\mathbb E_{\nu_{\pi,\ell}}[\Phi(N_\ell)]
+
\frac{B-1}{B}
\mathbb E_{\nu_{\pi,\ell}\otimes\nu_{\pi,\ell}}[\Psi(N_\ell, N_\ell')],
\]
together with the marginal terminal cost
\[
\Gamma_{\nu}^{\Phi,\Psi}(\mathbf n)
=
\frac{1}{B}\Phi(\mathbf n)
+
\frac{B-1}{B}
\int
\{\Psi(\mathbf n, \mathbf n') + \Psi(\mathbf n', \mathbf n)\}
\, d\nu(\mathbf n').
\]
The Bellman optimality condition implies that if a terminal law is locally optimal, the induced policy must choose actions minimizing the continuation value associated with this marginal terminal cost. This yields a Bellman certificate for nonoptimality: if there exists any reachable state-mask event on which greedy CART assigns positive probability to an action \(j\) while another feasible action \(k\) has strictly smaller marginal continuation value, then greedy CART is not even a local minimizer of the terminal-law objective [2605.26675].

The paper provides an explicit counterexample with
\[
d=6, \quad S=\{1,2\}, \quad m=4, \quad \ell=2, \quad
\beta_1=\beta_2=1, \quad \sigma_0^2 = 0,
\]
and shows that for \(B \ge 15\), the greedy CART terminal law is not a local minimizer of the forest objective. The stated conclusion is precise: greedy CART is locally stabilizing, but local stabilization does not imply global optimality for forest MSE [2605.26675].

## 6. Linear-model specialization and relation to adjacent randomized-tree formulations

In the linear specialization
\[
Y = X^\top \beta + \varepsilon, \qquad
X_j \stackrel{i.i.d.}{\sim} \mathrm{Unif}[0,1],
\]
the population CART impurity decrease is explicit:
\[
\mathcal G(C,j)
=
\begin{cases}
\beta_j^2\, 2^{-2N_{t-1,j}}/12, & j \in S,\\
0, & j \in S^c.
\end{cases}
\]
Hence, when an informative coordinate is available,
\[
A_{gr}(N_{t-1}, U_t)
=
\arg\max_{j \in U_t \cap S}
\beta_j^2\, 2^{-2N_{t-1,j}}
=
\arg\min_{j \in U_t \cap S}
\Bigl(N_{t-1,j} - \tfrac12 \log_2(\beta_j^2)\Bigr).
\]
This is the smallest shifted-count rule, and in this setting the shifts are
\[
\theta_j = \frac12 \log_2(\beta_j^2), \qquad j \in S.
\]
Under exponential stabilization, the informative block can be replaced by its balanced proxy in the risk functionals, yielding explicit nonasymptotic bounds in which the single-tree bias decays at rate \((1-q+q4^{-1/s})^\ell\), the cross-tree bias is controlled by a Poisson-kernel functional \(F_{\ell,r}\), and the cross-tree variance is governed by a reduced-dimensional overlap functional \(L_{\ell,d-s+1,r}\) [2605.26675].

The paper contrasts this with an exploratory benchmark policy,
\[
\pi_{ex}(j \mid n,u)
=
\begin{cases}
\frac{1}{|u^{\inf}|}\mathbf 1\{j \in u^{\inf}\}, & u^{\inf} \neq \varnothing,\\[1ex]
\frac{1}{|u|}\mathbf 1\{j \in u\}, & u^{\inf} = \varnothing,
\end{cases}
\]
for which the informative-time counts are multinomial and there is no negative drift:
\[
\mathbb E[\Delta_{n,J_{n+1}} \mid \mathcal F_n] = 0,
\qquad
\sup_n \mathbb E e^{\eta W_n} = \infty \ \text{for all } \eta > 0.
\]
The comparison is used to expose the bias–variance and exploration–exploitation tradeoff: larger \(\kappa\) gives stronger stabilization and better bias decay, smaller \(\kappa\) gives more exploratory behavior and potentially better cross-tree variance, and larger \(q\) increases exposure to informative opportunities [2605.26675].

CART-ROSA is distinct from Optimal Randomized Classification Trees (ORCT), a related but different randomized-tree formulation [2110.11952]. ORCT is a continuous, randomized, oblique-tree optimization model for classification in which each internal node routes an observation left or right with probabilities defined by a continuous CDF,
\[
p_{it}(\mathbf a_{\cdot t}, \mu_t)
=
F\!\left(
\frac{1}{p}\sum_{j=1}^p a_{jt}x_{ij} - \mu_t
\right),
\]
and training minimizes expected misclassification cost over a fixed maximal binary tree [2110.11952]. The formulation includes leaf-class assignment variables \(C_{kt}\), one-class-per-leaf constraints, optional class-coverage constraints, and a continuous nonlinear optimization relaxation that is exact in the sense that there exists an optimal solution with \(C_{kt} \in \{0,1\}\) [2110.11952]. It also proves that, for logistic \(F_\gamma\), the randomized model converges to a deterministic optimal decision tree as \(\gamma \to \infty\) [2110.11952].

The relation between the two frameworks is therefore one of conceptual proximity rather than identity. CART-ROSA is a stochastic-control theory of feature-subsampled CART random forests, centered on random opportunity sets, split-count dynamics, and terminal-law risk. ORCT is a continuous-optimization approach to a single randomized classification tree with soft routing. This suggests a broader family of nonstandard tree analyses in which hard deterministic splitting is replaced either by explicit random routing or by a control-theoretic description of masked action selection, but the two papers address different objects and different optimization questions [2605.26675].

Source: https://www.emergentmind.com/topics/cart-random-opportunity-set-allocation-cart-rosa