---
title: 'BLCE-G: Batched-Feedback Linear Contextual Bandit'
url: https://www.emergentmind.com/topics/blce-g
type: topic
---

# BLCE-G: Batched-Feedback Linear Contextual Bandit

Searching arXiv for BLCE-G and the cited paper to ground the article in current records.
BLCE-G denotes **Batched-Feedback Linear Contextual Bandit with Elimination and G-optimal design**, a rare-update algorithm for linear contextual bandits introduced in “Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter Updates” [2606.00984]. It is designed for settings in which reward feedback can be incorporated into the parameter estimate only at a small number of pre-specified update times, while contexts are still observed online and actions are selected sequentially. The algorithm combines a static update schedule with within-interval, reward-free adaptivity, using near G-optimal design, arm elimination, and greedy action selection. Its central result is minimax-optimal regret, up to polylogarithmic factors, in both the small-$K$ and large-$K$ regimes with only $\mathcal{O}(\log\log T)$ parameter updates [2606.00984].

## 1. Problem setting and rare-update model

BLCE-G is formulated for the linear contextual bandit model with i.i.d. context sets per round. At round $t \in [T]$, the learner observes
\[
\mathcal{A}_t := \{x_{t,1}, \dots, x_{t,K}\} \subseteq \mathbb{R}^d
\]
and selects $x_{t,a_t} \in \mathcal{A}_t$, receiving reward
\[
r_t = \langle x_{t,a_t}, \theta^* \rangle + \eta_t,
\]
where $\theta^* \in \mathbb{R}^d$ is unknown and $\eta_t$ is independent 1-subgaussian noise [2606.00984]. The standing assumptions are $\|x\|_2 \leq 1$ for all $x \in \mathcal{A}_t$ and $\|\theta^*\|_2 \leq 1$.

The performance criterion is cumulative expected regret,
\[
\mathcal{R}(T) := \mathbb{E}\!\left[\sum_{t=1}^T \bigl(\langle x_t^*, \theta^*\rangle - \langle x_{t,a_t}, \theta^*\rangle \bigr)\right],
\]
where $x_t^* \in \argmax_{x \in \mathcal{A}_t} \langle x, \theta^* \rangle$ [2606.00984]. The analysis distinguishes a **small-$K$** regime, $K \leq \mathcal{O}(e^d)$, from a **large-$K$** regime, $K \geq \Omega(e^d)$.

A defining feature of BLCE-G is the distinction between **rare parameter updates** and **strictly batched** operation. Batched feedback partitions the horizon into intervals and reveals rewards only at interval endpoints. Strictly batched methods additionally prohibit within-interval context adaptivity: the action rule inside an interval cannot depend on the realized sequence of contexts and actions in that interval, beyond the current round’s context. BLCE-G does **not** impose that restriction. It permits reward-free, within-interval updates such as Gram-matrix maintenance and elimination-set updates, while restricting reward-dependent parameter recomputation to interval boundaries [2606.00984]. This separation is operationally important because it preserves online responsiveness without frequent regression updates.

## 2. Static schedule and interval structure

BLCE-G uses a static grid with a minimal number of parameter updates, explicitly designed to be $\mathcal{O}(\log\log T)$ [2606.00984]. The first interval length is
\[
\mathcal{T}_1 = \left\lceil \frac{\sqrt{T}}{\log_2\log_2 T} \right\rceil + 1.
\]
For intervals $\ell \ge 2$, rounds are split into three phases with counts proportional to terms involving $c^2$, $c(1-c)$, and $(1-c)$, and the interval lengths grow rapidly, yielding few updates overall. The paper proves that the total number of intervals $B$ satisfies
\[
B \leq 3 \log_2\log_2T + 1,
\]
which implies interval complexity $\mathcal{O}(\log\log T)$ [2606.00984].

Within each interval, BLCE-G divides action selection into exploration and exploitation sub-phases. The algorithm first uses a near G-optimal design phase, then an informative-direction phase, and finally a greedy phase. This schedule couples fast growth of interval lengths with progressively lower uncertainty, so that later greedy actions can exploit accumulated information without requiring frequent reward-driven re-estimation.

This suggests that BLCE-G is designed around a computational asymmetry: regression updates are treated as scarce, but matrix and set operations based only on observed contexts remain admissible online. That viewpoint is explicit in the paper’s rare-update formulation and is a practical distinction from strictly batched methods [2606.00984].

## 3. Online state, ridge updates, and elimination

BLCE-G maintains an inverse design matrix online within each interval using the Sherman–Morrison update
\[
H_t^{-1} \gets H_{t-1}^{-1} - \frac{H_{t-1}^{-1}x_{t,a_t}x_{t,a_t}^\top H_{t-1}^{-1}}{1 + x_{t,a_t}^\top H_{t-1}^{-1}x_{t,a_t}}.
\]
The matrix is initialized as $H_0 \gets \lambda I$, and for BLCE-G the regularization is set to $\lambda = \log(dT)$ [2606.00984].

At the end of interval $\ell$, BLCE-G performs a ridge-regression update:
\[
V_\ell^{-1} \gets H_{\mathcal{T}_\ell}^{-1},\quad
\hat{\theta}_{\ell} \gets V_\ell^{-1} \sum_{t=\mathcal{T}_{\ell-1}+1}^{\mathcal{T}_\ell} r_tx_{t,a_t},\quad
H_{\mathcal{T}_\ell} \gets \lambda I .
\]
Thus the parameter estimate is recomputed only at interval boundaries, while the inverse Gram matrix is updated continuously inside intervals [2606.00984].

Elimination uses the past estimates $\hat{\theta}_1,\dots,\hat{\theta}_{\ell-1}$. For stage $k$,
\[
x_{t}^{(k)} \gets \arg\max_{x \in \mathcal{A}_t^{(k-1)}}\langle x, \hat{\theta}_{k}\rangle,
\]
and
\[
\mathcal{A}_t^{(k)} \gets \left\{x \in \mathcal{A}_t^{(k-1)} \,\bigg|\, \langle \hat{\theta}_k, x_{t}^{(k)} - x \rangle \leq 2\varepsilon_{t,k} \right\}.
\]
The elimination mechanism prunes arms that are demonstrably suboptimal under confidence-controlled comparisons while preserving the optimal arm on the good event established in the analysis [2606.00984].

The confidence radii are
\[
\beta_{t, \ell}^{(1)}(\delta) \coloneqq \sqrt{2\log\bigg(\frac{2|\mathcal{A}_{t}^{(\ell-1)}|(B-1)T}{\delta}\bigg)} + \sqrt{\lambda},
\]
\[
\beta_{t,\ell}^{(2)}(\delta) \coloneqq 2\sqrt{\log\bigg(\frac{2^{6d-3}\pi d(B-1)^2}{15^{d-1}\delta^2}\bigg)} +2\sqrt{\lambda},
\]
and
\[
\varepsilon_{t,\ell}(\delta) \coloneqq \max_{y \in \mathcal{A}_{t}^{(\ell-1)}}\|y\|_{V_\ell^{-1}} \cdot \Big(\beta_{t,\ell}^{(1)}(\delta) \wedge \beta_{t, \ell}^{(2)}(\delta) \Big).
\]
These bounds derive from self-normalized concentration and furnish uniform control over post-elimination arm sets [2606.00984].

## 4. Near G-optimal design and phase-wise action selection

The most distinctive component of BLCE-G is its near G-optimal design phase. For any arm set $X \subset \mathbb{R}^d$, the paper establishes the existence of a design distribution $\mathcal{K}_X$ supported on $X$ such that
\[
\max_{x\in X} x^\top\big(\mathbb{E}_{z \sim \mathcal{K}_{X}} [zz^\top]\big)^{-1}x \leq 2d,
\]
and such a design can be computed in time $\mathcal{O}(Kd^3)$ [2606.00984]. In BLCE-G, this distribution is denoted $\pi_{G'}$, and the algorithm samples
\[
x_{t,a_t} \sim \pi_{G'}(\mathcal{A}_t^{(\ell-1)})
\]
during the first fraction of each interval.

The phase-wise selection rules are compactly summarized below.

| Phase | Action rule | Role |
|---|---|---|
| Near G-opt phase | sample $x_{t,a_t} \sim \pi_{G'}(\mathcal{A}_t^{(\ell-1)})$ | covariance control |
| Informative-direction phase | pick $x_{t,a_t} \in \arg\max_{x \in \mathcal{A}_t^{(\ell-1)}}\|x\|_{H_{t-1}^{-1}}$ | uncertainty-guided exploration |
| Greedy phase | pick $x_{t,a_t} \in \arg\max_{x \in \mathcal{A}_t^{(\ell-1)}}\langle x, \hat{\theta}_{\ell-1}\rangle$ | exploitation |

The informative-direction phase selects the arm with maximal self-normalized uncertainty score $\|x\|_{H_{t-1}^{-1}}$, which is the quantity controlled by the elliptical potential argument in the regret proof [2606.00984]. The greedy phase then exploits the latest available estimate.

The conceptual division is precise. The near G-optimal phase controls worst-case variance across directions in the surviving arm set; the informative-direction phase sharpens estimation in directions that remain uncertain under the current covariance; and the greedy phase converts that reduction in uncertainty into low instantaneous regret. In the large-$K$ regime, the paper identifies the near G-optimal design step as crucial for achieving the $d\sqrt{T}$ minimax scale [2606.00984].

## 5. Regret guarantees, optimality, and proof structure

The main guarantee for BLCE-G is Theorem 1 of the paper:
\[
\mathcal{R}(T) = \mathcal{O}\!\Big(\sqrt{dT}(\sqrt{\log(KT)} \wedge \sqrt{d+\log T})\sqrt{\log d\log\log T}\Big)
= \tilde{\mathcal{O}}\!\Big(\sqrt{dT\log K} \wedge d\sqrt{T}\Big).
\]
Accordingly, BLCE-G attains $\widetilde{\mathcal{O}}(\sqrt{dT\log K})$ in the small-$K$ regime and $\widetilde{\mathcal{O}}(d\sqrt{T})$ in the large-$K$ regime [2606.00984].

The paper further states that known minimax lower bounds for fully sequential contextual bandits are $\Omega(\sqrt{dT\log K})$ in small-$K$ and $\Omega(d\sqrt{T})$ in large-$K$, so BLCE-G matches these lower bounds up to polylogarithmic factors in $T$ and $d$ while using only $\mathcal{O}(\log\log T)$ parameter updates [2606.00984]. This is the core optimality claim.

The proof strategy combines several ingredients. Self-normalized concentration yields high-probability control of $|\langle x,\hat{\theta}_\ell-\theta^*\rangle|$ over post-elimination sets. Elimination is then shown to preserve the optimal arm. The elliptical potential lemma controls cumulative uncertainty terms through log-determinant growth of the design matrix. A design-transfer argument shows that the near G-optimal design phase induces expected determinant growth that is logarithmic in dimension and interval lengths. Finally, the rapidly growing static schedule ensures that earlier exploration phases regularize the covariance sufficiently that later greedy phases incur small regret [2606.00984].

A plausible implication is that BLCE-G is not merely a batched approximation to fully sequential algorithms. Its regret proof relies essentially on reward-free within-interval adaptivity, especially through covariance updates and dynamic elimination, rather than only on coarse interval-level planning.

## 6. Computational profile, comparison with BLCE, and nomenclature

BLCE-G uses $\mathcal{O}(\log\log T)$ ridge-regression recomputations under its static schedule [2606.00984]. Its computational cost has several components: near G-optimal design calls cost $\mathcal{O}(Kd^3)$ each; arm elimination costs $\mathcal{O}(Kd^2)$ per round; and the overall time complexity is stated as
\[
\mathcal{O}(Kd^2T(d+\log\log T)).
\]
The memory footprint is described as typically $\mathcal{O}(d^2 + K)$, reflecting storage of $d\times d$ matrices, vector sums, and elimination sets [2606.00984].

The paper introduces a second algorithm, **BLCE**, which removes the near G-optimal design step entirely and relies on uncertainty-driven exploration, elimination, and greedy selection. BLCE retains minimax-optimal regret up to slightly larger polylogarithmic factors,
\[
\mathcal{R}(T) = \mathcal{O}\!\Big(\sqrt{dT}(\sqrt{\log(KT)} \wedge \sqrt{d+\log T})\sqrt{\log T\log\log T}\Big),
\]
while reducing runtime to
\[
\mathcal{O}(Kd^2T\log\log T).
\]
The paper therefore recommends BLCE-G when one can afford the near G-optimal design step and seeks the tightest regret bound, especially in large-$K$ regimes, and BLCE when runtime is the priority [2606.00984].

The same work also extends the rare-update perspective to generalized linear contextual bandits through **BGLE**, which uses weighted Gram matrices and elimination without relying on G-optimal design and achieves near-optimal regret independent of the worst-case curvature parameter $\kappa$ [2606.00984]. This places BLCE-G within a broader program: rare update schedules, combined with within-interval context adaptivity, can retain optimal or near-optimal statistical efficiency without frequent reward-dependent estimation.

A common source of confusion is the acronym itself. In the arXiv record, “BLCE-G” is also used in an unrelated 2025 condensed-matter paper to denote **bicircular-light-induced multi-state geometric current** [2503.03393]. The contextual-bandit BLCE-G discussed here is the algorithmic object introduced in [2606.00984]. The coincidence of abbreviations is terminological rather than conceptual.

Source: https://www.emergentmind.com/topics/blce-g