---
title: 'LAMIR: Look-Ahead Reasoning in Imperfect Games'
url: https://www.emergentmind.com/topics/lamir
type: topic
---

# LAMIR: Look-Ahead Reasoning in Imperfect Games

Searching arXiv for the LAMIR paper and closely related work on MuZero, CFR, and Regularized Nash Dynamics.
LAMIR, introduced in “Look-ahead Reasoning with a Learned Model in Imperfect Information Games” [2510.05048], is an algorithm for test-time look-ahead reasoning in two-player zero-sum extensive-form games with imperfect information. It learns an abstracted model of the game directly from agent–environment interaction and uses that model at inference time to build tractable subgames for theoretically principled reasoning. The method is designed for settings in which explicit environment models are unavailable or too complex, and it combines a learned simulator with a learned state abstraction that caps the number of abstract information sets per public state. In the reported experiments, LAMIR recovers the exact underlying game structure when capacity is sufficient and, under limited capacity, still learns abstractions that improve the performance of pre-trained agents in both small and large imperfect-information games [2510.05048].

## 1. Formal setting and problem formulation

LAMIR is formulated for a two-player zero-sum extensive-form game with imperfect information, equivalently viewed as a simultaneous-move game
$G = (N, W, A, T, R, O)$, where $N = \{1,2\}$ is the player set, $W$ is the set of world states with unique initial state $w^0 \in W$, $A = A_1 \times A_2$ is the set of joint actions, $T: W \times A \to W$ is the deterministic transition function, $R: W \times A \to \mathbb{R}$ gives the reward to player 1, and $O: W \times A \times W \to O$ is the observation function, factored into public and private components as $O = O^0 \times O_1 \times O_2$ [2510.05048].

A history $h = w^0, a^0, \ldots, a^{l-1}, w^l$ is any sequence consistent with $T$. For player $i$, the private information set at $h$ is
$$
I_i(h) = \{h' \mid h' \text{ ends in the same public observations } O^0 \text{ and same private } O_i \text{ as } h\}.
$$
The set of all information sets for player $i$ is denoted $S_i$, while public information sets partition histories by public observations alone [2510.05048].

Strategies are behavioral: $\sigma_i: S_i \to \Delta(A_i)$ assigns a distribution over legal actions at each information set, and a joint strategy $\sigma = (\sigma_1,\sigma_2)$ induces reach probabilities $\pi^\sigma(h)$ and expected utilities $u_i^\sigma(h)$. In the two-player zero-sum case, exploitability of $\sigma_i$ is measured by
$$
E(\sigma_i) = BR_{-i}(\sigma_i) - u_{-i}^\sigma(\emptyset),
$$
where $BR_{-i}(\sigma_i)$ is player $-i$’s best-response value [2510.05048].

This setup places LAMIR within the standard apparatus of imperfect-information game solving, but its central intervention is to replace a hand-specified look-ahead model with a learned and compressed one. A plausible implication is that LAMIR targets the same class of strategic planning problems as CFR-based solvers, while relaxing the assumption that the full game structure is known explicitly at test time.

## 2. Learned simulator and abstraction mechanism

LAMIR trains from self-play data sampled by a baseline policy and learns both a simulator of the imperfect-information game and a state abstraction that bounds each public-state subgame to at most $L$ abstract infosets per player [2510.05048]. The paper presents this as a direct response to the difficulty of applying model-based search, in the style of MuZero, to imperfect-information settings where reasoning depends on information states rather than fully observed states. MuZero itself is a canonical learned-model search method for perfect-information domains [1911.08265].

For each player $i$, the learned model contains three parameterized components. First, a representation map
$$
I_\theta: S_i \to \hat{\mathcal{S}}_i
$$
maps a real information set to a fixed-size latent vector. Second, a dynamics model
$$
g_\theta: \hat{\mathcal{S}}_1 \times \hat{\mathcal{S}}_2 \times A_1 \times A_2 \to (\hat{\mathcal{S}}_1 \times \hat{\mathcal{S}}_2 \times \mathbb{R} \times \{0,1\})
$$
predicts next latent states, immediate reward, and a termination bit from the two latent states and a joint action. Third, a legal-actions head
$$
L_\theta: \hat{\mathcal{S}}_i \to \{0,1\}^{|A_i|}
$$
predicts which actions are legal from a latent state [2510.05048].

Given a ground-truth trajectory $h$, the model is unrolled over multiple start times and depths. For $t = 0,\ldots,l-1$, one initializes
$$
s_i^{t,0} = I_\theta(I_i(h^t)),
$$
and for successive steps $k$,
$$
(s_1^{t,k+1}, s_2^{t,k+1}, r^{t,k+1}, l^{t,k+1}) = g_\theta(s_1^{t,k}, s_2^{t,k}, a_1^{t+k}, a_2^{t+k}).
$$
Legal-action logits are also predicted from the initial latent states [2510.05048].

The abstraction module is tied to public states. For a given public state $p$, a public-state encoder $\rho_{i,\psi}$ proposes $L$ abstract centers $\{z_{i,1},\ldots,z_{i,L}\} \subset \mathbb{R}^d$. An infoset-to-abstract selector
$$
\alpha_{i,\psi}: S_i \to \Delta^L
$$
assigns a real infoset $x \in S_i$ with public state $p$ to a soft distribution over those centers, while training and test-time use the argmax center to enforce a many-to-one mapping. A further network $\sigma_\omega: \mathbb{R}^d \to \mathbb{R}^K$ predicts ancillary features referred to as a “clustering property,” which drive cluster formation [2510.05048].

This factorization is the defining structural choice in LAMIR. Rather than learn a single latent state for planning, it learns player-specific latent information states and then compresses them into a bounded abstract subgame at each public state.

## 3. Optimization objectives and training signals

The model-learning objective combines supervision on legal actions, termination, rewards, and latent consistency across rollout steps. The per-trajectory loss $M(\theta)$ is
$$
M = \sum_{t=0}^{l-1} \Bigg[
\sum_{i=1,2} CE(L_\theta(s_i^{t,0}), \mathbf{1}_{A_i(h^t)})
+ \sum_{k=1}^{l-t} \Big(
CE(l^{t,k}, \mathbf{1}_{[t+k=l]})
+ MSE(r^{t,k}, R(h^{t+k-1}, a^{t+k-1}))
+ \sum_i MSE(s_i^{t,k}, I_\theta(I_i(h^{t+k})))
\Big)
\Bigg],
$$
where $CE$ is binary cross-entropy and $MSE$ is mean-squared error [2510.05048]. The stated purpose of this construction is to force $g_\theta$ to simulate both belief-state transitions and reward or termination behavior.

The abstraction objective is defined in terms of features
$$
\phi(x) = \sigma_\omega(I_\theta(x)).
$$
In a public state $p$, if the $L$ centers are $C = \{c_1,\ldots,c_L\}$, then the soft-clustering loss is
$$
A(\psi,\omega) = \sum_{x \in S_i(p)} \sum_{j=1}^L \|\phi(x)-c_j\|^2 \cdot softmax_j\big(-\|\phi(x)-c_j\|^2/\tau\big),
$$
and the assignment-matching loss is defined by choosing
$$
j^* = \arg\min_j \|\phi(x)-c_j\|,
$$
then
$$
S(\psi) = \sum_x CE(\alpha_{i,\psi}(x), e_{j^*}).
$$
All parts are trained jointly by minimizing
$$
M(\theta) + A(\psi,\omega) + S(\psi),
$$
with gradients from $M$ updating only $\theta$, gradients from $A$ updating $\psi,\omega$, and gradients from $S$ updating $\psi$ [2510.05048].

The choice of clustering property is empirically important. The reported experiments vary $\phi(\cdot)$ among “legal actions,” “legal+RNaD strategy,” and “legal+strategy+action-history” [2510.05048]. Regularized Nash Dynamics, used as the baseline policy generator, is a recent policy-learning framework for zero-sum games [2303.00914]. Within LAMIR, these features operationalize which aspects of an information set are preserved by abstraction. This suggests that the abstraction is not purely geometric in latent space; it is explicitly task-shaped by strategically relevant signals.

## 4. Test-time continual resolving in the abstract subgame

At test time, LAMIR assumes access only to the acting player’s real infoset $x \in S_i$, hence its public state $p$. It then applies continual resolving with depth-limited CFR in an abstract subgame learned from data [2510.05048]. The abstract subgame is built by first computing the $L$ abstract centers for each player from the public-state encoder and selecting the center matched to $x$ via the argmax of $\alpha$. A depth-$D$ game tree is then constructed in the abstracted model. Its states are pairs of abstract infoset indices $(j_1,j_2)$ together with latent memory, transitions are induced by $g_\theta$, and legal actions are provided by $L_\theta$ [2510.05048].

At depth $D$, the construction adds an extra joint “transformation” layer of $T$ heuristic actions leading to terminal payoffs given by a learned multi-valued state value function $\hat{v}$ [2510.05048]. The abstract subgame is then solved with CFR+, which is a refinement of counterfactual regret minimization for extensive-form games [1407.5042]. LAMIR runs CFR+ for $I$ outer iterations and obtains an approximate equilibrium policy $\rho^*$ over abstract infosets in the root public state [2510.05048].

Action selection maps the real infoset $x$ to its abstract center $j^*$ and samples a real action from $\rho^*(j^*)$. After observing the opponent’s action and the next public observation, LAMIR updates the public state, extracts new abstract infosets through $\rho_{\cdot,\psi}$, and reuses pertinent subtree values, specifically counterfactual values and reach probabilities, in a new subgame. This repeats until a terminal history is reached [2510.05048].

The reported pseudocode summarizes this process as a recursive `ACT(x)` routine that constructs the subgame, solves it with CFR+, plays according to the equilibrium policy at the selected abstract center, and then resolves again after the next observation [2510.05048]. In conceptual terms, LAMIR combines model-based rollouts with public-state subgame solving. That makes it closer to continual-resolving traditions in imperfect-information search than to one-shot policy inference.

## 5. Theoretical properties and representational limits

LAMIR’s principal tractability claim is combinatorial. By enforcing at most $L$ abstract infosets per public state, each depth-$D$ subgame has at most
$$
\sum_{d=0}^{D} \big[L^2 \cdot |A_1|^d \cdot |A_2|^d\big]
$$
nodes [2510.05048]. The stated significance is that the resulting search space is polynomial in $L$ and action-set cardinalities rather than exponential in the number of real hidden states.

The paper also states a capacity-based recovery result. As $L \to |S_i(p)|$ for every public state $p$, as the feature network $\sigma_\omega$ becomes infinitely expressive, and as the latent-state dimension tends to infinity, the learned abstraction and learned model converge in capacity to the true game, so LAMIR’s look-ahead recovers the exact public-state CFR solution [2510.05048]. This is not presented as a finite-sample guarantee, but as an asymptotic representational statement.

A crucial caveat concerns imperfect recall. General CFR convergence requires perfect recall, but LAMIR’s abstraction may violate it. The paper states that if the abstraction satisfies the A-loss recall condition, specifically “public observations and last round actions only,” CFR still converges; Goofspiel and Oshi-Zumo are cited as games meeting this condition, while other games may not admit formal guarantees [2510.05048]. This limitation aligns LAMIR with a broader literature in imperfect-information abstraction, where practical compression often outruns available convergence theory. A plausible implication is that empirical success may depend substantially on how benign the recall loss induced by abstraction is in a given domain.

## 6. Empirical evaluation and reported performance

The empirical study separates small domains, where exploitability can be computed exactly, from larger domains, where evaluation relies on head-to-head win rates [2510.05048].

In the small-domain setting, the paper studies Imperfect-Information Goofspiel with $N=5$ and Oshi-Zumo with $(K=3, N=5)$. The baseline is concurrently trained Regularized Nash Dynamics without test-time search, and the main metric is exploitability $E(\sigma)$. For abstraction limits $L \in \{2,5,10,20,30\}$ and clustering properties $\phi(\cdot) \in \{$legal actions, legal+RNaD strategy, legal+strategy+action-history$\}$, the method is trained for 10 seeds over 100 K episodes, and every 1 K episodes exploitability is computed by building depth-1 subgames in each public state, solving them via CFR+, and mapping back to the real game [2510.05048]. The reported Goofspiel-5 result is that $L=30$ with $\phi =$ “legal+strategy+history” yields exploitability approximately $0.02$, described as near zero, and that even $L=10$ produces significantly lower exploitability than RNaD alone [2510.05048].

In the large-game setting, the domains are II-Goofspiel with $N=10,13,15$, with the largest public-state sizes reported as up to $10^{18}$ real histories. The baseline remains RNaD with the same training budget of 3 M episodes. The metric is LAMIR’s win rate against RNaD over more than 100 K matches, averaged over $3 \times 6$ seed pairings with $2\sigma$ error bars [2510.05048].

| Configuration | Domain | Result |
|---|---|---|
| LAMIR ($\phi$ = legal actions) | Goofspiel 10 | $54.5\% \pm 0.3\%$ |
| LAMIR ($\phi$ = legal actions) | Goofspiel 13 | $60.7\% \pm 0.3\%$ |
| LAMIR ($\phi$ = legal actions) | Goofspiel 15 | $80.5\% \pm 0.3\%$ |
| LAMIR ($\phi$ = RNaD strategy) | Goofspiel 10 | $61.6\% \pm 0.3\%$ |
| LAMIR ($\phi$ = RNaD strategy) | Goofspiel 13 | $58.3\% \pm 0.3\%$ |
| LAMIR ($\phi$ = RNaD strategy) | Goofspiel 15 | $61.8\% \pm 0.4\%$ |

In all of these cases, LAMIR outperforms RNaD [2510.05048].

The paper also reports tabular K-means experiments on Goofspiel with $N=4,5,6$, described as purely offline, showing that exploitability degrades gracefully as $L$ shrinks and that richer clustering properties $\phi$ outperform mere legal-actions features [2510.05048]. In Leduc Hold’em, where chance nodes are present, chance is approximated by stochastically unrolling the first round; under that approximation, LAMIR with $L=6$—at least as large as the number of real infosets—matches low exploitability, and even $L=5$ still beats RNaD [2510.05048].

## 7. Limitations, scope, and relation to adjacent research

The paper identifies several limitations. First, scalability remains constrained because subgame size grows approximately as $L^2|A|^{2D}$, which limits the maximal feasible abstraction size $L$ and search depth $D$. It explicitly notes that future work could integrate GT-CFR or other iterative solvers to ameliorate this issue [2510.05048]. Second, chance nodes are not modeled directly in $g_\theta$; extending the method to stochastic transitions is left for future work [2510.05048]. Third, action abstraction is absent: LAMIR does not reduce $|A|$, so domains with huge or continuous action spaces would require action-abstraction methods layered on top [2510.05048]. Fourth, the imperfect-recall issue leaves convergence guarantees unavailable outside the games satisfying the cited recall condition [2510.05048].

Within the broader landscape, LAMIR is explicitly framed as combining model-based look-ahead “à la MuZero” with learned information-state abstraction to make CFR-style reasoning tractable in large imperfect-information games [2510.05048; 1911.08265]. That positioning is technically specific. MuZero learns a latent dynamics model that supports tree search, but it is designed for perfect-information games and MDP-like settings [1911.08265]. CFR and CFR+ provide principled equilibrium-seeking procedures in extensive-form games [1407.5042]. LAMIR’s contribution is to interpose a learned abstraction layer between those traditions so that look-ahead is performed not in the original hidden-state game, but in a bounded abstract public-state subgame [2510.05048].

The stated real-world implication is that, by obviating the need for explicit rules or simulators at test time, LAMIR can be applied to proprietary or dynamically changing games, or more generally to partially observable settings in which a small abstract model suffices [2510.05048]. This suggests a broader interpretation of LAMIR as a framework for learned subgame construction under partial observability, though the empirical evidence currently reported is concentrated in game benchmarks rather than non-game POMDPs.

Source: https://www.emergentmind.com/topics/lamir