---
title: Active Goal Recognition (AGR)
url: https://www.emergentmind.com/topics/active-goal-recognition-agr
type: topic
---

# Active Goal Recognition (AGR)

Searching arXiv for recent and foundational papers on Active Goal Recognition.
Active Goal Recognition (AGR) is the problem of inferring an agent’s hidden goal while the observer is itself an acting system whose choices affect what information becomes available. In contrast to passive goal recognition, AGR treats observation as a costly, decision-dependent process and embeds recognition into a broader control problem in which the observer may move, query, reconfigure the environment, or otherwise intervene to reduce uncertainty about the target’s goal [1909.11173; 2507.21846]. Across the literature, AGR appears in several closely related forms: as a POMDP in which the observer plans information-gathering actions under uncertainty [1909.11173; 2507.21846; 2411.17326], as environment design that modifies a decision-making setting so that behavior becomes more revealing of goals [2404.03054], and as online adaptive recognition architectures that can serve as the recognition core of a larger active system [2505.09737; 2501.01463]. A recurring theme is the separation between a goal-conditioned behavior model of the acting agent and a decision layer that exploits that model to choose informative actions.

## 1. Conceptual scope and formal problem variants

AGR extends classical goal recognition, where a goal recognition problem is given as a tuple such as \(\langle \mathcal{D}, G, O \rangle\) or \(T=(D,G,O)\), with \(D\) a domain theory, \(G\) a set of candidate goals, and \(O\) an observation sequence, and the task is to identify the goal that best explains the observations [2505.09737; 2501.01463]. In AGR, this passive inference problem is embedded in a setting in which the observer has its own state, action space, and costs, and must decide when to observe, where to position itself, or how to intervene [1909.11173; 2507.21846].

A canonical formulation models AGR as a POMDP. In “Active Goal Recognition” [1909.11173], the augmented state is \(S=S_P\times S_T\times G_T\), where \(S_P\) is the observer state, \(S_T\) the target state, and \(G_T\) the hidden target goal. The observer’s action space is partitioned into \(A=A_P\cup A_O\cup A_D\), corresponding to task actions, observation actions, and decision or prediction actions. The reward function explicitly trades off observer task progress, observation costs, and prediction costs. This formulation makes recognition itself part of the observer’s planning objective rather than a standalone estimation routine [1909.11173].

A more explicitly probabilistic version appears in “Probabilistic Active Goal Recognition” [2507.21846], which defines a multi-agent setting with an actor and an observer under the keyhole assumption. The observer maintains a joint belief
\[
j_t(s_t,g)=P(s_t,g\mid o_{0:t},u_{0:t}),
\]
over actor state and goal, with marginal goal belief
\[
b_t(g)=\sum_{s_t} j_t(s_t,g).
\]
The observer’s objective is to choose actions that sharpen this goal belief, using a belief-dependent reward
\[
R(j_t)=\sum_g b_t(g)^2,
\]
which is maximized when the posterior over goals is concentrated [2507.21846].

A broader formulation relevant to AGR is General Dynamic Goal Recognition (GDGR), introduced in “General Dynamic Goal Recognition” [2505.09737]. GDGR models not one recognition problem but a sequence of goal recognition tasks over time, with changing domains, changing goal sets, and an information state \(IS_t\) reused across tasks. Its objective,
\[
g_t^*=\arg\max_{g\in DG_t} P(g\mid O_t, IS_{t-1}),
\]
captures online, dynamic, adaptive recognition and is presented as a basis for AGR even though the observer in that work remains passive [2505.09737]. This suggests that AGR can be viewed as GDGR plus an active decision layer.

## 2. Belief, observation, and information-seeking action

The central technical distinction between AGR and passive recognition is that observer actions change the observation process. In the probabilistic AGR framework of [2507.21846], the observer controls its state \(u_t\), and observations are generated from an observation model \(P_{\text{obs}}(u_t,s_t,o_t)\). The observer therefore plans over how its future state will affect what it can see. The joint belief is updated by a predict–update recursion:
\[
P(s_t,g\mid o_{0:t-1},u_{0:t-1})=\sum_{s_{t-1}} P(s_t\mid s_{t-1},g)\, j_{t-1}(s_{t-1},g),
\]
followed by
\[
j_t(s_t,g)=\frac{P(o_t\mid s_t,u_t)\,P(s_t,g\mid o_{0:t-1},u_{0:t-1})}{\sum_{s'_t,g'} P(o_t\mid s'_t,u_t)\,P(s'_t,g'\mid o_{0:t-1},u_{0:t-1})}.
\]
This joint state–goal belief is more expressive than a goal-only posterior because it supports both positive evidence and negative evidence: not seeing the actor is itself informative when visibility depends on observer position [2507.21846].

The same principle appears in AGR for robotic assistants. “Towards Intention Recognition for Robotic Assistants Through Online POMDP Planning” [2411.17326] models a robot that must interleave support actions and information-gathering actions while assisting a human worker. The joint POMDP state is \(S=S_O\times S_T\), where \(S_T\) is driven by a stochastic target process \(\pi_T\). Information-gathering actions such as “Perceive” or “Inspect” have explicit negative reward, while timely support actions can yield positive reward or prevent penalties incurred by the human’s failures. Recognition is thus not a separate estimation module but an emergent consequence of reward-maximizing planning under partial observability [2411.17326].

A conceptually related but non-interventional formulation is “Goal-directed Planning and Goal Understanding by Active Inference” [2202.09976]. There, “goal understanding” is implemented in a variational recurrent neural network under active inference: given observed exteroceptive trajectories \(x^e_{1:t_c}\), the model minimizes a free-energy objective
\[
F_g(x^e,z)=\sum_{t=1}^{t_c}\Big(w\,D_{KL}[q(z_t\mid x^e_{t:t_c})\|p(z_t\mid d_{t-1})]-\mathbb{E}_q[\log P(x^e_t\mid d_t)]\Big)
\]
and outputs expected goals \(\bar g_t\). Although the paper does not label this AGR, it unifies planning and recognition as two modes of inference in the same generative model, which is directly relevant to active settings where a recognizer must both understand and act [2202.09976].

## 3. Planning-based AGR and POMDP control

The earliest explicit AGR formulation in the provided literature is “Active Goal Recognition” [1909.11173]. Its experimental domains show how optimal behavior balances observation and task completion. In a corridor domain, the observer can either “work,” “observe,” or open a door believed to be the target’s destination. In a map domain, the observer chooses between movement, work, and help actions. AGR policies learned with SARSOP exploit the fact that early observations may have low information value and instead spend time on observer tasks until recognition becomes decision-relevant [1909.11173].

The probabilistic extension in [2507.21846] replaces handcrafted reward engineering with a generic belief-based objective and solves the resulting problem online with Monte Carlo Tree Search. At decision nodes, AGR-MCTS uses UCB1-style action selection; at chance nodes, it samples next actor state, observer state, and observation, updates the joint belief \(j_{t+1}=f(j_t,u_{t+1},o_{t+1})\), and backs up belief-based returns. This yields a domain-independent planner that performs comparably to a domain-specific greedy baseline in grid worlds, while the joint belief update itself substantially outperforms passive recognition on the same observation sequences [2507.21846].

The robotic assistant formulation in [2411.17326] uses online POMDP planning with POMCP and a relevance-based extension called RAGE. Partial Goal Satisfaction defines a potential
\[
\phi(h)=\alpha\,\mathfrak{p}(h),
\]
with shaping term
\[
F(h_t,h_{t+1})=\gamma \phi(h_{t+1})-\phi(h_t),
\]
to mitigate delayed rewards during simulation. In maintenance and assembly scenarios, RAGE outperforms plain POMCP in average discounted return and variance, suggesting that reward shaping and relevance estimates help the observer time assistance and sensing more effectively [2411.17326].

These planning-based AGR methods share three structural commitments. First, they model the observer as an explicit decision-maker. Second, they represent the target’s goal as hidden state. Third, they evaluate actions by their downstream impact on both information and task utility. A plausible implication is that AGR is best understood not as a special-purpose recognizer but as a belief-space control problem.

## 4. Recognition engines used within AGR

Although not all recent work implements active observers, several papers provide recognition engines that are explicitly positioned as suitable backbones for AGR.

“General Dynamic Goal Recognition” [2505.09737] proposes a generic algorithm with an information state \(IS_t\), domain adaptation, goals adaptation, recognition inference, and information-state update. Its concrete implementation learns a goal-conditioned policy \(GCP_D\) once using SAC with HER and then, for each task, chooses between zero-shot transfer, few-shot fine-tuning, and cache reuse for each goal in the dynamic goal set. Recognition is then performed by selecting
\[
g^*=\arg\max_{g\in DG_i}\mathrm{DISTANCE}(O_i,\pi_g).
\]
The paper states directly that this framework is well-suited as a backbone for AGR because it supports online observations, rapid adaptation, and reusable goal-conditioned behavior models [2505.09737].

“Goal Recognition using Actor-Critic Optimization” introduces DRACO, which learns one actor–critic pair per goal and derives distances between trajectories and goal policies, including the critic-based state-only distance
\[
D_s(O^s)=\frac{1}{\sum_{s_i\in O^s}V_g(s_i)},
\]
the Wasserstein-style action distance
\[
D_W(O,\pi)=\operatorname{mean}\{\|a-\tilde a\|_{L_1}\},
\]
and the Z-score distance
\[
D_z(O,\pi)=\operatorname{mean}\left\{\left|\frac{a-\mu(\pi(s))}{\sigma(\pi(s))}\right|\right\}.
\]
Goal posteriors are then obtained by softmin-normalized distances and Bayes-style normalization. The paper explicitly notes that DRACO is a passive recognition oracle that could be inserted into an AGR loop and reevaluated online as new observations arrive [2501.01463].

“Goal Recognition as Reinforcement Learning” [2202.06356] takes a related approach with one Q-function per goal. It defines a utility-based domain theory \(\mathcal{Q}=\{Q_g\}_{g\in\mathcal{G}}\) and goal inference by
\[
g^*=\arg\min_{g\in\mathcal{G}} \mathrm{Distance}(Q_g,\Omega),
\]
with MaxUtil, KL-based, and divergence-point measures. The paper does not implement AGR, but the learned Q-functions and policies naturally serve as forward models of goal-conditioned behavior, which an active observer could exploit to select informative interventions [2202.06356].

“Leveraging Planning Landmarks for Hybrid Online Goal Recognition” [2301.10571] offers a symbolic–statistical online recognizer combining planning landmarks with a Naive Bayes model. Its landmark completion score
\[
h_{gc}(g,AL_g,L_g)=\frac{|AL_g|}{|L_g|}
\]
is updated incrementally as actions arrive, while a weighted combination with the Bayesian model yields a fast hybrid posterior-like score. This architecture is explicitly online and computationally efficient, making it a plausible inference module for AGR even though it remains passive [2301.10571].

## 5. Environment design as active goal recognition

A distinct line of work treats AGR not as active sensing but as active modification of the environment to make goals easier to infer. “Data-Driven Goal Recognition Design for General Behavioral Agents” [2404.03054] formulates goal recognition design as:
\[
\underset{w'}{\text{minimize}}\;\; wcd(w',h)
\quad
\text{subject to}\quad
c_i(w,w')\le B_i,
\]
where \(wcd\) is worst-case distinctiveness and \(h\) is a behavioral model. The metric is defined operationally as the number of initial actions that are identical for every pair of goals, i.e., the maximum length of a common action prefix across goal-conditioned paths [2404.03054].

This work is directly AGR-like because the observer or system designer intervenes in the environment before or during behavior to reduce ambiguity. Instead of selecting sensor actions, it selects layout modifications, blocked or unblocked cells, or object placements so that goal-conditional behaviors diverge earlier. The paper’s main technical contribution is to replace repeated exact \(wcd\) computation with a learned surrogate \(\widehat{wcd}\), enabling gradient-guided discrete optimization over environments [2404.03054].

Its broader significance for AGR is twofold. First, it weakens the usual optimal-agent assumption by allowing hyperbolically discounted and data-driven human behavior models. Second, it grounds the value of environment design with human-subject experiments: environments optimized using a learned human behavior model yield lower overlapping path prefixes and higher Bayesian inference accuracy on actual human trajectories [2404.03054]. This suggests that AGR interventions can target not only what the observer sees, but also the geometry of the decision problem itself.

A related implication emerges from landmark-based work such as [1904.11739] and [2102.11791], although these papers are not themselves AGR algorithms. Planning landmarks identify necessary subgoals, and landmark uniqueness measures how discriminative a landmark is across candidate goals. In an active setting, these structures can guide sensing or design choices toward observations that test high-uniqueness landmarks first. This suggests a bridge between symbolic goal structure and information value.

## 6. Learning-based, probabilistic, and human-centered directions

AGR increasingly intersects with data-driven recognition and human behavior modeling. “Imagination-Augmented Deep Learning for Goal Recognition” [2003.09529] augments recurrent neural networks with planner-derived cost gradients
\[
\frac{\partial c(s_t,g)}{\partial t}=c(s_{t-1},g)-c(s_t,g),
\]
or heuristic deviations
\[
\frac{\partial h(s_t,g)}{\partial t}=h(s_{t-1},g)-h(s_t,g),
\]
to improve recognition from partial trajectories. The planner acts as an imagination module, producing cost-derived features that summarize possible futures. While active control is absent, such goal posteriors are natural belief states for AGR policies that need fast updates under noisy and suboptimal behavior [2003.09529].

“Human Goal Recognition as Bayesian Inference: Investigating the Impact of Actions, Timing, and Goal Solvability” [2402.10510] expands the evidential basis of recognition beyond actions. It models a goal recognition problem with timing information as \(\langle D,G,Prior,O\rangle\), where observations contain action–time pairs \(\langle a_i,t_i\rangle\), and uses
\[
P(G\mid O)\propto Prior(G)\,LL_A(O,G)\,LL_T(O,G).
\]
Its key empirical finding is that actions dominate human inference, but timing and solvability matter when actions are uninformative [2402.10510]. For AGR, this supports a modality-selection view of active sensing: action information should be exploited first, while timing or solvability cues should be sought when action evidence is weak.

“Data-Driven Goal Recognition in Transhumeral Prostheses Using Process Mining Techniques” [2309.08106] offers an assistive-control perspective closely aligned with AGR. Continuous sensor streams are transformed into discrete events, goal-specific Petri nets are discovered, and alignment-based weights
\[
\omega(\tau,M_G)=\phi+\lambda^m\sum_{i=1}^n i^\delta c(\tau,M_G,i)
\]
are converted into goal probabilities
\[
\Pr(G\mid \tau)=\frac{e^{-\beta\,\omega(\tau,M_G)}}{\sum_{G'} e^{-\beta\,\omega(\tau,M_{G'})}}.
\]
Although the work does not implement a full active controller, it stresses that being less confident when wrong is beneficial because the prosthesis should not commit too aggressively to an incorrect goal. This is directly relevant to AGR systems whose actions depend on confidence calibration [2309.08106].

The active inference formulation in [2202.09976] similarly points toward a human-like AGR architecture in which the same generative model supports both action generation and goal understanding. A plausible implication is that AGR benefits from architectures where recognition and intervention share latent dynamics rather than being engineered as separate modules.

## 7. Empirical themes, limitations, and open problems

Several empirical regularities recur across the literature. First, negative evidence matters. Joint belief update in [2507.21846] outperforms passive methods largely because non-detections are informative when the observer controls visibility. Second, fast reusable behavior models matter. Goal-conditioned RL in [2505.09737] and actor–critic recognition in [2501.01463] shift computation offline and support cheap online reevaluation. Third, purely optimal planning assumptions are often brittle. Data-driven environment design explicitly targets general behavioral agents [2404.03054], and Bayesian analyses of human inference show that timing and solvability affect judgments in ways not captured by classical optimality-based models [2402.10510].

Common limitations are equally clear. Many AGR systems assume known dynamics, fixed candidate goal sets, or full observability of relevant variables [2505.09737; 2507.21846]. Planning-based POMDP formulations are computationally demanding and often demonstrated only in modest domains [1909.11173; 2411.17326]. RL-based recognizers may require a simulator and typically scale linearly with the number of goals when one policy is trained per goal [2501.01463]. Environment design methods depend on the fidelity of the learned behavior model and on training-distribution coverage [2404.03054].

A recurring open problem is the integration of recognition with intervention under richer uncertainty. The papers collectively point toward several directions. One is multi-domain, continual, or lifelong AGR, anticipated by GDGR’s information-state formulation [2505.09737]. Another is richer probabilistic belief-space planning that handles partial observability, unknown dynamics, or multi-agent interactions while retaining tractable online control [2507.21846; 2411.17326]. A third is better alignment with human behavior: bounded rationality, variable timing, and unsolvable goals are already shown to affect inference [2402.10510], and environment design demonstrates that tailoring interventions to actual human behavior can materially improve recognizability [2404.03054].

Taken together, the literature defines AGR as the convergence of online goal inference, active information gathering, and decision-theoretic control. The field now contains explicit probabilistic POMDP formulations [1909.11173; 2507.21846], active environment-design approaches [2404.03054], scalable learning-based recognition cores [2505.09737; 2501.01463; 2202.06356], and human-centered generative and Bayesian models [2202.09976; 2402.10510]. This suggests that AGR is less a single algorithmic technique than a family of architectures organized around one principle: the observer should act so as to make goals easier to infer, and should infer goals so as to act better.

Source: https://www.emergentmind.com/topics/active-goal-recognition-agr