--- title: Joint Attention Naming Game url: https://www.emergentmind.com/topics/joint-attention-naming-game-ja-ng type: topic --- # Joint Attention Naming Game The Joint Attention Naming Game (JA-NG) is a formal framework and experimental paradigm for modeling the emergence of shared symbols (signs) between two agents—biological or artificial—under the condition of joint attention. JA-NG integrates a Metropolis–Hastings-based probabilistic acceptance mechanism with a generative Bayesian graphical model, and has become a standard testbed for both computational and human-in-the-loop studies of decentralized symbol negotiation. It is the canonical empirical instantiation of the Metropolis-Hastings Naming Game (MHNG), providing concrete evidence that symbol emergence can be interpreted as decentralized Bayesian inference over shared representations [2305.19936, 2205.12392, 2506.15468]. ## 1. Formal Structure and Bayesian Framework In JA-NG, two agents (A and B; or Human and AI) sequentially take the roles of speaker and listener. Each round, both agents are presented with the same referent (object $x_n$), embodying joint attention, and independently assign it to a perceptual category $c^*_n$. The speaker generates a proposed sign $s^*_n \sim P(s_n | \Theta^{Sp}, c^{Sp}_n)$ from its internal parameters, which is then evaluated by the listener, who decides to accept or reject based on a probabilistic criterion. The interaction is formalized as an approximate decentralized inference process in an interpersonal probabilistic graphical model (Inter-PGM). The latent variables include the shared sign $s_n$, agent-specific perceptual category $c^*_n$ and observation $x^*_n$, sign–category parameters $\Theta^*$, and category–observation parameters $\Phi^*$. The generative process is: - $s_n \sim P(s_n | \gamma)$ - $\Theta^* \sim P(\Theta^* | \alpha),\;\; \Phi^* \sim P(\Phi^* | \beta)$ - $c^*_n \sim P(c^*_n | s_n, \Theta^*)$ - $x^*_n \sim P(x^*_n | c^*_n, \Phi^*)$ Symbol negotiation thus targets the joint posterior $P(\{s_n\} | \{x^A_n, x^B_n\})$; under MHNG conditions, the dyad implements an approximate Metropolis–Hastings sampler for this distribution [2305.19936, 2506.15468]. ## 2. Metropolis–Hastings Acceptance Logic At the core of JA-NG is the Metropolis–Hastings acceptance probability governing the listener's response. Given a speaker's proposal $s^*_n$, the listener computes: \[ r_n^{MH} = \min\left(1, \frac{P(c_n^{Li} | \Theta^{Li}, s^*_n)}{P(c_n^{Li} | \Theta^{Li}, s_n^{Li})}\right) \] This ratio measures the relative compatibility of the listener’s current category structure with the proposed versus the existing sign; it is functionally equivalent to an MH update for the sign posterior in the joint Bayesian model [2305.19936, 2205.12392, 2506.15468]. Acceptance of proposals with this probability ensures that, over multiple roles and rounds, the empirical sign distribution approximates the shared posterior targeted in Bayesian data fusion. The generative model and acceptance update can be extended using deep generative models (for example, inter-GMM+VAE), enabling symbol emergence with high-dimensional or multimodal perceptual input [2205.12392]. ## 3. Experimental Protocols and Model Instantiations JA-NG has been implemented in human–human, human–AI, and pure AI–AI settings to empirically test decentralized Bayesian symbol emergence. Protocols are characterized by: - Alternating speaker/listener roles across $N$ objects and multiple rounds - Joint presentation of perceptually ambiguous referents (e.g., color patches drawn from overlapping Gaussians, digits (MNIST), fruits (Fruits 360)) - Internal representations as agent-specific Gaussian mixture models or VAEs A canonical experimental protocol involves initializing category and sign assignments, conducting repeated communication rounds (each with speaker proposal, listener accept/reject, and parameter updates), and recording all decisions. In human–AI studies, AI agents may use MH acceptance, always-accept (supervised learning mimic), or always-reject (unsupervised learning mimic) behavioral policies [2506.15468]. ## 4. Empirical Outcomes and Model Comparisons Empirical studies consistently demonstrate that human and AI listeners track the Metropolis–Hastings criterion: observed acceptance rates increase monotonically with $r_n^{MH}$, closely matching predicted psychometric curves ($P(\text{accept}) = a\,r + b$ with $a, b$ fitted). In [2305.19936], for human–human dyads, $a=0.5105$, $b=0.4842$; for human–AI pairs [2506.15468], $a=0.645\pm0.300$, $b=0.201\pm0.187$. MH-based models provide statistically superior prediction of trial-level decisions compared to alternatives (constant, numerator-only, subtraction, binary models). Quantitatively, MHNG-based JA-NG yields: - Higher categorization accuracy (Adjusted Rand Index, ARI) and greater convergence in sign usage relative to always-accept or always-reject baselines - Strong agent–agent or human–AI agreement with posterior sign histograms (agreement >0.76 for MH, significantly exceeding baselines) - MNIST and Fruits 360 results show ARI $>0.76$ with $\kappa>0.91$ for shared signs [2205.12392] A summary of core empirical findings is provided below. | Study | Partner Types | Outcome: Accuracy (ARI) | MH vs. Baseline | |-----------------|---------------------|-------------------------|---------------------------| | Human–Human | MH | $a=0.5105$, $b=0.4842$ | MH > Constant, Num., Bin. | | Human–AI | MH, AA, AR | MH: ARI $0.609\pm0.25$ | MH > AA > AR | | AI–AI | MHNG + VAE | ARI $>0.76$, $\kappa>0.91$ | MHNG > all-accept, unsup. | ## 5. Decentralized Bayesian Inference and Predictive Coding JA-NG constitutes an empirical realization of “collective predictive coding”: multiple agents dynamically adjust their internal concept–sign and category–percept mappings to minimize prediction error (free energy) not only with respect to their own observations, but also in reaction to proposals from their partner. Symbol emergence thereby becomes a distributed inference process—joint statistical alignment on a shared latent variable (the sign system)—rather than unilateral learning or explicit referential agreement [2205.12392, 2506.15468]. The process is fundamentally decentralized; no agent has direct access to the partner’s observations or priors. Agreement on signs and categories is achieved via local sampling (Gibbs for continuous latents, MH for signs) and repeated reciprocation, operationalizing distributed Bayesian data fusion. ## 6. Broader Implications and Integration with Co-Creative Learning JA-NG under MHNG provides the first quantitative evidence that human–AI teams can engage in fully co-creative symbol emergence: both agents, each with partial and non-overlapping views of objects, fuse their beliefs through local interactions to form shared external representations. This mechanism supports symbiotic AI alignment, in which an artificial agent learns with—not only from—a human partner by balancing its own internal model with external proposals. A plausible implication is that such interaction-driven alignment can produce communication protocols and shared symbolic repertoires adaptable to heterogeneous, multimodal environments, with direct application to mixed human–robot and hybrid agent systems. These results indicate a new paradigm for symbiotic human–AI collaboration, diverging from traditional supervised or unsupervised frameworks by implementing mutual decentralization in representation learning and symbol negotiation [2506.15468]. ## 7. Limitations and Future Directions Current JA-NG experiments primarily use low-dimensional, synthetic stimuli (e.g., color patches, digits, restricted sign/index sets). Extending JA-NG to rich perceptual domains (such as natural language or complex vision), larger vocabularies, ecological referents, and continuous semantic spaces remains to be addressed. The choice of generative model (Gaussian mixture, VAE hybridization), parameter initialization, and absence of constraints such as real-time interaction, metacognitive feedback, or ecological validity may affect the generality of observed dynamics. Future research may address mixed human–robot/AI games, scaling to many agents, integration with real-world perceptual tasks, and in-the-wild evaluation [2305.19936, 2205.12392, 2506.15468]. Source: https://www.emergentmind.com/topics/joint-attention-naming-game-ja-ng