Papers
Topics
Authors
Recent
Search
2000 character limit reached

Game State Impact Rate Analysis

Updated 5 July 2026
  • Game State Impact Rate is a measure of how changes in game states affect strategic outcomes, defined variably across domains such as AI, market dynamics, evolutionary games, and esports.
  • Its applications span human-AI interaction equilibria, market impact in Minority Games, and dynamic evaluations in hidden-role games, employing diverse methodologies.
  • Frameworks range from adaptation rates and Markov transitions to state-dependent reinforcement learning and win probability deltas, emphasizing practical evaluation.

In the cited literature, Game State Impact Rate refers to how a game state, or the rate at which the state changes, affects strategic outcomes. The expression is used for the effect of the AI’s adaptation rate α\alpha on the joint action (ht,mt)(h_t,m_t) in a human-AI continuous game (Isa et al., 2024), for the susceptibility-controlled permanent impact of a meta-order in the Minority Game (Barato et al., 2011), for transition rates λi,μi\lambda_i,\mu_i between game states in an evolutionary Markov model (Feng et al., 9 Feb 2025), for state-dependent reinforcement in a SARSA-based spatial Prisoner’s Dilemma (Yang et al., 2024), and for action-level changes in a game-state evaluation or win probability in Secret Hitler and Counter-Strike: Global Offensive (Bauer, 9 Apr 2026, Xenopoulos et al., 2020). This suggests that the term functions as a cross-domain label rather than as a single standardized invariant.

1. Major meanings in the literature

The available works use closely related but non-identical formalizations. In some settings, the quantity of interest is a control parameter that changes the trajectory of play; in others it is a transition rate, a state-dependent response coefficient, or an action-level delta computed from a state evaluator.

Setting Game state Impact-rate notion
Human-AI continuous game joint action vector (ht,mt)(h_t,m_t) AI adaptation rate α\alpha
Minority Game stationary regime with HH and χ\chi permanent impact Δ\Delta^*
Evolutionary Markov game Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\} transition rates λi,μi\lambda_i,\mu_i
Spatial Prisoner’s Dilemma with SARSA local cooperation state state-dependent reinforcement effect
Bayesian repeated zero-sum game random state (ht,mt)(h_t,m_t)0 communication rate (ht,mt)(h_t,m_t)1 with strategic randomization
Secret Hitler / CSGO evaluated state before and after an action mean state delta or win-probability delta

A common misconception is to treat all of these quantities as interchangeable. The cited papers instead distinguish between equilibrium-selection dynamics, market response, population redistribution across game states, reinforcement-learning feedback, adversarial state communication, and action valuation.

2. Adaptation rate as a game-state driver in human-AI continuous games

In "Effect of Adaptation Rate and Cost Display in a Human-AI Interaction Game" (Isa et al., 2024), the game state is the joint action vector (ht,mt)(h_t,m_t)2, where the human chooses (ht,mt)(h_t,m_t)3 and the AI chooses (ht,mt)(h_t,m_t)4. The AI updates its action by gradient descent on its own cost:

(ht,mt)(h_t,m_t)5

For the quadratic AI cost

(ht,mt)(h_t,m_t)6

this becomes

(ht,mt)(h_t,m_t)7

The paper interprets these cases directly: (ht,mt)(h_t,m_t)8 means the AI is fixed at its Nash-equilibrium action, small (ht,mt)(h_t,m_t)9 means the AI changes slowly, and λi,μi\lambda_i,\mu_i0 means the AI instantaneously reaches its best response to the human.

The equilibrium concepts are the Nash equilibrium and the human-led Stackelberg equilibrium. The Nash equilibrium satisfies

λi,μi\lambda_i,\mu_i1

with

λi,μi\lambda_i,\mu_i2

Letting

λi,μi\lambda_i,\mu_i3

the human-led Stackelberg equilibrium satisfies

λi,μi\lambda_i,\mu_i4

The experiments used two feedback conditions. In Experiment 1, the human saw only the current cost λi,μi\lambda_i,\mu_i5, displayed as an expanding or shrinking circle, with the instruction to keep the circle as small as possible. In Experiment 2, the human saw a λi,μi\lambda_i,\mu_i6 local heat map of cost values around the current cursor position,

λi,μi\lambda_i,\mu_i7

with lighter color meaning lower cost and the instruction to keep the color inside the black circle cursor as light as possible.

Across both experiments, the distribution of human and AI actions moved from near Nash equilibrium at low λi,μi\lambda_i,\mu_i8 to near Stackelberg equilibrium at high λi,μi\lambda_i,\mu_i9. Slow AI adaptation shifted outcomes toward Nash equilibrium, whereas fast adaptation shifted outcomes toward the human-led Stackelberg equilibrium. Human cost generally decreased as (ht,mt)(h_t,m_t)0 increased, and AI cost showed a U-shaped trend across rates. The local landscape display shifted outcomes toward Nash relative to the current-cost display. The paper’s own summary identifies this as the “game state impact rate”: (ht,mt)(h_t,m_t)1 changes the trajectory of (ht,mt)(h_t,m_t)2 over time and thus the eventual equilibrium neighborhood.

3. Stationary-state susceptibility and market impact in the Minority Game

"Impact of meta-order in the Minority Game" (Barato et al., 2011) studies market impact by adding a trader who buys or sells a fixed amount (ht,mt)(h_t,m_t)3 for a finite time (ht,mt)(h_t,m_t)4. In the grand-canonical Minority Game, speculators update scores according to

(ht,mt)(h_t,m_t)5

with excess demand

(ht,mt)(h_t,m_t)6

The meta-order modifies this to

(ht,mt)(h_t,m_t)7

so the total executed size is

(ht,mt)(h_t,m_t)8

Price formation is assumed linear:

(ht,mt)(h_t,m_t)9

Impact is then defined as

α\alpha0

with permanent impact

α\alpha1

The central state variable is predictability

α\alpha2

The paper distinguishes a predictable phase with α\alpha3 and finite susceptibility α\alpha4, and an unpredictable / information-efficient phase with α\alpha5 and divergent α\alpha6. The exact stationary response formula is

α\alpha7

and this yields

α\alpha8

The resulting interpretation is explicit. In the unpredictable state, α\alpha9, so HH0: the market absorbs the meta-order without leaving a permanent trace. In the predictable state, HH1, so the permanent impact is non-zero and linear in HH2. The paper therefore defines state dependence through the stationary-state susceptibility HH3: the more efficient and unpredictable the state, the smaller the lasting impact per unit traded volume; the more predictable the state, the larger the response.

The same framework also connects execution cost to the impact trajectory and notes that the impact law is more linear than empirical concave laws because of the assumed linear relation between excess demand and price. This is a precise example in which “game state impact rate” is neither a behavioral heuristic nor a generic metric, but an exact state-dependent response coefficient.

4. Markov transition rates between game states in evolutionary dynamics

In "An Evolutionary Game With the Game Transitions Based on the Markov Process" (Feng et al., 9 Feb 2025), the impact rate is the rate at which an individual’s current game state changes over time. Each individual HH4 has a game-state process

HH5

with state space

HH6

The model assumes adjacent-state transitions: HH7 at exponential rate HH8, and HH9 at exponential rate χ\chi0. The authors explicitly interpret this as a continuous-time homogeneous Markov chain.

Transition probabilities over a short interval χ\chi1 are

χ\chi2

and the transition rate is defined by

χ\chi3

The chain is described as homogeneous, irreducible, and continuous.

For the limiting probability χ\chi4, the stationary distribution satisfies the global balance equation

χ\chi5

where χ\chi6 is the outflow rate from χ\chi7 and χ\chi8 is the inflow rate. The paper emphasizes that occupancy of each game state is determined by the chain rates.

The simulations specialize to three game states: PDG, SDG, and SHG, with transitions PDG χ\chi9 SDG at rate Δ\Delta^*0, SDG Δ\Delta^*1 SHG at rate Δ\Delta^*2, SDG Δ\Delta^*3 PDG at rate Δ\Delta^*4, and SHG Δ\Delta^*5 SDG at rate Δ\Delta^*6. The stationary expected numbers are

Δ\Delta^*7

Δ\Delta^*8

Δ\Delta^*9

Increasing Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}0 decreases the number of individuals in PDG and increases SDG/SHG; increasing Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}1 decreases PDG and SDG and increases SHG; increasing Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}2 pushes mass back toward PDG; increasing Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}3 reduces SHG and increases PDG/SDG. The reported relative errors between theory and simulation are all below about Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}4.

The qualitative conclusion is equally direct: Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}5 and Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}6 promote cooperation, whereas Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}7 and Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}8 inhibit cooperation. The mechanism is that each game state Xj(t){G0,G1,,Gn}X_j(t)\in\{G_0,G_1,\cdots,G_n\}9 has its own payoff matrix

λi,μi\lambda_i,\mu_i0

so moving probability mass toward SDG and SHG changes the local incentive structure in a more cooperative direction.

The paper further includes a reputation mechanism,

λi,μi\lambda_i,\mu_i1

neighbor selection probability

λi,μi\lambda_i,\mu_i2

and Fermi strategy adoption

λi,μi\lambda_i,\mu_i3

Game transitions alone help cooperation somewhat, but adding reputation enhances the cooperative outcome more strongly. The model also distinguishes the time scale of game transitions from the time scale of strategy updates, which may be fixed, exponential, or power-law distributed.

5. State-dependent reinforcement in the spatial Prisoner’s Dilemma

"The State-Action-Reward-State-Action Algorithm in Spatial Prisoner’s Dilemma Game" (Yang et al., 2024) states explicitly that “game state impact rate” is not given as a single explicit scalar formula. Instead, it is reflected through how the state definition, action choice, and reward feedback shape the evolution of cooperation and defection over time.

Agents are placed on an λi,μi\lambda_i,\mu_i4 square lattice with periodic boundaries, with λi,μi\lambda_i,\mu_i5, and each agent interacts with its four neighbors. The Prisoner’s Dilemma payoff matrix is

λi,μi\lambda_i,\mu_i6

with

λi,μi\lambda_i,\mu_i7

The paper later sets the single dilemma-strength measure to

λi,μi\lambda_i,\mu_i8

SARSA is used in two ways. In one version, the state λi,μi\lambda_i,\mu_i9 is determined from the cooperation rate between the agent and its neighbors, the action (ht,mt)(h_t,m_t)00 is selecting one neighboring agent as the learning target, and the reward (ht,mt)(h_t,m_t)01 is the cumulative payoff obtained after interacting with neighbors using the chosen strategy. In the second version, the state is again based on the cooperation rate between the agent and its neighbors, but the action is to cooperate or defect directly.

The SARSA update is

(ht,mt)(h_t,m_t)02

For comparison, the paper gives the Q-learning update

(ht,mt)(h_t,m_t)03

The interaction process is described as a Markov decision process

(ht,mt)(h_t,m_t)04

and action choice is (ht,mt)(h_t,m_t)05-greedy: with probability (ht,mt)(h_t,m_t)06, the agent chooses (ht,mt)(h_t,m_t)07; with probability (ht,mt)(h_t,m_t)08, it chooses a random action. The reported parameters are (ht,mt)(h_t,m_t)09, (ht,mt)(h_t,m_t)10, (ht,mt)(h_t,m_t)11, and noise (ht,mt)(h_t,m_t)12.

The paper’s central claim is that the current local neighborhood composition determines the state, the SARSA policy chooses an action, and the resulting payoff becomes the reward signal that drives future behavior. Cooperative clusters, mixed boundaries, and defecting regions therefore produce different Q-values and different action probabilities. Reported spatial dynamics include tight cooperator clusters, difficulty for defectors in penetrating stable cooperative regions, expansion of cooperative clusters over time, and a shown case in which defectors are ultimately eliminated.

Heatmaps show that as (ht,mt)(h_t,m_t)13 and (ht,mt)(h_t,m_t)14 increase, cooperation becomes harder, but SARSA consistently improves cooperation relative to the traditional baseline, especially under harsher dilemma conditions. When the proportion (ht,mt)(h_t,m_t)15 of SARSA agents is varied, cooperation first increases and then decreases, with maximum cooperation occurring when about (ht,mt)(h_t,m_t)16–(ht,mt)(h_t,m_t)17 of agents are SARSA agents. Average reward under SARSA rises over time and becomes higher than the traditional case, while cooperation and reward curves both tend to fall initially and then rise later as SARSA experience accumulates.

6. State information, communication rate, and adversarial unpredictability

"State Information in Bayesian Games" (0911.0874) studies a two-player repeated zero-sum Bayesian game with a random state (ht,mt)(h_t,m_t)18 drawn i.i.d. across stages from (ht,mt)(h_t,m_t)19. At each stage, Player A chooses action (ht,mt)(h_t,m_t)20, Player B chooses action (ht,mt)(h_t,m_t)21, and the stage payoff to Player A is (ht,mt)(h_t,m_t)22. A helper observes the state sequence (ht,mt)(h_t,m_t)23 non-causally and can communicate to Player A over a noiseless link of rate (ht,mt)(h_t,m_t)24 bits per game iteration.

The paper considers several information structures: neither player knows (ht,mt)(h_t,m_t)25; only Player A knows (ht,mt)(h_t,m_t)26; only Player B knows (ht,mt)(h_t,m_t)27; both know (ht,mt)(h_t,m_t)28; and the helper knows (ht,mt)(h_t,m_t)29 and communicates to Player A at rate (ht,mt)(h_t,m_t)30. Its central claim is that communication for adversarial games is not the same as rate-distortion coding, because mixed-strategy randomization is strategically essential.

The erasure game provides the canonical example. Here (ht,mt)(h_t,m_t)31 is equally likely; Player A has actions (ht,mt)(h_t,m_t)32; Player B has actions (ht,mt)(h_t,m_t)33; and if Player A chooses the wrong symbol relative to the state, the payoff is (ht,mt)(h_t,m_t)34 or a very large negative number in a finite version. If Player A knows (ht,mt)(h_t,m_t)35, the optimal mixed strategy is

(ht,mt)(h_t,m_t)36

The reported values under different information structures are: neither knows (ht,mt)(h_t,m_t)37, value (ht,mt)(h_t,m_t)38; both know (ht,mt)(h_t,m_t)39, value (ht,mt)(h_t,m_t)40; A knows (ht,mt)(h_t,m_t)41, value (ht,mt)(h_t,m_t)42; B knows (ht,mt)(h_t,m_t)43, value (ht,mt)(h_t,m_t)44.

The helper’s scheme uses an auxiliary variable (ht,mt)(h_t,m_t)45 with

(ht,mt)(h_t,m_t)46

so that (ht,mt)(h_t,m_t)47 forms a Markov chain. The paper frames this in terms of strong coordination: the aim is to synthesize a joint law on (ht,mt)(h_t,m_t)48 close in total variation to i.i.d. samples from a target (ht,mt)(h_t,m_t)49. The required rate for full synthesis is tied to Wyner common information (ht,mt)(h_t,m_t)50 rather than only (ht,mt)(h_t,m_t)51.

The main theorem uses the quantities (ht,mt)(h_t,m_t)52, (ht,mt)(h_t,m_t)53, and (ht,mt)(h_t,m_t)54 in the rate-performance tradeoff. The paper’s interpretation is that communication rate has two roles: to convey the state information needed to correlate behavior with (ht,mt)(h_t,m_t)55, and to support the randomness needed to keep the action sequence hard for the adversary to predict. For the erasure game, when Player B knows the state and the optimal strategy is

(ht,mt)(h_t,m_t)56

the minimum description rate needed to achieve the optimal payoff is

(ht,mt)(h_t,m_t)57

The paper also describes non-stationary effects over a block: early actions may appear random and well correlated with the state, while later actions may become predictable as the opponent learns the message. This motivates layered coding with multiple auxiliaries. A plausible implication is that, in adversarial repeated games, a “state impact rate” can be understood not only as a dynamical parameter but also as a communication budget governing how much state correlation and strategic unpredictability can be maintained simultaneously.

7. Action-level state deltas in hidden-role games and esports analytics

"Evaluating LLMs in a Complex Hidden Role Game" (Bauer, 9 Apr 2026) introduces Game State Impact Rate (GSIR) as an explicit action-level metric in Secret Hitler. It is designed to measure how much a player’s individual action changes the strategic position of the game. The game state is mapped to a continuous evaluation function, gamestate, ranging from (ht,mt)(h_t,m_t)58 to (ht,mt)(h_t,m_t)59, where negative values mean a fascist advantage and positive values mean a liberal advantage. The score combines five components: policy progress score, deck composition score, president score, role identification accuracy, and Hitler danger score. The normalized game-state score is

(ht,mt)(h_t,m_t)60

where (ht,mt)(h_t,m_t)61 is the raw weighted sum and (ht,mt)(h_t,m_t)62 is the round number.

GSIR is computed from the change in game-state score caused by an action:

(ht,mt)(h_t,m_t)63

The paper then defines GSIR as the mean delta in gamestate attributable to actions by an agent in role (ht,mt)(h_t,m_t)64. Fascist-affiliation scores are inverted so that higher GSIR always means better play for the player’s side. GSIR is presented alongside Role Identification Accuracy (RIA), which measures whether a model correctly identifies others, and Deception Retention Rate (DRR), which measures whether others are fooled about the model’s identity.

The empirical findings are role-sensitive. R1 Distill 70B achieved the best overall GSIR, with an average impact of (ht,mt)(h_t,m_t)65. Qwen 3 32B had the strongest liberal GSIR at (ht,mt)(h_t,m_t)66. R1 Distill 70B was the only model with consistently positive GSIR across all roles, including Hitler, with Hitler GSIR reported as (ht,mt)(h_t,m_t)67. Most models showed negative average impact when playing Fascist or Hitler. In the prompting ablation, a Role Prompt as Hitler produced a delta of (ht,mt)(h_t,m_t)68 on average; Memory achieved (ht,mt)(h_t,m_t)69 overall; and CoT + Memory had the strongest liberal GSIR at (ht,mt)(h_t,m_t)70. The broader benchmark used five-player games against reputation-based agents, and the abstract reports that models playing as Fascists consistently yielded negative impact scores and failed to sustain deception, resulting in roughly (ht,mt)(h_t,m_t)71 shorter games compared to humans.

A closely related construct appears in "Valuing Player Actions in Counter-Strike: Global Offensive" (Xenopoulos et al., 2020), although the paper does not use the label GSIR. Its action-value framework is Win Probability Added (WPA). A game state (ht,mt)(h_t,m_t)72 contains round context at tick (ht,mt)(h_t,m_t)73, and the predictor estimates

(ht,mt)(h_t,m_t)74

where (ht,mt)(h_t,m_t)75 if CT wins round (ht,mt)(h_t,m_t)76. The value of action (ht,mt)(h_t,m_t)77 is

(ht,mt)(h_t,m_t)78

This is the change in predicted win probability caused by the action. Player WPA is the sum of action values, reported as WPA per round.

The state features used for prediction are Map, Ticks Since Start, Equipment Value, Players Remaining, HP Remaining, Bomb Planted, Bomb Plant Site, and Team Bombsite Distance. The paper evaluates logistic regression, CatBoost, and XGBoost, with XGBoost performing best: log loss (ht,mt)(h_t,m_t)79, Brier score (ht,mt)(h_t,m_t)80, and AUC (ht,mt)(h_t,m_t)81. It also reports that WPA has the highest month-to-month correlation among the compared metrics at (ht,mt)(h_t,m_t)82, ahead of KDR at (ht,mt)(h_t,m_t)83, ADR at (ht,mt)(h_t,m_t)84, KAST\% at (ht,mt)(h_t,m_t)85, and Rating 2.0 at (ht,mt)(h_t,m_t)86. An illustrative use case is a ZywOo clutch in which a headshot in a 1-vs-2 situation with 13 HP increases win probability by (ht,mt)(h_t,m_t)87.

Taken together, these works suggest that “game state impact rate” is best understood as a state-relative measure of consequence. Depending on the domain, it may be the rate at which an adaptive opponent updates, the susceptibility of a stationary regime, the transition intensity between game states, the reinforcement effect of local social state, the communication rate required for strategically useful state information, or the change in a continuous game-state evaluation induced by a single action. The common structure is that impact is defined relative to a state representation and a dynamical or evaluative rule, not as an isolated property of actions alone.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Game State Impact Rate.