Speculative Actions in Cross-Domain Systems
- Speculative Actions are provisional procedures that execute candidate steps under uncertainty and verify outcomes later to ensure exactness or strategic advantage.
- They span diverse fields such as language model inference, agentic control, autonomous planning, financial trading, and security, each with tailored safety or performance checks.
- Recurring design principles include draft–verify accuracy, parallel pre-launch with authoritative verification, and strategic allocation to balance risk and reward.
Searching arXiv for the cited works and closely related papers on speculative actions across inference, agentic systems, finance, systems security, and control. “Speculative actions” is a cross-domain label for procedures that act ahead of full validation under uncertainty, while preserving some target property such as exact output distribution, safety, or strategic advantage. In sequence modeling, speculative actions are provisional token choices drafted by a smaller model and later verified by a larger model without changing the final sampling law (Leviathan et al., 2022). In agentic systems, they are pre-launched environment interactions predicted by a faster model and committed only when they match the authoritative trajectory (Ye et al., 5 Oct 2025). In autonomous driving and embodied control, they are candidate controls chosen against multiple possible futures and retained only when safety remains guaranteed across feasible scenarios (Liu et al., 2023, Wang et al., 3 Apr 2026). In finance and token markets, the phrase refers instead to economically motivated actions such as buying on expected rises, selling on expected falls, withdrawing supply from circulation, or liquidating into cash in anticipation of devaluation (Inoua, 2016, Wang et al., 2024, Hymas et al., 6 Feb 2026). In computer systems, speculative actions are transient instructions executed before control-flow resolution, including loads and stores whose architectural effects are rolled back but whose microarchitectural effects may persist (Guarnieri et al., 2018, Kocher et al., 2018, Kiriansky et al., 2018, Wu et al., 2019). Across these literatures, the common structure is provisional execution plus later validation, correction, or strategic consequence.
1. Language-model inference and exact speculative execution
The most formal computational use of speculative actions in the provided literature comes from speculative decoding for autoregressive Transformers (Leviathan et al., 2022). In the standard setup, a target model defines the next-token distribution
and a smaller approximation model defines
Ordinary decoding requires one serial target-model call per token. Speculative decoding instead treats future next-token predictions as speculative actions: drafts candidate tokens, and verifies the corresponding continuations in parallel (Leviathan et al., 2022).
The core single-token primitive is speculative sampling. One first samples , accepts it with probability
and if it is rejected, resamples from the residual distribution
This correction step is the exactness mechanism: speculative actions are repaired by reallocating the rejected mass to the part of 0 not already covered by 1, rather than by naive rejection retry (Leviathan et al., 2022).
At sequence level, 2 rolls out a draft trajectory 3, while 4 evaluates
5
in parallel. Tokens are accepted until the first rejection, and the rejected position is corrected from
6
The resulting emitted sequence has exactly the same distribution as ordinary decoding from 7 (Leviathan et al., 2022). This exactness is central: speculative actions are provisional, but the final sampling law is unchanged.
The acceptance rate is
8
and the paper defines
9
so that
0
Under an i.i.d. approximation with average acceptance 1, the expected number of generated tokens per target-model iteration is
2
and the expected walltime improvement factor is
3
where 4 is the runtime cost of one call to 5 relative to one call to 6 (Leviathan et al., 2022). The method was demonstrated on T5-XXL with T5-large, T5-base, and T5-small as draft models, yielding 2.6X and 3.4X on WMT EnDe and 2.3X and 3.1X on CNN/DM for 7 and 8 respectively, with identical outputs (Leviathan et al., 2022).
Subsequent work generalizes what is being speculated about. “Speculative Decoding with a Speculative Vocabulary” (Williams et al., 14 Feb 2026) introduces vocabulary speculation: instead of scoring a fixed reduced vocabulary, the draft model predicts a context-specific subset 9 at each decoding step. With draft hidden state 0, the method computes
1
then evaluates exact logits only on the selected rows
2
The restricted draft distribution is
3
The paper emphasizes that this preserves the identical-output guarantee because the target verifier remains authoritative (Williams et al., 14 Feb 2026). Reported gains include a 4 acceptance-length increase on Qwen3 8B, throughput improvements of 5, 6, 7, and 8 over reproduced EAGLE-3 across Qwen3 8B, Qwen3 4B, OLMo 2 1B, and OLMo 2 7B, and an implementation result of roughly 9 to 0 speedup for the indexed LM head kernel (Williams et al., 14 Feb 2026).
A related line combines speculative decoding with model cascades. “Faster Cascades via Speculative Decoding” (Narasimhan et al., 2024) defines a cascade target distribution
1
where 2 is a deferral rule. The speculative action remains the small model’s drafted token, but verification is now against the cascade-induced target rather than always against 3. The paper derives the speculative-optimal token-level deferral rule
4
and proposes the plug-in rule
5
Empirically, SpecCascade [OPT] reached latency reductions such as 1.95\times on WMT and 1.80\times on CNN/DailyMail for T5-small 6 T5-large when matching the large model’s quality, and 2.61\times on WMT for T5-small 7 T5-XL (Narasimhan et al., 2024). This suggests that speculative actions can be coupled not only to exact verification but also to selective deferral logic.
2. Agentic systems, planning, and embodied control
The term “Speculative Actions” is made explicit as a systems framework in “Speculative Actions: A Lossless Framework for Faster Agentic Systems” (Ye et al., 5 Oct 2025). There, an agentic system is modeled as an MDP with states 8 and actions 9, but actions are interpreted operationally as API calls: 0 The bottleneck is serialized environment interaction. The speculative-action remedy is to introduce a faster Speculator that predicts likely current-step responses 1, from which likely next-step calls can be pre-launched while the authoritative Actor is still executing (Ye et al., 5 Oct 2025).
The framework’s two explicit assumptions are Assumption 1 (Speculation accuracy) and Assumption 2 (Concurrent, reversible pre-launch). Under these assumptions, Algorithm 1: Speculative actions with 2-way parallel next calls maintains a cache 3 from predicted API descriptors to pending futures. The system checks for cache hits, otherwise launches the real call
4
obtains 5 candidate predicted current-step responses
6
maps them to speculative next states
7
derives predicted next calls
8
and pre-launches them asynchronously. If one of these matches the realized trajectory, the next step becomes a cache hit (Ye et al., 5 Oct 2025).
The paper provides an expected runtime analysis. With speculation success probability 9, speculative latency 0, actual API latency 1, and negligible 2 overhead, the asymptotic runtime ratio is
3
The ideal one-step bound approaches roughly 50% latency reduction when 4 and 5 (Ye et al., 5 Oct 2025). Experiments report 54.7% next-action prediction accuracy and 19.5% time saving in chess with 3 predictions, 22% to 38% API prediction accuracy in e-commerce, 34% approximate pre-resolution accuracy at about 30 seconds user-typing time in the multi-model setting, and 46% strict exact-match next-call accuracy with top-3 prediction in HotpotQA (Ye et al., 5 Oct 2025). A lossy OS-control extension reports p95 latency improvements from 102.97 ms untuned to 54.00 ms for Actor-only and 37.93 ms for Actor + Speculator, with the combined system reaching approximately 0.2 ms min_granularity in 10–15 seconds versus around 200 seconds for Actor-only (Ye et al., 5 Oct 2025).
A different but related use of speculative actions appears in autonomous driving. “Safety-Assured Speculative Planning with Adaptive Prediction” (Liu et al., 2023) treats the speculative action as a current ego acceleration chosen under multimodal uncertainty about surrounding vehicles. The system state is
6
and the prediction interface is
7
combining route-level probabilities 8 and trajectory-level uncertainty 9. The planner maximizes expected reward over scenarios while enforcing robust safety: 0 Safety requires
1
The reward is instantiated as 2. The planner first filters unsafe actions by worst-case gap, then evaluates expected reward by sampling feasible scenarios (Liu et al., 2023). In 10,000 SUMO simulations, the proposed SPAP achieved 100% safety with 27.56 m/s average speed, and SPAP+agg achieved 100% safety with 27.90 m/s, outperforming MPC at 25.85 m/s, MPC+agg at 26.45 m/s, and the IDM baselines (Liu et al., 2023).
Speculative actions in embodied control are also central in “Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA” (Wang et al., 3 Apr 2026). There, a heavy VLA macro-planner produces
3
with
4
while a lightweight verifier continuously monitors current observations 5 using
6
The discrepancy with the planned action 7 is
8
and replanning is triggered when 9. The execution rule is
0
On LIBERO, SV-VLA reached 90.9% average success at 2.17\times speed, versus 79.5% at 3.15\times for blind open-loop 1 and 96.0% at 1.00\times for dense 2 replanning (Wang et al., 3 Apr 2026). The paper reports 1.373 s per macro-planner call and 0.081 s per verifier call, making the verifier cheap enough for continuous monitoring (Wang et al., 3 Apr 2026). This is another strong instance of speculative actions as provisional execution with online verification.
3. Finance, token markets, and trading behavior
In economic settings, speculative actions are not provisional computations but strategic market acts. “Speculation and Power Law” (Inoua, 2016) defines a purely speculative market as one in which traders buy because they expect a price rise and sell because they expect a price fall. The individual speculative action rule is
3
with aggregate demand
4
and linear price impact
5
Combining these yields
6
Under passive expectations,
7
so returns follow
8
The paper’s main claim is that speculative actions induce a Kesten process, yielding power-law return tails when the Cramér condition
9
holds (Inoua, 2016). This framework interprets speculative action as directional trend reinforcement: expected rises induce buying; expected falls induce selling. It explains heavy tails but, as the paper explicitly states, does not explain volatility clustering (Inoua, 2016).
A more applied token-market formulation appears in “Modeling Speculative Trading Patterns in Token Markets: An Agent-Based Analysis with TokenLab” (Wang et al., 2024). There, speculative actions are modeled as a supply controller layered on top of utility-token demand. The pricing backbone is the token-economy version of the Quantity Theory of Money,
0
where 1 is token supply, 2 is token price, 3 is transaction volume, and 4 is average token holding time (Wang et al., 2024). The core modeling move is to represent speculation not as a change in average holding time but as changes in market-accessible supply: speculative buying removes tokens from liquid circulation, while take-profit and stop-loss triggers reintroduce supply later (Wang et al., 2024).
The speculative controller’s logic is: a fixed proportion of trading volume is allocated to speculation; speculative purchases are stored with take-profit and stop-loss thresholds; sales occur when thresholds are met; and these sales alter effective circulating supply, which feeds back into QTM-style price formation (Wang et al., 2024). The five archetypes in the LINK case study are concrete realizations of speculative actions. For example, Limited Short-term Trading (Low Volume) uses 30% speculative volume, take profit at 120% of purchase price, and stop loss at 80%; Massive Patient Capital (High Volume) uses 70%, take profit at 240%, and stop loss at 25% (Wang et al., 2024). The “no speculator” benchmark underpredicts prices strongly, with average percentage deviations of 5, 6, 7, and 8, while the best-fitting speculative regime changes by market phase: Speculator 2 in the early upward phase, Speculator 3 in the correction phase, and patient-capital types in later stabilization (Wang et al., 2024). This suggests that in token markets, speculative actions reshape both effective supply and inferred market sentiment.
“Repeated Auctions with Speculators: Arbitrage Incentives and Forks in DAOs” (Eschenbaum et al., 27 May 2025) analyzes speculative actions in governance systems. Here the speculative action is strategic entry into repeated auctions for governance shares in order to later redeem treasury value through a fork or exit mechanism. Treasury evolves as
9
and a fork can occur when
00
The arbitrageur’s utility from winning depends on the expected redemption value
01
The paper shows three equilibrium regimes: guaranteed exploitative exit, exploitative exit in expectation, and no exploitative exit (Eschenbaum et al., 27 May 2025). The most important design result is that a capped contribution-based redemption rule,
02
eliminates speculative entry entirely: no Type I or Type II equilibria can arise and no forking occurs (Eschenbaum et al., 27 May 2025). This is a clean case in which speculative actions are strategic governance purchases for later treasury extraction.
A more unconventional market model appears in “Quenching Speculation in Quantum Markets via Entangled Neural Traders” (Hymas et al., 6 Feb 2026). The paper interprets speculative actions as recursive downward valuation and liquidation: agents “anticipated the devaluation of the commodity and sought to maximize their net worth by rapidly liquidating stock holdings in exchange for cash,” which “precipitated a sharp decline in the commodity price” (Hymas et al., 6 Feb 2026). In the classical learned market, eight RL traders repeatedly choose sign and magnitude of a valuation signal, with matching under a bid-ask tolerance of 1 cash unit, initial endowments of 10 cash and 10 stock units, and training via REINFORCE with ADAM at learning rate 03 (Hymas et al., 6 Feb 2026). The classical benchmark aligns with the 04-guessing game, where the unique pure-strategy equilibrium is
05
The quantum market modifies valuations using an entangling circuit
06
and adjusted valuations
07
The reported effect is that the average price stabilizes near the initialized value rather than collapsing, and entanglement strength 08 improves stabilization monotonically (Hymas et al., 6 Feb 2026). This suggests a different use of the term: speculative actions as self-reinforcing liquidation choices induced by higher-order expectations.
Finally, “Reinforcement Learning for Speculative Trading under Exploratory Framework” (Zhao et al., 2 Apr 2026) treats speculative actions as entry and exit timing decisions in a continuous-time trading problem. The original objective is
09
The paper relaxes stopping times into Cox-process intensities 10 and 11, then introduces exploratory control via distributions 12 and 13 over 14, regularized by Shannon differential entropy
15
This yields closed-form Gibbs policies for entry and exit intensities, such as
16
Here speculative actions are not approximate computations but randomized timing controls over when to enter and liquidate positions (Zhao et al., 2 Apr 2026).
4. Speculative actions in computer architecture, security, and static analysis
In systems security, speculative actions are transient instructions executed before the processor knows they belong to the architecturally correct path. “Spectre Attacks: Exploiting Speculative Execution” (Kocher et al., 2018) emphasizes the distinction between architectural rollback and persistent microarchitectural side effects. In the canonical bounds-check-bypass example,
28
speculative execution may transiently read array1[x] out of bounds and use it to access array2[array1[x] * 256], encoding the secret-dependent value into cache state (Kocher et al., 2018). The paper also presents branch target injection, where predictor mistraining causes an indirect branch to transiently jump to a gadget (Kocher et al., 2018). In this literature, speculative actions are transient loads, stores, and control transfers whose architectural effects are discarded but whose cache, predictor, or timing footprints remain.
“SPECTECTOR: Principled Detection of Speculative Information Flows” (Guarnieri et al., 2018) gives a semantic account of such actions. It models branch speculation with bounded speculative transactions, a prediction oracle 17, and rollback markers. The speculative semantics extends observations with start id, commit id, and rollback id, and formalizes speculative non-interference: 18
The central requirement is that speculatively executed instructions should not leak more information into microarchitectural state than non-speculative execution already does (Guarnieri et al., 2018). The paper proves that checking an always-mispredict bounded-window semantics suffices for SNI up to that window (Guarnieri et al., 2018).
“Speculative Buffer Overflows: Attacks and Defenses” (Kiriansky et al., 2018) extends the threat model from speculative loads to speculative stores. Its canonical Spectre1.1 pattern is
29
which yields a speculative arbitrary write primitive: attacker-controlled address via c + y and attacker-controlled or known value via z (Kiriansky et al., 2018). Because of speculative store-to-load forwarding, such stores can transiently overwrite return addresses, function pointers, vtables, GOT/IAT entries, or mitigation metadata, enabling arbitrary speculative code execution (Kiriansky et al., 2018). Spectre1.2 further considers speculative overwrite of read-only data on CPUs that defer read/write permission enforcement (Kiriansky et al., 2018). In this context, speculative actions are transient memory-safety violations, not just transient reads.
“Abstract Interpretation under Speculative Execution” (Wu et al., 2019) addresses how to statically analyze speculative actions. Its key abstraction is virtual control flow, which augments the CFG with special nodes 19 and 20 to model speculative branch execution and rollback. The abstract interpreter maintains ordinary states 21 and speculative states 22, propagating both through the augmented CFG. In the implemented cache analysis, cache state is represented as
23
with must-join
24
The method is sound under a user-supplied speculation-depth bound and outperforms a prior non-speculative static cache analysis while detecting leaks in benchmarks where the baseline found none (Wu et al., 2019). This shows that speculative actions in hardware can be reified as virtual control-flow behaviors for analysis.
5. Speculative beliefs, hidden opponents, and social-world interventions
Not all uses of speculative actions concern execution or markets. “Decision-making with Speculative Opponent Models” (Sun et al., 2022) uses the term in multi-agent RL to refer to speculated opponent actions. In a partially observable Markov game, agent 25 cannot observe opponents’ observations or actions directly, so it learns opponent models 26 from its own local information. These produce explicit distributions over opponents’ actions, yielding the belief-conditioned policy
27
Thus the controlled action is chosen by marginalizing over speculative opponent joint actions (Sun et al., 2022). The paper derives gradients for both the policy and speculative opponent models under an entropy-regularized return objective and reports superior performance across MPE, Pommerman, and SMAC (Sun et al., 2022). Here speculative actions are internal conjectures about what hidden opponents will do next.
A sociotechnical use appears in “What If We Work Together? Fostering Reflections on Designer Inclusion in Open Source Software Through Speculative Design” (Nezhad et al., 27 Apr 2026). This paper is qualitative rather than mathematical, but it also treats speculative actions as alternative ways of acting under imagined futures. Two speculative societies—Husia and Reetar—are used to provoke reflection on OSS designer inclusion. Husia emphasizes collective infrastructure such as the Hive, Central Board, and Xagons; Reetar centers Reputation Points (RPs), Aplat, and a design master role (Nezhad et al., 27 Apr 2026). The empirical corpus included 65 posts and 652 comments from OSS-related forums, and the user study involved 12 OSS practitioners: seven designers and five developers (Nezhad et al., 27 Apr 2026). The paper reports that these speculative scenarios elicited action proposals around onboarding, design-credit systems, integrated tooling, and institutional support (Nezhad et al., 27 Apr 2026). This suggests a broader, non-algorithmic sense of speculative actions: acting on alternative institutional arrangements to surface latent norms and possible interventions.
6. Comparative synthesis and recurrent design patterns
Across the cited literature, speculative actions fall into several structurally distinct families. In inference and agentic systems, they are provisional computations or environment interactions whose validity is checked later (Leviathan et al., 2022, Ye et al., 5 Oct 2025, Wang et al., 3 Apr 2026). In robust planning and control, they are candidate actions chosen under multimodal forecasts, screened by safety or online verification (Liu et al., 2023, Wang et al., 3 Apr 2026). In finance and governance, they are market or portfolio moves motivated by anticipated future price changes, supply effects, or redemption opportunities (Inoua, 2016, Wang et al., 2024, Eschenbaum et al., 27 May 2025, Zhao et al., 2 Apr 2026). In security, they are transient machine instructions executed under unresolved control flow (Guarnieri et al., 2018, Kocher et al., 2018, Kiriansky et al., 2018, Wu et al., 2019). In multi-agent learning and speculative design, they become, respectively, inferred opponent actions and action possibilities surfaced by counterfactual sociotechnical worlds (Sun et al., 2022, Nezhad et al., 27 Apr 2026).
Several recurring design principles are visible.
| Pattern | Representative papers | Core idea |
|---|---|---|
| Draft–verify exactness | (Leviathan et al., 2022, Williams et al., 14 Feb 2026, Narasimhan et al., 2024) | Act early, then verify or correct without changing the target distribution |
| Parallel pre-launch with authoritative commit | (Ye et al., 5 Oct 2025, Wang et al., 3 Apr 2026) | Overlap slow sequential steps by predicting future actions and caching likely branches |
| Worst-case safety with probabilistic exploitation | (Liu et al., 2023) | Use likely futures for reward, but filter actions through robust safety constraints |
| Strategic speculative allocation | (Inoua, 2016, Wang et al., 2024, Eschenbaum et al., 27 May 2025, Zhao et al., 2 Apr 2026) | Buy, sell, hold, enter, or exit based on anticipated future returns or redemption value |
| Transient execution with persistent side effects | (Guarnieri et al., 2018, Kocher et al., 2018, Kiriansky et al., 2018, Wu et al., 2019) | Architectural rollback does not remove microarchitectural consequences |
A plausible implication is that the term “speculative actions” is best understood not as a single method but as a general schema: advance a candidate action under an uncertainty model, preserve a domain-specific correctness criterion by verification or robust screening when possible, and otherwise accept strategic exposure to risk when verification is not available. The exact criterion differs by field: identical output distribution in speculative decoding (Leviathan et al., 2022), as-if-sequential semantics in lossless agentic systems (Ye et al., 5 Oct 2025), hard safety in autonomous driving (Liu et al., 2023), equilibrium profit in finance (Eschenbaum et al., 27 May 2025), or microarchitectural observability in security (Guarnieri et al., 2018).
Important misconceptions are corrected by this comparison. Speculative actions are not always approximations: speculative decoding is exact with respect to the target model (Leviathan et al., 2022), and speculative cascades are exact with respect to their target distribution (Narasimhan et al., 2024). Conversely, they are not always benign performance tricks: in hardware security they create attack surfaces (Kocher et al., 2018, Kiriansky et al., 2018), and in governance design they create extractive opportunities (Eschenbaum et al., 27 May 2025). Nor are they identical to bubbles or irrationality in finance: several of the financial papers model them as individually rational responses to expected returns, arbitrage, or threshold rules (Inoua, 2016, Wang et al., 2024, Zhao et al., 2 Apr 2026).
Taken together, the literature indicates that speculative actions are most analytically fruitful when four elements are explicit: a proposal mechanism, a latent or delayed validation event, a state channel through which provisional actions can persist or matter, and a criterion for commit, correction, or rollback. This suggests a shared vocabulary across machine learning, control, finance, and systems research, even though the objects being speculated about—tokens, API calls, accelerations, supply withdrawals, governance shares, or transient instructions—are domain-specific.