Papers
Topics
Authors
Recent
Search
2000 character limit reached

Mini Amusement Parks (MAPs) Benchmark

Updated 5 July 2026
  • Mini Amusement Parks (MAPs) is an open-ended simulator that integrates business management, pricing, spatial planning, and long-horizon decision-making under uncertainty.
  • The benchmark evaluates multi-faceted aspects including ride placement, staffing, research sequencing, and sandbox experimentation to mirror realistic business dynamics.
  • Empirical results reveal significant performance gaps between human operators and LLM-based agents, highlighting challenges in world modeling and strategic planning.

Mini Amusement Parks (MAPs) is an amusement-park simulator designed to evaluate decision making in a domain that combines open-ended objectives, sparse experience, long-horizon stochastic planning, and spatial reasoning. In its 2025 formulation, MAPs is presented as a benchmark for modelling business decisions, with human baselines and a comparative evaluation of LLM-based agents; humans outperform the tested systems by 6.5x on easy mode and 9.8x on medium mode. A related antecedent is Micro RollerCoaster Tycoon, an earlier open-source simulator that used MAP-Elites to explore diverse park layouts and theoretical questions about complexification and resource constraints in open-ended gameplay design (Aroca-Ouellette et al., 19 Nov 2025, Green et al., 2021).

1. Scope, domain, and research framing

MAPs is motivated by the claim that practical domains such as business management require optimizing an open-ended and multi-faceted objective, actively learning environment dynamics from sparse experience, planning over long horizons in stochastic settings, and reasoning over spatial information. The benchmark is intended to assess an agent’s ability to model its environment, anticipate long-term consequences under uncertainty, and strategically operate a complex business. The published codebase is available at https://github.com/Skyfall-Research/MAPs (Aroca-Ouellette et al., 19 Nov 2025).

This framing distinguishes MAPs from benchmarks that isolate only one capability. In MAPs, park operation is not reduced to static layout design: the formal task includes pricing, inventory, staffing, research, and optional experimentation in a sandbox before evaluation. A plausible implication is that MAPs is meant to test whether an agent can integrate operational control, environment modelling, and strategic adaptation within one sequential decision process rather than solve these components independently.

Micro RollerCoaster Tycoon provides a complementary reference point. Its goal is to place rides and shops in an amusement park to maximize profit earned from park guests, and it was used to study whether starting from a minimal starting point for evolution and complexifying incrementally is beneficial, and what effects resource limitations have on creativity and optimization. This suggests a lineage in which amusement-park simulators moved from quality-diversity exploration of layouts toward broader tests of business-style decision making (Green et al., 2021).

2. Formal environment model

In MAPs, the park state at day tt is formalized as

st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),

where Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20} is the occupancy matrix, RtR_t and StS_t record each ride and shop’s subtype, subclass, location, price pip_i, stock qiq_i, and dynamic stats, TtT_t is staff allocation and locations, ρt{“none”,“slow”,“medium”,“fast”}\rho_t\in\{\text{“none”,“slow”,“medium”,“fast”}\} and topic queue encode research progress, mtR+m_t\in\mathbb{R}_+ is money on hand, and st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),0 summarizes estimated arrival rate, current guest count, and aggregate satisfaction features (Aroca-Ouellette et al., 19 Nov 2025).

Each morning the agent chooses exactly one action st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),1. The action set includes:

  • place(x,y,type,subtype,subclass,price,order_quantity)
  • move(id,x′,y′), remove(id)
  • modify(id,price) or modify(id,order_quantity)
  • hire(subtype,subclass)
  • set_research(topic,speed)
  • survey_guests(), wait()

The per-period reward is defined as operating revenue minus operating cost minus overhead: st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),2 and the finite-horizon objective is

st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),3

Transition dynamics are stochastic. Guest arrivals follow a Poisson whose rate depends on park rating and capacity; breakdowns occur with per-ride Bernoulli probability st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),4; dirt accumulates proportionally to guest footfall; and staff cleaning and mechanics repair reduce dirt and downtime according to deterministic rates plus small noise. Spatially, the park is a st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),5 grid with a path matrix st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),6, water matrix st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),7, and occupancy matrix st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),8. Guests follow shortest-path distances on st=(Ot,Rt,St,Tt,ρt,mt,guest_statst),s_t=\bigl(O_t,R_t,S_t,T_t,\rho_t,m_t,\,\text{guest\_stats}_t\bigr),9, and a ride’s appeal is increased by the number of adjacent water tiles. This combination makes the state partially operational, partially geometric, and explicitly dynamic (Aroca-Ouellette et al., 19 Nov 2025).

3. Decision variables, difficulty modes, and sandboxing

MAPs exposes a daily business-control interface. The agent may choose locations Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}0 for attractions or shops, set ticket prices Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}1 for rides and item prices for shops, choose order quantity Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}2 for each shop to balance stockouts versus waste, allocate staff by hiring or firing mechanics, janitors, and specialists and placing them on the grid, and sequence research topics to unlock higher-tier entities (Aroca-Ouellette et al., 19 Nov 2025).

The benchmark defines three official difficulty modes.

Mode Horizon and unlock state Emphasis
Easy Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}3 days; all ride/shop/staff subclasses unlocked; no research Basic capacity-pricing trade-offs
Medium Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}4; only yellow tier unlocked at start; research depth requires one or more research steps at monetary cost Extended planning and research sequencing
Hard (in development) Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}5; additional mechanics include terraforming, guest-preference heterogeneity, and debt Deeper long-horizon strategy

In addition, every agent can optionally use a sandbox mode for up to 100 in-game days before evaluation. Sandbox actions are max_money, unlock_all, reset, and switch_layout. These actions allow curated experiments to learn transition dynamics under a limited sample budget.

A common simplification is to view amusement-park environments as only placement problems. MAPs is broader: placement is only one action family within a control regime that also includes pricing, inventory, staffing, research, surveying, and deliberate waiting. This is central to its use as a testbed for modelling business decisions (Aroca-Ouellette et al., 19 Nov 2025).

4. Evaluation protocol and empirical baselines

The primary evaluation metric is final park value,

Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}6

where Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}7 is a small constant for intellectual-property credit. Additional metrics are total profit Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}8, customer satisfaction via average rides and shops visited, and sample efficiency in sandbox, measured as increase in Ot{0,1}20×20O_t\in\{0,1\}^{20\times 20}9 per sandbox day (Aroca-Ouellette et al., 19 Nov 2025).

Human players collectively achieved mean RtR_t0 on easy and RtR_t1 on medium. LLM-based agents use a ReAct loop with a 5-step context window, conditioning on the JSON observation and the game manual. Evaluation is reported over three held-out layouts RtR_t2 3 seeds.

Difficulty GPT-5 Nano GPT-5 Grok 4 Sonnet 4.5 Gemini 2.5
Easy RtR_t3 RtR_t4 RtR_t5 RtR_t6 RtR_t7
Medium RtR_t8 RtR_t9 StS_t0 StS_t1 StS_t2

GPT-5’s easy-mode lead over the other LLMs is reported as StS_t3 under a paired StS_t4-test across layouts. The aggregate comparison nevertheless remains strongly unfavorable to current systems: even the strongest model reaches only StS_t5 of human performance on medium. This supports the benchmark’s claim that current agents struggle when open-ended objectives, temporal credit assignment, stochasticity, and spatial reasoning are coupled in one environment (Aroca-Ouellette et al., 19 Nov 2025).

5. Diagnosed capability gaps

The MAPs evaluation isolates five recurring failure modes. First, under open-ended objectives, models exhibit myopic, greedily optimized strategies. Second, under long-horizon planning, doubling the horizon from StS_t6 and adding research cuts GPT-5’s relative score from StS_t7. Third, under active world-model learning, allowing 100 sandbox days with “undo” and “max_money” produces no consistent improvement: GPT-5 moves from StS_t8 on easy but often degrades on medium, and qualitative analysis reports overfitting to day-specific observations, regurgitation of manual text, and failure to extract actionable, generalizable hypotheses (Aroca-Ouellette et al., 19 Nov 2025).

Fourth, under spatial reasoning, a simple heuristic that places rides near water, shops at path intersections, and clusters attractions raises GPT-5 from StS_t9 on easy, while LLM-only policies often produce parks that lack density or misinterpret winding path distances. Fifth, under stochastic transitions, per-day coefficient of variation for revenue can exceed pip_i0 in early stages and drops to approximately pip_i1 later. In the reported planning experiment, MPC with a learned WALL-E world model degrades performance because of prediction errors, whereas an oracle model yields pip_i2 improvement over the policy alone. The random-shooting MPC uses pip_i3 rollouts and pip_i4 world-model steps.

These findings also correct a possible misconception about sandbox access: optional experimentation does not by itself solve model-learning deficits. The published results indicate that better experimentation policies and better summarization of experimental outcomes are both necessary before sandboxing becomes reliably beneficial (Aroca-Ouellette et al., 19 Nov 2025).

6. Relation to MicroRCT and implications for park-design research

Micro RollerCoaster Tycoon defines a park on a pip_i5 tile grid with a single, “donut-shaped” main path, with the entrance in the upper-left, that is pre-built and immutable. Attractions may be added, removed, or replaced on empty non-path tiles, and when a new attraction is added, depth-first-search on the free-space graph builds the shortest connecting spur from the attraction’s door to the main path. The environment includes 24 attraction types, including 5 rollercoasters, thrill rides, transportation rides, cinemas, Circus, Crooked House, shops, restrooms, and first-aid; each has a cost per tile and metadata pip_i6 matching original RCT values (Green et al., 2021).

MicroRCT defines total profit as

pip_i7

and uses static and runtime descriptors including average excitement, intensity, nausea, Shannon-entropy ride-type diversity, happiness, vomit, and revenue. Its search procedure is MAP-Elites with a single objective, maximize total profit pip_i8, and three 2-D behavior-characterization pairings: Excitement vs Intensity, Happiness vs Ride Diversity, and Happiness vs Vomit. Initialization is either small-park, with 0–4 attractions and mutation bias pip_i9 remove versus qiq_i0 add/replace, or medium-park, with 8–12 attractions and 50/50 add versus remove. There is no crossover operator; only mutation is used (Green et al., 2021).

The experimental design comprised qiq_i1 initial-size qiq_i2 cost qiq_i3 descriptor pairings qiq_i4 experiment types, with 20 independent runs per type, 240 runs total, and 10,000 generations per run. Cost-disabled parks routinely reached qiq_i5 peaks, while cost-enabled parks were capped lower at approximately qiq_i6. For the Excitement-Intensity pairing, reported QD scores were qiq_i7 for small, no cost; qiq_i8 for medium, no cost. In every pairing, “small + no cost” yielded the highest QD score, and cost-disabled runs filled more cells in the MAP (Green et al., 2021).

The reported elite maps further show that, in the Excitement-Intensity space, the highest-profit cells correspond to moderate excitement and intensity around 30–40 and use a mix of coasters and freefall rides; in the Happiness-Vomit space, the most profitable parks occupy the low-happiness, high-vomit region. Two distinct high-profit strategies are identified: “Shock & awe,” with many nauseating rides and minimal shops, and “Comfort funnel,” with fewer coasters and many concessions. A plausible implication for MAPs is that the amusement-park domain naturally supports multiple behaviorally distinct profit strategies, which makes it suitable both for quality-diversity analysis and for diagnosing failures in long-horizon business decision making.

7. Open directions

The MAPs roadmap includes a hard difficulty with qiq_i9, terraforming, guest-preference heterogeneity, and debt. Additional proposed directions are richer observation modalities, including grid-vector inputs for traditional RL and image plus text for multimodal LLMs; improved active world-model learning through concise, general causal hypotheses; scalable stochastic world models through hybrid neuro-symbolic or programmatic inference beyond WALL-E; and spatial or graph-based planners that explicitly optimize layout density and flow by embedding TtT_t0 and TtT_t1 into a learnable graph representation (Aroca-Ouellette et al., 19 Nov 2025).

Taken together, the published results position MAPs as a benchmark for holistic decision-making competence in a controlled but open-ended business environment, while MicroRCT demonstrates that even a simpler amusement-park simulator already exhibits wide design-space diversity and strong interactions between budget, layout, guest experience, and revenue. The combination of these two lines of work suggests that mini amusement parks are not merely game environments; they are compact laboratories for studying optimization under uncertainty, world modelling, and strategic adaptation (Aroca-Ouellette et al., 19 Nov 2025)

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Mini Amusement Parks (MAPs).