---
title: 'Verti-Arena: Indoor Off-Road Benchmark'
url: https://www.emergentmind.com/topics/verti-arena
type: topic
---

# Verti-Arena: Indoor Off-Road Benchmark

Verti-Arena is a reconfigurable indoor facility designed specifically for off-road autonomy, introduced to address the lack of a controllable and standardized real-world testbed for systematic data collection and validation in off-road navigation research. It provides a repeatable benchmark environment for reproducible experiments across vertically challenging terrains, precise ground-truth measurement through onboard sensors and a motion-capture system, and a web-based interface for remotely conducting standardized experiments [2508.08226].

## 1. Research role and problem setting

Off-road navigation is framed as a core capability for mobile robots operating in environments that are inaccessible or dangerous to humans, including disaster response and planetary exploration. The central limitation identified for the field is not only algorithmic difficulty but also experimental infrastructure: progress is constrained by the absence of a controllable and standardized real-world testbed that supports systematic data collection, validation, and comparative evaluation [2508.08226].

Within that setting, Verti-Arena is positioned as an indoor benchmark facility rather than merely a robotics course. Its function is to make experiments repeatable across terrain conditions, to support consistent data collection, and to permit comparative evaluation of off-road autonomy algorithms under shared conditions. This suggests a research emphasis on inter-run comparability, cross-model benchmarking, and reproducibility across laboratories rather than solely on one-off demonstrations.

## 2. Physical configuration and terrain modularity

Verti-Arena spans an $8\,\mathrm{m}\times 8\,\mathrm{m}$ footprint and supports a maximum elevation change of $0.7\,\mathrm{m}$. The floor is composed of a $4\times 4$ grid of $2\,\mathrm{m}\times 2\,\mathrm{m}$ terrain panels, each of which can be individually swapped or rearranged. Elevation features are constructed from interlocking plywood wedges and foam inserts that lock into dovetail channels on each panel, enabling the formation of hills, cliffs, ravines, and ramps. Slopes and steps can be configured with varying pitch up to $30^\circ$ [2508.08226].

The surface semantics are also modular. Semantic modules include sand beds, stone-dust mats, fine pebbles, grass turf, flagstone tiles, wood planks, foam board, concrete slabs, and artificial trees, mounted on magnetized sub-panels for rapid reconfiguration. To generate a new layout, operators choose which panels carry which semantic cover, insert elevation blocks, and place obstacles such as boulders greater than $0.3\,\mathrm{m}$ diameter, wooden barriers, and shrub clusters. The arena supports thousands of possible layouts [2508.08226].

This combination of topographic variation and semantic variation is central to the facility’s design. Standardization is achieved at the level of panelized assembly, measurement, and protocol, while environmental diversity is achieved through reconfiguration. A plausible implication is that Verti-Arena standardizes *how* terrain is specified and reproduced, not by collapsing terrain diversity into a single canonical layout.

## 3. Sensing stack, coordinate frames, and calibration

The experimental platform uses a V4W four-wheeled vehicle instrumented with onboard sensors and external motion capture. The onboard RGB-D sensor is a Microsoft Azure Kinect with color at $1280\times 720\times 3$ up to $30\,\mathrm{Hz}$ and depth at $512\times 512$ at $30\,\mathrm{Hz}$; intrinsic parameters $(f_x,f_y,c_x,c_y)$ are stored in each ROS 2 bag. The IMU provides a 3-axis gyroscope and accelerometer at $100\,\mathrm{Hz}$ with noise density approximately $0.01\,\mathrm{deg}/\mathrm{s}/\sqrt{\mathrm{Hz}}$. Wheel encoders and joint states provide four wheel speeds and steering angles at $100\,\mathrm{Hz}$. Computation is performed on an NVIDIA Jetson Xavier NX running ROS 2 Foxy. External ground truth is supplied by eight Vicon or OptiTrack cameras surrounding the arena, sampling at $100\,\mathrm{Hz}$ with sub-millimeter translational accuracy and sub-degree orientation accuracy [2508.08226].

| Component | Specification | Rate / accuracy |
|---|---|---|
| RGB-D camera | Microsoft Azure Kinect | Color up to 30 Hz; depth 30 Hz |
| IMU | 3-axis gyroscope and accelerometer | 100 Hz; $\sim 0.01\,\mathrm{deg}/\mathrm{s}/\sqrt{\mathrm{Hz}}$ |
| Wheel encoders & joint states | 4 wheel speeds and steering angles | 100 Hz |
| Motion capture | 8 Vicon or OptiTrack cameras | 100 Hz; sub-mm / sub-degree |

The coordinate-frame conventions follow ROS 2 TF practice. The world frame $W$ has origin at the center of the arena floor, with $x$ forward, $y$ left, and $z$ up. The base link $B$ is defined at the geometric center between wheel axles with the same axis orientation. The camera frame $C$ uses standard Kinect coordinates, with $z$ forward from the camera lens. The motion-capture system publishes TF2 transforms `/world → /mocap_base_link` and `/mocap_base_link → /base_link`, the latter obtained through static calibration [2508.08226].

Calibration is formalized in two places. Camera–IMU extrinsics are calibrated via the Kalibr toolbox. The mocap-to-vehicle transform $T_{WB}$ is obtained via a one-time hand-eye calibration:
$$
T_{WB} = (T_{WO})^{-1} T_{CB},
$$
where $O$ is an OptiTrack marker frame, $C$ the camera frame, and $B$ the base link. This calibration chain is what allows the platform to align onboard estimates with external ground truth in a common reference system.

## 4. Ground truth, vehicle models, and evaluation formalism

The motion-capture system provides the $6$-DoF pose $p_t^{gt}\in SE(3)$ of the vehicle `base_link` at $100\,\mathrm{Hz}$, while onboard odometry $p_t^{odom}$ is recorded from wheel encoders and IMU. Vehicle kinodynamics are formalized with the forward model
$$
x_{t+1} = f(x_t,u_t),
$$
where $x_t=[x,y,\theta]^T$ and $u_t=[v,\omega]^T$, with $v$ denoting longitudinal velocity and $\omega$ steering rate [2508.08226].

The reported evaluation formalizes multiple error metrics. Pose error at time $t$ is
$$
e_p(t) = \|p_t^{est} - p_t^{gt}\|_2.
$$
Orientation error is
$$
e_o(t) = \arccos\bigl((\mathrm{trace}(R_t^{est}(R_t^{gt})^T)-1)/2\bigr).
$$
Velocity error is
$$
e_v(t) = \|v_t^{est} - v_t^{gt}\|_2.
$$
In the reported experiments, mean positional RMSE and angular RMSE are plotted over each trajectory segment [2508.08226].

Benchmarking is organized around five terrain zones: boulder, flagstone, stone dust, grass, and pebble. For each zone, $N=50$ runs are executed over the same start-goal waypoint pair in low-gear mode with locked differentials. Success Rate is defined as
$$
\mathrm{SR} = \frac{1}{N}\sum_{i=1}^N \mathbf{1}\{d(p_i^{end},p_{goal})<d_{\mathrm{thresh}}\},
$$
Traversal Time for run $i$ is
$$
T_i = t_i^{end} - t_i^{start},
$$
and Average Slip Error is
$$
e_{\mathrm{slip}} = \frac{1}{T}\sum_{t=1}^{T}|s_t^{est} - s_t^{gt}|,
$$
where $s_t$ is the slip ratio estimated from wheel encoders versus ground-truth velocity. Model comparison is performed between classical bicycle and Ackermann kinematic models and zone-specific MLPs. Per-zone RMSE reported in Fig. 7 places MLP positional RMSE in the range $0.03$–$0.15\,\mathrm{m}$ and classical models in the range $0.15$–$0.40\,\mathrm{m}$; the terrain difficulty ranking from highest RMSE to lowest is boulder $>$ pebble $>$ stone dust $>$ grass $>$ flagstone [2508.08226].

## 5. Remote experimentation and reproducible data collection

A web-based remote interface allows research groups worldwide to conduct standardized experiments. The workflow comprises authentication and reservation of an experiment slot through a web portal, upload of autonomy nodes as ROS 2 packages or Docker containers, configuration of terrain layout through presets or custom JSON describing panel arrangement, selection of start/goal coordinates and run count, and choice between teleop and autonomy mode. Experiments can then be launched remotely, monitored through live RGB and depth video feeds together with streaming telemetry including pose, control commands, and error plots. After completion, users download recorded ROS 2 bag files containing all sensors, mocap, and TF2 trees, as well as summary CSV logs of metrics [2508.08226].

The reproducibility layer is specified in operational detail. All data are stored in ROS 2 bag2 format. Standard topic names include `/camera/color/image_raw` at $30\,\mathrm{Hz}$, `/camera/depth/image_raw` at $30\,\mathrm{Hz}$, `/imu/data` at $100\,\mathrm{Hz}$, and `/tf` and `/tf_static` as `geometry_msgs/TransformStamped` at $100\,\mathrm{Hz}$. Global clock synchronization is maintained via Chrony to less than $1\,\mathrm{ms}$ offset, and motion capture and onboard sensors are triggered by PTP, ensuring sub-millisecond alignment. Recommended operating parameters are low-gear speed $v \leq 0.5\,\mathrm{m/s}$, steering rate limited to $\omega \leq 30^\circ/\mathrm{s}$ to avoid drivetrain slip beyond $0.2$, and locked differentials for baseline data, with unlocked differentials reserved for advanced traction-control studies [2508.08226].

These design choices make reproducibility a property of both the environment and the data products. The standardization extends from terrain layout and vehicle state estimation to packaging, synchronization, logging, and post hoc retrieval.

## 6. Empirical findings and research significance

The reported forward-model evaluation shows that per-zone MLPs achieve mean positional RMSE $e_p \approx 0.05\,\mathrm{m}$ on flagstone and approximately $0.15\,\mathrm{m}$ on boulders, while classical kinematic models uniformly exceed $0.2\,\mathrm{m}$ RMSE and fail to predict rollovers and wheel lift-off in $6$-DoF motions. The results are interpreted as evidence that zone-specialized data-driven models capture subtle terrain–vehicle interactions, including slip bursts on pebbles. The same evaluation also indicates that blended semantics, such as grass over flagstones, introduce mixed dynamic regimes for which training on pure zones only partially generalizes [2508.08226].

A separate empirical observation concerns repeatability. Remote users reportedly reproduce runs within $5\%$ variance in traversal time across weeks of experiments. This suggests that the facility’s claims to controllability are not limited to local operation by the host laboratory but extend to remote use under standardized protocols [2508.08226].

A plausible misconception is that standardization in off-road robotics necessarily entails simplification into flat or low-variance terrain. Verti-Arena instead combines a fully modular $8\,\mathrm{m}\times 8\,\mathrm{m}$ arena, ten terrain types, up to $0.7\,\mathrm{m}$ elevation change, a millimeter-accurate ground-truth pipeline, and open benchmarking scenarios with success, traversal, and slip metrics. In that sense, its significance lies in making multi-terrain off-road autonomy experimentally comparable without removing the vertically structured and semantically heterogeneous conditions that generate the problem in the first place [2508.08226].

Source: https://www.emergentmind.com/topics/verti-arena