---
title: 'MUJICA: Unified Wheeled-Legged Control'
url: https://www.emergentmind.com/topics/mujica
type: topic
---

# MUJICA: Unified Wheeled-Legged Control

Searching arXiv for the specified MUJICA paper and related entries to ground the article in current arXiv records.
MUJICA, short for **Multi-skill Unified Joint Integration of Control Architecture**, is a unified control framework for wheeled-legged robots that integrates diverse low-level skills—including **omnidirectional moving**, **high platform climbing**, and **fall recovery**—within a single **fully proprioceptive** policy. The framework is designed for the specific difficulties of wheeled-legged locomotion: the need to balance wheeled driving with legged control, to remain robust under noisy proprioceptive sensing, and to respect real-world motor constraints that are often oversimplified in reinforcement learning. In the reported implementation, MUJICA is validated in simulation and on the **Unitree Go2-W** robot, with an emphasis on sim-to-real robustness, seamless transitions across locomotion modes, and adaptive behavior based solely on proprioceptions [2605.13058].

## 1. Scope and problem formulation

MUJICA is motivated by three obstacles identified for wheeled-legged robots in unstructured environments. First, existing multi-skill blind controllers usually handle only a narrow family of tasks, often with similar dynamics, such as flat-ground walking or stair/slope traversal, rather than unifying strongly dissimilar skills such as **omnidirectional moving**, **high platform climbing**, and **fall recovery** in one policy. Second, many multitask methods rely on manual switching or multiple separate experts, which increases system complexity and can create interference between behaviors. Third, real robots exhibit actuator constraints that are frequently modeled too coarsely in RL; for **DC motors**, the torque limit depends not only on magnitude but also on **joint velocity**, and for some joints also on **joint position** [2605.13058].

The control problem is modeled as a **Constrained Partially Observable Markov Decision Process (C-POMDP)**:
$$
\max \mathbb{E}_{\pi}\left[\sum_{t=0}^\infty \gamma^t R\left(\boldsymbol{s}_{t},\bm{a}_t,\boldsymbol{s}_{t+1}\right)\right] \ \text{s.t.}\ \ 
\mathbb{E}_{\pi}\left[\sum_{t=0}^\infty \gamma^t C_i\left(\boldsymbol{s}_{t},\boldsymbol{a}_t,\boldsymbol{s}_{t+1}\right)\right] \leq \delta_i,\forall i \in \left\{1,...,k\right\}
$$
A defining design choice is that the deployment policy is **blind**: it uses only **proprioceptive observations**, while privileged information is used during training for critics and auxiliary supervision. This places MUJICA in the class of blind locomotion systems, but with an explicit focus on multi-skill wheeled-legged control under hardware-feasible actuation [2605.13058].

The proprioceptive observation is
$$
\boldsymbol{o}_t=\left[\boldsymbol{\omega}^b_t,\boldsymbol{g}^b_t,\boldsymbol{cmd}_t,\boldsymbol{q}_t,\boldsymbol{\dot{q}_t,\boldsymbol{a}_t,\zeta_t\right]^T
$$
and the privileged state is
$$
\boldsymbol{s}_t\triangleq \boldsymbol{o}^{priv}_t=\left[\boldsymbol{o}_t,\boldsymbol{v}_t,\boldsymbol{c}_t,\boldsymbol{u}_t,\boldsymbol{h}_t\right]^T.
$$
Here, the observation includes base angular velocity, gravity vector in the base frame, command input, joint positions, joint velocities, previous action, and a **skill indicator** $\zeta_t$; the privileged state augments this with base linear velocity, collision-related privileged signals, wheel-ground distances, and a latent state or hidden embedding [2605.13058].

## 2. Unified multi-skill architecture

MUJICA is organized into two stages. In **Stage S1**, a single low-level policy is trained jointly on three skills: **omnidirectional moving** on ordinary terrains, **high platform climbing**, and **fall recovery**. These skills are unified by conditioning the shared policy on a **skill indicator** $\zeta_t$, with a unique indicator variable for each skill. The paper states that the indicator does not merely act as a tag; it separates the policy’s behavior space along a dedicated dimension, allowing one network to represent distinct low-level behaviors without collapsing them into a single undifferentiated control mode [2605.13058].

In **Stage S2**, the low-level skills are frozen and a **high-level skill selector** is trained. This selector receives a short history of proprioceptive observations, excluding the skill indicator, and predicts which skill should be active. It therefore chooses $\zeta_t$ automatically and enables autonomous transitions among recovery, rolling, and climbing modes based only on internal state [2605.13058].

This hierarchy distinguishes MUJICA from systems based on manual switching or multiple separate experts. The low-level controller is shared across tasks, but the tasks are explicitly disentangled by the indicator variable. The high-level selector then learns when to activate each mode. A plausible implication is that the framework treats multi-skill control not as simple reward aggregation, but as structured behavior composition under partial observability.

The paper reports that this mechanism is important in sequential tasks. In an ablation comparing policies without an indicator to the full system, the reported stage-wise success rates are **72%, 72%, 38%** for **w/o indicator, shared reward**, versus **95%, 95%, 91%** for **with skill selector (ours)** [2605.13058]. This suggests that explicit skill conditioning and learned switching are central to the system’s ability to execute heterogeneous task sequences.

## 3. Observation design, estimator, and blind control

Because MUJICA is deployed without cameras, depth sensing, or terrain reconstruction, it supplements the blind policy with a learned **state estimator**. The estimator uses the last $H=6$ frames of proprioceptive observations and processes them through an online encoder with a GRU:
$$
\boldsymbol{f}_t=\operatorname{GRU}\left(\operatorname{NN}\left(\boldsymbol{o}_{t-H:t}\right),\boldsymbol{f}_{t-1}\right)
$$
with output
$$
\boldsymbol{f}_t = [\boldsymbol{\hat{v}_t,\hat{c}_t,\hat{u}_t,\hat{e}_t}]^T.
$$
The estimator predicts base linear velocity, collision probabilities for robot components, wheel-ground distances, and a latent state vector [2605.13058].

The reported motivation for these prediction targets is task-specific. **Velocity** helps distinguish stable from unstable locomotion. **Wheel-ground distance** helps infer roughness and avoid unnecessary leg lifting on flat ground. **Collision probabilities** help detect contact with obstacles and support adaptive behaviors such as using head collision to sense a ledge [2605.13058]. This is a structured privileged-to-blind transfer mechanism rather than a generic latent-state learner.

The estimator is trained with supervised prediction losses and a contrastive self-supervision term:
$$
\mathcal{L}^{\text{Estimate}=\mathcal{L}^{\text{Pred}+\mathcal{L}^{\text{SwAV}(\boldsymbol{e}_{t},\boldsymbol{\hat{e}_{t})
$$
$$
\mathcal{L}^{\text{Pred}=\mathcal{L}_{\text{MSE}(\boldsymbol{v}_t,\boldsymbol{\hat{v}_t) + \mathcal{L}_{\text{BCE}(\boldsymbol{c}_t,\boldsymbol{\hat{c}_t) + \mathcal{L}_{\text{MSE}(\boldsymbol{u}_t,\boldsymbol{\hat{u}_t)
$$
where $\mathcal{L}_{\text{MSE}}$ is mean squared error, $\mathcal{L}_{\text{BCE}}$ is binary cross-entropy, and SwAV is the self-supervised contrastive loss from Caron et al. A reference encoder maps successor observations $\boldsymbol{o}_{t+1}$ to a latent target $\boldsymbol{e}_t$, which supervises the online encoder [2605.13058].

Ablations reported in the paper indicate that removing any estimator component reduces performance; removing **velocity estimation** is described as particularly harmful for non-recovery locomotion. The comparison against **DreamWaQ + P3O** is reported to favor MUJICA, which the paper attributes to the chosen state targets and architecture being better suited to wheeled-legged tasks. **Vanilla PPO** can traverse some simple terrain, especially slopes, but cannot learn robust fall recovery without state estimation [2605.13058].

## 4. Action space, low-level control, and constrained optimization

The action vector $\boldsymbol{a}_t$ contains commands for all joints. MUJICA uses a heterogeneous low-level actuation interface: for **leg joints**, the policy outputs angular offsets from a default posture; for **wheel joints**, it outputs desired motor velocity. These outputs are converted to torques by a PD-style controller:
$$
\tau^i_t = \begin{cases} K_d^i \left( \dot{q}^i_t - a_t^i \right), & \text{if } i = \text{wheel} \\
K_p^i \left( q_t^i - a_t^i \right) - K_d^i \dot{q}_t^i, & \text{otherwise}
\end{cases}
$$
Thus wheels are velocity-controlled, whereas leg joints are controlled by position offsets [2605.13058].

Training uses an **asymmetric actor-critic**. The actor sees the blind input stream plus the estimator output, while the critics receive privileged state information. Constraint handling is performed with **P3O (Penalized PPO)**:
$$
\mathcal{L}^{\text{P3O}(\theta) = \mathcal{L}^{\text{CLIP}_R(\theta)+\kappa \sum_{i=1}^k \max\{0,\mathcal{L}^{\text{CLIP}_{C_i}(\theta)\}
$$
together with the reward and constraint surrogates stated in the paper [2605.13058]. This optimization setup is used to balance task performance against safety-related constraint violations.

The main reward and constraint terms listed in the system are:
$$
R_{cmd_v,t} = \exp\left(-\lVert\boldsymbol{cmd}_{xy,t}-\boldsymbol{v}_{xy,t}\rVert^2/\sigma^2\right)
$$
$$
R_{cmd_{\omega},t} = \exp\left(-\lVert\boldsymbol{cmd}_{\omega,t}-\omega_{z,t}\rVert^2/\sigma^2\right)
$$
$$
R_{gravity,t} = \exp\left(-\angle\left(\boldsymbol{g}^b_t,\boldsymbol{g}^{world}\right)/\sigma^2\right)
$$
$$
R_{poserr,t} = \exp\left(-\lVert\boldsymbol{q}-\boldsymbol{q}_{stand}\rVert^2)\right/\sigma^2) \ \text{if } |\angle\left(\boldsymbol{g}^b_t,\boldsymbol{g}^{world}\right)| < \epsilon
$$
$$
C_{DC-motor,t} = \sum_{i=1}^{16} \mathbf{1}_{|\tau^i_t| \geq \tau_{\text{limit}^i}
$$
$$
C_{collision,t} = \sum_i c_t^i, \quad i=\text{thigh,calf}.
$$
The task applicability is also explicit: $R_{cmd_v}$ is used for skills i and ii, $R_{cmd_\omega}$ for skill i, $R_{gravity}$ and $R_{poserr}$ for skill iii, $C_{DC-motor}$ for all tasks, and $C_{collision}$ for i and ii [2605.13058].

A particularly important modeling choice is the **hard DC-motor constraint**. The paper states that, at low speed, maximum torque is constant; at high speed, maximum torque decreases linearly with velocity; and calf joints also exhibit a position-dependent limit with cosine-like dependence. The authors describe this as being inspired by actuator operating-region data from the Unitree motor manual and prior actuator-constrained RL literature [2605.13058]. The reported ablation indicates that, without this constraint, simulated policies often leave feasible actuator regions, especially during high platform climbing, causing unsafe torques and motor faults on the real robot. With the constraint, the torque-velocity distribution remains inside the feasible region and **violation rates drop to below 3.5%** [2605.13058].

## 5. Training pipeline, curriculum, and empirical results

Training is conducted in **IsaacLab** with **4,096 parallel environments**, a single **NVIDIA RTX 4090**, **50 Hz** control for both the low-level policy and skill selector, and **200 Hz** physics simulation. Low-level training runs for **30,000 iterations**, and high-level selector training for **10,000 iterations** [2605.13058].

The curriculum is defined on a **33 × 20 grid**, where rows correspond to terrain or task assignments and columns correspond to difficulty levels. For Stage S1, the correct skill indicator is provided. For Stage S2, all environments are treated equally and the selector learns to choose skills autonomously [2605.13058]. The listed terrains are stairs, slope, discretized terrain, rough terrain, and a pit or depression used for platform climbing. The difficulty parameter $l\in[1,20]$ modifies terrain parameters, including:

- **Stairs**: step width $0.3$ m, step height $0.05 + 0.18 \times l/20$ m  
- **Slope**: $0.5 \times l/20 \times 100\%$  
- **Discretized terrain**: 30 bumps, heights $0.05 + 0.17 \times l/20$ m  
- **Rough terrain**: height sampled from $[0.04, 0.12]$ m  
- **Pit**: $2 \text{ m} \times 4 \text{ m}$, depth $0.05 + l/20$ m [2605.13058]

Domain randomization is used for sim-to-real robustness. The randomized parameters include static friction in $[0.6, 1.0]$, dynamic friction in $[0.4, 0.8]$, base mass bias in $[-1.0, 3.0]$ kg, external force every 2–3 s in $[-10, 10]$ N, push every 8–12 s at $[-1.0, 1.0]$ m/s in $x$ or $y$, and motor gain multiplier in $[0.8, 1.2]$ [2605.13058].

The experimental platform is the **Unitree Go2-W**, with real-world computation on an **NVIDIA Jetson Orin NX** [2605.13058]. The paper evaluates individual skills, sequential multi-skill transitions, sim-to-real transfer, state-estimator ablations, DC-motor-constraint ablations, and comparisons against **MUJICA**, **MUJICA w/o Velocity**, **MUJICA w/o Wheel Height**, **MUJICA w/o Collision**, **DreamWaQ + P3O**, and **Vanilla PPO**.

The reported qualitative results include successful **omnidirectional movement** on ordinary and uneven terrain, **stair recovery** from upside-down states on **30° stairs**, and **high platform climbing** on an **80-cm outdoor platform** and a **1-m indoor platform**, the latter described as near the robot’s mechanical and actuation limits [2605.13058]. The paper also reports that the robot can chain recovery, stair climbing, ramp traversal, and high-platform climbing in one continuous mission, with the high-level selector switching skills autonomously.

## 6. Interpretation, significance, and disambiguation

MUJICA occupies a specific niche within locomotion research: unified **multi-skill**, **blind**, **constraint-aware** control for wheeled-legged robots. Its defining combination is a shared low-level policy, an explicit skill indicator, a learned high-level selector, a state estimator driven by proprioceptive history, and physically informed DC-motor constraints [2605.13058]. This differs from single-task controllers, manually switched systems, and methods that simplify actuator feasibility.

The system’s practical significance, as presented in the paper, lies in showing that a wheeled-legged robot can recover from falls, roll, climb, and switch among these modes without external sensing and without leaving the safe motor envelope on real hardware [2605.13058]. A plausible implication is that the framework is aimed at operational regimes where exteroception is unreliable or unavailable, and where actuator-safe behavior is as critical as task completion.

The term **“Mujica”** also appears in a separate body of arXiv literature as the surname of **Jorge Mujica**, associated with research on holomorphic functions on Banach spaces, polynomial decompositions, and operator-theoretic structures. For example, recent work on monomial bases in spaces of holomorphic functions explicitly extends results of Dineen and Mujica [2507.05138], while several other papers invoke **Mujica’s linearization theorem** or related results in holomorphic Lipschitz spaces, holomorphic ideals, norm-attaining operators, and convolution dynamics [2304.07149], [2209.02956], [2105.03967], [2102.06452], [1806.07413]. In the robotics context, however, **MUJICA** is an acronym for **Multi-skill Unified Joint Integration of Control Architecture**, not a reference to that functional-analytic literature [2605.13058].

Source: https://www.emergentmind.com/topics/mujica