---
title: Proportion-Based Motion Synthesis
url: https://www.emergentmind.com/topics/proportion-based-motion-synthesis
type: topic
---

# Proportion-Based Motion Synthesis

Proportion-based motion synthesis encompasses algorithmic frameworks and neural architectures that generate temporally coherent motion by interpolating or combining pre-learned components—motion primitives, pose exemplars, point clouds, or latent vectors—in strict or adaptive proportions. This paradigm supports the synthesis of plausible, controllable actions for articulated robots, digital characters, or skeleton-agnostic representations. Recent advances have rigorously extended these principles to accommodate arbitrary morphologies, handle cross-domain retargeting, and increase robustness in data-sparse settings [2602.03188] [2507.20170] [2310.20249].

## 1. Fundamental Models and Mathematical Formulation

Core to proportion-based motion synthesis is the direct generation of motion commands as convex combinations of basis motions or primitives, characterized by time-dependent proportion coefficients. For $N$ primitives $\{\varphi_1(t), \dots, \varphi_N(t)\}$, the synthesized command at time $t$ is:

\[
x(t) = \sum_{i=1}^{N} p_i(t) \cdot \varphi_i(t)
\]
with $p_i(t) \geq 0, \sum_{i=1}^{N} p_i(t) = 1$. In vectorized form, $x(t) = \Phi(t) p(t)$ where $\Phi(t) \in \mathbb{R}^{d \times N}$ and $p(t) \in \mathbb{R}^{N}$ [2602.03188]. This framework yields guaranteed boundedness under interpolation and exposes controllable degrees of freedom via the proportions $p_i(t)$.

In skeleton-agnostic settings, as in Temporal Point Cloud (TPC) architectures, a human motion of length $T$ is a sequence $\mathbf{P} = \{\mathcal{P}_0, ..., \mathcal{P}_{T-1}\}$ where each $\mathcal{P}_f = \{p_{f,0}, ..., p_{f,N-1}\}$ and $p_{f,i} \in \mathbb{R}^3$ [2507.20170]. Here, spatial composition and sequence reconstruction are performed not over curated primitive sets but over identities parametrized through latent point vectors, to enable anatomy-agnostic proportion-based synthesis.

## 2. Hierarchical Control and Synthesis Architectures

A predominant approach utilizes hierarchical models with separation of planning and primitive generation. The upper layer (UL) executes long-horizon planning or proportion selection, either by outputting future follower state trajectories or explicit primitive mixture weights. The lower layer (LL) implements a suite of primitive networks (typically MLPs), each generating candidate motor commands for its corresponding motion primitive [2602.03188]. Synthesis proceeds through:

1. UL reads the current state, updates plans or proportions every $n$ steps via LSTM or similar sequence models.
2. Every LL module produces a candidate primitive-wise command.
3. The commands are composed as per the current proportion vector.

This architecture supports three major proportion-model variants:

| Model Type      | Proportion Generation        | Upper Layer Learning         | Characteristics                  |
|-----------------|-----------------------------|-----------------------------|----------------------------------|
| Learning-based  | Softmax over LSTM outputs   | End-to-end trainable        | Full flexibility, limited scalability |
| Sampling-based  | Weighted MC samples (MPC)   | Plans future follower states | Adaptable, MC-MPC integration    |
| Playback-based  | From stored demos           | No UL learning              | Fast, task-invariant, less reactive   |

[2602.03188]

Distinctly, PUMPS [2507.20170] employs an encoder-decoder architecture over TPCs, leveraging masked modeling in latent space, while Pose-to-Motion [2310.20249] deploys skeleton-aware GANs where per-bone lengths directly modulate kernel responses, enabling on-the-fly adaptation to novel proportions.

## 3. Representational Methods for Proportion Robustness

Proportion-based synthesis requires representations allowing straightforward interpolation or recombination irrespective of underlying kinematic topology or bone lengths.

- **Motion primitives/commands**: Defined as time sequences in joint, velocity, or torque space; suited for robotics contexts [2602.03188].
- **Temporal point clouds (TPCs)**: Frame-wise sets of 3D points (optionally grouped by body part), with unstructured sampling to support arbitrary morphological variation. TPCs permit latent factorization and network-based decoding for any skeleton [2507.20170].
- **Proportion-aware latent vectors**: Key for models transferring motion to skeletons of drastically different proportions, achieved by introducing kinematic features (e.g., chain/bone lengths) to network layers [2310.20249].

Skeleton normalization (e.g., scaling by global height $H$) and root-relative coordinate frames are critical preprocessing steps to ensure that synthesized motions are metrically consistent across characters of different sizes [2310.20249].

## 4. Training Objectives and Optimization Protocols

Training in proportion-based frameworks bifurcates into primitive network optimization and global composition model learning:

- LL primitives are first independently fitted by imitation to demonstration segments: $\mathcal{L}_i = \sum_k ||LL_i(F_k) - \varphi_i^*(k+1)||^2$ [2602.03188].
- UL optimization for learning-based methods seeks to minimize the discrepancy between compositional output and the demonstrated trajectory: $\mathcal{L}_{UL} = \sum_k ||\sum_i p_i(k) \varphi_i(k+1) - L_{k+1}||^2$.
- For sampling-based/MC-MPC models, cross-entropy weighting via cost-based softmax over sampled trajectories stabilizes synthesis under uncertainty.
- In TPC latent-space models, linear assignment (Hungarian algorithm) is used for strict pointwise pairing in loss computation, preventing point collapse and guaranteeing identifiability across varying proportions and topologies [2507.20170].
- Adversarial cycles, pose- or motion-level GAN losses, and end-effector contact/consistency regularizers are applied in complex cross-domain setups to enforce plausibility and proportional accuracy [2310.20249].

Network structures employ multi-layer LSTMs/MLPs (UL/LL), Adam or AdamW for optimization, and batchwise latent masking for generalization.

## 5. Practical Applications and Evaluation

Proportion-based synthesis has been empirically validated in robotic manipulation and animation domains.

In a dual-object pick-and-place robot task, the method with 50 motion primitives (spanning spatial directions and segments) achieved 100% success rate on in-set motions for both sampling- and playback-based models. For complex out-of-set tasks, success rates were 70% (sampling) and 90% (playback), compared to 60% for baseline hierarchical IL [2602.03188]. Placement errors on challenging tasks were $~$10 cm on intermediate grasps and $~$3 cm at final placement, limitations attributed to primitive coverage.

In skeleton-agnostic human motion, PUMPS achieves mean per joint position errors (MPJPE) of 38–73 mm and mean per joint velocity errors of 11–16 mm/s across categories, surpassing MixSTE, PoseFormer, and MotionBERT, and equalling MHFormer when finetuned [2507.20170]. For motion denoising, it reduces MPJPE by $\sim$25% over HuMoR and Pose-NDF and matches Laplacian smoothing and Transformer baselines.

The Pose-to-Motion framework demonstrated that with as few as 60 static target poses, high precision and recall in retargeted motion is obtained. User studies found that 78%–82% of participants preferred these results for perceptual realism and artifact reduction over established baselines [2310.20249].

## 6. Comparative Characteristics and Trade-offs

Each composition and proportion-selection method exhibits distinct trade-offs:

| Model Type      | Flexibility       | Scalability        | Adaptability      | Reactivity to Perturbations     |
|-----------------|------------------|--------------------|-------------------|-------------------------------|
| Learning-based  | High             | Poor (large $N$)   | Low (task-specific)| Moderate                        |
| Sampling-based  | Moderate–High    | Good               | High               | High                            |
| Playback-based  | Low (copying)    | Excellent          | Low (demonstration)| Low                             |

[2602.03188]

Common limitations include restricted extrapolation when the target motion or pose lies outside the convex hull of the primitive/preset space, which leads to accumulation of positional errors. Enriching the diversity of primitives or point samples, and incorporating global scene/world models (e.g., VAEs, Transformers), are anticipated to improve coverage and generalization.

## 7. Future Directions and Extensions

The literature points to several promising directions:

- **Scene/world models**: Adding variational autoencoders or Transformers at the UL level for compositional reasoning and global context modeling [2602.03188].
- **Universal motion priors**: Masked latent pre-training (e.g., PUMPS paradigm) combined with strict pointwise assignment can provide generalizable bases for downstream tasks, even when little domain-specific motion exists [2507.20170].
- **Lightweight supervision**: Pose-to-Motion demonstrates that proportional adaptation from static pose datasets is feasible for cross-domain retargeting, suggesting significant reduction in data requirements for motion synthesis in new morphologies [2310.20249].
- **Robustness to topology changes**: Unstructured representations (TPCs) and skeleton-aware differentiable architectures are key enablers for generalizing across arbitrary articulations.

A plausible implication is that as motion synthesis matures, future research may focus on hybrid models that combine primitive modulation, unstructured latent reasoning, and adaptive control, thereby achieving robust, universal motion strategies under extreme morphological and environmental variability.

Source: https://www.emergentmind.com/topics/proportion-based-motion-synthesis