Papers
Topics
Authors
Recent
Search
2000 character limit reached

Motion Alignment Score (MAS) Overview

Updated 17 December 2025
  • Motion Alignment Score (MAS) is a metric that quantifies motion fidelity by comparing predicted optical flow fields with ground truth using normalized displacement measures.
  • It computes both magnitude and directional deviations, applying normalization and weighting to ensure scale invariance and robustness against outliers.
  • MAS is integrated into training frameworks like MotionNFT, serving as an evaluation metric and reward signal to enhance motion-centric image editing performance.

The Motion Alignment Score (MAS) quantifies the fidelity and precision of motion-centric image edits by comparing predicted optical flow fields between model outputs and ground-truth targets. Introduced in the context of the MotionNFT fine-tuning framework for the MotionEdit-Bench as presented in "MotionEdit: Benchmarking and Learning Motion-Centric Image Editing," MAS serves as both an evaluation metric and a reward signal guiding the training of generative models to achieve accurate motion transformations while preserving semantic and identity consistency (Wan et al., 11 Dec 2025).

1. Formal Definition and Mathematical Construction

MAS is computed by first extracting optical flow fields between the original image and both the edited sample and the ground-truth image using a pretrained flow network F\mathcal F (such as UniMatch). For images IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}, IeditedI_{\rm edited}, and IgtI_{\rm gt}, the corresponding flows are: Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2}) Normalization by the image diagonal d=H2+W2d=\sqrt{H^2+W^2} yields resolution-agnostic displacements: V~pred(i,j)=Vpred(i,j)/d,V~gt(i,j)=Vgt(i,j)/d\tilde V_{\rm pred}(i,j)=V_{\rm pred}(i,j)/d,\quad \tilde V_{\rm gt}(i,j)=V_{\rm gt}(i,j)/d

Two per-pixel deviations are computed:

  • Magnitude deviation:

Dmag=1HWi,jV~pred(i,j)V~gt(i,j)1qwith  q=0.4D_{\rm mag} = \frac{1}{HW}\sum_{i,j} \left\|\tilde V_{\rm pred}(i,j)-\tilde V_{\rm gt}(i,j)\right\|_1^q \quad\text{with}\; q=0.4

  • Direction deviation (for all pixels with sufficient GT motion mgt(i,j)>τmm_{\rm gt}(i,j)>\tau_m):

mgt(i,j)=V~gt(i,j)2,v^gt(i,j)=V~gt(i,j)mgt(i,j)+ϵm_{\rm gt}(i,j)=\|\tilde V_{\rm gt}(i,j)\|_2,\quad \hat v_{\rm gt}(i,j)=\frac{\tilde V_{\rm gt}(i,j)}{m_{\rm gt}(i,j)+\epsilon}

IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}0

IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}1

Directional errors are weighted: IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}2, giving

IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}3

A weighted overlay combines both: IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}4 Final MAS is normalized and clipped to IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}5: IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}6 If overall predicted motion is negligible IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}7, then IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}8.

2. Optical Flow Field Estimation

MAS relies critically on robust flow estimation between image pairs. The choice of IorigRH×W×3I_{\rm orig}\in\mathbb R^{H\times W\times3}9 (pretrained flow network) can include UniMatch, RAFT, or GMFlow. Both IeditedI_{\rm edited}0 and IeditedI_{\rm edited}1 pairs are processed through IeditedI_{\rm edited}2, producing dense displacement fields in pixel coordinates. All resulting flows are divided by the diagonal IeditedI_{\rm edited}3 to ensure scale invariance across resolutions (Wan et al., 11 Dec 2025).

3. Normalization, Weighting, and Thresholding in MAS

The MAS formulation incorporates several normalization and weighting mechanisms to address outlier suppression, dynamic relevance, and scale alignment:

  • Pixel-wise magnitude deviations are raised to exponent IeditedI_{\rm edited}4 (IeditedI_{\rm edited}5) for outlier robustness.
  • Directional errors are weighted by the relative magnitude of ground-truth motion; static or nearly static pixels (IeditedI_{\rm edited}6, IeditedI_{\rm edited}7) are excluded.
  • The overlay distance IeditedI_{\rm edited}8 is produced through a convex combination with empirically selected coefficients (IeditedI_{\rm edited}9).
  • The final MAS score is derived by mapping IgtI_{\rm gt}0 into a bounded range, shifted and scaled relative to dataset-specific IgtI_{\rm gt}1, and applying a hard zeroing rule if model-applied motion is extremely weak (IgtI_{\rm gt}2).

4. Integration of MAS into Training Objectives

Within the MotionNFT framework, MAS is implemented as a core reward signal during negative-aware fine-tuning of diffusion models. The process operates:

  • For each training instance, IgtI_{\rm gt}3 samples are generated in response to an editing instruction.
  • MAS is calculated for each, then discretized to IgtI_{\rm gt}4.
  • A parallel “MLLM reward” assesses instruction fidelity and stylistic alignment.
  • The final reward is an affine combination: IgtI_{\rm gt}5; IgtI_{\rm gt}6.
  • Rewards are group-wise normalized and used to interpolate between positive and negative velocity terms in the diffusion flow-matching loss:

IgtI_{\rm gt}7

This design ensures that model updates are directly sensitive to the degree of motion alignment achieved, as quantified by MAS, balanced against general editing quality metrics (Wan et al., 11 Dec 2025).

High-level Pseudocode of the MAS-based Training Loop

Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})7

5. Ablation Studies and Sensitivity Analysis

Ablation experiments demonstrate the importance and optimal usage of MAS in fine-tuning:

  • Varying IgtI_{\rm gt}8 in the reward blend affects final alignment: pure-motion (IgtI_{\rm gt}9) underperforms relative to the best mixed setting (Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})0); pure-MLLM (Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})1) yields higher semantic fidelity but reduced geometric precision.
  • MAS alone is insufficient for highest visual quality, but its inclusion is critical for accurate motion transfer.
  • During training, policies optimizing only MLLM rewards plateau or degrade in MAS, while MAS-guided optimization produces consistent improvements (+1–2 MAS points).
  • On MotionEdit-Bench, baseline diffusion models achieve MAS Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})2, while MotionNFT-tuned variants reach MAS Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})3. The average MAS gain observed with MotionNFT is 1.2–1.7 points over competitive baselines (see Tables and Figures in (Wan et al., 11 Dec 2025)).
Reward Mixing (Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})4) Visual Fidelity MAS Precision
0.0 (MLLM only) High Low
0.5 (Optimal blend) High High
1.0 (MAS only) Lower Moderate (Someartifacts)

A plausible implication is that MAS, while robust for motion fidelity, must be harmonized with broader perceptual signals to yield semantically and visually optimal results.

6. Empirical Ranges and Practical Implications

Typical MAS values, as reported on MotionEdit-Bench, scale from Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})518 for weak baselines up to Vpred=F(Iorig,Iedited)Vgt=F(Iorig,Igt)(VRH×W×2)V_{\rm pred} = \mathcal F(I_{\rm orig},I_{\rm edited}) \quad V_{\rm gt} = \mathcal F(I_{\rm orig},I_{\rm gt}) \quad (V\in \mathbb R^{H\times W\times2})657 for MotionNFT-tuned models, calibrated on a [0,100] scale. These figures characterize both the difficulty of the motion-centric editing task and the incremental benefits yielded by MAS-guided fine-tuning. The zeroing rule, which sets MAS to zero for negligible predicted motion, prevents reward leakage in trivial or static cases, ensuring that the metric remains informative and reliable in overseeing meaningful edits (Wan et al., 11 Dec 2025).

This rigorous construction and the empirical performance of MAS establish it as a specialized, quantitatively sensitive metric for training and benchmarking motion-centric image editing systems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (1)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Motion Alignment Score (MAS).