Animus3D: Text-Driven 3D Motion

• Animus3D is a text-driven 3D animation framework that converts static Gaussian assets into dynamic sequences using motion score distillation.
• It replaces vanilla SDS with a dual-distribution approach and explicit spatiotemporal regularization to improve motion quality while preserving appearance.
• The modular pipeline decouples geometry acquisition from motion synthesis, enabling smoother animations through per-asset optimization and refinement.

Searching arXiv for the primary paper and a few directly related works mentioned in the provided data to ground the article with current paper metadata. Primary paper found: "Animus3D: Text-driven 3D Animation via Motion Score Distillation" (Sun et al., 14 Dec 2025). I’ll also check directly related companion/contrast papers referenced in the data block. Animus3D is a text-driven 3D animation framework that generates a motion field from a static 3D asset and a natural-language motion prompt, then optimizes that field so that rendered videos of the asset conform to motion priors distilled from a pretrained text-to-video diffusion model while preserving the asset’s original appearance and geometry. Its central methodological claim is that vanilla Score Distillation Sampling (SDS) is poorly matched to 3D animation because it lacks an explicit static source distribution and tends to entangle motion with appearance; Animus3D addresses this with Motion Score Distillation (MSD), explicit spatiotemporal regularization, and a refinement stage that extends temporal resolution beyond the fixed video length of the underlying generative prior (Sun et al., 14 Dec 2025).

1. Problem formulation and scope

Animus3D addresses text-driven 3D animation in the setting where the geometry already exists as a static canonical asset. The input is a canonical 3D Gaussian Splatting representation $\mathcal G_c$ and a motion prompt $c$, optionally paired with a static prompt $c'$ used to model the source distribution. The output is an optimized motion field $f(\phi)$ that deforms the canonical object through time, yielding a dynamic sequence $\mathcal G_{0:T-1}$ and, after optional refinement, a temporally denser 4D Gaussian animation (Sun et al., 14 Dec 2025).

The method is explicitly positioned against earlier SDS-based approaches to 3D animation. In the reported formulation, prior methods that directly apply vanilla SDS to text-to-video diffusion often produce animations with minimal movement or noticeable jitter. The paper attributes this to three structural issues: the absence of a modeled static source distribution, motion–appearance entanglement inside the diffusion guidance, and a lack of direct constraints on temporal coherence in 3D space. Animus3D therefore reframes the objective as transport from a static canonical object to a dynamic, text-conditioned video distribution rather than transport from Gaussian noise to a target distribution (Sun et al., 14 Dec 2025).

A practical implication of this design is that Animus3D solves the motion stage rather than the asset-creation stage. The canonical 3D-GS may be obtained by an external Gaussian reconstruction pipeline, and the learned component is the deformation field that converts this static representation into an animated one. This suggests a modular pipeline in which geometry acquisition and motion synthesis remain separable, but motion optimization is tightly coupled to a video prior through differentiable rendering.

2. Canonical representation and motion-field parameterization

The canonical object is represented as a set of 3D Gaussian splats,

$\mathcal G_c = \{g_i\}_{i=1}^N,$

where each Gaussian has a center $\mathbf x_i \in \mathbb R^3$, rotation or covariance parameters, scale, opacity, and view-dependent color via spherical harmonics (Sun et al., 14 Dec 2025).

Animus3D parameterizes motion with a multi-resolution HexPlane plus MLP decoders. The field is queried with a 4D coordinate $(x,y,z,\tau)$, where $\tau$ is the time index, and returns deformations for position and rotation. The resulting animated sequence is

$$\mathcal G_{0:T-1} = \{\mathcal G_\tau\}_{\tau=0}^{T-1}, \qquad \mathcal G_\tau = f(\mathcal G_c,\tau;\phi).$$

Rendering is performed with a differentiable splatting renderer $c$0, giving a single canonical frame

$c$1

and a video

$c$2

Only the motion field parameters $c$3 are optimized; the canonical Gaussian set $c$4 remains fixed during animation synthesis (Sun et al., 14 Dec 2025).

This choice of representation gives Animus3D two properties that are central to its reported behavior. First, motion is encoded directly as time-dependent deformation of a 3D Gaussian scene rather than as latent video tokens detached from geometry. Second, because the renderer is differentiable, gradients from the video model can be backpropagated into spatial offsets and rotational updates of the Gaussians. The system is therefore a 4D Gaussian optimization method guided by video diffusion rather than a pure video synthesis model.

3. From SDS to Motion Score Distillation

The paper presents MSD as a direct alternative to vanilla SDS. In the standard diffusion setup, a rendered sample $c$5 is noised at timestep $c$6 according to

$c$7

and the SDS gradient is written as

$c$8

The critique advanced by Animus3D is that this objective does not encode the fact that 3D animation begins from a known static asset, and that the stochastic reference noise does not isolate motion-specific change (Sun et al., 14 Dec 2025).

MSD replaces the random-noise contrast with a contrast between two denoisers: one for a dynamic target distribution and one for a static source distribution. Let $c$9 be the static video rendered from $c'$0, and let $c'$1 be the dynamic video rendered from the animated sequence. Using a pretrained latent video diffusion model for the dynamic branch and a LoRA-adapted denoiser for the static branch,

$c'$2

The motion-specific score is then defined as

$c'$3

and the MSD gradient becomes

$c'$4

Under this formulation, appearance content shared by the static and dynamic branches is subtracted out, and the residual guidance is interpreted as the component required to move from the static object to the text-conditioned dynamic one (Sun et al., 14 Dec 2025).

The base video prior is ModelScope T2V, used as a latent diffusion model at $c'$5 resolution with $c'$6 frames. The paper argues that this dual-distribution formulation is the key reason Animus3D can induce larger, more semantically meaningful deformations than SDS while maintaining high visual integrity.

4. Static source modeling, faithful noise estimation, and regularization

A technical difficulty identified by the method is that generic video diffusion models do not reliably produce truly static outputs even when prompted with “static, not moving” descriptions. Animus3D therefore adapts the base denoiser with Low-Rank Adaptation so that the source distribution is learned from the specific canonical asset. The LoRA-enhanced denoiser is trained on rendered static videos $c'$7 with objective

$c'$8

using rank $c'$9 and $f(\phi)$0 (Sun et al., 14 Dec 2025).

Appearance preservation is further strengthened by replacing stochastic noise injection with DDIM inversion. Given $f(\phi)$1, the estimated clean sample is

$f(\phi)$2

and the inversion trajectory is advanced deterministically rather than by sampling fresh Gaussian noise. Separate inversion paths are computed for the dynamic and static sequences. The reported motivation is that faithful, inversion-based noise reflects the actual content of each video and thereby reduces the appearance drift that arises when random noise is used as the reference signal (Sun et al., 14 Dec 2025).

The motion field is additionally regularized in both time and space. Temporal coherence is enforced with a 3D total-variation loss over Gaussian centers,

$f(\phi)$3

which suppresses abrupt frame-to-frame motion. Spatial integrity is enforced with an As-Rigid-As-Possible loss,

$f(\phi)$4

where $f(\phi)$5 is the best rigid rotation for the neighborhood of Gaussian $f(\phi)$6 at frame $f(\phi)$7. The paper reports that removing TV-3D leads to large inter-frame jumps, while removing ARAP yields non-rigid and structurally broken deformations (Sun et al., 14 Dec 2025).

5. Motion refinement and optimization procedure

Because ModelScope T2V is limited to 16 frames, Animus3D introduces a post hoc refinement stage to increase temporal resolution and recover finer motion detail. After the main MSD optimization converges, the motion field is interpolated to a denser sequence of length

$f(\phi)$8

The interpolated animation is rendered as $f(\phi)$9, then refined with a larger rectified-flow text-to-video model using an SDEdit-style procedure. The refined video $\mathcal G_{0:T-1}$0 becomes a target for a final motion-field update under

$\mathcal G_{0:T-1}$1

This stage does not alter the canonical Gaussian asset; it sharpens motion detail and extends temporal continuity beyond the fixed horizon of the base model (Sun et al., 14 Dec 2025).

The reported implementation is based on threestudio and runs on a single 24GB GPU. Static LoRA pretraining uses approximately 3k iterations at learning rate $\mathcal G_{0:T-1}$2. MSD-based motion optimization then uses approximately 5k iterations per asset, followed by about 100 iterations for motion refinement. The canonical 3D-GS can be obtained from an external Gaussian reconstruction pipeline and is not fixed to any single upstream method. The overall optimization is explicitly described as taking hours per scene, which the paper treats as a major limitation rather than a deployment-ready runtime profile (Sun et al., 14 Dec 2025).

The full objective during the main optimization stage is

$\mathcal G_{0:T-1}$3

with the refinement loss applied afterward. This decomposition clarifies the intended functional roles: MSD supplies semantic motion direction, TV-3D enforces temporal smoothness, ARAP preserves local structure, and the refinement stage restores high-frequency temporal detail.

6. Evaluation and reported performance

Animus3D is evaluated with CLIP-Image, CLIP-Text, FID, and FVD. CLIP-Image measures similarity between images of the canonical and animated 3D-GS rendered from eight azimuth views and is used as an appearance-preservation indicator. CLIP-Text measures alignment between rendered dynamic outputs and the motion prompt. FID and FVD assess frame-level and video-level realism, respectively, with lower values preferred (Sun et al., 14 Dec 2025).

Method	CLIP-Image / CLIP-Text	FID / FVD
AYG	91.75 / 44.31	105.33 / 647.6
TC4D	90.99 / 50.02	179.14 / 340.0
Animus3D	93.04 / 51.05	88.50 / 204.1

These values show reported gains over both baselines in appearance preservation, text alignment, and temporal video quality. The qualitative comparisons in the paper attribute AYG’s failures to small or local motion and jitter, and TC4D’s failures to trajectory-dominated global transformations, stiffness, and appearance distortion. Animus3D is described as producing more substantial semantic motion, smoother dynamics, and stronger preservation of object identity and texture (Sun et al., 14 Dec 2025).

The paper also reports a user study with 17 participants evaluating overall quality, appearance preservation, motion dynamism, motion–text alignment, and motion realism. Animus3D is preferred in all criteria. Ablation studies further isolate the contributions of the method’s components: SDS with moderate classifier-free guidance produces almost no motion, SDS with very high guidance increases motion at the cost of severe artifacts, MSD without faithful noise remains limited, MSD without dual-distribution modeling induces stronger appearance drift, and the full system yields the best balance between substantial motion and visual stability (Sun et al., 14 Dec 2025).

7. Relation to adjacent research and open problems

Animus3D belongs to a broader strand of work that attempts to make static 3D assets animatable, but it does so through a specific combination of 4D Gaussian deformation and text-to-video score distillation. “AnimaMimic: Imitating 3D Animation from Video Priors” animates a static textured mesh by first synthesizing a monocular animation video, then automatically constructing a skeleton and skinning weights, optimizing joint parameters through differentiable rendering, and refining deformation through differentiable FEM-based soft-body simulation. Unlike Animus3D, AnimaMimic reconstructs explicit rigged motion and soft-tissue dynamics from video priors rather than directly optimizing a 4D Gaussian motion field from text (Xie et al., 16 Dec 2025).

“AniGen: Unified $\mathcal G_{0:T-1}$4 Fields for Animatable 3D Asset Generation” addresses a different stage of the pipeline: from a single image, it generates geometry, skeleton, and skinning weights as a unified animatable asset $\mathcal G_{0:T-1}$5. This suggests a complementary division of labor in which AniGen-like systems solve asset generation and rig validity, while Animus3D presupposes a static canonical asset and solves text-conditioned motion synthesis over that asset (Huang et al., 9 Apr 2026).

“Digital Life Project: Autonomous 3D Characters with Social Intelligence” situates motion generation inside a larger language-centric agent framework in which behavior strings encode <speech>, <motion>, and <place>, and a motion layer converts such descriptions into bodily action. A plausible implication is that an Animus3D-like motion module could serve as the deformation or execution layer within a broader autonomous-character architecture, although the two systems operate at different representational levels and with different motion substrates (Cai et al., 2023).

The limitations reported for Animus3D are narrow but consequential. Because the motion field only deforms existing Gaussians, it cannot generate new content or topological change; effects such as rocket exhaust, fluid sprays, breaking, or splitting fall outside its representational scope and are compensated for by distortion. The method is also computationally expensive because it requires per-asset optimization for thousands of iterations, taking hours. The paper proposes several future directions: coupling the motion field with particle or volume generation modules, amortized training in the style of Att3D, more efficient data structures such as hash-encoded grids as in Instant-NGP, and improved distillation schedules or second-stage refinement models that reduce iteration count (Sun et al., 14 Dec 2025).

In this sense, Animus3D is best understood not as a general 4D generative model, but as a specialized score-distillation framework for animating an already-reconstructed 3D Gaussian asset under textual motion control. Its main historical significance lies in replacing SDS’s dynamic-versus-noise contrast with a dynamic-versus-static contrast, thereby making motion, rather than appearance drift, the primary quantity being distilled.