---
title: FLAME 3D Morphable Model (3DMM)
url: https://www.emergentmind.com/topics/flame-3d-morphable-model-3dmm
type: topic
---

# FLAME 3D Morphable Model (3DMM)

The FLAME (Faces Learned with an Articulated Model and Expressions) 3D Morphable Model (3DMM) is a parametric model specifically designed to represent the full human head, including facial identity, expressions, and articulated pose, in a way that is both compact and highly disentangled. FLAME’s architecture allows for robust statistical modeling of facial geometry and animation-ready mesh deformations, supporting applications including facial reconstruction from images, neural volumetric rendering, animation, and facial expression inference.

## 1. Mathematical Formulation and Parameterization

FLAME models the human head mesh via a low-dimensional parameter space, enabling the generation of anatomically plausible, poseable 3D head shapes. The formulation consists of three main sets of parameters:

- **Shape coefficients** $\alpha\in\mathbb{R}^{n_s}$ (typically $n_s=100$), encoding subject-specific identity variation.
- **Expression coefficients** $\delta\in\mathbb{R}^{n_e}$ (typically $n_e=50$), parameterizing facial expressions.
- **Pose parameters** $\theta\in\mathbb{R}^{n_p}$ (e.g., $n_p=6$, covering global rotation and jaw articulation).

The mean template mesh $\bar S$ is combined with principal component analysis (PCA) bases for shape $B_s$ and expression $B_e$, and a pose basis $B_p$ for corrective deformations:
\[
S(\alpha) = \bar S + B_s \alpha,\quad E(\delta) = B_e \delta,\quad P(\theta) = B_p \theta.
\]
The unposed mesh is
\[
M(\alpha, \delta, \theta) = S(\alpha) + E(\delta) + P(\theta).
\]
A learned linear blend skinning operator $W$ applies pose-dependent articulation over joints $J(\alpha)$. The posed mesh is then:
\[
V(\alpha, \delta, \theta) = W(M(\alpha, \delta, \theta), J(\alpha), \theta).
\]
Optionally, a global scale $s$ and translation $t$ are applied,
\[
\mathcal{M} = s\cdot V(\alpha, \delta, \theta) + t.
\]
This structure ensures disentangled, interpretable, and differentiable mapping between parameter vector $[\alpha, \delta, \theta]$ and mesh vertices $V\in\mathbb{R}^{3N}$, with $N$ typically 10,000–20,000.

## 2. FLAME-Based Reconstruction Pipelines

Modern 3D face reconstruction pipelines leverage FLAME as the target parameter space for fitting 3D head geometry and appearance from monocular or multi-view images. KaoLRM [2601.12736] exemplifies this by projecting features from a pretrained Large Reconstruction Model (LRM) into FLAME parameters through a gating and regression scheme. Specifically:

- LRM produces triplane features $\mathcal{T}$, which are flattened into tokens $\{f_i\}$.
- A self-gating MLP predicts per-token gates $g_i$, yielding gated tokens $f'_i=g_i f_i$.
- A regressor $M$ outputs predicted FLAME parameters: $[\hat\alpha, \hat\beta, \hat\theta, \hat s, \hat t]=M(\{f'_i\})$.

Supervision can include a landmark loss:
\[
L_{\mathrm{lmk}} = \sum_{j=1}^{68} \left\| \pi(v_j(\alpha, \beta, \theta)) - \ell_j^{2D} \right\|^2,
\]
as well as $\ell_2$ regularizers on shape and expression:
\[
L_{\mathrm{reg}} = \|\alpha\|^2 + \|\beta\|^2.
\]

For appearance modeling, KaoLRM applies FLAME-based 2D Gaussian splatting. Points $\{x_i\}$ are densely sampled on the reconstructed mesh; each is transformed into a 2D Gaussian primitive in image space, and appearance is rendered by weighted splatting. Rendering and binding losses (relying on depth and normals from both mesh and Gaussian splats) enable end-to-end optimization.

Multi-stage training is common: landmark and regularization losses enable coarse alignment, then photometric and geometric binding losses refine fine structure and appearance. KaoLRM demonstrates this yields state-of-the-art reconstruction accuracy and cross-view consistency on benchmarks such as FaceVerse and NoW [2601.12736].

## 3. Integration with Neural Volumetric Rendering

Several frameworks combine FLAME's explicit mesh structure with implicit neural representations like NeRF to obtain both photorealistic rendering and full expression/pose control.

**NeRFlame** [2303.06226] and **FLAME-in-NeRF** [2108.04913] both incorporate FLAME in radiance field pipelines:

- The FLAME mesh generates a dense 3D surface; a distance field $\sigma(x; \alpha_s, \alpha_e, \theta)$ is defined to be nonzero only near the mesh surface:
\[
\sigma(x;\alpha_s,\alpha_e,\theta) =
\begin{cases}
0 & d(x,\mathcal{M}) > \epsilon \\
1 - \frac{d(x,\mathcal{M})}{\epsilon} & \text{otherwise}
\end{cases}
\]
with $d(x,\mathcal{M})$ the minimum distance from $x$ to the mesh.

- For color, a NeRF-MLP $f_\phi$ receives positional encodings and predicts RGB: $f_\phi(\gamma(x), \gamma(d)) \rightarrow c\in[0,1]^3$.

- Control over expression and pose is achieved by manipulating FLAME parameters, which induce deformations of both the mesh and the NeRF density support.

**FLAME-in-NeRF** further conditions the NeRF MLP on the FLAME expression code, concatenated to input layers, and uses a spatial prior (occupancy mask) to enforce that only facial regions respond to expression changes. Training employs combined losses: photometric, regularization on parameters, and novel disentanglement and spatial priors [2108.04913].

**Joint optimization** over neural rendering weights and FLAME parameters, often in multiple training phases, produces models with high-fidelity reconstructions that are directly controllable via FLAME's low-dimensional latent space [2303.06226].

## 4. Data-Driven FLAME Fitting from Images

FLAME parameter extraction is commonly performed via deep regression models trained to predict FLAME codes from monocular imagery under a battery of self-supervised and supervised objectives.

Anisetty et al. [2208.12078] develop an unsupervised encoder for in-the-wild images that outputs FLAME coefficients regulating both facial and full-head shape, even under severe hair occlusion. Core components include:

- **Dice consistency loss** aligning the silhouette of rendered mesh (post-hair-inpainting) to observed skin.
- **Scale consistency loss** ensuring shape invariance across varying crop levels (tight/loose framing).
- **Landmark detection** for extended 71-point topology to constrain upper-head reconstruction.
- **Encoder consistency and regularization** to stabilize predicted parameters.

The system yields competitive performance on face (NoW) and full-head (CoMA, LYHM) evaluation datasets, confirming FLAME's utility for unsupervised, accurate geometry recovery from unconstrained images [2208.12078].

## 5. Applications in Facial Expression Inference and Recognition

FLAME-derived representations encode rich information on both facial identity and expression, and recent work has incorporated these 3D parameters as feature spaces for facial expression inference (FEI) tasks.

Ig3D [2408.16907] conducts a systematic study, evaluating both “short” (just $[\alpha; \delta; \theta]$) and “full” (all regressed FLAME parameters) embeddings extracted via EMOCA or SMIRK regressors. Two fusion strategies are analyzed:

- **Intermediate fusion**: 3DMM parameters are projected and concatenated with late-stage 2D CNN features, then passed joint through final MLPs.
- **Late fusion**: 2D and 3D-based classifiers/regressors produce predictions which are fused at the score level (max, mean, weighted).

On AffectNet and RAF-DB, fusing FLAME embeddings—especially via late fusion—delivers consistent improvements over 2D-only baselines for both discrete expression classification (e.g., $+3.84\%$ accuracy on RAF-DB) and valence-arousal regression (e.g., $-8.43\%$ MSE on AffectNet VA), thereby validating the complementary power of 3DMM-based features [2408.16907].

## 6. Supervision, Losses, and Optimization Strategies

FLAME-based models are typically supervised using a mix of geometric, photometric, and perceptual losses, as well as statistical priors on latent codes:

- **Landmark alignment** (commonly, $L_{\rm lmk}$): improves geometric consistency across views.
- **Photometric and perceptual losses** (e.g., pixelwise, VGG feature, D-SSIM).
- **Regularization** (e.g., $\ell_2$ losses on $\alpha$, $\delta$, $\theta$) to prevent parameter drift.
- **Specialized terms** such as dice loss for head silhouette, scale consistency for invariance to image crop, encoder consistency, and geometric binding in renderer-fitted pipelines.

Optimization can proceed in multi-stage fashion: coarse alignment is established using geometric cues, followed by photometric/appearance refinement. In end-to-end neural pipelines (e.g., NeRFlame), mesh and NeRF weights are co-optimized, sometimes with staged schedules to balance mesh rigidity and appearance flexibility [2303.06226, 2601.12736, 2208.12078, 2408.16907].

## 7. Quantitative Performance and Impact

FLAME-based 3DMM pipelines consistently deliver state-of-the-art results across multiple 3D face benchmarks:

- **KaoLRM**: Chamfer mean on FaceVerse $2.68$ (cf. DECA $3.17$, EMOCA $3.15$, SMIRK $3.20$); NoW challenge split mean $0.99$ mm (cf. DECA $1.24$ mm) [2601.12736].
- **Occlusion-robustness**: Dice and scale invariant losses yield accurate full-head reconstructions even with occluding hair [2208.12078].
- **Expression transfer and recognition**: FLAME-based features, when fused with 2D CNN or transformer pipelines, provide significant accuracy and robustness boosts for emotion recognition and valence-arousal estimation [2408.16907].

These results underline the model’s adaptability for controlled facial synthesis, neural rendering, and affective computing.

---

**Relevant References:**  
KaoLRM [2601.12736], NeRFlame [2303.06226], FLAME-in-NeRF [2108.04913], Full-head regulation [2208.12078], Ig3D (FEI fusion) [2408.16907].

Source: https://www.emergentmind.com/topics/flame-3d-morphable-model-3dmm