---
title: Multinomial Diffusion Process
url: https://www.emergentmind.com/topics/multinomial-diffusion-process
type: topic
---

# Multinomial Diffusion Process

A multinomial diffusion process is a stochastic discrete-state Markov chain defined over categorical data, in which information is gradually corrupted by randomly resampling each token, symbol, or state according to a schedule of probabilities. This formulation encompasses a range of phenomena and applications, from microscopic particle diffusion in statistical physics to generative modeling in machine learning for categorical data such as semantic maps, text, speech, and quantized image codes. By construction, each step in multinomial diffusion consists of a categorical transition kernel that interpolates between the current state and a uniform distribution, yielding analytically tractable posteriors and well-defined variational bounds for training neural denoisers, in contrast to the continuous Gaussian case. The process admits closed-form marginal and posterior distributions, exact ancestral sampling by Gumbel–Max, and enables discrete inversion and controllable editing via approaches such as DICE. The regime encompasses both physical and computational models, including the Multinomial Diffusion Equation for particle-level simulation and coarse-to-fine latent generation for high-dimensional data.

## 1. Mathematical Construction and Transition Kernels

A multinomial diffusion process operates over a categorical space $\mathcal{X} = \{1,...,K\}^N$, where each dimension is a one-hot (or integer) encoding of a categorical variable. The forward process defines a $T$-step corruption chain,
\[
q(x_{1:T}\mid x_0) = \prod_{t=1}^T q(x_t\mid x_{t-1})
\]
where the transition kernel at step $t$ is
\[
q(x_t\mid x_{t-1}) = \mathrm{Cat}\left(x_t; \pi^t = (1-\beta_t)x_{t-1} + \frac{\beta_t}{K}\mathbf{1}\right)
\]
with $\beta_t\in(0,1)$ the noise schedule, $\alpha_t = 1-\beta_t$, and $\mathbf{1}$ the all-ones vector. At every time $t$, each token is retained with probability $\alpha_t$ or replaced by a uniformly sampled category with probability $\beta_t$ [2303.02737, 2210.07677, 2108.08827, 2102.05379, 2410.08207].

The cumulative marginal from $x_0$ to $x_t$ admits a closed-form:
\[
q(x_t\mid x_0) = \mathrm{Cat}\left(x_t; \bar \alpha_t x_0 + (1-\bar \alpha_t)\frac{1}{K}\mathbf{1}\right)
\]
where $\bar \alpha_t = \prod_{s=1}^t \alpha_s$. Thus, at each step, the probability that a token remains uncorrupted is $\bar \alpha_t$; otherwise, the token is uniformly random. This forward process is elemental for both classical and modern multinomial diffusion models [2102.05379].

## 2. Reverse Process and Posterior Computation

The reverse (denoising) process seeks to reconstruct uncorrupted data by learning a backward Markov chain:
\[
p_\theta(x_{t-1} \mid x_t) = \mathrm{Cat}\left(x_{t-1}; p_{\mathrm{post}}(x_t, \hat x_0)\right)
\]
where the exact posterior given $x_0$ is
\[
q(x_{t-1}\mid x_t, x_0) = \mathrm{Cat}\left(x_{t-1}; \tilde p(k) = u_k v_k \right), \quad
u_k = \alpha_t [x_t]_k + \frac{1-\alpha_t}{K}, \quad
v_k = \bar \alpha_{t-1} [x_0]_k + \frac{1-\bar \alpha_{t-1}}{K}
\]
and then $p_{\mathrm{post}}$ is normalized over $k$ [2303.02737, 2102.05379, 2410.08207].

In practice, $x_0$ is unknown; thus, a neural network predicts $\hat x_0 = \mu_\theta(x_t, t)$, a softmax estimate. Generation proceeds via backward ancestral sampling: at each step, sample $x_{t-1} \sim \mathrm{Cat}(p_{\mathrm{post}}(x_t, \hat x_0))$, commonly using the Gumbel–Max trick for categorical sampling [2303.02737, 2410.08207].

## 3. Training Objectives and Variational Bounds

Multinomial diffusion models are trained by minimizing a time-decomposed evidence lower bound (ELBO):
\[
\mathcal{L}_{\mathrm{vlb}} = \mathbb{E}_{x_0 \sim q} \sum_{t=1}^T \mathrm{KL}\left(q(x_{t-1}\mid x_t, x_0)\,\|\;p_\theta(x_{t-1}\mid x_t)\right)
\]
where both terms are categorical distributions, and the KL reduces to cross-entropy between the true and predicted posteriors [2303.02737, 2102.05379, 2108.08827]. An additional reconstruction term at $t=0$ ensures $\hat x_0$ matches the ground truth:
\[
\mathcal{L}_0 = -\sum_k [x_0]_k \log [\hat x_0]_k
\]

Noise schedules (cosine or position-dependent variants) and importance sampling for $t$ are employed to stabilize training; all computations leverage log-space numerics for categorical probabilities [2102.05379].

## 4. Discrete Inversion and Editing in Categorical Space

Discrete inversion (DICE) records categorical noise residuals during forward corruption and re-injects them at generation time. The inversion follows the actual noise sequence by Gumbel–Max reparameterization,
\[
x_t = \arg\max( \log(\overline{Q}_t v(x_0)) + g)
\]
with $g\sim \mathrm{Gumbel}(0,1)$, then logs the difference between sampled logits and the model logits as $z_t = y_{t-1} - \hat y_{t-1}$ [2410.08207].

At editing, injected residuals and controlled Gumbel noise allow smooth transitions between pure reconstruction and creative synthesis, modulated by parameters $\lambda_1, \lambda_2$. No masks or continuous relaxations are needed; all information is preserved in discrete logit corrections [2410.08207].

## 5. Physical Multinomial Diffusion Equation

In physical systems, the Multinomial Diffusion Equation (MDE) is a microscopic model for particle-level diffusion, discretizing space into voxels with $N_i(t)$ particles, each of which can hop left or right with probability $\kappa = D\Delta t/\Delta x^2$ per time step. Updates are governed by multinomial draws:
\[
N_i(t+\Delta t) = N_i(t) + L_{i+1}^t - R_i^t - L_i^t + R_{i-1}^t
\]
with $(L_i^t, R_i^t, N_i - L_i^t - R_i^t)$ multinomially distributed [1010.0719].

Under suitable scaling ($N_i \gg 1$, $\kappa \ll 1$), the MDE converges in law to the classical stochastic diffusion PDE, but the MDE remains accurate even for low-density regimes where the PDE fails. Simulation comparisons verify precise mass conservation and correct fluctuation statistics, in contrast to the SDE at low $N_i$ [1010.0719].

## 6. Multinomial Diffusion in Generative Modeling

### Semantic Inpainting

In semantic map inpainting, multinomial diffusion fills missing regions by conditioning on observed data. The Look-Back Condition (LB-Con) merges known and unknown regions at every step, enforcing bidirectional consistency via forward–reverse cycles [2303.02737].

### Speech and Text Synthesis

TransFusion trains a multinomial diffusion to denoise random symbol sequences into valid transcriptions of speech, using classifier-free guidance and advanced sampling (resampling, progressive noise) for alignment [2210.07677]. Discrete diffusion exhibits robustness to noise and avoids mode collapse found in continuous text models.

### Image Generation

ImageBART employs multinomial diffusion in discrete latent space, synthesized via coarse-to-fine autoregressive transformers. At sampling, global context is provided at each scale, overcoming the unidirectional bias of classic AR models. Multinomial kernels guarantee tractable posteriors and discrete consistency, supporting mask-free inpainting and local image edits [2108.08827].

### Categorical Data Modeling

The multinomial diffusion process yields exact ELBO-based generative models for categorical data, directly optimizing cross-entropy with no need for continuous relaxations. Key tricks include cosine noise schedules, importance sampling, and log-space numerics [2102.05379].

## 7. Connections to Markov Velocity Chains and Generalizations

Path diffusion models, with Markovian velocity processes on discrete grids, instantiate multinomial diffusion as coupled binomial or multinomial chains over possible velocity states. The continuum limit recovers the damped Telegraph and Klein–Gordon equations, with fine grids yielding hyperbolic-function kernels. Generalizations to multi-dimensional velocity spaces under specific rate matrices allow the mean motion to obey Newton's law, providing links between random walks and PDEs governing physical transport phenomena [1406.0077].

## Table: Forward/Reverse Kernel Formulations

| Model/Context           | Forward Kernel                                             | Reverse Posterior (Exact)                              |
|------------------------ |---------------------------------------------------------- |------------------------------------------------------- |
| Generative modeling     | $\mathrm{Cat}((1-\beta)x_{t-1} + \frac{\beta}{K}\mathbf{1})$  | $\mathrm{Cat}(u_k v_k / \sum_j u_j v_j)$               |
| Physical MDE            | Multinomial($N_i$, $\kappa, \kappa, 1-2\kappa$)           | -                                                     |
| Markov velocity chain   | Matrix kernel with reversal rates $(\alpha, \beta)$        | -                                                     |

## Applications and Limitations

Multinomial diffusion is employed in generative modeling of semantic data, speech/text, and discrete latent image codes; physical simulation of low-density diffusion; controllable editing in categorical spaces; and as theoretical models connecting discrete Markov chains with PDE limits. Its strengths are analytic tractability, pure categorical consistency, mass conservation in particle models, and elimination of continuous surrogate biases. Main limitations are slow inference (large $T$), requirement of tractable sampling, and, in physical models, step-size constraints for mass conservation and numerical stability.

## References

- Semantic map inpainting: "SePaint: Semantic Map Inpainting via Multinomial Diffusion" [2303.02737]
- Speech recognition: "TransFusion: Transcribing Speech with Multinomial Diffusion" [2210.07677]
- Image generation: "ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis" [2108.08827]
- Theory and categorical data applications: "Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions" [2102.05379]
- Discrete inversion and editing: "DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Models" [2410.08207]
- Microscopic physical model: "Multinomial Diffusion Equation" [1010.0719]
- Markov velocity process and hyperbolic PDE connection: "Path Diffusion, Part I" [1406.0077]

Source: https://www.emergentmind.com/topics/multinomial-diffusion-process