---
title: Amortised Variational Inference
url: https://www.emergentmind.com/topics/amortised-variational-inference-avi
type: topic
---

# Amortised Variational Inference

Amortised Variational Inference (AVI) is a core methodology in contemporary probabilistic machine learning that enables efficient, scalable, and flexible approximate inference in complex latent variable models. By replacing instance-specific optimization of variational parameters with a shared parametric inference mechanism—typically a neural network—AVI is foundational to deep generative modeling, structured Bayesian inference, and probabilistic meta-learning. Recent advances address its theoretical guarantees, computational trade-offs, and algorithmic extensions, with methodological and empirical progress spanning hierarchical Bayesian models, dynamical systems, meta-learning, and stochastic processes.

## 1. Conceptual Foundation and Mathematical Framework

Amortised Variational Inference seeks to approximate intractable posterior distributions $p(z|x)$ in latent variable models by introducing a parameterized family of tractable distributions $q_\phi(z|x)$ and optimizing the reverse Kullback–Leibler divergence via maximization of the evidence lower bound (ELBO):
\[
\mathcal{L}(\phi, \theta; x) = \mathbb{E}_{q_\phi(z|x)}[\log p_\theta(x, z) - \log q_\phi(z|x)].
\]
Instead of instantiating and optimising local parameters for each $x$ (“classical” mean-field VI), AVI employs a global inference network (encoder) $\phi$, typically a neural network mapping $x$ to the parameters of $q_\phi(z|x)$ [2209.10888]. This network is trained jointly with the generative model $p_\theta(x|z)$ such that, for unseen $x^*$, variational inference can be executed in a single forward pass with no per-instance optimization.

The ELBO, optimized with stochastic re

Source: https://www.emergentmind.com/topics/amortised-variational-inference-avi