--- title: Feed-Forward Gaussian Splats url: https://www.emergentmind.com/topics/feed-forward-gaussian-splats type: topic --- # Feed-Forward Gaussian Splats Feed-forward Gaussian splats are a class of real-time, optimization-free scene representations in which the parameters of 3D Gaussian primitives—encoding geometry and appearance—are regressed in a single forward pass from sparse or unconstrained input images. This paradigm supplants traditional iterative fitting or test-time optimization with large-scale, end-to-end learned networks that generalize to new scenes and, in many cases, novel camera and illumination domains. Feed-forward Gaussian splatting has achieved rapidly increasing scene fidelity, reconstruction efficiency, and robustness, and now underpins a broad array of research in learning-based 3D scene representation, novel view synthesis, and semantic lifting. ## 1. Mathematical Model and Rendering of 3D Gaussian Splats A 3D Gaussian splat, parameterized by its mean $\mu \in \mathbb{R}^3$, covariance matrix $\Sigma \in \mathbb{R}^{3\times3}$, opacity $\alpha$, and view-dependent color coefficients $c$ (frequently via spherical harmonics), defines a volumetric density field: \[ g(\mathbf{x}) = \alpha \, \exp\left(-\frac{1}{2}(\mathbf{x} - \mu)^\top \Sigma^{-1} (\mathbf{x} - \mu)\right) \] Rendering a set of $N$ such splats, $\mathcal{G} = \{g_i\}_{i=1}^N$, involves projecting each Gaussian into the image plane (via a pinhole or perspective camera model, including Jacobian-corrected projection of $\Sigma$), evaluating their 2D footprints at each pixel, and depth-sorted, alpha-blended compositing: \[ C(\mathbf{x}) = \sum_{i=1}^N T_{i-1}(\mathbf{x}) \, \alpha_i \, G^{2D}_i(\mathbf{x}) \, c_i, \quad \text{with}\;\; T_{i}(\mathbf{x}) = \prod_{j