Papers
Topics
Authors
Recent
Search
2000 character limit reached

3D Skew Gaussian Splatting: A Detailed Overview

Updated 5 July 2026
  • 3D Skew Gaussian Splatting is a technique that replaces symmetric Gaussian primitives with asymmetric skewed kernels to better capture complex boundaries and discontinuities.
  • It employs a skew-normal formulation that modulates opacity and adjusts primitive centroids for improved visualization in real-time rendering pipelines.
  • The method optimizes parameters via a decoupled strategy, enhancing structural fidelity and reducing redundancy compared to traditional symmetric approaches.

Searching arXiv for papers on 3D Skew Gaussian Splatting and closely related skew-normal splatting formulations. 3D Skew Gaussian Splatting (3DSGS) is an extension of 3D Gaussian Splatting that replaces symmetric Gaussian primitives with asymmetric skewed kernels in order to improve real-time novel view synthesis and interactive visualization, particularly near object boundaries, thin structures, one-sided surfaces, and shape or color discontinuities. In the recent literature, one formulation adopts the Azzalini Skew-Normal distribution as the fundamental primitive and is termed Skew-Normal Splatting (SNS), while another introduces a general skew Gaussian primitive together with enhanced opacity modeling, depth-aware densification, and a decoupled free-camera visualization engine (Wu et al., 14 May 2026, Zhao et al., 18 May 2026).

1. Motivation and relation to symmetric 3DGS

3D Gaussian Splatting (3DGS) is described as a leading representation for real-time novel view synthesis because Gaussian primitives provide favorable mathematical and computational properties. The limitation identified by skew-based extensions is that, under a finite primitive budget, the symmetric shape of each primitive directly affects representation compactness, especially near asymmetric structures such as object boundaries and one-sided surfaces. The visualization-oriented formulation states the same issue in rendering terms: symmetric kernels struggle to capture shape and color discontinuities, which cause blurriness and primitive redundancy that mislead human perception during visual analysis (Wu et al., 14 May 2026, Zhao et al., 18 May 2026).

The central intervention is therefore not merely to enlarge the kernel family, but to introduce intrinsic asymmetry while preserving rasterization efficiency. One paper emphasizes continuous interpolation between symmetric Gaussians and Half-Gaussian-like shapes; the other emphasizes structural fidelity, compactness, and compatibility with real-time rendering. A common misconception is that any asymmetric primitive can be treated as a hard truncation of a Gaussian. The skew-normal formulation explicitly distinguishes itself from approaches that rely on hard truncation, arguing that such approaches limit continuous shape control and introduce distributional discontinuities (Wu et al., 14 May 2026).

2. Skew primitive and distributional structure

In the skew-normal formulation, a random variable XRdX\in\mathbb R^d follows Azzalini’s Skew-Normal distribution with location μ\mu, scale matrix Ω\Omega, and slant vector α\alpha, written XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha), with unnormalized density

f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),

where Φ\Phi is the CDF of a standard univariate normal, ΩRd×d\Omega\in\mathbb R^{d\times d} is positive-definite, μRd\mu\in\mathbb R^d is the location parameter, and αRd\alpha\in\mathbb R^d is the slant vector. If μ\mu0, the density reduces, up to a constant factor, to the μ\mu1-variate Gaussian. As μ\mu2, the distribution approaches a “half-Gaussian” truncated on one side (Wu et al., 14 May 2026).

The paper also stresses that the location parameter is not the centroid. The mean is shifted by a skew-dependent term,

μ\mu3

so the primitive’s effective center differs from μ\mu4. This matters directly for rasterization, culling, and tile assignment. The same formulation measures overall skewness using Mardia’s multivariate skewness and reports that it saturates at μ\mu5, which ensures each primitive remains spatially compact (Wu et al., 14 May 2026).

A closely related formulation writes the 3DSGS primitive as a skew Gaussian obtained by modulating a standard anisotropic Gaussian with a one-dimensional CDF along a skewness direction: μ\mu6 Here the factor of μ\mu7 ensures normalization to a true PDF when μ\mu8, and the construction recovers the symmetric Gaussian when μ\mu9. This suggests that the naming difference between “skew-normal” and “skew Gaussian” reflects two presentations of the same basic idea: a Gaussian core modulated by a univariate normal CDF to induce directed asymmetry (Zhao et al., 18 May 2026).

3. Projection, rasterization, and compositing

A decisive technical property of the skew-normal primitive is closure under affine transforms and marginalization. Let Ω\Omega0 denote the local affine approximation of the world-to-screen map. If Ω\Omega1, then the projected variable remains skew-normal in two dimensions,

Ω\Omega2

with Ω\Omega3 and Ω\Omega4. The paper also gives a reparameterized 2D kernel

Ω\Omega5

where Ω\Omega6 is a closed-form function of Ω\Omega7. This analytical projection is what allows seamless integration into existing Gaussian Splatting rasterization pipelines (Wu et al., 14 May 2026).

Compositing follows front-to-back alpha blending. For each pixel Ω\Omega8, the renderer collects the front-to-back sorted set of primitives intersecting that pixel and evaluates

Ω\Omega9

Because the skew-normal location parameter is not the centroid, the tile-bounding-box center is shifted to the true 2D mean rather than kept at α\alpha0. This is a nontrivial correction: without it, screen-space support estimation would be biased for strongly skewed splats (Wu et al., 14 May 2026).

The generalized 3DSGS CUDA pipeline describes the same rendering logic at the systems level. The image is partitioned into tiles; each tile stores a list of overlapping primitives; each primitive is affinely projected; the α\alpha1 projected covariance is computed; and the forward-splat kernel evaluates a Gaussian fall-off α\alpha2, a skew term via α\alpha3, and then α\alpha4. The resulting opacity is α\alpha5, after which color and transmittance are accumulated exactly as in standard front-to-back splatting. The backward pass remains analytical, with closed-form gradients for covariance terms, opacity, and the skew vector (Zhao et al., 18 May 2026).

4. Parameterization and optimization

One source of instability in skewed splatting is the coupling between scale, rotation, and skewness. The skew-normal paper addresses this through a decoupled parameterization. As in 3DGS, the covariance is factorized as

α\alpha6

with α\alpha7 and diagonal α\alpha8. Instead of optimizing α\alpha9 directly, the method introduces a latent intrinsic skew vector XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)0 and sets

XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)1

Under this construction, XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)2 alone controls skewness in the primitive’s canonical frame, while XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)3 and XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)4 only orient and scale that intrinsic shape (Wu et al., 14 May 2026).

The same work further decomposes XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)5 into magnitude and direction: XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)6 where XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)7 and XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)8 are unconstrained. This cleanly separates “how much skew” from “which direction.” The primitive parameter set is

XSNd(μ,Ω,α)X\sim\mathcal{SN}_d(\mu,\Omega,\alpha)9

The reported training schedule is two-phase. During warm-up, all shape and skew parameters are updated jointly via Adam. After f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),0, the optimizer switches to cyclic Block-Coordinate Descent on f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),1 versus f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),2: for the first f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),3 steps of each cycle, f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),4 are frozen while f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),5 are updated; for the remaining f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),6 steps, f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),7 are frozen while f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),8 are updated. Positional parameters f(x;μ,Ω,α)=exp(12(xμ)Ω1(xμ))  Φ ⁣(αΩ1/2(xμ)),f(x;\mu,\Omega,\alpha) = \exp\Bigl(-\tfrac12(x-\mu)^\top\Omega^{-1}(x-\mu)\Bigr) \;\Phi\!\bigl(\alpha^\top\,\Omega^{-1/2}(x-\mu)\bigr),9 are updated with SGHMC to promote global exploration, all other parameters use Adam, and the only explicit image-space loss is the per-pixel Φ\Phi0 color loss

Φ\Phi1

No additional regularizers are needed beyond bounded skewness and parameter decoupling (Wu et al., 14 May 2026).

The visualization-oriented formulation reports complementary optimization details rather than a different objective. Its listed hyperparameters include learning rate Φ\Phi2 for mean, covariance, and color, learning rate Φ\Phi3 for skewness Φ\Phi4, densification thresholds Φ\Phi5 and Φ\Phi6, and an opacity-bisect regularizer Φ\Phi7 (Zhao et al., 18 May 2026).

5. Opacity modeling, densification, and visualization engine

Beyond asymmetric spatial support, 3DSGS can alter the opacity model itself. In the 3DSGS visualization framework, screen-space opacity for primitive Φ\Phi8 is

Φ\Phi9

so skewness modulates opacity directly after projection. The same work introduces a bisected-region opacity model in which a single primitive carries two base opacities, ΩRd×d\Omega\in\mathbb R^{d\times d}0 and ΩRd×d\Omega\in\mathbb R^{d\times d}1, separated by a directional partition ΩRd×d\Omega\in\mathbb R^{d\times d}2 in screen space. The stated purpose is to represent a sharp in-kernel discontinuity analytically, rather than by overlapping multiple Gaussians (Zhao et al., 18 May 2026).

The same paper augments standard 3DGS densification with a depth-aware criterion. In addition to the 2D screen-space position gradient norm ΩRd×d\Omega\in\mathbb R^{d\times d}3, it tracks a depth-gradient

ΩRd×d\Omega\in\mathbb R^{d\times d}4

If either ΩRd×d\Omega\in\mathbb R^{d\times d}5 or ΩRd×d\Omega\in\mathbb R^{d\times d}6, the Gaussian is split along its principal scale axis: parameters ΩRd×d\Omega\in\mathbb R^{d\times d}7 are cloned, the scale is reduced by ΩRd×d\Omega\in\mathbb R^{d\times d}8 on that axis, skew and base opacities are adjusted by heuristic, two new Gaussians are inserted, and the original is removed. The reported interpretation is that large ΩRd×d\Omega\in\mathbb R^{d\times d}9 indicates under-resolved depth discontinuities such as thin occluders and floaters (Zhao et al., 18 May 2026).

At the implementation level, the skew-normal method is a PyTorch extension of the 3DGS rasterizer in which the new 2D skew-normal kernel is inserted wherever 3DGS originally used a Gaussian. Each skew-normal evaluation requires one call to μRd\mu\in\mathbb R^d0, described as an erf-based overhead that adds a small constant slowdown while remaining real-time on tile-based GPU splatting. Training on an NVIDIA RTX A6000 for 30,000 iterations on the “drjohnson” scene takes approximately 38 minutes, reported as on par with Student-t splatting (SSS), and the asymptotic per-frame complexity remains μRd\mu\in\mathbb R^d1 (Wu et al., 14 May 2026).

The 3DSGS visualization engine re-derives the CUDA rasterization flow so that both symmetric and skew Gaussians are natively supported with minimal branching. The implementation stores primitives in Structure-of-Arrays for coalesced memory loads, performs bounding-box checks and covariance untangling once per tile-primitive pair and stores them in shared memory, approximates μRd\mu\in\mathbb R^d2 via a fast polynomial, places intrinsics μRd\mu\in\mathbb R^d3 and the coordinate-alignment matrix μRd\mu\in\mathbb R^d4 in constant memory, and assigns one CUDA block to each tile. During free-camera exploration in Blender via VisEngine, the reported runtime is μRd\mu\in\mathbb R^d5–μRd\mu\in\mathbb R^d6 FPS depending on resolution, with render-time remaining above μRd\mu\in\mathbb R^d7 FPS even under μRd\mu\in\mathbb R^d8 M primitives (Zhao et al., 18 May 2026).

6. Empirical behavior and reported gains

The skew-normal paper evaluates on Mip-NeRF360 with μRd\mu\in\mathbb R^d9 scenes, Tanks & Temples with αRd\alpha\in\mathbb R^d0 scenes, and Deep Blending with αRd\alpha\in\mathbb R^d1 scenes, using PSNRαRd\alpha\in\mathbb R^d2, SSIMαRd\alpha\in\mathbb R^d3, and LPIPSαRd\alpha\in\mathbb R^d4. Its reported averages are: 3DGS αRd\alpha\in\mathbb R^d5, GES αRd\alpha\in\mathbb R^d6, 3D-HGS αRd\alpha\in\mathbb R^d7, SSS αRd\alpha\in\mathbb R^d8, and SNS αRd\alpha\in\mathbb R^d9. On all three benchmarks, 3DSGS achieves the highest PSNR, with average μ\mu00 dB over SSS, and ties or exceeds SSIM and LPIPS. The same report states that on every single scene, SNS outperforms 3DGS, GES, 3D-HGS, and SSS by at least μ\mu01 dB; one cited example is “Room,” which improves from μ\mu02 dB with 3D-HGS to μ\mu03 dB with SNS. Its ablation study starts from a “vanilla” skew-normal primitive and reports μ\mu04 dB on Mip-NeRF360 from μ\mu05-decomposition alone, μ\mu06 dB from alternating optimization alone, and μ\mu07 dB from combining both, yielding the full μ\mu08 dB result. Qualitatively, the paper highlights sharper castle towers, curtain folds, thin poles, and box lips (Wu et al., 14 May 2026).

The visualization-engine paper reports a different set of absolute numbers but a similar trend. On the Mip-NeRF-360 outdoor dataset with μ\mu09 scenes, vanilla 3DGS is reported at PSNR μ\mu10, SSIM μ\mu11, LPIPS μ\mu12, kernels μ\mu13 M, and μ\mu14 FPS, while 3DSGS reaches PSNR μ\mu15, SSIM μ\mu16, LPIPS μ\mu17, kernels μ\mu18 M, and μ\mu19 FPS. On Tanks & Temples with μ\mu20 scenes, PSNR rises from μ\mu21 to μ\mu22 and SSIM from μ\mu23 to μ\mu24, while kernel count decreases from μ\mu25 to μ\mu26 M at μ\mu27 FPS. On Deep Blending with μ\mu28 scenes, PSNR increases from μ\mu29 to μ\mu30 and LPIPS decreases from μ\mu31 to μ\mu32. The qualitative description emphasizes crisper edges and fewer “ghost-glows” in railings, wires, window frames, and foliage, with lower absolute pixel-error heatmaps along those features (Zhao et al., 18 May 2026).

Taken together, these results indicate a consistent empirical pattern: asymmetric primitives improve reconstruction quality and structural compactness most clearly at sharp boundaries, thin geometry, one-sided surfaces, and regions with complex transparency. A plausible implication is that the main advantage of 3DSGS is not uniformly higher fidelity everywhere in the scene, but more efficient allocation of representational capacity where symmetry is intrinsically mismatched to the underlying geometry or appearance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to 3D Skew Gaussian Splatting (3DSGS).