---
title: Planar-Adapted Gaussian Representation
url: https://www.emergentmind.com/topics/planar-adapted-gaussian-representation
type: topic
---

# Planar-Adapted Gaussian Representation

Searching arXiv for the cited papers and closely related planar Gaussian methods.
Planar-adapted Gaussian representation denotes a class of Gaussian-based models in which Gaussian primitives are constrained, parameterized, or regularized by planes or locally planar surface structure rather than treated as unconstrained volumetric ellipsoids. In the cited literature, the formulation appears in planar reconstruction from RGB images, high-fidelity surface reconstruction, dynamic scene modeling, indoor reconstruction, rendering of planar transmission and reflection, and radio-frequency radiance modeling for Spatial-CSI. Across these settings, the central operation is to make the Gaussian primitive surface-aligned: by collapsing one covariance axis, embedding 2D Gaussians in a 3D plane, constraining centers to fitted planes, or attaching explicit planar interaction models to otherwise standard Gaussians [2412.01931], [2406.06521], [2408.13972], [2508.16849].

## 1. Primitive definition and geometric parameterization

A common starting point is the standard 3D Gaussian Splatting parameterization, in which each Gaussian carries a centroid $\boldsymbol\mu_i\in\mathbb R^3$, a covariance $\Sigma_i\in\mathbb R^{3\times3}$, an opacity or density term, and a color or radiance term. In several planar-adapted variants, the covariance is factorized as $\Sigma_i=R_i\,S_i\,S_i^T\,R_i^T$, with $S_i=\mathrm{diag}(s_{i1},s_{i2},s_{i3})$, and one principal axis is driven to become very small so that the primitive behaves like a thin disk rather than a volumetric blob [2406.06521], [2510.23930], [2510.17095].

In PGSR, each Gaussian is explicitly “flattened” along its smallest principal axis. The Gaussian center is $\boldsymbol\mu_i\in\mathbb R^3$, the normal $\mathbf n_i$ is the unit-length eigenvector of $\Sigma_i$ associated with the smallest eigenvalue, and the in-plane covariance is written as
\[
\Sigma_i^\parallel = R_i\,\mathrm{diag}(0,s_2,s_3)\,R_i^T.
\]
The residual thickness along the normal direction is penalized through
\[
L_s=\sum_i \min(s_1,s_2,s_3)\longrightarrow 0.
\]
This turns the Gaussian into a thin, oriented planar disk [2406.06521].

RF-PGS adopts an analogous construction in radio-frequency modeling. A single Planar Gaussian is parameterized by center position $\mathbf x_g\in\mathbb R^3$, rotation quaternion $\mathbf q_g$ or rotation matrix $R_g$, scale vector $\mathbf s_g=(s_1,s_2,s_3)$, and base density $\alpha_g>0$, with covariance
\[
\Sigma_g = R_g\,\mathrm{diag}(s_1^2,s_2^2,s_3^2)\,R_g^T.
\]
Planarity is enforced by shrinking one scale dimension through
\[
L_{\rm scale}=\bigl\|\min(s_1,s_2,s_3)\bigr\|_1.
\]
The surface normal $\mathbf n_g$ is the column of $R_g$ corresponding to the minimum $s_i$ [2508.16849].

Other planar-adapted parameterizations are more structured. DynaSurfGS augments each Gaussian with a local plane normal $n_i$ and offset $d_i$, with $d_i=-n_i^T\mu_i$, and rewrites the covariance as
\[
\Sigma_i = R_i\,\mathrm{diag}(s_{i,u}^2,s_{i,v}^2,s_{i,n}^2)\,R_i^T
\]
so that the third axis is aligned with the plane normal and $s_{i,n}\to 0$ drives the Gaussian into a pancake-shaped primitive [2408.13972]. In contrast, 3D Gaussian Flats represents planar regions by explicit 3D planes $P_p$ with origin $o_p$ and unit normal $n_p$, then places 2D Gaussians with in-plane parameters $\hat\mu_k\in\mathbb R^2$ and $\hat\Sigma_k\in\mathbb R^{2\times2}$ on those planes and embeds them in 3D via
\[
\mu_k=T_p[\hat\mu_k;0;1],\qquad
\Sigma_k=T_p\cdot\mathrm{diag}(\hat\Sigma_k,0)\;T_p^T.
\]
This yields Gaussians whose mass lies exactly on the plane [2509.16423].

## 2. Rendering, depth estimation, and surface queries

Planar adaptation is not only a geometric regularizer; it directly changes how depth, normals, and surface interactions are computed. In PGSR, each planar Gaussian is projected to image space through the standard anisotropic 2D Gaussian kernel
\[
G_i(\mathbf p)=\exp\!\Bigl(-\tfrac12(\mathbf p-\boldsymbol\mu_i')^T(\Sigma_i')^{-1}(\mathbf p-\boldsymbol\mu_i')\Bigr),
\]
converted into opacity $\alpha_i(\mathbf p)\approx 1-\exp(-w\,G_i(\mathbf p))$, and composited front-to-back with
\[
T_i(\mathbf p)=\prod_{j<i}(1-\alpha_j(\mathbf p)),\qquad
\omega_i(\mathbf p)=T_i(\mathbf p)\,\alpha_i(\mathbf p).
\]
From these weights, PGSR renders a blended normal map
\[
\mathbf N(\mathbf p)=\sum_i \omega_i(\mathbf p)\,\mathbf n_i^{\rm cam},
\]
and a blended signed distance map
\[
\mathcal D(\mathbf p)=\sum_i \omega_i(\mathbf p)\,d_i.
\]
Its “unbiased depth” is then
\[
D(\mathbf p)=\frac{\mathcal D(\mathbf p)}{\mathbf N(\mathbf p)\cdot \hat{\mathbf r}(\mathbf p)}.
\]
The cited formulation states that dividing by $\mathbf N(\mathbf p)\cdot \hat{\mathbf r}(\mathbf p)$ cancels the ray-accumulation weight and yields the exact intersection depth on the blended plane [2406.06521].

The same geometric logic is extended to dynamic scenes in DynaSurfGS. Normals are rendered by $\alpha$-blending the per-splat normals, a distance map is accumulated as
\[
L(m)=\sum_{i\in\mathcal N(m)}T_i\,l_i\,\alpha_i,
\]
and the depth is recovered as
\[
D(m)=\frac{L(m)}{N(m)^T K^{-1}\tilde m}.
\]
A local plane normal is reconstructed from depth at each pixel and four neighbors, and normal consistency is enforced between the depth-derived normal and the Gaussian-rendered normal [2408.13972].

In RF-PGS, the analogous surface query is a ray–surface intersection in radio space. For a receiver at $\mathbf x_{\rm Rx}$ and query direction $\mathbf d$, the intersection depth of a Planar Gaussian is computed from
\[
d_{\perp}=\bigl|(\mathbf x_{\rm Rx}-\mathbf x_g)\!\cdot\!\mathbf n_g\bigr|,\qquad
d_{\rm depth}=\left|\frac{d_{\perp}}{\mathbf d\cdot \mathbf n_g}\right|,
\]
and per-Gaussian depths are alpha-blended to find the first surface intersection. The RF radiance stage then decomposes each multipath component path loss into free-space path loss and surface interaction gain, with the latter encoded by spherical-harmonic coefficients stored on the intersected Planar Gaussians. The cited text states that accurate geometry ensures that each SH-modeled leaf precisely corresponds to a physical surface patch [2508.16849].

## 3. Optimization objectives and structural supervision

Planar-adapted Gaussian models are typically trained by combining the baseline photometric objective with planar, geometric, and multi-view constraints. In PGSR, the full objective is
\[
L=L_{\mathrm{rgb}}
+\lambda_1 L_s
+\lambda_2 L_{\mathrm{svgeo}}
+\lambda_3 L_{\mathrm{mvrgb}}
+\lambda_4 L_{\mathrm{mvgeom}},
\]
where $L_s$ is the flattening term, $L_{\mathrm{svgeo}}$ penalizes the discrepancy between a local normal reconstructed from neighboring depths and the rendered normal, $L_{\mathrm{mvrgb}}$ is a multi-view photometric term based on normalized cross-correlation under a plane-induced homography, and $L_{\mathrm{mvgeom}}$ enforces forward–backward homography cycle consistency. The paper also introduces a camera exposure compensation model,
\[
I_i^a=e^{a_i}I_i^r+b_i,
\]
inside the photometric loss [2406.06521].

RF-PGS adds RF-specific regularization. Beyond the minimum-scale loss $L_{\rm scale}$, it uses curvature-aware refinement based on two alpha-blended maps, plane depth $D_{\rm depth}$ and perpendicular distance $D_{\rm perp}$. A wedge point is identified when $\|\nabla D_{\rm perp}\|$ is large and $\|\nabla D_{\rm depth}\|$ is small, and wedge Gaussians are enlarged to capture diffraction in a single primitive. Surface uniformity is imposed by estimating a local plane normal from neighboring intersection points,
\[
\mathbf N_{\rm local}
=\bigl(\mathbf x_{\rm nb1}-\mathbf x_{\rm nb3}\bigr)\times\bigl(\mathbf x_{\rm nb2}-\mathbf x_{\rm nb4}\bigr),
\]
and penalizing the angular discrepancy between $\mathbf n_g$ and $\widehat{\mathbf N}_{\rm local}$. The total geometry loss is
\[
L_{\rm geom}
=\lambda_s L_{\rm scale}
+\lambda_d L_{\rm depth}
+\lambda_u L_{\rm uniform}
+\lambda_{\rm reg}L_{\rm reg},
\]
supplemented by a multi-view consistency term based on NCC between neighboring receiver poses [2508.16849].

A separate line of work uses planar semantics rather than only covariance collapse. Planar Gaussian Splatting lifts 2D segmentation embeddings and 2D normals into Gaussians, storing a plane descriptor $d_i$ and a surface normal $n_i$ per Gaussian. It then constructs a tree-structured Gaussian mixture and performs bottom-up probabilistic merges using a criterion that combines photometric likelihood, descriptor similarity, and normal alignment. The merge probability is
\[
p_{\rm merge}(i,j)\propto
\exp\!\Bigl[(\Delta L_{\rm photo}+\lambda_d S_{\rm desc}+\lambda_n S_{\rm norm})/T\Bigr],
\]
and planar instances are recovered by agglomerative clustering on the final hierarchy. The abstract states that this method achieves state-of-the-art performance in 3D planar reconstruction without requiring either 3D plane labels or depth supervision [2412.01931].

More recent structured methods incorporate external priors. PlanarGS builds Language-Prompted Planar Priors through GroundedSAM proposals, cross-view fusion, and geometric inspection using depth-derived normals and plane-distance maps. It adds planar prior supervision,
\[
L_{\rm plane}=\lambda_s L_s+\lambda_p L_p,
\]
and geometric prior supervision,
\[
L_{\rm geom}=\lambda_{rd}L_{rd}+\lambda_{rn}L_{rn}+\lambda_{dn}L_{dn},
\]
where $L_p$ aligns rendered depth with plane-consistent depth, and the depth and normal priors are obtained from DUSt3R. GSPlane imposes an even stronger structural constraint by representing planar Gaussian centers as convex combinations of three basis points on a fitted plane,
\[
\boldsymbol\mu_i=\sum_{k=1}^3 \omega_{i,k}F_k,\qquad
\sum_{k=1}^3\omega_{i,k}=1,\ \omega_{i,k}\ge 0,
\]
and introduces a Dynamic Gaussian Re-classifier that reverts persistently high-gradient planar Gaussians to unconstrained means in $\mathbb R^3$ [2510.23930], [2510.17095].

## 4. Major variants in the literature

The literature does not reduce planar adaptation to a single primitive design. It includes covariance-collapse models, explicit plane-coordinate models, hierarchical plane parsing, and planar transport or reflection models.

| Method | Planar mechanism | Task domain |
|---|---|---|
| PGS | Gaussians augmented with plane descriptors and normals; hierarchical Gaussian mixtures | 3D planar reconstruction |
| PGSR | Flattened 3D Gaussians with unbiased depth and normal rendering | Surface reconstruction |
| DynaSurfGS | Planar-based Gaussians plus 4D neural-voxel deformation | Dynamic reconstruction |
| RF-PGS | Planar Gaussians with RF-specific optimizations and structured RF radiance | Spatial-CSI / RF modeling |
| 3D Gaussian Flats | Hybrid constrained planar 2D Gaussians and freeform 3D Gaussians | Photometric scene reconstruction |
| GSPlane | Plane-constrained Gaussian coordinates and planar-guided remeshing | Structured planar reconstruction |
| PlanarGS | 3DGS with language-prompted planar priors and geometric supervision | Indoor reconstruction |
| TR-Gaussians | Learnable planes and mirrored Gaussians for reflection/transmission | Planar reflection and transmission rendering |

TR-Gaussians illustrates a distinct branch of the family. Rather than flattening every Gaussian onto a plane, it keeps ordinary 3D Gaussians for the real scene, introduces an explicit plane $\mathbf n_p^T\mathbf x+d=0$, and generates mirrored Gaussians across that plane to model reflections. Reflection and transmission are blended through a Fresnel-based, view-dependent weighting,
\[
R_{\rm raw}(\mathbf u)=R_0+(1-R_0)\bigl(1-\mathbf n_p\!\cdot\!\mathbf d\bigr)^5,
\]
with the final composition
\[
\mathbf C(\mathbf u)=\bigl(1-\mathbf R(\mathbf u)\bigr)\mathbf C_t(\mathbf u)+\mathbf R(\mathbf u)\mathbf C_r(\mathbf u).
\]
Its optimization is staged, and includes depth variance, gradient conflict, and reflection mask losses [2511.13009].

This diversity counters a recurrent simplification: planar adaptation is not exhausted by shrinking one covariance axis. The cited methods show at least four distinct mechanisms—flattened covariances, 2D Gaussians embedded in 3D planes, plane-constrained Gaussian coordinates, and explicit planar interaction models. This suggests that “planar-adapted Gaussian representation” is best understood as a design principle rather than a single architecture.

## 5. Reported empirical behavior

The reported empirical behavior consistently links planar adaptation to better geometric fidelity, improved multi-view consistency, or more physically structured interaction models. In RF-PGS, the comparison against RF-3DGS is especially explicit. The cited results report mean depth error $<0.05\,\mathrm m$, a PSNR improvement from $14.2\,\mathrm{dB}\to 20.6\,\mathrm{dB}$ over RF-3DGS, geometry-stage training in $\sim 3\,\mathrm{min}$, full RF training $<4\,\mathrm{min}$, inference $\sim 4\,\mathrm{ms/query}$, and primitive budgets of $\sim1$–$2\,\mathrm M$ Gaussians. On a 2.4 GHz simulation with 50 training samples, RF-PGS reports $\mathrm{PSNR}=20.61\,\mathrm{dB}$, $\mathrm{SSIM}=0.6606$, and $\mathrm{LPIPS}=0.3945$, versus RF-3DGS with $\mathrm{PSNR}=14.22\,\mathrm{dB}$, $\mathrm{SSIM}=0.3680$, and $\mathrm{LPIPS}=0.4250$. The same paper states that RF-PGS reconstructs Tx-side path-loss spectra up to $95\%$ fidelity using only Rx-side supervision, achieves $\ge 92\%$ of the theoretical MIMO capacity with only 10 training samples in the 2.4 GHz setup, and after 30 s fine-tuning on 100 real 60 GHz NIST samples recovers about $+6\,\mathrm{dB}$ PSNR and $+0.3$ SSIM from the direct simulation-to-field gap [2508.16849].

In scene reconstruction, 3D Gaussian Flats reports on ScanNet++ an $\mathrm{RMSE}_{\rm depth}=0.27\,\mathrm m$, $\mathrm{MAE}=0.18\,\mathrm m$, $\mathrm{AbsRel}=0.10$, $\delta<1.25=0.88$, $\mathrm{PSNR}=27.01\,\mathrm{dB}$, and $2.43\,\mathrm M$ Gaussians, of which $27.8\%$ are planar. On ScanNetv2 it reports $\mathrm{RMSE}=0.40$, $\mathrm{MAE}=0.31$, and $\mathrm{PSNR}=21.75$. For planar-surface mesh extraction on the DSLR subset, it reports $F_1=53.7\%$, accuracy $=6.93\,\mathrm{cm}$, and completeness $=17.31\,\mathrm{cm}$. Its ablations also attribute large degradations to removing the mask loss, alternating plane optimization, snapping of Gaussians to planes, or relocation densification [2509.16423].

GSPlane emphasizes mesh structure and compactness. On ScanNetV2, the cited table reports a 2DGS baseline with $F$-score $0.583$ and $1.73\,\mathrm M$ vertices, versus 2DGS + GSPlane with $F$-score $0.689$ and $946\,\mathrm K$ vertices. On Tanks & Temples, the cited table reports 3DGS with $F$-score $0.09$, planar vertices $317.5\,\mathrm K$, total vertices $1.86\,\mathrm M$, versus 3DGS + GSPlane with $F$-score $0.17$, planar vertices $4.53\,\mathrm K$, and total vertices $1.55\,\mathrm M$. On the top 20 ScanNet planes, the reported planar-wise Chamfer distances are about $17.53\,\mathrm{cm}$ for PlanarRecon, about $8.37\,\mathrm{cm}$ for AirPlanes, and about $7.08\,\mathrm{cm}$ for 3DGS + GSPlane [2510.17095].

PlanarGS reports that on Replica, ScanNet++, and MuSHRoom it cuts Chamfer Distance roughly in half versus vanilla 3DGS, raises $F$-score at the $5\,\mathrm{cm}$ threshold from about $39\%$ to about $77\%$, improves normal consistency from about $62\%$ to about $83\%$, and maintains or slightly improves novel-view PSNR/SSIM over 3DGS. PGSR, for its part, states a training time of about 30k iterations, about 1 hr on $1\times 4090$, followed by TSDF fusion of rendered depths for mesh extraction, and characterizes itself as $100\times$ faster than NeRF in training while retaining real-time rendering in milliseconds [2510.23930], [2406.06521].

## 6. Scope, misconceptions, and adjacent meanings

The dominant contemporary use of planar-adapted Gaussian representation concerns surface-aligned primitives for rendering, reconstruction, and RF propagation. Two adjacent literatures, however, use “planar” structure differently. In the adaptive fast Gauss transform, the central representation is a plane-wave spectral approximation of the Gaussian kernel rather than a surface-aligned Gaussian primitive. The Gaussian
\[
G(x;\delta)=\exp(-x^2/\delta)
\]
is approximated by a truncated plane-wave expansion with fixed expansion length $N_F=O(\log^d(1/\epsilon))$, diagonal translations, and adaptive tree structures. The paper states that this avoids classical Hermite expansions and yields $O(\log^d(1/\epsilon))$ complexity per box [2305.07165].

A different meaning appears in geometric modeling of plane curves. There, each segment of a polygonal approximation carries tangent direction $e_i$, normal direction $n_i$, segment length $\ell_i$, and user-defined normal uncertainty $\tau_i$, producing a Gaussian component with mean at the segment midpoint,
\[
\mu_i=\frac{v_{i-1}+v_i}{2},
\]
and covariance
\[
\Sigma_i=\frac{\ell_i^2}{12}\,e_i e_i^T+\tau_i^2\,n_i n_i^T.
\]
The mixture weights are chosen proportional to segment length. This is a planar-adapted Gaussian representation of uncertainty on a plane curve, not a splatting model [2606.06505].

Within the 3DGS-derived literature, a common misconception is that planar adaptation is universally beneficial. The cited papers qualify that claim. PlanarGS explicitly notes that curved or highly organic geometry sees no direct benefit, and that outdoor scenes lacking large, consistent planes or scenes where language prompts cannot easily enumerate all plane types remain challenging [2510.23930]. 3D Gaussian Flats is motivated specifically by flat, texture-less surfaces, where purely photometric reconstruction is ill-conditioned [2509.16423]. RF-PGS, meanwhile, enlarges wedge Gaussians in high-curvature regions to capture diffraction, indicating that strict local planarity alone is not sufficient for every propagation phenomenon [2508.16849].

Taken together, the literature presents planar-adapted Gaussian representation as a structured response to a specific failure mode of unconstrained Gaussian models: ambiguous geometry on flat regions, weak surface alignment, or physically uninterpretable interaction points. The cited methods differ in implementation, but they share a common objective: to bind Gaussian support more tightly to planar or locally planar geometry so that rendering, reconstruction, or propagation queries become more accurate, more structured, and more computationally useful.

Source: https://www.emergentmind.com/topics/planar-adapted-gaussian-representation