---
title: 'Mirror-3DGS: Reflection-Aware 3D Gaussian Splatting'
url: https://www.emergentmind.com/topics/mirror-3dgs
type: topic
---

# Mirror-3DGS: Reflection-Aware 3D Gaussian Splatting

Mirror-3DGS refers to a family of methods and frameworks that explicitly incorporate planar mirror geometry and reflection modeling into 3D Gaussian Splatting (3DGS) pipelines for the purposes of novel view synthesis, scene reconstruction, or compression. Unlike conventional 3DGS, which yields incorrect geometry and photometry in reflective environments by misinterpreting mirror signals as direct scene content, Mirror-3DGS constructs mathematically explicit virtual mirror images—either by reflecting the scene’s Gaussian primitives or the camera itself—restoring physical fidelity and multi-view consistency in mirror regions. These reflection-aware techniques have enabled state-of-the-art results for real-time rendering, accurate scene editing, single- and multi-view geometry recovery, and substantial compression gains.

## 1. Mirror Geometry: Parameterization and Virtual Camera Construction

A planar mirror is defined in 3D by its surface normal $n \in \mathbb{R}^3$ and signed offset $d \in \mathbb{R}$, yielding a plane equation
$$
P(x):\ n^\top x + d = 0.
$$
Given a point $x$, its reflection $x'$ across $P$ is computed as
$$
x' = x - 2(n^\top x + d) n.
$$
The reflection can be expressed in homogeneous coordinates via a $4\times4$ matrix, enabling the transformation of both scene primitives and camera extrinsics.

For camera extrinsics $[R_\text{c}\ |\ t_\text{c}]$, the corresponding mirrored camera (“virtual camera”) has
\begin{align*}
R_\text{mirrored} &= (I - 2n n^\top) R_\text{c}, \\
t_\text{mirrored} &= (I - 2n n^\top) t_\text{c} + 2d n.
\end{align*}
This construction guarantees that rendering from the virtual camera is physically equivalent to observing the real scene via the mirror, thus creating multi-view consistency between direct and reflected rays [2404.01168][2410.01614][2509.20607][2405.11921].

## 2. Reflection-Aware Gaussian Splatting: Rendering and Fusion

Standard 3DGS represents a scene with $N$ anisotropic Gaussians $\{\mu_i, \Sigma_i, c_i, \alpha_i\}$. In the presence of mirrors, direct mapping of all image evidence to the scene cloud results in “ghost” Gaussians (“floaters”) behind the mirror and blurred or inconsistent mirror regions.

Mirror-3DGS overcomes this using reflection-aware dual rendering:

- Each real Gaussian is reflected about the mirror plane to create a virtual Gaussian with parameters
  \[
  \mu_i' = R \mu_i + 2d n,\quad \Sigma_i' = R \Sigma_i R^\top,\quad c_i' = c_i,\quad \alpha_i' = \alpha_i,
  \]
  where $R = I - 2nn^\top$.
- The real and mirrored Gaussian clouds are rendered independently to produce front-view and mirror-view images via EWA splatting and alpha blending.
- A per-pixel or per-Gaussian mirror mask $M(p)$ distinguishes mirror regions; the final output is fused as
  \[
  C(p) = (1 - M(p))\,C_\text{front}(p) + M(p)\,C_\text{mirror}(p).
  \]
This framework achieves physically correct reflection synthesis while preserving the real-time differentiability and high performance of 3DGS [2404.01168][2405.11921].

## 3. Mirror Plane Estimation and Mask Prediction

Mirror-3DGS requires accurate estimation of the mirror plane and associated segmentation mask. Multiple strategies are employed:

- Learnable per-Gaussian mirror probabilities $m_i \in [0,1]$ (derived from rendering residuals or explicit mask loss) are aggregated to produce a soft spatial mirror mask.
- Centers of high $m_i\,\alpha_i$ Gaussians are used to fit the mirror plane via RANSAC or least-squares (optionally refining with point normals back-projected from CNN/3DGS-inferred depths).
- Mask prediction loss $L_\mathrm{mask} = \|M - M_{gt}\|_1$ is imposed, either supervised via ground-truth masks or with consistency to predicted mirror content.
- In fully unsupervised or weakly annotated domains, geometric priors or self-supervision on spatial symmetry can be combined with photometric objectives [2404.01168][2410.01614][2509.20607][2405.11921][2509.18956].

## 4. Optimization and Loss Functions

Mirror-3DGS models are optimized through joint objectives that combine color, mask, geometry, and symmetry losses:

- **Photometric loss**:
  \[
  L_\mathrm{rgb} = (1 - \gamma)\, \|C_\text{fused} - C_\text{gt}\|_1 + \gamma\, D\text{-}SSIM(C_\text{fused}, C_\text{gt})
  \]
  ensuring both perceptual and structural alignment.
- **Mirror mask loss** and, when applicable, **depth supervision** or **mirror-plane regularization**:
  \[
  L_\mathrm{plane} = \frac{1}{N_f}\sum_i |n^\top p_i + d|,\qquad
  L_\mathrm{depth} = (1 - \gamma)\|D_\text{pred} - D_\text{gt}\|_1 + \gamma\,D\text{-}SSIM(D_\text{pred}, D_\text{gt}).
  \]
- **Symmetry consistency losses**:
   - For matched real and mirrored Gaussians, enforce $L_\mathrm{sym} = \frac{1}{N}\sum_i \|\mu_i - \mu_i'\|_2$ [2509.18956].
   - For virtual camera alignment, penalize pose differences: $L_\mathrm{sym} = (1-\mathbf{q}'_\mathrm{real}{}^\top\mathbf{q}_\mathrm{vir}) + \|\mathbf{t}'_\mathrm{real} - \mathbf{t}_\mathrm{vir}\|^2$ [2509.20607].
- Composite loss weights $(\lambda_\mathrm{mask}, \lambda_\mathrm{sym}, \lambda_\mathrm{depth})$ are set by cross-validation or ablation.

Optimization proceeds in multiple phases: initial geometry/mask fitting, mirror plane estimation, dual-view rendering and fusion, and final refinement of Gaussian and pose parameters, typically utilizing Adam or L-BFGS for 15–60 minutes on a modern GPU, yielding real-time inference performance [2404.01168][2405.11921][2410.01614][2509.20607][2509.18956].

## 5. Empirical Results and Benchmarks

Mirror-3DGS achieves substantial qualitative and quantitative improvements in mirror-rich scenes:

| Method         | PSNR↑ (Synth) | SSIM↑ (Synth) | LPIPS↓ (Synth) | FPS↑    | PSNR↑ (Real) | SSIM↑ (Real) | LPIPS↓ (Real) | FPS↑   |
|:--------------:|:-------------:|:-------------:|:--------------:|:-------:|:------------:|:------------:|:-------------:|:------:|
| Mirror-3DGS    |   37.89–39.87 |   0.97–0.979  | 0.01–0.038     |120–172  | 23.01–29.14  | 0.77–0.874   | 0.08–0.291    |96–128  |
| Mirror-NeRF    |   27.33–38.08 |   0.94–0.958  | 0.05–0.028     | 0.55–0.71 |25.04–25.25 | 0.86        | 0.06          |0.07–0.55|
| 3DGS vanilla   |   22.15–37.00 |   0.84–0.97   | 0.17–0.04      |208–480  | 22.13–26.88  | 0.72–0.884   | 0.24–0.332    |209–480 |

- Mirror-3DGS reconstructs physically valid mirror reflections, eliminates “floaters,” and recovers occluded geometry visible only via reflection.
- Rendering rates are 1–2 orders of magnitude higher than NeRF-based approaches.
- On synthetic datasets, Mirror-3DGS outperforms all prior methods in F1, PSNR, SSIM, and LPIPS [2404.01168][2410.01614][2509.20607][2405.11921][2509.18956].
- Real-world results show both visual quality and accurate mirror mask prediction, with convergence in 1–15 minutes.

## 6. Compression via Local Symmetry Exploitation

Mirror symmetry can also be exploited for compression of 3DGS scenes [2511.13264]:

- SymGS introduces learnable, scene-specific mirror planes and reflects the set of surviving Gaussians about these planes, eliminating redundant primitives.
- The pipeline iteratively detects strong planar symmetries by voting in a discretized normal–offset space, partitions and reflects Gaussian clusters, and then re-optimizes over plane parameters and primitives with standard photometric losses.
- SymGS achieves up to $108\times$ compression relative to the raw 3DGS baseline (and $1.66\times$ over previous SOTA compression HAC) while preserving PSNR within $0.2\,\mathrm{dB}$.

This symmetry-driven approach demonstrates the value of explicit geometric reasoning in large-scale 3DGS memory reduction and provides a plug-and-play module compatible with generic 3DGS compression methods.

## 7. Limitations, Extensions, and Open Problems

The current Mirror-3DGS paradigm exhibits several important limitations and opportunities for future advancement:

- Restriction to single, planar, and static mirrors: handling of curved, multi-planar, dynamic, or partially specular surfaces remains unresolved [2404.01168][2405.11921][2410.01614][2509.20607][2509.18956].
- Dependence on ground-truth mirror masks or accurate per-Gaussian mirror attributes during training; robust, automated mirror detection in general scenes is an open challenge.
- Incomplete handling of multi-bounce, occlusions, and volumetric/specular effects; mirror-to-mirror reflections and non-lambertian BRDFs are not modeled [2509.18956].
- Potential quadratic computational cost in symmetry detection and voting (mitigated by heuristic clustering and CUDA acceleration) [2511.13264].
- Extensions of the framework to learnable multi-symmetry families (including rotation or translation symmetries), end-to-end hypothesis generation, and dynamic or video scenes have been suggested but not yet fully realized.

Future directions include integrating robust self-supervised or CNN-based mirror detection, leveraging higher-order symmetry groups (SO(3), translation), adding multi-modal inputs (e.g., LiDAR and RGB via 3DRef [2403.06538]), hybrid neuron-explicit models for speed and memory, and joint modeling of specular/glossy/diffuse interactions.

---

**References:**
- [2404.01168] Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting
- [2405.11921] MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections
- [2410.01614] Gaussian Splatting in Mirrors: Reflection-Aware Rendering via Virtual Camera Optimization
- [2509.18956] Seeing Through Reflections: Advancing 3D Scene Reconstruction in Mirror-Containing Environments with Gaussian Splatting
- [2509.20607] Reflect3r: Single-View 3D Stereo Reconstruction Aided by Mirror Reflections
- [2511.13264] SymGS : Leveraging Local Symmetries for 3D Gaussian Splatting Compression
- [2403.06538] 3DRef: 3D Dataset and Benchmark for Reflection Detection in RGB and Lidar Data

Source: https://www.emergentmind.com/topics/mirror-3dgs