Papers
Topics
Authors
Recent
Search
2000 character limit reached

X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph

Published 2 Jul 2026 in cs.CV | (2607.02099v1)

Abstract: Generating a 3D dental volume from a single panoramic radiograph (PXR) could provide a low-radiation alternative to Cone-Beam Computed Tomography (CBCT), but the problem is highly underdetermined: panoramic acquisition integrates 3D attenuation along curved X-ray paths into a 2D image, leaving depth-resolved anatomy unobserved. Existing implicit and generative approaches often produce oversmoothed geometry or anatomically inconsistent hallucinations, lacking geometry-driven supervision and relying on smooth representations unable to precisely localize sharp anatomical boundaries. We propose X-Splat, the first Gaussian Splatting framework for generating CBCT-like 3D dental volumes from a single PXR. X-Splat uses the known panoramic acquisition geometry as a generation scaffold: learnable anisotropic Gaussian primitives are initialized along the X-ray paths that formed the input image and adjusted in a single feed-forward pass, constrained by Beer-Lambert reprojection and multi-view radiographic training supervision. A lightweight residual refiner adds dataset-level anatomical priors without overriding the geometry already resolved by the Gaussians. We train on synthetic PXR-CBCT pairs, enabling direct volumetric supervision without paired real scans. We further introduce segmentation-based geometry-aware metrics, providing the first evaluation of PXR-based generation over maxillofacial anatomy. X-Splat outperforms NeRF- and GAN-based baselines, recovering individual teeth, cortical boundaries, and alveolar structure, including the mandibular canal which prior methods fail to reconstruct. Code will be available at https://github.com/tomek1911/X-Splat

Summary

  • The paper introduces ray-anchored anisotropic 3D Gaussian primitives to reconstruct accurate 3D dental anatomy from a single panoramic radiograph.
  • It employs a differentiable Gaussian splatting operator with physics-corrected rasterization and perceptual regularization to refine volume synthesis.
  • The approach markedly improves metrics like BA-ASD, TVR, and CVR, effectively reducing hallucinations and preserving fine structural details.

X-Splat: Gaussian Splatting for 3D CBCT Generation from a Single Panoramic Radiograph

Introduction and Motivation

The challenge of reconstructing 3D dental anatomy from a single panoramic X-ray (PXR) image is a highly ill-posed inverse problem. Conventional CBCT provides depth-resolved volumes through multi-view projections, but panoramic radiographs, while ubiquitous and low dose, encode 3D information as a single highly compressed 2D integral along curved X-ray trajectories. This lossy mapping discards depth and leaves large anatomical ambiguities. Existing approaches utilizing implicit fields or generative architectures generally fail to produce volumes with crisp structural fidelityโ€”oversmoothing or hallucination are common, particularly at fine boundaries like tooth roots and the mandibular canal. The "X-Splat" framework directly addresses this deficit by introducing explicit, geometry-anchored, anisotropic 3D Gaussians as the principal representation, tightly constraining volume generation via acquisition-aware parameterization and scan physics.

Figure 1

Figure 1: X-Splat leverages the known panoramic acquisition geometry, deploying learnable, anisotropic 3D Gaussians anchored along rays to recover dense 3D anatomy from 2D projections, in contrast to prior NeRF or voxel-grid approaches.

Methodology

Ray-Anchored 3D Gaussian Representation

At the core of X-Splat is the principle of initializing a dense, spatially-informed scaffold of anisotropic 3D Gaussian primitives directly along the acquisition rays of the panoramic X-ray scan. Each Gaussianโ€™s parameters (displacement, orientation, scale, and density) are inferred in a single, feed-forward pass through a shared MLP, conditioned both on global image features (from a 2D U-Net encoder) and per-primitive positional encoding. Constraining Gaussians to move and rotate strictly within the axial plane of each acquisition ray not only enforces anatomical plausibility but also anchors geometric reasoning to physical imaging formation, discarding the unconstrained flexibility that leads to hallucinations in traditional generative models.

Figure 2

Figure 2: Pipeline for processing a single PXR with a U-Net encoder and shared MLP to predict 3D Gaussians, refined by a residual 3D U-Net, with multi-level physics and perceptual regularization.

Differentiable Rasterization and Volumetric Synthesis

The predicted Gaussians are voxelized into a coarse volumetric representation using a physics-corrected, radiative Gaussian splatting operator that integrates each primitiveโ€™s contribution according to Beerโ€“Lambert law. This rasterization is fully differentiable and supports end-to-end gradient flow, allowing both explicit geometric and radiometric losses to shape the generative process.

Residual Refinement and Multi-View Consistency

Downstream, a lightweight residual 3D U-Net refiner operates on the coarse Gaussian-based volume. The model restricts refiner capacity, functioning solely as a minor anatomical prior injector rather than an unconstrained shape composerโ€”this design decision prevents data-driven overfitting to population means and ensures that geometric details specified by the Gaussians are preserved rather than erased.

X-Splatโ€™s training objective is composite, with dominant weight apportioned to multi-view geometric supervision through digitally reconstructed radiographs (DRRs) rendered at 31 azimuthal angles. This loss encourages depth and consistency impossible to obtain from the single-view input alone, sharply contracting the solution space toward anatomically plausible configurations. Additional terms include physics-driven reprojection losses, maximum-intensity projection constraints, and perceptual penalties drawn from deep features, operating at the level of both coarse and refined volumes.

Representation and Optimization Dynamics

A key feature of the approach is the dynamic capability of the Gaussian primitives: during inference, splats initialized along rays actively rotate and translate within their permitted local neighborhoods, aligning with tissue boundaries (e.g., tooth roots, cortical surfaces), with observed displacements up to 10 px in proximity to high-density structures.

Figure 3

Figure 3: Gaussian primitive dynamics post-training, exhibiting rotation and translation along anatomical boundaries, demonstrating the modelโ€™s explicit geometric alignment capacity.

This local flexibilityโ€”paired with dense, acquisition-informed anchoringโ€”enables X-Splat to efficiently and accurately fill inter-ray gaps that are otherwise prone to artifacts or blurring in conventional NeRF/implicit field models. Restricting both the spatial movement and possible scales of Gaussians to physically justified extents serves as a built-in regularizer, preserving anatomical structure even in the absence of volumetric cues.

Quantitative and Qualitative Results

Empirical evaluation is conducted on ToothFairy3โ€”a public dataset with full arch maxillofacial CBCT and dense segmentation. The most critical advances manifest in explicitly geometry-aware metrics: Big Anatomy Average Surface Distance (BA-ASD), Teeth Volume Recall (TVR), Canal Volume Recall (CVR), and Hallucinated Volume (HV). While intensity-based scores such as PSNR and SSIM are competitive across methods, geometric recovery, as quantified by BA-ASD and CVR, reveals pronounced distinctions.

  • X-Splat attains the lowest BA-ASD (2.39 mm), exceeding other non-oracle approaches by at least 4.4ร—.
  • Canal recovery (CVR) is 67.3%, compared with 1.1% for NeBLa (implicit) and 27.6% for the best non-implicit competitor.
  • TVR approaches 85%, indicating no substantial loss in overall dental completeness.
  • HV is minimized, evidencing robust hallucination suppression.

Figure 4

Figure 4: X-Splat recovers full 3D anatomyโ€”cortical/trabecular bone, sinuses, mandibular canal, and avoids hallucinating absent teeth, outperforming prior work in structural fidelity.

Fine-grained qualitative analysis confirms these findings: X-Splat sharply delineates key bony and dental structures, reconstructs the mandibular canal as a continuous tube (a frequent failure point for all prior work), and refrains from hallucinating teeth in edentulous areas. Competing methods are variously over-smoothed, blur boundaries, or introduce high-frequency noise without anatomical support.

Cross-section comparisons further illustrate the modelโ€™s inductive bias: even before refinement, the Gaussian voxelizer alone yields a coarse volume that is spatially continuous, with pronounced dental arch localization and jaw curvatureโ€”whereas NeBLaโ€™s coarse representations are sparse and structurally impoverished, relying entirely on the refiner.

Figure 5

Figure 5: X-Splatโ€™s coarse volume directly localizes major anatomical features, in contrast to implicit-field approaches where structure must be invented by the refiner.

Ablation and Representation Analysis

Ablation studies confirm that the transition from implicit fields to explicit, ray-anchored Gaussians delivers the bulk of geometry-aware accuracy improvements. The efficiency of geometric coverage is further modulated by the count and configuration of splats, with diminishing returns above ~6M Gaussian anchors. The addition of displacement (i.e., allowing travel along rays) and the introduction of multi-view DRR regularization yield quantifiable, independent benefitsโ€”each incrementally sharpening geometric localization, mitigating hallucinatory predictions, and enforcing clinical plausibility. Notably, increasing the density of rays/splats in the implicit setting does not fundamentally overcome their representational weaknesses.

Clinical and Theoretical Implications

X-Splat exemplifies a paradigm shift for single-view volumetric inference in medical imaging: explicit, acquisition-aware geometric scaffolding, physics-consistent data formation constraints, and lightweight statistical regularization yield volumetric predictions far superior in task-relevant anatomical fidelity than either purely implicit or generative data-driven frameworks. Particularly in applications where diagnostic accuracy hinges on the recovery of fine structures (e.g., surgical planning, implant design, or forensic estimation), this representation-driven philosophy is likely to catalyze new classes of efficient, trustworthy inverse architectures.

Future research directions may include the adaptation of X-Splat to heterogeneous real-world panoramic systems via domain adaptation and the integration of adaptive, anatomically-specific Gaussian densification. The approach itself portends practical transformation in settings with limited CBCT accessibility or strong cost/radiation constraints, opening 3D dental analytics to heretofore inaccessible cohorts.

Conclusion

X-Splat provides a rigorously geometric, physics-grounded solution for the single-view CBCT generation problem, decisively outperforming prior implicit and generative architectures in structurally critical clinical metrics. Its fusion of explicit ray-anchored Gaussians, differentiable rasterization, and multi-view consistency regularization constitutes a robust template for future 3D inference work in domains of sparse or underdetermined medical imaging, with broad methodological and translational relevance.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.