Papers
Topics
Authors
Recent
Search
2000 character limit reached

MEP-Diffusion: Hybrid Electron Ptychography

Updated 7 July 2026
  • MEP-Diffusion is a hybrid framework that combines a learned diffusion prior with a traditional physics-based ptychographic solver to reconstruct 3D crystal structures from 4D diffraction data.
  • It employs Diffusion Posterior Sampling with a Shifted Sigmoid guidance schedule to effectively balance global periodic constraints with refined atomic details, resulting in significant PSNR and SSIM improvements.
  • The method addresses challenges like depth ambiguity and local minima in multislice electron ptychography, delivering reconstructions with distinct depth slices and improved fidelity over conventional approaches.

MEP-Diffusion is a hybrid reconstruction framework for multislice electron ptychography (MEP) that combines a learned diffusion prior over crystal structures with a traditional physics-based ptychographic solver. Its central idea is not to replace existing iterative reconstruction machinery, but to augment it with a generative model that knows what plausible crystal structures look like. The method is integrated into reconstruction through Diffusion Posterior Sampling (DPS), and is motivated by the ill-posedness of recovering a 3D crystal volume from diffraction measurements, especially the weak depth information in MEP (Belardi et al., 23 Jul 2025).

1. Definition and conceptual scope

In multislice electron ptychography, a focused electron probe is scanned across a specimen on a 2D grid, and at each scan position the scattered wave is recorded as a 2D diffraction pattern. Collectively, this produces a 4D dataset: a stack of diffraction images indexed by scan position. MEP-Diffusion addresses the inverse problem of reconstructing the underlying 3D crystal structure from those measurements by combining a learned prior with the physical measurement model (Belardi et al., 23 Jul 2025).

The framework is explicitly hybrid. The diffusion model supplies a prior over plausible atomic volumes, while the ptychographic forward model enforces measurement consistency. This design reflects the paper’s claim that the diffusion prior should augment rather than replace the physical solver. In practical terms, the method is aimed at failure modes of existing iterative solvers such as blurry reconstructions, depth collapse, and suboptimal local minima.

In this usage, MEP denotes multislice electron ptychography. This differs from the separate literature in which MEP denotes a minimum energy pathway in atomistic simulation. Recent work on minimum energy pathway discovery has instead used active-learning surrogates for nudged elastic band calculations (Kakhandiki et al., 17 Dec 2025), while a distinct line of work has used the string method to compute MEPs and principal curves from pretrained diffusion models (Moreau et al., 25 Feb 2026). This suggests that “MEP-Diffusion” is not a universally standardized term across domains.

2. Forward model and inverse-problem structure

The reconstructed structure is represented as a 3D real-valued volume

xRD×H×W,\mathbf{x} \in \mathbb{R}^{D \times H \times W},

where DD is depth and H,WH,W are lateral dimensions. Under the strong phase approximation,

O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),

where V(r)V(\mathbf{r}) is the atomic scattering potential and σe\sigma_e is the electron interaction parameter. The formulation absorbs the exponential and works with

x:=σeV(r),\mathbf{x} := \sigma_e V(\mathbf{r}),

which is the structure to be recovered. The simplified forward model is written as

y=f(x;ϕ,Ω),\mathbf{y} = f(\mathbf{x}; \boldsymbol{\phi}, \boldsymbol{\Omega}),

where ff describes how the probe ϕ\boldsymbol{\phi} interacts with the material at scan positions DD0, producing measured diffraction patterns DD1 (Belardi et al., 23 Jul 2025).

The inverse problem is described as inherently ill-posed for several reasons. First, depth resolution is much worse than lateral resolution: lateral resolution can be sub-angstrom, while depth resolution is around DD2, roughly 100 times worse than lateral dimensions. Second, the forward model loses information because the measurements are diffraction intensities rather than direct 3D atomic coordinates. Third, real measurements are noisy. Fourth, conventional iterative solvers remain weakly constrained even with regularization. The paper notes that this combination can leave physics-only methods vulnerable to depth ambiguity and poor local minima.

The empirical consequence is a characteristic reconstruction pathology: different 3D structures can explain essentially the same diffraction data, and conventional solvers may reconstruct nearly uniform depth slices. MEP-Diffusion is formulated specifically to counter this by introducing a prior over realistic crystal lattices and atomic arrangements.

3. Diffusion prior, architecture, and training data

The diffusion component is a diffusion probabilistic model (DPM) trained on a large corpus of crystal structures. The forward noising process is

DD3

with a continuous noise parameterized by log signal-to-noise ratio,

DD4

The model uses a variance-preserving parameterization,

DD5

Training uses a velocity-prediction objective,

DD6

where

DD7

A notable design choice is the weighting function

DD8

which places extra emphasis on low logSNR / high-noise regimes. The stated motivation is that, for crystal data, periodic structure emerges very early in the reverse process, so the model must learn to recover the onset of periodicity from near-Gaussian noise (Belardi et al., 23 Jul 2025).

The denoiser is a 3D UNet modified for anisotropic voxel spacing,

DD9

so the network first downsamples only in height and width, then performs full 3D downsampling, with symmetric reversal during upsampling. The model has about 100M parameters.

The training set is constructed from the Inorganic Crystal Structure Database (ICSD). The pipeline starts with H,WH,W0 entries, keeps materials with all lattice vectors H,WH,W1, yields H,WH,W2 unique materials, renders each in 3 orientations, and thereby produces H,WH,W3 examples. The procedure also randomly removes H,WH,W4 of atoms to simulate vacancies. Each crystal is rendered as a tensor of size H,WH,W5, and training uses crops of size H,WH,W6. Validation uses 5,000 materials = 15,000 examples, and the test set uses 100 materials = 300 examples.

4. Posterior sampling and physics-guided guidance

MEP-Diffusion is incorporated into reconstruction through Diffusion Posterior Sampling. The posterior score is decomposed as

H,WH,W7

Because H,WH,W8 is difficult to compute directly, the method uses an approximation based on the model’s MMSE estimate of the clean sample,

H,WH,W9

Operationally, this yields a correction to the model’s O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),0-prediction,

O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),1

This is the core hybrid step: the diffusion model proposes a plausible crystal structure, while the physical gradient nudges it toward consistency with the observed diffraction data (Belardi et al., 23 Jul 2025).

The guidance schedule is treated as a major algorithmic component rather than a minor hyperparameter. The paper reports that standard schedules can fail in MEP because excessively strong late-stage physical guidance can collapse reconstructions into nearly identical depth slices. To avoid this, the method uses a Shifted Sigmoid schedule,

O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),2

which anneals the physical guidance toward zero as sampling proceeds. The stated intuition is that early sampling should use physics to establish global periodic structure, while late sampling should allow the learned prior to refine atomic detail and avoid depth collapse. This schedule is reported to outperform the simpler baseline O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),3.

5. Evaluation protocol, quantitative results, and computational behavior

Evaluation uses simulated diffraction patterns generated with abTEM under realistic conditions: 300 kV acceleration voltage, 21.4 semi-convergence angle, 200 O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),4 overfocus, 500 nm spherical aberration, 0.512 O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),5 scan step size, O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),6 scan positions, and dose O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),7. Reconstruction quality is measured with PSNR and SSIM. Because absolute intensity scale can vary across materials and ptychography is only defined up to an arbitrary phase offset, all reconstructions are instance-normalized to O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),8 before computing metrics. The paper reports results for both full 3D reconstruction and depth-summed 2D projection (Belardi et al., 23 Jul 2025).

For full 3D reconstruction, the reported results are as follows:

Method PSNR SSIM
LSQ-ML 27.49 0.3949
PtyRAD[Adam] 26.85 0.4629
PtyRAD[L-BFGS] 31.49 0.6506
MEP-Diffusion 33.7190 0.7523

For depth-summed 2D reconstruction, the reported results are:

Method PSNR SSIM
LSQ-ML 27.97 0.4279
PtyRAD[Adam] 27.42 0.4896
PtyRAD[L-BFGS] 33.56 0.7096
MEP-Diffusion 41.5101 0.8852

The paper states that MEP-Diffusion outperforms all baselines and highlights a 90.50% SSIM improvement over existing methods. It also states that all improvements are statistically significant with O(r)exp ⁣(iσeV(r)),\mathbf{O}(\mathbf{r}) \approx \exp\!\left(i \sigma_e V(\mathbf{r})\right),9. Qualitatively, the central contrast with the baselines is the recovery of distinct depth slices rather than nearly uniform ones.

An ablation on the guidance schedule reinforces the importance of annealed conditioning. For full 3D reconstruction, the Alpha schedule V(r)V(\mathbf{r})0 gives PSNR 32.7677 and SSIM 0.6494, whereas the Shifted Sigmoid schedule gives PSNR 33.7190 and SSIM 0.7523. For depth-summed metrics, the corresponding SSIM values are 0.7745 and 0.8852.

The method also exposes a quality–time trade-off. The paper reports that 100 sampling steps already beat the conventional baselines, that additional steps improve quality further, and that gains saturate beyond about 1000 steps. All time experiments were run on a single NVIDIA H100 GPU. This supports the intended use of the framework as a tunable posterior sampler rather than a fixed-cost solver.

6. Limitations and relation to adjacent research

The paper identifies several remaining failure modes: slice misordering, missing or extra atoms, incorrect local structures, and errors concentrated in the depth dimension. It also notes that the method may still suffer when the forward model is ambiguous. These caveats are significant because they indicate that the learned prior mitigates, but does not eliminate, the observability limits of multislice electron ptychography (Belardi et al., 23 Jul 2025).

The broader significance of MEP-Diffusion is clearest when set against neighboring literatures. In minimum-energy-pathway discovery, the main computational bottleneck is repeated energy and force evaluation along a path. One recent solution, Neural Network Bayesian Algorithm Execution (NN-BAX), replaces repeated simulator calls inside NEB with an actively refined surrogate, achieving a one to two order of magnitude reduction in energy and force evaluations with negligible loss in MEP accuracy and scalability to V(r)V(\mathbf{r})1-dimensional systems (Kakhandiki et al., 17 Dec 2025). That framework addresses the same general question of efficient path discovery, but it does so through active-learning-based NEB rather than a diffusion prior.

A second adjacent line of work uses the string method to probe pretrained diffusion models directly. There, one evolves a curve under the learned score field to obtain either pure transport paths, minimum energy paths, or finite-temperature principal curves. In image models, the reported result is that MEPs can pass through high-likelihood but unrealistic “cartoon” intermediates, whereas principal curves produce more realistic transitions; in protein structure prediction, the same machinery yields physically plausible pathways between metastable conformers (Moreau et al., 25 Feb 2026). This is conceptually related to MEP-Diffusion only at the level of score-based geometric reasoning.

A further neighboring example comes from biased surface diffusion. For V(r)V(\mathbf{r})2 on Al(111), NEB combined with constant-V(r)V(\mathbf{r})3 methods shows that the MEP, adsorption site, and activation barrier depend strongly on applied bias, and that the relevant thermodynamic potential is the grand potential V(r)V(\mathbf{r})4 rather than only the total energy V(r)V(\mathbf{r})5 (Hagiwara et al., 2020). This underscores that “MEP” in the atomistic literature typically refers to a pathway on an energy landscape, not to electron ptychographic reconstruction.

Taken together, these adjacent results indicate that MEP-Diffusion in the strict sense of (Belardi et al., 23 Jul 2025) is a physics-guided generative reconstruction method for multislice electron ptychography, whereas nearby “MEP” literatures concern minimum energy pathways in learned or atomistic landscapes. A plausible implication is that the term is best interpreted through its host field: in ptychography, it denotes a crystal-reconstruction framework; in atomistic simulation, it denotes transition-path computation.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to MEP-Diffusion.