---
title: Multi-Plane Phase Retrieval Sensors
url: https://www.emergentmind.com/topics/multi-plane-phase-retrieval-sensors
type: topic
---

# Multi-Plane Phase Retrieval Sensors

Searching arXiv for recent papers on multi-plane phase retrieval sensors and related architectures.
Multi-plane phase retrieval sensors are intensity-only optical sensing systems that infer a complex field—amplitude and phase—from measurements acquired at several axially separated planes, or from formally equivalent diversity channels produced by propagation, wavelength, media, or structured diffractive hardware. In adaptive optics, they include curvature and nonlinear curvature wavefront sensors; in microscopy and inline holography, they include multi-height quantitative phase imagers; and in computationally engineered hardware, they include diffractive processors that map phase information into directly measurable intensity outputs [2508.09256][1211.6751][2404.18946][1705.05766][2603.11832][2403.11035][2401.16779]. Across these instantiations, the common inverse problem is to recover a pupil- or object-plane field \(U_0(x,y)\) from intensities \(I_n(x,y)=|U_n(x,y;z_n)|^2\) measured after propagation to multiple planes \(z_n\), with the propagation typically modeled by Fresnel or angular-spectrum operators [2508.09256][2404.18946].

## 1. Physical basis and measurement models

The defining principle is path-length or propagation diversity. A single complex field is observed after several distinct forward operators, and the resulting intensity evolution along \(z\) encodes information that is absent from a single intensity image. In the standard paraxial formulation used by multi-plane phase retrieval sensors, one writes
\[
U_n(x,y;z_n)=\mathcal{P}_{z_n}\{U_0(x,y)\},\qquad
I_n(x,y)=|U_n(x,y;z_n)|^2,
\]
and seeks a field \(U_0\) whose propagated intensities match all measured planes simultaneously [2508.09256][2404.18946]. In curvature sensing, a linearized relation near the pupil connects defocused intensity differences to the Laplacian of phase, \(\Delta I(x,y)=C\,\nabla^2\phi(x,y)\); nonlinear curvature sensing instead uses the full multi-plane nonlinear diffraction physics and an iterative phase retrieval algorithm [2603.11832].

This formulation generalizes naturally. In multi-frequency phase retrieval, the diversity index is wavelength rather than axial plane, and the forward operator is written \(\mathbf{u}_{s,\lambda}=\mathbf{H}_{s,\lambda}\mathbf{u}_{0,\lambda}\) with noisy intensity observations \(y_{s,\lambda,i}\sim p(y_{s,\lambda,i}\mid |(\mathbf{H}_{s,\lambda}\mathbf{u}_{0,\lambda})_i|^2)\) [1802.02011]. In media-diversity phase retrieval, the same incident field is propagated through different linear or nonlinear media, producing intensities \(I_{m,p}(\bx)=|u_m(z_p,\bx)|^2\); the diversity then arises from the medium parameters \((\kappa_m,\beta_m)\) rather than from plane spacing alone [2410.12767]. In partially coherent multi-channel formulations, multiple coherently linked measurements define block-structured operators \(A_c\) and permit null-space formulations such as \(Qx=0\) or \(Ry=0\), where coherent linking reduces the number of unknown phase variables [2002.02939].

A recurrent theme is that “multi-plane” is not restricted to literal stacks of defocused images. The same inverse structure appears in four-plane curvature sensors, translated-sensor inline holography, prism-split simultaneous multi-plane microscopes, convergent-beam layouts mapped to free-space equivalents, and wavelength-multiplexed diffractive processors [1211.6751][2404.18946][1705.05766][2603.11832][2403.11035].

## 2. Representative architectures

The literature spans several distinct hardware realizations that implement the same underlying diversity principle.

| Architecture | Diversity mechanism | Representative details |
|---|---|---|
| Four-plane nonlinear curvature WFS | Four defocused pupil-adjacent planes | Classical layout at \(\pm z_1,\pm z_2\); laboratory nlCWFS at \(z=\pm1\) cm and \(z=\pm5\) cm [1211.6751][2508.09256] |
| Align-free inline holography | Single sensor translated to multiple heights | Three planes at \(z=30,40,50\) mm in simulation; experimental spacing \(\sim 5\) mm [2404.18946] |
| Simultaneous multi-plane QPI with prism | Beam splitting into several conjugate image planes | Eight planes acquired simultaneously, \(\Delta z_{\text{IP}}=347\pm11\) nm in object space, up to 200 Hz [1705.05766] |
| Convergent-beam nlCWFS | Four contemporaneous planes in a focused beam | Physical planes \(z=[100,140,180,220]\) mm for \(f=300\) mm, mapped to \(z_{\rm eff}=[150,263,450,825]\) mm [2603.11832] |
| Diffractive optical processors | Multiple learned diffractive layers with output-channel encoding | Five-layer amplitude/phase imager over \(150\lambda\); ten-layer wavelength-multiplexed multi-plane QPI processor [2401.16779][2403.11035] |

The classical adaptive-optics lineage is exemplified by the four-plane nonlinear curvature wavefront sensor. In one formulation, the sensor records two planes near the pupil and two farther from it, so that the inner planes retain strong near-pupil sensitivity while the outer planes sample lower Fresnel-number structure and encode low-order variance more strongly [1211.6751][2603.11832]. The 2025 jitter-sensing study uses four measurement planes at \(z=\pm1\) cm and \(z=\pm5\) cm from the pupil and reconstructs with a modified Gerchberg–Saxton algorithm using up to five iterations [2508.09256].

A second lineage is lensless or minimal-optics inline holography. Here a single 2D sensor is translated axially to acquire a stack \(\{I_k(x,y)\}_{k=1}^K\), typically \(K=3\), and computational calibration is required because lateral shifts, small rotations, scaling, and field-of-view loss invalidate naive pixelwise correspondence across planes [2404.18946]. The same paper models inter-plane distortions with a general \(3\times3\) projective transformation and shows that raw-hologram homography is inadequate because diffraction changes the intensity nonlinearly with \(z\) [2404.18946].

A third lineage is simultaneous multi-plane microscopy. In the white-light quantitative phase tomography platform that combines phase imaging with SOFI, a customized prism splits the detection beam into eight conjugate planes recorded on two synchronized sCMOS cameras, yielding an effective inter-plane spacing of \(347\pm11\) nm in object space and enabling 3D phase imaging at up to 200 Hz [1705.05766]. A different single-shot strategy replaces multiple measured planes with multiple internal diffractive layers: the output plane then contains dedicated amplitude and phase channels, or wavelength-multiplexed channels corresponding to different axial object planes [2401.16779][2403.11035].

## 3. Reconstruction algorithms and inverse formulations

The dominant reconstruction family is multi-plane Gerchberg–Saxton. In its standard form, one propagates a current estimate between planes, replaces the amplitude in each measurement plane with the measured \(\sqrt{I_n}\), back-propagates, and iterates. One explicit update is
\[
U_n^{\text{new}}(x,y)=\sqrt{I_n(x,y)}\,\exp\big(i\arg(U_n(x,y))\big),
\]
after which the constrained fields are propagated back to the pupil and combined [2508.09256][2404.18946]. The four-plane nonlinear curvature literature develops Gerchberg–Saxton variants with feedback terms—Error-Reduction, Input-Output, Output-Output, and In-Out-Out—parameterized through coefficients \(a_i,b_i\) and step-size \(h\), with propagation implemented by two-step Fresnel operators \(A_{i,j}\) [1211.6751].

In lensless multi-height imaging, alignment becomes part of the inverse problem. The Adaptive Cascade Calibrated strategy performs autofocusing of each measured hologram by minimizing a Laplacian sharpness metric,
\[
\Delta I(m,n)=\sum_m^M\sum_n^N |\nabla^2 I(m,n)|,
\]
then detects SIFT features in the refocused object-space images, estimates homographies between neighboring planes, cascades them to a common reference, warps the measured intensities into a shared coordinate system, and only then applies an energy-conserved multi-plane Gerchberg–Saxton algorithm [2404.18946]. This changes the computational role of calibration: the registration is performed in refocused object space rather than directly on the raw holograms.

More statistical formulations replace hard amplitude replacement with explicit likelihoods. In the multi-frequency framework, Poisson and Gaussian negative log-likelihoods are combined with BM3D priors on both complex field and phase, producing an alternating-projection or ADMM-like scheme with forward propagation, measurement-domain data fitting, backward propagation, and complex/phase denoising [1802.02011]. The paper argues that the same ML+BM3D structure transfers directly to multi-plane sensors by substituting propagation operators \(\mathbf{P}_p\) for the diversity operators \(\mathbf{H}_{s,\lambda}\) [1802.02011].

At the opposite end of the spectrum are explicit, non-iterative reconstructions derived from uniqueness theorems. For phase retrieval via media diversity, the linear Schrödinger and Gross–Pitaevskii cases use multiple \(\kappa_m\) media to recover the phase gradient \(\nabla\varphi\) up to a constant, while the quadratic nonlinear Schrödinger case uses multiple \(\beta_m\) media to reconstruct the full phase without global-phase ambiguity, under full-rank conditions on matrices \(\mathcal{K}(\bx)\) or \(\mathcal{B}(\bx)\) [2410.12767]. These algorithms operate on estimates of \(\partial_z|u|\) and \(\partial_z^2|u|\) at \(z=0\), extracted from near-field multi-plane data [2410.12767].

Diffractive optical processors shift the inversion almost entirely into the optical front-end. In one design, successive learned diffractive layers produce two output intensity channels, one approximating the input amplitude and the other the input quantitative phase, with no iterative per-measurement phase retrieval [2401.16779]. In another, a wavelength-multiplexed ten-layer diffractive network maps several axial input phase planes onto a single output field of view, with one wavelength channel per plane and a final normalization
\[
\Psi_w(x,y)=\frac{D_w(x,y)}{\text{Ref}_w}
\]
that directly approximates the phase map of plane \(P_w\) [2403.11035]. This suggests that multi-plane phase retrieval can be embedded into hardware as a fixed learned operator rather than executed numerically after measurement.

## 4. Calibration, alignment, and auxiliary low-order sensing

Practical multi-plane sensors are limited as much by calibration and registration as by inversion. In translated-sensor holography, lateral shifts dominate, but small rotations, scaling, perspective terms, and field-of-view loss also matter; the estimated transformation matrices for plant-stem data show diagonal terms near 1, off-diagonal rotational terms of order \(10^{-3}\), and translation terms of order \(10\) pixels [2404.18946]. Because diffraction patterns at different \(z\) are not related by a simple homography, direct geometric registration on raw holograms is inadequate [2404.18946].

Nonlinear curvature sensors add another calibration dimension: low-order pointing. Tip and tilt appear as lateral shifts of the recorded intensity patterns, and each measurement plane encodes this shift with a lever arm proportional to \(z\). The weighted-average centroid at plane \(n\) is
\[
x_n=\frac{\sum x_i\,I_n(x_i,y_j)}{\sum I_n(x_i,y_j)},\qquad
y_n=\frac{\sum y_j\,I_n(x_i,y_j)}{\sum I_n(x_i,y_j)},
\]
and pixel shifts are converted to angular shifts through
\[
\theta_N=\arctan\left(\frac{N\,\delta_{\rm pixel}}{z}\right).
\]
Reference centroids are calibrated by a Hough–Canny procedure: Canny edge detection identifies the circular beam boundary, a Circular Hough Transform fits the circle, and the fitted center becomes the reference centroid [2508.09256]. In the reported laboratory geometry, the outer planes correspond to \(0.055\,\lambda/D\) per pixel while the inner planes correspond to \(0.273\,\lambda/D\) per pixel, so the outer planes are more sensitive to small angular shifts [2508.09256].

This capability challenges a common architectural assumption. The 2025 jitter-sensing work demonstrates that image jitter may be sensed and compensated for using a fast steering mirror and the wavefront sensor alone, without peripheral quad-cells or access to a separate scientific imaging channel [2508.09256]. In effect, the same multi-plane data stream supports both high-order phase retrieval and low-order tip/tilt control. A related misconception is that low-order estimation is independent of high-order reconstruction; the reported reconstructions show instead that small tip/tilt errors can cascade into large uncertainties in higher-order phase retrieval, producing branch cuts and irregularities until the low-order shift is corrected [2508.09256].

## 5. Performance across operating regimes

Reported performance varies strongly with optical regime, photon budget, and algorithmic assumptions. In the align-free multi-plane holography study, the Adaptive Cascade Calibrated pipeline improves reconstruction quality substantially in simulation: for crystal data, PSNR/SSIM increase from \(13.14\) dB / \(0.30\) without calibration to \(20.25\) dB / \(0.81\) with ACC; for onion data, from \(18.47\) dB / \(0.43\) to \(28.62\) dB / \(0.82\) [2404.18946]. Under pure translation errors, naive reconstructions degrade as plane shifts grow to \(11\) and \(22\) pixels, whereas ACC remains at roughly \(20.0\)–\(20.4\) dB PSNR and \(0.81\)–\(0.82\) SSIM across all tested shifts [2404.18946].

In nonlinear curvature sensing, performance is often controlled by photon starvation and by the coupling between tip/tilt and higher-order modes. The four-plane low-light analysis shows that preprocessing by Gaussian convolution can reduce by an order of magnitude the photon flux required for accurate phase retrieval of low-order errors, and identifies differentially blurred Gaussian convolution as especially effective when its blur scales match the speckle size in the inner and outer planes [1211.6751]. The same study compares ER, IO, OO, and IOO feedback schemes and finds that no single step-size is uniformly optimal across photon levels [1211.6751]. In the 2025 jitter experiments, weighted-average centroiding on the outer planes recovers injected tip and tilt to within \(\pm0.1\,\lambda/D\) on average for an unaberrated beam; inner-plane estimates are worse at \(\pm0.57\,\lambda/D\), and accuracies better than \(\sim0.5\,\lambda/D\) remain achievable in the presence of aberrations [2508.09256]. The same paper reports that diffraction-limited reconstruction required tip/tilt accuracy of approximately \(\pm0.5\,\lambda/D\) for one aberration and approximately \(\pm0.2\,\lambda/D\) for two others [2508.09256].

The convergent-beam four-plane nlCWFS study reports a simulated RMS wavefront error of approximately \(0.03\) waves (\(0.17\) radians) after rescaling the measured convergent-beam intensities into free-space-equivalent planes and running a standard multi-plane Gerchberg–Saxton reconstruction [2603.11832]. In the laboratory, the same method recovers a nearly \(2\)-wave peak-to-valley horizontal coma imposed by a \(12\times12\) deformable mirror, using a compact module that fits inside a standard 2-inch Thorlabs mount [2603.11832].

In white-light multi-plane quantitative phase tomography, the eight-plane prism system reaches lateral and axial phase-imaging resolutions of \(380\) nm and \(560\) nm, respectively, and records live-cell 3D phase data at up to 200 Hz [1705.05766]. For a nanometric staircase sample, the retrieved phase varies linearly with AFM-measured height according to
\[
\varphi[\mathrm{rad}] = 0.0005~\mathrm{nm}^{-1}\cdot \mathrm{AFM}[\mathrm{nm}],
\]
supporting the quantitative character of the reconstruction [1705.05766].

Learned diffractive processors currently occupy a different performance niche. The all-optical amplitude/phase imager reports test-set PSNRs of \(16.47\pm0.96\) dB for amplitude and \(14.90\pm1.60\) dB for phase in one spatially multiplexed design, rising to \(17.04\pm1.06\) dB and \(15.06\pm1.63\) dB in a combined spatial-and-wavelength-multiplexed design [2401.16779]. The wavelength-multiplexed multi-plane QPI processor reports average PCC of approximately \(0.993\pm0.001\) for five non-overlapping planes at matched phase contrast, decreasing when planes overlap laterally or when test phase contrast departs from the training regime [2403.11035].

## 6. Limitations, misconceptions, and future directions

Several limitations recur across the literature. First, identifiability often depends on assumptions that are stronger than the phrase “phase retrieval” suggests. The media-diversity uniqueness results assume known, non-vanishing amplitude \(a(\bx)\), exactly known \(\kappa_m\) and \(\beta_m\), and local-in-\(z\) access to intensity derivatives near the incidence plane [2410.12767]. The white-light tomography method assumes weak scattering and the first Born approximation; it also suppresses low spatial frequencies by applying an axial high-pass filter \(K(g_z)\), and with only eight planes rather than the approximately eighteen suggested by the sampling analysis, additional high-pass behavior appears laterally [1705.05766]. The diffractive-processor paradigm replaces iterative inversion with a fixed learned optical transform, but its performance depends on the training distribution, the designed wavelengths, and fabrication/alignment tolerances [2401.16779][2403.11035].

Second, compactness does not eliminate sampling constraints. The convergent-beam mapping
\[
z_{\rm eff}=\frac{zf}{f-z},\qquad S=\frac{f}{f-z}
\]
shows that a short physical distance \(z\) can emulate a long free-space propagation \(z_{\rm eff}\), but the effective Fresnel number and the sampling condition still depend on \(z_{\rm eff}\), and operation too close to focus drives \(S\to\infty\) and \(z_{\rm eff}\to\infty\) [2603.11832]. The same paper notes that interpolation during intensity rescaling can distort noise statistics, particularly in photon-limited regimes [2603.11832].

Third, alignment-free does not mean calibration-free. The ACC method removes the need for calibration targets or markers, but it still depends on successful autofocus, feature extraction, and robust homography estimation in refocused object space; feature-poor or strongly scattering samples can defeat this stage [2404.18946]. Similarly, nonlinear curvature jitter sensing eliminates dedicated tip/tilt hardware, but it depends on robust centroid calibration, known \(z\)-distances, and adequate outer-plane sampling [2508.09256].

Several misconceptions are addressed directly by the published results. One is that multi-plane phase retrieval sensors measure only high-order phase and therefore require a separate low-order channel; the nonlinear curvature literature shows that tip/tilt is embedded in the multi-plane intensities themselves and can be estimated with the wavefront sensor alone [2508.09256]. Another is that “multi-plane” necessarily denotes literal stacks of defocused sensor images; the diffractive-processor and media-diversity results show instead that multi-plane phase retrieval is better understood as a diversity principle that can be realized through wavelength, medium, or learned optical transformations [2410.12767][2403.11035][2401.16779]. A plausible implication is that future systems will increasingly decouple the source of diversity from the numerical inversion method, combining compact optical front-ends with calibration-aware or learned reconstructors rather than treating defocus stacks as the only viable architecture.

The field’s current trajectory therefore combines three directions. One is improved physical modeling and calibration for compact sensors, including convergent-beam layouts and simultaneous low-order/high-order control [2603.11832][2508.09256]. A second is statistically grounded inversion, including likelihood-based phase retrieval with object-domain priors and coherent multi-channel null-space formulations [1802.02011][2002.02939]. The third is optical compilation of the inverse problem into diffractive hardware, reducing or eliminating per-frame digital optimization for specific imaging tasks [2401.16779][2403.11035]. Taken together, these developments indicate that multi-plane phase retrieval sensors now constitute a broad technical class rather than a single instrument design: a family of intensity-only sensors that trade optical diversity, calibration structure, and computational strategy against one another in order to recover complex fields under increasingly constrained photon, size, and latency budgets.

Source: https://www.emergentmind.com/topics/multi-plane-phase-retrieval-sensors