---
title: Compressed Ultrafast Photography (CUP)
url: https://www.emergentmind.com/topics/compressed-ultrafast-photography-cup
type: topic
---

# Compressed Ultrafast Photography (CUP)

Searching arXiv for recent and foundational papers on Compressed Ultrafast Photography and close variants.
Search query: "Compressed Ultrafast Photography CUP streak camera compressed sensing arXiv"
Compressed Ultrafast Photography (CUP) is a single-shot computational imaging method that captures an ultrafast transient event by compressing a 3D spatiotemporal scene \(I(x,y,t)\) into a single 2D measurement using coded aperture and streak imaging, then reconstructing the movie computationally [2309.02835]. Within the broader family of compressed streak imaging (CSI), CUP is the best-known implementation of a framework that combines spatial coding with temporal shearing so that non-repeatable or difficult-to-repeat transients can be recorded in one exposure [2412.16427]. Its subsequent development has produced hyperspectral extensions, auxiliary-constraint architectures, and alternative optical encodings, while also clarifying the boundary between CUP proper and CUP-like single-shot ultrafast imaging systems that pursue the same objective through different mechanisms [2505.21086].

## 1. Definition and lineage

CUP belongs to CSI, a class of systems in which a dynamic scene is spatially encoded by a coded aperture and then temporally sheared before being integrated on a 2D detector. In this lineage, CUP is the canonical streak-camera-based implementation. The general CSI formulation described in later work preserves this basic structure while modifying the way temporal and spatial diversity are introduced, or the way compression is distributed across the sensor [2412.16427].

The principal motivation for CUP is the acquisition of nonrepeating ultrafast events. In regimes where conventional framing would require either event repetition or a prohibitive trade-off between frame rate and pixel count, CUP instead forms a compressed measurement whose inversion yields a time-resolved movie. This places CUP in the same broad methodological family as other ultrafast computational imaging systems, but its defining characteristic is the coupling of coded spatial modulation with streak-camera temporal shearing rather than ordinary high-speed readout or purely passive optical delay multiplexing [2105.06555].

A persistent conceptual point is that CUP is not merely “very fast video.” Its identity is tied to a specific inverse problem: a 3D scene is not directly sampled frame by frame, but mapped into a compressed 2D observation that must be reconstructed computationally. That distinction becomes important when CUP is compared with related systems such as rolling-shutter compressive video, lensless ultrafast sensing, or passive time-to-space mapping architectures, which may be single-shot and ultrafast yet differ fundamentally in encoding physics and reconstruction philosophy [1905.13221].

## 2. Forward model and inverse reconstruction

A standard CUP forward model is written as
\[
E(m,n)=TSCI(x,y,t),
\]
where \(C\) is the spatial-encoding operator, \(S\) is the temporal-shearing operator, and \(T\) is the spatiotemporal-integration operator [2105.06555]. The measurement \(E(m,n)\) is therefore a 2D detector image containing multiplexed information from the full spatiotemporal scene. The inverse problem is commonly posed in a compressed-sensing form, for example
\[
\arg \min \left\{ \|E - TSCI\| + \lambda TV(I) \right\},
\]
with \(TV(I)\) imposing a total-variation prior [2105.06555].

The same structure generalizes naturally to higher-dimensional variants. In hyperspectrally compressed ultrafast photography (HCUP), the target becomes a 4D data cube \(I(x,y,t,\lambda)\), and acquisition is expressed as
\[
E(x',y') = M T S C I(x,y,t,\lambda),
\]
where \(C\) is the spatial encoding operator, \(S\) the spectral shearing operator, \(T\) the temporal shearing operator, and \(M\) the spatial-temporal-spectral integration operator [2309.02835]. This formulation makes explicit that CUP-style reconstruction is fundamentally an ill-conditioned inversion problem whose success depends on both measurement design and prior modeling.

Reconstruction algorithms have therefore become a central part of CUP research. HCUP work identifies TwIST and AL as widely used iterative solvers based on TV regularization, while later methods introduce plug-and-play ADMM formulations in which denoisers act as implicit priors [2309.02835]. In the TV-CD framework, the denoising cascade
\[
[\text{TV}, \text{FFDNet}, \text{DRUNet}, \text{FastDVDNet}, \text{TV}]
\]
is embedded into PnP-ADMM so that local smoothness, learned image priors, and temporal neighborhood information are combined within the iterative reconstruction [2309.02835]. Other CUP-adjacent systems retain the compressive inversion but alter the forward operator, as in diffuser-based rolling-shutter video recovery or time-of-flight-based lensless ultrafast sensing [2004.09614].

## 3. Architectural variants and encoding strategies

Subsequent work has diversified CUP chiefly by changing how time is encoded before reconstruction, how many dimensions are multiplexed, and how much burden is placed on the streak camera. The result is a family of systems that share a compressed single-shot objective but differ in whether the dominant encoding is temporal, spectral, object-motion-based, or entirely passive [2309.02835].

| Variant | Encoding strategy | Distinguishing feature |
|---|---|---|
| CUP | Coded aperture + streak-camera temporal shearing | Standard single-shot reconstruction of \(I(x,y,t)\) |
| HCUP | Pseudo-random spatial mask + spectral dispersion + temporal shearing | Single-exposure recovery of \(I(x,y,t,\lambda)\) |
| TACSI | Standard CSI streak shear + second scanning axis translating the object relative to the coded aperture | Lower streak compression ratio and reduced coded-aperture motion blur |
| AOD-CUP | FACED-generated discrete illumination + spatial encoding + spectral shearing by diffraction grating | Eliminates the streak camera and enables adjustable frame number and inter-frame interval |
| Passive time-to-space mapping | Microlens-array image replication + cover-glass path delays + CMOS detection | Computation-free direct ordering of delayed replicas rather than compressed-sensing inversion |

HCUP adds an extra spectral dimension to CUP. The scene is first spatially encoded by a pseudo-random binary mask, then different spectral components are dispersed horizontally by a prism or grating, different time frames are sheared vertically by a streak camera or electro-optical deflector, and the resulting mixed information is integrated into a single 2D detector image [2309.02835]. This preserves the CUP logic while increasing dimensionality and compression burden.

Two-axis compressed streak imaging (TACSI) modifies CSI rather than replacing it. A second scanning axis shuttles a conjugate image of the object with respect to the coded aperture during exposure, so that the object moves laterally across the coded mask while the usual temporal shear proceeds vertically. The stated consequence is a lower streak compression ratio and a flash-and-shutter phenomenon that reduces coded-aperture motion blur, especially for stationary or weakly varying fluorescent objects [2412.16427].

All-optical discrete illumination compressed ultrafast photography (AOD-CUP) responds directly to two identified CUP bottlenecks: dependence on a streak camera and the image-quality loss caused by excessive compression. It replaces the streak-camera time-shearing stage with a FACED-based discrete illumination scheme that converts a femtosecond pulse into a train of sub-pulses, after which temporal information is mapped into the spectral domain and read out by dispersive gratings. The acquisition chain is written as
\[
E(x',y') = T S C D I(x,y,t),
\]
with \(D\) denoting the discrete illumination operator [2505.21086].

A useful boundary case is the fully passive architecture built from a commercial \(6\times 6\) microlens array, a stack of microscope cover glasses, relay optics, and a consumer-grade CMOS sensor. Here each microlens creates a replicated sub-image, selected channels experience different optical path delays, and the time sequence is recovered by channel segmentation and delay ordering rather than by iterative inversion. The paper explicitly contrasts this with CUP: no sparsity prior, no compressed sensing, no streak camera, and no computational reconstruction [2604.27898].

## 4. Performance envelope, fidelity limits, and mitigation strategies

CUP and its extensions are characterized by extreme temporal compression. HCUP is described as possessing “an incredibly high frame rate of tens of trillions of frames per second and a sequence depth of several hundred,” which is precisely why reconstruction becomes difficult when fine spatial and spectral detail must be recovered from a single 2D observation [2309.02835]. The same tension is visible across the literature: higher sequence depth and stronger multiplexing increase temporal reach but amplify ill-posedness.

Several bottlenecks recur. HCUP work attributes poor reconstruction quality to the ultra-high data compression ratio induced by extremely large sequence depth and to the limited fidelities of traditional reconstruction algorithms; TV-based solvers are said to suffer from staircasing artifacts, texture loss, and poor recovery of weak or low-SNR components under extremely high compression ratio [2309.02835]. AOD-CUP identifies an additional hardware limitation specific to conventional streak-camera CUP: charge-coupling artifacts in the streak tube distort the sheared image and compromise spatial fidelity [2505.21086]. In X-ray CUP for laser-fusion diagnostics, spatial resolution becomes especially problematic when coded masks must have relatively large pixels because of fabrication constraints [2105.06555].

Mitigation strategies fall into two broad classes: added measurements and altered encoding. In the hohlraum diagnostic study, supplementing CUP with a simplified space-resolving flux detector (SSRFD) improved the baseline \(10\times 10\) mask reconstruction from **PSNR = 30.3833 dB** and **SSIM = 0.8797** for CUP alone to **PSNR = 36.4277 dB** and **SSIM = 0.9329** for the proposed method [2105.06555]. In dense-gas plasma imaging, CUP reconstruction was enhanced by an auxiliary channel consisting of a spatially integrated and temporally sheared unencoded signal projected onto an unused region of the streak camera, which the authors describe as a new technological improvement [2507.04608].

Altered encoding can also lower effective compression before inversion. TACSI reports, in simulation, an improvement from **PSNR 15.9 dB to 18.3 dB**, **SSIM 0.524 to 0.740**, **BUR 3.62% to 15.8%**, and **CR 40.3 to 6.55** when moving from single-axis CSI to two-axis TACSI [2412.16427]. AOD-CUP, by shifting to FACED-based discrete illumination and spectral shearing, reports that a USAF 1951 target could resolve element **7-1** while **7-2** was not clearly resolved, with an estimated spatial resolution of approximately **128 lp/mm** compared with **45.3 lp/mm** for DI-CUP, corresponding to about a **1.82× improvement** [2505.21086].

These results suggest that CUP performance is controlled as much by measurement design as by nominal frame rate. A plausible implication is that practical CUP development increasingly hinges on balancing temporal depth, compression ratio, detector artifacts, and prior modeling rather than pushing any single parameter in isolation.

## 5. Scientific and diagnostic applications

CUP has been used as a direct diagnostic of dense plasma dynamics. In laser breakdown of argon and xenon at pressures up to **40 bar**, CUP recorded 2D images of single-event plasma evolution with a spatial resolution of **250 × 100 pixels** and an equivalent frame rate of **500 billion frames per second** [2507.04608]. The data were collected through red, green, blue, and broad-band filters and used to infer temperature, emissivity, opacity, heat flow, and ionization behavior. The resulting interpretation was that dense plasmas can contract rather than expand, that observed ionization exceeds Saha-equation expectations even with screening corrections, and that during the first few nanoseconds internal plasma processes dominate evolution while heat loss to the surroundings is too weak to explain the observed cooling [2507.04608].

In inertial-confinement-fusion diagnostics, CUP has been proposed as the high-temporal-resolution backbone of a 2D time- and space-resolved X-ray diagnostic method for hohlraum implosion. The simulated scene comprised **80** frames over **2 ns**, corresponding to **25 ps/frame**, and the combined CUP + SSRFD architecture was designed to retain the temporal resolution of streak imaging while adding spatial and flux constraints [2105.06555]. The significance here is not a new CUP principle but an adaptation to X-ray conditions where mask coarseness and reconstruction ambiguity are especially severe.

CUP-style compressed streak imaging has also been pushed toward biological fluorescence microscopy. TACSI demonstrated microsecond-scale imaging of **CHO-K1 cells loaded with FluoVolt voltage-sensitive dye** during microsecond pulsed electric field stimulation at about **~800 V/cm**, **50 μs pulse width**, and **50% duty cycle** [2412.16427]. In the reported comparison, single-axis CSI reconstructions were dominated by artifacts, whereas two-axis TACSI preserved cell boundaries and resolved the expected polarity-dependent fluorescence response across the membrane.

The CUP concept has been extended beyond optical imaging in the usual sense. In the gravity proposal termed T-CUP, CUP serves as the ultrafast event recorder in a passive optical measurement scheme where an orbiting particle periodically blocks laser beams at a detection point, creating a sudden void or drop in the optical signal that is captured by the T-CUP data acquisition unit [2003.02924]. The proposal claims **10 trillion frames per second** and a sensitivity of **\(10^{-15}\,\text{s}\)**, using temporal imaging based on the duality between paraxial diffraction and narrow-band dispersion with quadratic phase modulation. This use of CUP turns a short-range gravity problem into a temporal measurement problem rather than a conventional displacement measurement [2003.02924].

AOD-CUP preserves CUP’s single-shot ultrafast function while targeting scenes with complex spatial detail. Demonstrations include spatiotemporally chirped light fields, laser-induced stress-wave propagation in LiF crystals, and femtosecond-laser-induced air plasma channel formation, with reported fitted wave velocities of **9.2 km/s** along \(\langle 100\rangle\), **8.7 km/s** along \(\langle 110\rangle\), **5.1 km/s** for the inner stress wave, and plasma expansion velocity of approximately **31.5 km/s** [2505.21086].

## 6. Conceptual boundaries, related methods, and common misconceptions

A common misconception is that any single-shot ultrafast imaging system is a CUP system. The passive architecture assembled from an MLA, cover-glass delay stack, relay lens, and CMOS sensor shows why that is not so. It captures the evolution of a picosecond laser pulse with a temporal sampling interval of **1.46 ps**, an effective frame rate of **685 Gfps**, and a sequence depth of **ten frames**, at a total hardware cost below **US\$500**; however, the time sequence is recovered by channel segmentation and delay ordering, not by solving an inverse problem [2604.27898]. The paper explicitly states that the method is much closer to a passive optical delay line array than to CUP.

Rolling-shutter compressive video provides a second boundary case. In one diffuser-based lensless system, sparse recovery reconstructs **140 video frames** at over **4,500 frames per second** from a single rolling-shutter exposure, with the row-dependent shutter function providing temporal sampling and the diffuser providing spatial multiplexing [1905.13221]. A related lens-based system with a diffuser in the pupil plane and a conventional rolling-shutter camera reconstructs **54 frames** at **104,166 fps** from a single frame while maintaining diffraction-limited resolution [2004.09614]. These systems are CUP-like in that they compress a spatiotemporal scene into one exposure and recover it computationally, but their coding is primarily spatial and sensor-timing-based rather than streak-camera-based temporal shearing.

Lensless imaging with compressive ultrafast sensing is likewise CUP-adjacent rather than CUP proper. There the measurement is produced by active pulsed structured illumination and time-resolved detection, with each acquisition yielding a time series in which time is a function of the photon’s origin in the scene. The goal is static planar reflectance recovery with fewer illumination patterns than a conventional single-pixel camera, not snapshot recording of a transient movie [1610.05834]. The relationship to CUP is therefore conceptual and methodological—forward modeling plus compressive inversion—rather than architectural identity.

These comparisons clarify what is specific about CUP. CUP is defined not merely by high speed, nor merely by single-shot acquisition, but by the particular conjunction of coded spatial modulation, streak-camera temporal shearing, and compressed reconstruction. Much of the recent literature can be read as either refining this conjunction—through improved priors, auxiliary constraints, or modified shear geometries—or circumventing one of its liabilities, especially streak-camera artifacts and excessive compression, while retaining the broader aim of single-shot ultrafast imaging [2505.21086].

Source: https://www.emergentmind.com/topics/compressed-ultrafast-photography-cup