Vertical Jitter Compensation (VJC)
- Vertical Jitter Compensation is a cross-domain technique that estimates and corrects vertical motion disturbances in imaging, beam positioning, and sensor data streams.
- Methods vary from applying a global feature-space shift in panoramic robotics to using real-time feedback systems in accelerator physics and multi-plane phase retrieval.
- Empirical evaluations demonstrate modest gains in robotic occupancy prediction and significant improvements in systems requiring precise stabilization, such as beam alignment and phase reconstruction.
In the broad sense used across recent technical literature, Vertical Jitter Compensation (VJC) denotes the estimation and mitigation of the vertical component of motion-induced perturbations in sensing or beam-delivery systems. The term appears explicitly in VoxelHound as a module for quadruped panoramic perception, where it compensates gait-induced vertical feature displacement before 2D-to-BEV lifting (Zhao et al., 13 Mar 2026). Closely related forms of vertical jitter compensation also appear in accelerator physics as vertical orbit stabilization at ATF2 (Resta-Lopez et al., 2011), in event-based spacecraft sensing as vertical-axis jitter estimation using controlled hardware data (Bagchi et al., 19 May 2025), and in multi-plane wavefront sensing when vertical jitter is treated as one axis of general tip/tilt image motion rather than as a specialized vertical-only problem (Abbott et al., 12 Aug 2025). This suggests that VJC is best understood as a cross-domain control and estimation problem rather than a single canonical algorithm.
1. Scope, terminology, and domain-specific usage
The explicit designation “Vertical Jitter Compensation” is used in "Panoramic Multimodal Semantic Occupancy Prediction for Quadruped Robots" (Zhao et al., 13 Mar 2026). In that setting, the perturbation source is quadruped locomotion: “body oscillation along the vertical axis introduces vertical jitter in the captured images,” producing “misalignment in spatial feature representation” and degrading “the stability of the BEV transformation” (Zhao et al., 13 Mar 2026). The compensation target is therefore a vertically shifted panoramic feature map.
In accelerator physics, the terminology is different but the objective is directly vertical. "Pulse-to-pulse Orbit Jitter Propagation in Multi-bunch Operation at the KEK Accelerator Test Facility 2 (ATF2)" studies pulse-to-pulse vertical orbit jitter, its propagation through the extraction line and final focus system, and its reduction using the FONT5 intra-train feedback system (Resta-Lopez et al., 2011). Here, VJC refers to suppression of the vertical beam position and angle excursion rather than to image stabilization.
In event-based spacecraft sensing, "Event-based Star Tracking under Spacecraft Jitter: the e-STURT Dataset" does not present a named VJC module, but it explicitly includes vertical sensor-plane motion through Axis2, or the y-axis, and provides hardware ground truth for developing and evaluating high-frequency jitter estimation and compensation methods (Bagchi et al., 19 May 2025). In optical phase retrieval, "Jitter Sensing and Control for Multi-Plane Phase Retrieval" addresses general 2D image jitter, that is tip and tilt, with no vertical-axis-only correction scheme; however, if vertical jitter is interpreted as one axis of image motion, the method is directly relevant in the broader sense (Abbott et al., 12 Aug 2025).
| Context | Vertical quantity of interest | Compensation or estimation mechanism |
|---|---|---|
| Quadruped panoramic occupancy | Vertical jitter in captured images | Global vertical feature shift via grid sampling |
| ATF2 accelerator feedback | Vertical beam position and angle | FONT5 intra-train orbit feedback |
| Event-based star tracking | Axis2 / y-axis sensor-plane motion | Event-stream jitter estimation with hardware ground truth |
| Multi-plane phase retrieval | Vertical component of tip/tilt image motion | Centroiding plus FSM-like correction |
A plausible implication is that the phrase “VJC” is domain-specific in its exact implementation, but consistent in its functional role: it isolates the vertical component of disturbance and attempts to remove or estimate it before downstream degradation accumulates.
2. VJC in panoramic multimodal occupancy prediction
In VoxelHound, VJC is a lightweight feature-space stabilization module inserted between the image encoder and the 2D-to-BEV view transform (Zhao et al., 13 Mar 2026). Its purpose is to compensate the dominant vertical displacement induced by quadruped locomotion, especially pitch and roll coupled to gait and terrain interaction. The paper is explicit that the module is not a full 2D warp estimator: it models only a single global vertical offset and applies a vertical shift to the image feature map (Zhao et al., 13 Mar 2026).
The input is a 2D image feature map
and the output is a vertically compensated feature map
The method first collapses the horizontal dimension:
yielding
This operation summarizes vertical structure while suppressing horizontal redundancy (Zhao et al., 13 Mar 2026).
The pooled feature is then processed by a 1D encoder:
where consists of two Conv1D layers with ReLU activations. A single scalar offset is regressed by
with defined as adaptive average pooling followed by a linear layer. The raw offset is normalized for grid sampling:
An identity grid is then shifted vertically:
0
and the compensated feature map is obtained by bilinear sampling:
1
The final output is passed to the downstream view transform (Zhao et al., 13 Mar 2026).
The paper does not derive VJC from an explicit spherical camera reprojection model. Instead, it performs a learned feature-space vertical alignment in the normalized image domain before BEV lifting. Because the input camera is a panoramic annular lens camera and the broader pipeline uses a panoramic ERP-like representation, the operative assumption is that small vertical perturbations can be approximated by a global vertical shift in feature space (Zhao et al., 13 Mar 2026). This suggests that VJC is intentionally restricted to the dominant locomotion-induced distortion rather than to general pose recovery.
3. Optimization, ablations, and empirical behavior in VoxelHound
VJC is trained end-to-end as part of the full occupancy network and does not have a separate dedicated loss (Zhao et al., 13 Mar 2026). The training objective is the overall occupancy loss
2
with cross-entropy loss, Lovasz-Softmax loss, and affinity losses from prior work. The full model is trained on 4 NVIDIA RTX 3090 GPUs, using AdamW, with initial learning rate 3, weight decay 4, for 48 epochs, and with ResNet-18 image backbones (Zhao et al., 13 Mar 2026).
The ablation results isolate the contribution of VJC. The baseline without VJC and without MIPF reaches 22.74 mIoU. Adding VJC only increases performance to 22.92 mIoU, while MIPF only gives 23.14 mIoU, and the full model with both VJC and MIPF reaches 23.34 mIoU (Zhao et al., 13 Mar 2026). The paper therefore attributes a gain of 5 mIoU to VJC alone. It also reports that VoxelHound achieves state-of-the-art performance on PanoMMOcc with a gain of 6 in mIoU (Zhao et al., 13 Mar 2026).
A hidden channel dimension study indicates that VJC remains lightweight across tested capacities. For 7, the reported parameter counts vary from 43.46 M to 43.50 M and memory from 386.83 MB to 386.97 MB, while the best mIoU, 23.34, occurs at 8 (Zhao et al., 13 Mar 2026). The paper interprets this as evidence that the module has minimal impact on parameters and memory.
The limitations follow directly from the design. VJC corrects only a global vertical shift, not local deformation, full affine warping, roll-specific skew, or complex motion blur (Zhao et al., 13 Mar 2026). It assumes that the dominant gait-induced perturbation can be approximated as vertical displacement in feature space and is therefore most suitable for small-to-moderate vertical jitter rather than severe viewpoint changes. The paper also notes that extremely dark nighttime scenes and sparse LiDAR at long range can still produce boundary sparsity in occupancy prediction, indicating that compensating image jitter alone does not resolve all failure modes (Zhao et al., 13 Mar 2026).
4. Multi-plane phase retrieval as a broader VJC analogue
"Jitter Sensing and Control for Multi-Plane Phase Retrieval" is directly relevant to VJC only in the broader sense that it demonstrates tip/tilt, that is 2D image jitter, sensing and correction using a nonlinear curvature wavefront sensor (nlCWFS) and a fast steering mirror (FSM) (Abbott et al., 12 Aug 2025). The paper is explicit that it does not describe a specialized vertical jitter sensor or a vertical-axis-only correction scheme. If vertical jitter is treated as the vertical component of image motion, however, the method supports that use case as part of general tip/tilt compensation (Abbott et al., 12 Aug 2025).
The nlCWFS uses four intensity measurement planes placed at known axial offsets from the pupil: near or inner planes at 9 cm and far or outer planes at 0 cm (Abbott et al., 12 Aug 2025). The central observation is that multi-plane phase retrieval sensors “contain tip/tilt information embedded in their signals,” so lateral centroid displacement at known 1 can be used to infer angular jitter (Abbott et al., 12 Aug 2025). The paper emphasizes that the outer planes provide a larger geometric lever arm and are therefore more reliable for tip/tilt estimation. The pixel-scale equivalence is given as 2 per pixel for the inner planes and 3 per pixel for the outer planes (Abbott et al., 12 Aug 2025).
Centroiding uses the intensity weighted-average method:
4
for measurement plane 5 (Abbott et al., 12 Aug 2025). Reference centroids for an unaberrated beam are determined by a Canny edge detector, followed by a Circular Hough Transform that fits a circle to the beam boundary, with the fitted circle center taken as the reference centroid (Abbott et al., 12 Aug 2025).
The laboratory setup includes a HeNe laser at 6 nm, single-mode fiber injection, a 1 mm pinhole, a fast steering mirror, an optional aberrator plate, a deformable mirror, and an Allied Vision camera with plate scale 7; a 2:1 beam reducer shrinks the beam diameter to 0.5 mm (Abbott et al., 12 Aug 2025). Injected test cases are 8, 9, and 0, together with corresponding opposite-signed tilt values 1, 2, and 3 (Abbott et al., 12 Aug 2025). For an unaberrated beam, averaging the outer-plane estimates allows the weighted-average method to estimate tip and tilt to within about 4 on average across the three cases, whereas the inner planes show spread around 5 (Abbott et al., 12 Aug 2025).
The reported correction is not implemented as a direct real-time optical feedback loop in the experiment. Instead, the authors emulate closed-loop operation in the image domain: they estimate tip/tilt from the outer planes, convert the angular offset to a pixel shift using the known 6 geometry and plate scale, apply the corrective pixel shift to each image, and then perform phase reconstruction using a modified Gerchberg–Saxton algorithm with up to five iterations (Abbott et al., 12 Aug 2025). The paper states that uncorrected tip/tilt can blur reconstructions, create branch cuts, increase RMS wavefront reconstruction error, and reduce the accuracy of higher-order phase retrieval, whereas correction produces flatter and smoother wrapped phase (Abbott et al., 12 Aug 2025). In the broader VJC sense, this is a clear example of vertical-axis compensation implemented within a general 2D tip/tilt framework.
5. Vertical orbit jitter compensation in accelerator physics
In ATF2, vertical jitter compensation is formulated as stabilization of the vertical beam position and angle before the beam reaches the virtual Interaction Point (IP) (Resta-Lopez et al., 2011). The facility is designed to demonstrate beam sizes around 40 nm at the IP, while also pursuing a second goal: stabilizing the vertical beam position at the virtual IP to about 5% of the nominal rms vertical beam size. The paper states that this requires controlling the orbit to better than 1 7m at the entrance of the ATF2 final focus system (FFS) (Resta-Lopez et al., 2011).
The compensation hardware is the FONT5 feedback system in the extraction line. It uses two stripline kickers, 8 and 9, separated by a phase advance of 0 so that both vertical position 1 and angle 2 can be corrected, together with three stripline BPMs, 3, 4, and 5, and an FPGA-based digital processor that performs coupled 6 and 7 correction (Resta-Lopez et al., 2011). The system is tested in 3-bunch train mode with 154 ns bunch spacing at 1.3 GeV. The first bunch is measured and the correction is applied to later bunches, so the target disturbance is correlated pulse-to-pulse jitter (Resta-Lopez et al., 2011).
The vertical-plane phase-space vector is
8
and the pulse ensemble is represented by the covariance matrix
9
with zero mean assumed. The rms jitters are
0
and linear transport between positions satisfies
1
with
2
The paper also reconstructs phase-space covariance from the rms position measurements at three BPMs and then performs tracking simulations with MAD to include the nonlinear effects of the FFS sextupoles (Resta-Lopez et al., 2011).
For the 16 April 2010 dataset with 1000 pulses, the measured rms vertical position jitter at 3 drops from 2.3 4m to 0.4 5m for bunch 2 and from 2.5 6m to 1.1 7m for bunch 3 when feedback is enabled (Resta-Lopez et al., 2011). The corresponding angle jitter at 8 changes from 1.9 9rad to 0.65 0rad for bunch 2 and to 0.72 1rad for bunch 3. The BPM resolutions are better than 0.4 2m at 3 and about 1 4m at 5, and the feedback-off correlations are 98% between bunches 1 and 2 and 89% between bunches 2 and 3 (Resta-Lopez et al., 2011). These strong correlations are precisely what make intra-train correction effective.
At the entrance to the FFS, the predicted jitter for bunch 2 changes from 6m and 7rad to 3.3 8m and 0.3 9rad with feedback, while bunch 3 changes from 5.9 0m and 0.9 1rad to 3.7 2m and 0.5 3rad (Resta-Lopez et al., 2011). At the IP, the predicted vertical position jitter is reduced from 17.3 nm to 8.0 nm for bunch 2 and from 16.0 nm to 7.5 nm for bunch 3, while the corresponding vertical angle jitter changes from 155.6 4rad to 100.0 5rad and from 173.7 6rad to 110.5 7rad (Resta-Lopez et al., 2011). In this literature, VJC is therefore a feedback and transport problem defined on beam centroid phase space rather than on image features.
6. Event-based spacecraft sensing and vertical-axis jitter benchmarks
The e-STURT dataset addresses spacecraft jitter as a sensing problem: jitter degrades fine-pointing required for optical communication, earth observation, and space domain awareness, and event cameras are attractive because they provide asynchronous, high temporal resolution observations (Bagchi et al., 19 May 2025). For VJC, the essential design choice is that jitter is simulated along both sensor axes, including Axis2, the vertical sensor-plane or y-axis motion, under controlled frequency bands (Bagchi et al., 19 May 2025).
The hardware consists of a Prophesee Gen4 HD event camera with resolution 8, temporal resolution 9, pixel size 0, maximum bandwidth 1066 Meps over USB3, and a field of view of 1 with 100 mm optics. The camera is mounted on a Physik Instrumente U-723 PILine XY Stage with motion range 2, bidirectional repeatability 3, and minimum incremental motion 4; the optics use a 100 mm / F2.8 lens (Bagchi et al., 19 May 2025). Calibration with a checkerboard under uniform motion yields
5
and the dataset defines the jitter amplitude as
6
corresponding to about 20.58 pixels (Bagchi et al., 19 May 2025).
The dataset includes single-axis x motion, single-axis y motion, and simultaneous x-y motion in three frequency bands: slow, 7; medium, 8; and fast, 9 (Bagchi et al., 19 May 2025). It comprises 20 experimental episodes and about 200 sequences total, with 10 sequences per episode: one static reference, three Axis1 sequences, three Axis2 sequences, and three BothAxes sequences (Bagchi et al., 19 May 2025). Each sequence lasts 190 s, including 10 s for initialization, homing, and stabilization and 180 s of acquisition, and each contains a raw event stream .dat, piezo telemetry .csv, and hardware synchronization log .log (Bagchi et al., 19 May 2025). Episode 2 has incomplete data because of actuator stiction and malfunction, and Episode 20 lacks the synchronization spike protocol used in later episodes (Bagchi et al., 19 May 2025).
The baseline estimator operates directly on the event stream
0
where 1 is the polarity (Bagchi et al., 19 May 2025). Events are partitioned into non-overlapping temporal batches
2
with
3
then accumulated in a circular queue
4
DBSCAN identifies star-event clusters 5, after which linear trends are fit:
6
Evaluating at the current batch time
7
gives a centroid estimate
8
A support set
9
is formed near the centroid, and the inter-batch displacement is estimated by
00
so that 01 directly represents vertical sensor-plane jitter (Bagchi et al., 19 May 2025).
Ground truth is obtained from the piezoelectric actuator at 30 Hz, with
02
and synchronization uses a 0.4 mm spike after initial 0.1 mm motions (Bagchi et al., 19 May 2025). The reported trend is that slow motion yields the best recovery, while medium and fast motion reduce fidelity because star events become sparser and noise separation becomes harder. Axis2-only and BothAxes sequences nonetheless demonstrate that vertical motion and mixed-axis jitter can be estimated from event data (Bagchi et al., 19 May 2025). This makes e-STURT a benchmark for VJC-oriented estimation algorithms rather than a closed-loop compensator in its own right.
7. Cross-domain interpretation, misconceptions, and limits
A frequent source of ambiguity is the assumption that VJC denotes a single standardized algorithm. The available literature supports a narrower statement: the explicit module name appears in VoxelHound, while other domains implement related functionality under field-specific names such as vertical orbit feedback, event-based jitter estimation, or tip/tilt sensing and control (Zhao et al., 13 Mar 2026, Resta-Lopez et al., 2011, Bagchi et al., 19 May 2025, Abbott et al., 12 Aug 2025). This suggests that VJC is better treated as a problem class organized around vertical disturbance suppression.
A second ambiguity concerns dimensionality. In VoxelHound, the compensation variable is a single global vertical displacement in feature space (Zhao et al., 13 Mar 2026). In ATF2, the vertical plane is intrinsically two-dimensional in phase space, with both 03 and 04 corrected by coupled feedback (Resta-Lopez et al., 2011). In multi-plane phase retrieval, compensation is fundamentally 2D tip/tilt, and any “vertical jitter” interpretation refers only to one orthogonal component of that motion (Abbott et al., 12 Aug 2025). In e-STURT, vertical jitter is one explicit axis of hardware actuation, but the baseline estimator is formulated for general 05 displacement (Bagchi et al., 19 May 2025). A plausible implication is that “vertical” often identifies the dominant or operationally critical axis rather than a complete motion model.
A third misconception is to equate vertical jitter compensation with generic stabilization. The cited systems show more specific objectives. In panoramic occupancy prediction, VJC exists to stabilize image-to-BEV correspondence before multimodal fusion (Zhao et al., 13 Mar 2026). In accelerator physics, the objective is to preserve nanometre-scale beam overlap and therefore luminosity at the IP (Resta-Lopez et al., 2011). In phase retrieval, jitter correction is integrated with wavefront reconstruction because low-order pointing errors can cascade into branch cuts and larger RMS reconstruction error (Abbott et al., 12 Aug 2025). In spacecraft event sensing, the current contribution is chiefly a dataset and a baseline estimator that enable future compensation algorithms (Bagchi et al., 19 May 2025).
Across these settings, the recurring pattern is consistent: vertical jitter is estimated from an internal signal representation, whether pooled image features, BPM measurements, event streams, or multi-plane optical centroids; the estimate is mapped into a correction variable; and compensation is judged by its effect on a downstream scientific or control objective. This suggests that the core significance of VJC lies less in any one architecture than in its role as an intermediate stabilization layer that prevents vertical perturbations from degrading subsequent inference, reconstruction, or beam transport.