Papers
Topics
Authors
Recent
Search
2000 character limit reached

StereoAdapter: Adaptation in Stereo Vision

Updated 12 July 2026
  • StereoAdapter is a research label that unifies techniques for adapting stereo systems using optical, algorithmic, and PEFT-based methods.
  • These approaches range from smartphone catadioptric rigs and online/federated learning adaptations to geometry-aware cross-view fusion in super-resolution.
  • The diverse strategies enable robust stereo matching, depth estimation, and 3D reconstruction in dynamic, domain-shifted, and underwater environments.

Searching arXiv for papers related to "StereoAdapter" and closely named variants to ground the article in current literature. StereoAdapter is a name that has been used for multiple, technically distinct research artifacts in stereo vision and related imaging systems. In the literature, it denotes at least four major lines of work: a planar-mirror smartphone catadioptric stereo rig for 3D reconstruction (Bartol et al., 2021); a meta-learning and online-adaptation framework for deep stereo, later extended to federated adaptation and geometry-aware domain adaptation (Tonioni et al., 2019, Poggi et al., 2024, Sakuma et al., 2021); a parameter-efficient stereo image super-resolution method based on adapter modules inserted into a frozen single-image transformer (Zhou et al., 2024); and an underwater stereo depth estimation framework that combines LoRA-adapted monocular foundation encoders with recurrent stereo refinement, followed by a second generation using a selective state-space updater (Wu et al., 19 Sep 2025, Ren et al., 18 Feb 2026). The shared label therefore refers not to a single canonical architecture, but to a family of adapter-oriented or adaptation-oriented approaches that address stereo acquisition, stereo matching, stereo super-resolution, and underwater stereo depth estimation.

1. Terminological scope and disambiguation

The term “StereoAdapter” first appears, in the supplied corpus, in “Learning to Adapt for Stereo,” where it refers to a framework that enables deep stereo methods to continuously adapt to new target domains in an unsupervised manner (Tonioni et al., 2019). In that work, the emphasis is on online parameter adaptation of a stereo network through a learned unsupervised objective weighting mechanism.

A different use appears in “Catadioptric Stereo on a Smartphone,” where StereoAdapter is a compact, low-cost catadioptric rig that converts the front- and back-facing cameras of an off-the-shelf smartphone into a calibrated stereo pair (Bartol et al., 2021). Here the term denotes a physical optical-mechanical device rather than a learning algorithm.

The name is later used again in distinct algorithmic contexts. In “ASTeISR,” “stereo adapters” are small cross-view fusion modules and “spatial adapters” are local refinement modules inserted into a frozen single-image super-resolution transformer for stereo image super-resolution (Zhou et al., 2024). In “StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes,” the term refers to a self-supervised underwater stereo depth estimation system with LoRA-adapted monocular priors and a recurrent stereo refinement module (Wu et al., 19 Sep 2025). “StereoAdapter-2” then replaces the ConvGRU updater with a ConvSS2D operator based on selective state-space models and augments the training data with UW-StereoDepth-80K (Ren et al., 18 Feb 2026).

This multiplicity of meanings suggests that “StereoAdapter” functions as a recurrent research label for stereo-specific adaptation mechanisms. A plausible implication is that any technical discussion must distinguish between physical stereo conversion, online domain adaptation, parameter-efficient transfer, and underwater stereo estimation, because their assumptions, objectives, and evaluation protocols differ substantially.

2. Smartphone catadioptric StereoAdapter

In “Catadioptric Stereo on a Smartphone,” StereoAdapter is implemented as a 3D-printed mount (“mask”) and two planar mirrors, each 3cm×3cm3\,\mathrm{cm}\times 3\,\mathrm{cm}, which steer light from the scene into the front and rear smartphone cameras (Bartol et al., 2021). The two mirrors are held at an identical tilt angle β\beta with respect to the phone’s body, one in front of the rear camera and one in front of the selfie camera. By reflection, each real camera produces an image of a virtual camera whose optical center lies behind the mirror. The effective baseline is b2bmb \simeq 2\cdot b_m, where bmb_m is the distance from the phone’s camera lens to the mirror plane.

The optical design is expressed in terms of mirror side length lml_m, mirror tilt β\beta, camera-to-mirror distance bmb_m, and mirror height hm=lmsinβh_m=l_m\sin\beta. For a single virtual camera, the field of view is

αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).

For β55\beta\approx 55^\circ, β\beta0, and β\beta1, the paper reports β\beta2, which is approximately β\beta3 of the stock single-camera field of view β\beta4 (Bartol et al., 2021).

Because the virtual cameras tilt toward each other, the inner convergence angle is

β\beta5

For a full β\beta6-tall person, the minimal camera-object distance is reported as

β\beta7

with β\beta8 and β\beta9. Only about b2bmb \simeq 2\cdot b_m0 of the original vertical field of view is shared by both virtual cameras (Bartol et al., 2021). Mechanically, the mask is printed in PLA, includes adjustable slots for mirror angle and tuning for different phone models, and uses a screw-driven slider to vary b2bmb \simeq 2\cdot b_m1. The mirrors sit in b2bmb \simeq 2\cdot b_m2-precision grooves.

Calibration uses Zhang’s chessboard method in MATLAB. Each raw mirror image is flipped and rotated so that both virtual images share the same upright convention and optical axis direction. The calibration procedure uses 14 stereo pairs of a b2bmb \simeq 2\cdot b_m3 chessboard with b2bmb \simeq 2\cdot b_m4 squares, with autofocus and auto-exposure locked (Bartol et al., 2021). The virtual stereo transform b2bmb \simeq 2\cdot b_m5 yields an estimated baseline b2bmb \simeq 2\cdot b_m6, matching the design. Reprojection error is minimized with nonlinear Levenberg-Marquardt, and the final mean reprojection error is approximately b2bmb \simeq 2\cdot b_m7 pixels. Distances between reconstructed 3D points on the calibration planes and their true plane positions are on average b2bmb \simeq 2\cdot b_m8–b2bmb \simeq 2\cdot b_m9 along bmb_m0 (Bartol et al., 2021).

The reconstruction pipeline runs each virtual image through OpenPose, producing up to 25 human-joint detections. Since the keypoints are already semantically matched across views, no additional stereo matching is required. Triangulation uses either the linear system

bmb_m1

or the horizontal-stereo depth-from-disparity form

bmb_m2

On a standing subject at approximately bmb_m3, six anthropometric segments were evaluated against manual tape measurements. The reconstructed lengths were bmb_m4 cm, manual lengths were bmb_m5 cm, and the corresponding errors were bmb_m6 cm, with mean absolute error approximately bmb_m7 (Bartol et al., 2021).

The paper attributes the largest deviations to keypoint mis-detections at elbows and knees and to the relatively small baseline of approximately bmb_m8, which causes depth sensitivity issues. Proposed improvements include larger mirrors to increase baseline, asymmetric mirror tilts or variable-focus auxiliary optics to enlarge stereo overlap, more varied chessboard views and sub-pixel corner detection for calibration, and fusion with model-based pose priors or temporal filtering for more stable 3D skeletons (Bartol et al., 2021).

3. StereoAdapter as online and federated adaptation for deep stereo

In “Learning to Adapt for Stereo,” StereoAdapter denotes a “learning-to-adapt” framework for robust stereo matching under environmental variation (Tonioni et al., 2019). The base network is DispNet-Corr1D, written as

bmb_m9

with lml_m0 the network parameters. The central objective is to learn an initialization lml_m1 that is especially amenable to rapid unsupervised online adaptation.

The meta-learning setup uses short stereo sequences lml_m2. For each sequence, lml_m3 consecutive inner-loop steps minimize an unsupervised loss lml_m4, while the outer loop evaluates a supervised loss lml_m5 on the next frame: lml_m6 The outer-loop objective minimizes

lml_m7

The unsupervised loss combines photometric reprojection, edge-aware smoothness, and left-right consistency: lml_m8 The photometric term uses SSIM and lml_m9, smoothness is edge-aware, and left-right consistency uses predictions from both view orderings (Tonioni et al., 2019).

A learned confidence measure is then appended. A small 3-layer fully convolutional network β\beta0 takes the pixel-wise error map β\beta1 derived from β\beta2 and outputs a confidence mask β\beta3, normalized so that β\beta4. The weighted unsupervised loss becomes

β\beta5

At test time, no ground truth is used. The model updates online from each incoming stereo pair by computing β\beta6 and taking a gradient step with respect to the weighted unsupervised objective (Tonioni et al., 2019).

The reported training recipe includes supervised pretraining on FlyingThings3D, meta-training on synthetic sequences such as Carla or Synthia with β\beta7, β\beta8, β\beta9, and online test-time adaptation with momentum bmb_m0 and learning rate bmb_m1 (Tonioni et al., 2019). On synthetic-to-real transfer, the best reported variant, L2A + weighted adaptation, achieves D1-all approximately bmb_m2 and EPE approximately bmb_m3, compared with bmb_m4 and bmb_m5 for supervised learning plus unsupervised online adaptation and bmb_m6 and bmb_m7 for static supervised learning on Carla bmb_m8 KITTI. The paper states that this matches the “ideal” fine-tuned model at bmb_m9 D1-all and hm=lmsinβh_m=l_m\sin\beta0 EPE (Tonioni et al., 2019).

This adaptation-oriented interpretation of StereoAdapter is extended in “Federated Online Adaptation for Deep Stereo,” which introduces a distributed framework based on federated learning (Poggi et al., 2024). There, a pre-trained stereo model with parameters hm=lmsinβh_m=l_m\sin\beta1 is adapted collaboratively across clients observing non-stationary stereo streams hm=lmsinβh_m=l_m\sin\beta2. The active set hm=lmsinβh_m=l_m\sin\beta3 performs local adaptation, while the listening set hm=lmsinβh_m=l_m\sin\beta4 receives aggregated weights without adapting locally. The server uses FedAvg: hm=lmsinβh_m=l_m\sin\beta5

The underlying network is MADNet 2, an encoder-decoder stack of five scales that replaces original radius-hm=lmsinβh_m=l_m\sin\beta6 correlation volumes with all-pairs correlation from RAFT-Stereo, samples a fixed number hm=lmsinβh_m=l_m\sin\beta7 of channels at each scale, and removes the heavy context network to keep runtime low (Poggi et al., 2024). This supports both full adaptation and modular adaptation, the latter updating only one decoder block per step.

The paper reports, on KITTI single-device adaptation, that MADNet 2 without adaptation reaches D1-all hm=lmsinβh_m=l_m\sin\beta8 and EPE hm=lmsinβh_m=l_m\sin\beta9, while FULL (photo) adaptation reaches D1-all αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).0, EPE αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).1, and MAD (photo) reaches D1-all αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).2, EPE αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).3. FULL++ (proxy) and MAD++ (proxy) obtain D1-all αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).4, EPE αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).5, and D1-all αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).6, EPE αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).7, respectively (Poggi et al., 2024). In the federated setting with three active clients and update interval αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).8, FedFULL yields on KITTI D1-all values αvirtual=tan1 ⁣(lmcosβ2bm+lmsinβ)+tan1 ⁣(lmcosβ2bmlmsinβ).\alpha_{\mathrm{virtual}}=\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m + l_m\sin\beta}\Bigr)+\tan^{-1}\!\Bigl(\frac{l_m\cos\beta}{2b_m - l_m\sin\beta}\Bigr).9 across City, Residential, Campusβ55\beta\approx 55^\circ0, and Road, whereas FedMAD gives β55\beta\approx 55^\circ1. Communication is β55\beta\approx 55^\circ2 to server and β55\beta\approx 55^\circ3 to client for FedFULL, versus β55\beta\approx 55^\circ4 and β55\beta\approx 55^\circ5 for FedMAD (Poggi et al., 2024).

These results frame StereoAdapter not simply as a model family, but as a deployment paradigm in which stereo systems are designed for unsupervised adaptation during operation, including collaborative adaptation across devices.

4. Geometry-aware adaptation and cross-view attention

A further development appears in “Geometry-Aware Unsupervised Domain Adaptation for Stereo Matching,” summarized in the provided data as another StereoAdapter line (Sakuma et al., 2021). The problem addressed is that image-to-image translation applied independently to the left and right views of a stereo pair can destroy epipolar geometry, leading to mismatched translated pairs and degraded downstream disparity learning.

The proposed mechanism is Stereoscopic Cross Attention (SCA), inserted into a translation network β55\beta\approx 55^\circ6 based on TSIT. At a given scale, each view has a feature map β55\beta\approx 55^\circ7 and a reprojected 3D point cloud β55\beta\approx 55^\circ8. Query and key projections are computed from the concatenated representation β55\beta\approx 55^\circ9, while the value is β\beta00. Cross-attention is constrained to the horizontal epipolar line over disparity candidates β\beta01: β\beta02

β\beta03

The same construction is applied in the reverse direction (Sakuma et al., 2021).

The overall pipeline has three stages: source-supervised pretraining of a stereo matcher β\beta04, pixel-level adaptation through β\beta05 and a discriminator β\beta06, and target training or fine-tuning of β\beta07 on translated pairs plus optional unsupervised reprojection on target stereo pairs (Sakuma et al., 2021). The losses include adversarial, perceptual, feature matching, stereo-consistency, supervised disparity, and target reprojection terms. The stereo-consistency loss is computed on translated multi-scale features using known source disparities and an occlusion mask.

Quantitatively, on Driving β\beta08 KITTI 2015 with a DispNetC backbone, the paper reports D1-all β\beta09, EPE β\beta10 px without SCA, and D1-all β\beta11, EPE β\beta12 px with SCA (Sakuma et al., 2021). In comparison to other unsupervised methods, the proposed approach reaches D1-all β\beta13, EPE β\beta14 px, compared with StereoGAN at β\beta15, β\beta16 px and L2A+Wad at β\beta17, β\beta18 px. With a GwcNet backbone on SceneFlow β\beta19 KITTI, the proposed method reaches D1-all β\beta20, EPE β\beta21 px (Sakuma et al., 2021).

This line of work is methodologically related to later “adapter” approaches in that it introduces a stereo-specific cross-view mechanism into a pre-existing architecture. The difference is that the inserted mechanism is geometry-preserving attention for domain translation, not parameter-efficient fine-tuning in the modern PEFT sense.

5. Adapter modules for stereo image super-resolution

In “ASTeISR: Adapting Single Image Super-resolution Pre-trained Model for Efficient Stereo Image Super-resolution,” the phrase “stereo adapter” has a more specific PEFT meaning (Zhou et al., 2024). The method starts from a frozen, pre-trained single-image super-resolution transformer, HAT-L, and injects two kinds of lightweight modules: stereo adapters for cross-view fusion and spatial adapters for local feature refinement.

Stereo adapters are placed immediately after each Residual Hybrid Attention Group (RHAG), while spatial adapters are inserted inside each Hybrid Attention Block (HAB), after the hybrid-attention layer and before the feed-forward MLP (Zhou et al., 2024). For a pair of feature tensors β\beta22, the stereo adapter applies LayerNorm, linear projections, and temperature-scaled cross-attention: β\beta23

β\beta24

The residual updates are

β\beta25

The spatial adapter is a bottleneck MLP within each HAB: β\beta26 The reduction ratio is β\beta27 in practice (Zhou et al., 2024).

Fine-tuning keeps the base HAT-L model, approximately β\beta28M parameters, fully frozen. Only the stereo adapters and spatial adapters are trained, totaling approximately β\beta29M tunable parameters, or approximately β\beta30 of the base (Zhou et al., 2024). The loss is β\beta31 between super-resolved left and right outputs and their ground-truth high-resolution targets. Training uses AdamW with initial learning rate β\beta32, no extra regularizer beyond weight decay, Flickr1024 plus Middlebury with random β\beta33 crops, β\beta34 A40 GPUs, batch size β\beta35, and β\beta36K iterations (Zhou et al., 2024).

The reported quantitative gains center on Flickr1024. For β\beta37 super-resolution, frozen HAT-L yields β\beta38 dB, full fine-tuning yields β\beta39 dB, PEFT with spatial adapters only gives β\beta40 dB, stereo adapters only give β\beta41 dB, and stereo plus spatial adapters give β\beta42 dB (Zhou et al., 2024). For β\beta43 super-resolution on Flickr1024, HAT-L gives β\beta44 dB and ASteISR gives β\beta45 dB, a β\beta46 dB gain. Compared with full fine-tuning, the method reduces fine-tuning time from β\beta47 h to β\beta48 h and GPU memory from β\beta49 GB to β\beta50 GB, corresponding to reductions of β\beta51 and β\beta52, respectively (Zhou et al., 2024).

Ablations indicate that the spatial adapter alone provides negligible gain, approximately β\beta53 dB, whereas the stereo adapter alone provides β\beta54 dB, and both together provide β\beta55 dB in the β\beta56 setting. Performance increases as more stereo-adapter layers are added and saturates after approximately β\beta57–β\beta58 adapters, one per RHAG. Alternative spatial-adapter placements in parallel to the MLP or after the MLP increase tunable parameters and GPU time by at least β\beta59 but slightly hurt PSNR by approximately β\beta60 to β\beta61 dB (Zhou et al., 2024). The paper also states that full fine-tuning on the small stereo dataset degrades texture restoration relative to the frozen SISR prior, whereas stereo adapters recover and improve on that prior.

This work is representative of a newer use of “adapter” in the PEFT literature: instead of adapting a stereo model online, the method adapts a monocular pre-trained model into a stereo-capable one by adding small trainable modules.

6. Underwater StereoAdapter and StereoAdapter-2

In “StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes,” the term denotes a self-supervised underwater stereo depth estimation framework that addresses severe underwater domain shift, including wavelength-dependent attenuation, backscattering and forward scattering, refraction at water-glass interfaces, specular highlights, and textureless regions (Wu et al., 19 Sep 2025). The paper identifies two key challenges: adapting large pre-trained vision encoders to underwater appearance in a parameter-efficient manner without dense depth labels, and fusing globally coherent but scale-ambiguous monocular priors with locally metric yet photometrically fragile stereo correspondences.

The architecture is two-stage. Stage 1 uses a LoRA-adapted Depth Anything V2 encoder, frozen except for inserted LoRA modules, to generate multi-scale features

β\beta62

aggregate them with SDFA blocks into a discrete disparity volume β\beta63, and produce a coarse disparity map β\beta64 and metric depth β\beta65 (Wu et al., 19 Sep 2025). The LoRA update for each transformer weight β\beta66 is

β\beta67

Stage 2 performs recurrent stereo refinement. Stereo feature maps β\beta68 are used to build a 4D correlation volume

β\beta69

followed by hybrid scale alignment to verify or correct the global scale of β\beta70 through sparse stereo correspondences β\beta71, multi-scale context aggregation, and iterative ConvGRU refinement: β\beta72 The final disparity is upsampled RAFT-style to full resolution (Wu et al., 19 Sep 2025).

The method also introduces dynamic LoRA adaptation, in which the update is written as

β\beta73

with β\beta74 sparsity on the importance weights β\beta75. The joint training objective is

β\beta76

and the importance weights are updated using a proximal-gradient soft-threshold rule with a threshold β\beta77 ramped from β\beta78 to β\beta79 (Wu et al., 19 Sep 2025).

Self-supervised learning is divided into monocular and stereo losses. The monocular stage uses

β\beta80

while the stereo stage uses

β\beta81

The guidance term constrains agreement between the coarse monocular disparity β\beta82 and the refined stereo disparity β\beta83 in both gradients and values, including an outlier mask β\beta84 (Wu et al., 19 Sep 2025).

Pre-training uses the synthetic UW-StereoDepth-40K dataset rendered in Unreal Engine 5 with caustics, scattering, color attenuation, and particles. The four scene types are coral reefs, shipwrecks, industrial structures, and natural seabed. Baselines are β\beta85, and the dataset contains β\beta86 stereo pairs at β\beta87 with dense ground-truth depth and segmentation (Wu et al., 19 Sep 2025).

The reported results cover zero-shot, fine-tuned, and real-world deployment. On TartanAir Underwater, zero-shot StereoAdapter trained on UW-StereoDepth-40K yields REL β\beta88, SQ REL β\beta89, RMSE β\beta90, and β\beta91 β\beta92, compared with Stereo Anywhere at REL β\beta93, RMSE β\beta94, and FoundationStereo at REL β\beta95, RMSE β\beta96. Fine-tuning on TartanAir gives REL β\beta97, RMSE β\beta98, β\beta99 b2bmb \simeq 2\cdot b_m00 (Wu et al., 19 Sep 2025). On SQUID, zero-shot StereoAdapter yields REL b2bmb \simeq 2\cdot b_m01, RMSE b2bmb \simeq 2\cdot b_m02, b2bmb \simeq 2\cdot b_m03 b2bmb \simeq 2\cdot b_m04, and the fine-tuned version yields REL b2bmb \simeq 2\cdot b_m05, RMSE b2bmb \simeq 2\cdot b_m06, b2bmb \simeq 2\cdot b_m07 b2bmb \simeq 2\cdot b_m08. On BlueROV2 indoor tank deployment, StereoAdapter yields REL b2bmb \simeq 2\cdot b_m09, SQ REL b2bmb \simeq 2\cdot b_m10, RMSE b2bmb \simeq 2\cdot b_m11, and b2bmb \simeq 2\cdot b_m12 b2bmb \simeq 2\cdot b_m13. Test-time latency on Jetson Orin NX at b2bmb \simeq 2\cdot b_m14, batch size b2bmb \simeq 2\cdot b_m15, is b2bmb \simeq 2\cdot b_m16 ms, compared with b2bmb \simeq 2\cdot b_m17 ms for FoundationStereo and b2bmb \simeq 2\cdot b_m18 ms for Stereo Anywhere (Wu et al., 19 Sep 2025).

“StereoAdapter-2” revises this design by retaining the LoRA-adapted monocular foundation encoder, now Depth Anything 3 ViT-B, for feature extraction and disparity initialization, while replacing the ConvGRU-based updater with a ConvSS2D operator based on selective state-space models (Ren et al., 18 Feb 2026). The continuous-time SSM

b2bmb \simeq 2\cdot b_m19

is discretized to a structured convolution kernel and 1D recurrence

b2bmb \simeq 2\cdot b_m20

In ConvSS2D, the recurrence is input-dependent: b2bmb \simeq 2\cdot b_m21 with

b2bmb \simeq 2\cdot b_m22

The scan is applied in four directions: left-to-right, right-to-left, top-to-bottom, and bottom-to-top (Ren et al., 18 Feb 2026). The horizontal directions align with epipolar geometry, while the vertical directions enforce structural consistency.

The complexity discussion contrasts ConvGRU and ConvSS2D. ConvGRU requires approximately four convolutions of kernel size b2bmb \simeq 2\cdot b_m23 over b2bmb \simeq 2\cdot b_m24, giving b2bmb \simeq 2\cdot b_m25, whereas ConvSS2D performs four linear recurrences of length b2bmb \simeq 2\cdot b_m26 with b2bmb \simeq 2\cdot b_m27 per location, giving b2bmb \simeq 2\cdot b_m28. Since b2bmb \simeq 2\cdot b_m29 is small, such as b2bmb \simeq 2\cdot b_m30, the method is effectively linear in the number of pixels with a smaller constant (Ren et al., 18 Feb 2026).

StereoAdapter-2 also expands the synthetic corpus to UW-StereoDepth-80K by generating b2bmb \simeq 2\cdot b_m31K new diffusion-based samples and merging them with UW-StereoDepth-40K. The pipeline combines Atlantis style transfer conditioned on source depth with NVS-Solver novel-view synthesis. Baselines are b2bmb \simeq 2\cdot b_m32 cm, and the resulting stereo pairs are b2bmb \simeq 2\cdot b_m33 with ground-truth disparity (Ren et al., 18 Feb 2026).

The zero-shot TartanAir-UW results reported for StereoAdapter-2 trained on b2bmb \simeq 2\cdot b_m34K are AbsRel b2bmb \simeq 2\cdot b_m35, SqRel b2bmb \simeq 2\cdot b_m36, RMSE b2bmb \simeq 2\cdot b_m37, LogRMSE b2bmb \simeq 2\cdot b_m38, b2bmb \simeq 2\cdot b_m39, b2bmb \simeq 2\cdot b_m40, and b2bmb \simeq 2\cdot b_m41. Compared with StereoAdapter-1 trained on b2bmb \simeq 2\cdot b_m42K, which gives AbsRel b2bmb \simeq 2\cdot b_m43 and RMSE b2bmb \simeq 2\cdot b_m44, this corresponds to a b2bmb \simeq 2\cdot b_m45 REL reduction and b2bmb \simeq 2\cdot b_m46 RMSE reduction (Ren et al., 18 Feb 2026). On SQUID, StereoAdapter-2 gives AbsRel b2bmb \simeq 2\cdot b_m47, RMSE b2bmb \simeq 2\cdot b_m48, and b2bmb \simeq 2\cdot b_m49, improving over StereoAdapter-1’s AbsRel b2bmb \simeq 2\cdot b_m50 and RMSE b2bmb \simeq 2\cdot b_m51. On BlueROV2, it reports REL b2bmb \simeq 2\cdot b_m52, SqRel b2bmb \simeq 2\cdot b_m53, RMSE b2bmb \simeq 2\cdot b_m54, LogRMSE b2bmb \simeq 2\cdot b_m55, and b2bmb \simeq 2\cdot b_m56, outperforming the cited baseline FoundationStereo at REL b2bmb \simeq 2\cdot b_m57, RMSE b2bmb \simeq 2\cdot b_m58 (Ren et al., 18 Feb 2026). On-board inference with Jetson Orin NX and TensorRT at b2bmb \simeq 2\cdot b_m59, batch b2bmb \simeq 2\cdot b_m60, is b2bmb \simeq 2\cdot b_m61 (Ren et al., 18 Feb 2026).

7. Common themes, distinctions, and interpretive context

Across these works, “StereoAdapter” consistently refers to a mechanism for making stereo systems usable outside the narrow regime assumed by a base setup or model. In the smartphone rig, the adaptation is optical: planar mirrors adapt monocularly separated front and rear cameras into a stereo pair (Bartol et al., 2021). In online and federated stereo matching, the adaptation is parametric: model weights are updated to accommodate domain shift during deployment (Tonioni et al., 2019, Poggi et al., 2024). In geometry-aware domain adaptation, the adaptation is representational: cross-view attention preserves epipolar structure during image translation (Sakuma et al., 2021). In ASteISR, adaptation is parameter-efficient transfer from single-image super-resolution to stereo super-resolution using inserted modules (Zhou et al., 2024). In underwater StereoAdapter and StereoAdapter-2, adaptation combines PEFT, self-supervision, and recurrent stereo refinement to bridge the severe physics-induced gap between terrestrial and underwater imagery (Wu et al., 19 Sep 2025, Ren et al., 18 Feb 2026).

A common misconception would be to treat these as successive versions of a single architecture. The corpus does not support that interpretation. Only the underwater pair, StereoAdapter and StereoAdapter-2, forms an explicit generational sequence (Wu et al., 19 Sep 2025, Ren et al., 18 Feb 2026). The smartphone device, learning-to-adapt framework, federated adaptation system, geometry-aware SCA method, and ASteISR are independent uses of the same or closely related naming convention.

Another distinction concerns what is being “adapted.” In the 2019 and 2024 online-adaptation works, a stereo matcher is adapted to the environment (Tonioni et al., 2019, Poggi et al., 2024). In the 2021 geometry-aware method, the source images are adapted to the target domain while preserving stereo geometry (Sakuma et al., 2021). In ASteISR, a single-image pre-trained transformer is adapted to stereo super-resolution (Zhou et al., 2024). In the 2025 and 2026 underwater works, a monocular foundation encoder is adapted to underwater stereo depth estimation, and then the stereo updater itself is redesigned for more global propagation (Wu et al., 19 Sep 2025, Ren et al., 18 Feb 2026). In the smartphone rig, the cameras are physically adapted into a stereo apparatus (Bartol et al., 2021).

This suggests that “StereoAdapter” has become a productive research label precisely because it is semantically broad: it can denote a device, an online learning rule, a federated adaptation framework, an attention mechanism, a PEFT module, or a domain-specific stereo depth system. The unifying idea is stereo functionality obtained through an added structure—optical, architectural, algorithmic, or optimization-based—rather than through a stereo system designed from scratch.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to StereoAdapter.