---
title: Stereo Super-Resolution (SSR)
url: https://www.emergentmind.com/topics/stereo-super-resolution-ssr
type: topic
---

# Stereo Super-Resolution (SSR)

Stereo Super-Resolution (SSR) is the task of reconstructing a high-resolution stereo pair from a low-resolution stereo pair by exploiting both intra-view image structure and cross-view correspondence. In the binocular case, SSR learns a mapping from left and right low-resolution inputs to left and right super-resolved outputs while preserving the disparity structure that underlies stereo perception and 3D geometry. A representative formulation is
\[
f_\theta:(I_L^{LR}, I_R^{LR}) \mapsto (I_L^{SR}, I_R^{SR}),
\]
with the additional requirement that the two outputs remain mutually consistent under stereo correspondence rather than being treated as two unrelated single-image SR problems [2003.08539]. In the broader SR taxonomy, SSR is usually distinguished from SISR, VSR, and LFSR by its explicit use of cross-view disparity correlation, with inputs often written as \(X_{lr}^i \in \mathbb{R}^{M \times H \times W \times C}\) and outputs as \(X_{hr}^i \in \mathbb{R}^{M \times sH \times sW \times C}\), where \(M\) denotes the number of views [2509.22692].

## 1. Geometric formulation and problem characteristics

SSR differs from single-image SR because the two views are related by epipolar geometry, horizontal disparity, and partial occlusion. Rectified stereo pairs satisfy the constraint that corresponding points lie on the same row, which makes cross-view fusion fundamentally a correspondence problem along the width dimension. The second view contributes redundant and complementary observations: the same scene structure appears from a slightly different viewpoint, some details occluded in one view may be visible in the other, and repeated textures can be disambiguated by binocular agreement [2011.03802].

This additional information also introduces extra failure modes. A stereo SR model must not only sharpen edges and restore fine textures, but also avoid left-right inconsistencies, disparity distortion, and occlusion-induced artifacts. In endoscopic stereo, these issues are compounded by small baselines, deformation, specular highlights, non-uniform illumination, smoke, and imperfect rectification [2003.08539]. In stereoscopic video, temporal-consistency becomes an additional requirement, because stereo-consistency and temporal-consistency jointly affect 3D comfort and “3D fatigue” [2204.10039].

The survey literature therefore treats SSR as a geometry-constrained restoration problem rather than a simple two-image extension of SISR. The central design question is how to exploit cross-view information strongly enough to improve SR, yet selectively enough to avoid transferring mismatched content from the auxiliary view [2509.22692].

## 2. Architectural families and representative models

A common taxonomy divides SSR methods into CNN-based regression models, Transformer-based regression models, and generative models including GAN-based and diffusion-based approaches [2509.22692]. Within CNN-based regression, the dominant pattern is a symmetric two-branch network with shared feature extractors and an explicit cross-view interaction module.

Parallax-attention architectures were a decisive step in this line. "Symmetric Parallax Attention for Stereo Image Super-Resolution" introduced iPASSR, which uses a Siamese network with a symmetric bi-directional parallax attention module (biPAM), inline occlusion handling, and bilateral stereo-consistency losses. The attention maps \(\mathbf{M}_{R\rightarrow L}\) and \(\mathbf{M}_{L\rightarrow R}\) have shape \(H\times W\times W\), so each pixel attends along its epipolar line, and cross-view converted features are formed by batch-wise matrix multiplication with the opposite-view feature map [2011.03802]. In the medical domain, "Stereo Endoscopic Image Super-Resolution Using Disparity-Constrained Parallel Attention" generalizes this idea with an Atrous Parallax-Attention Module (APAM) that uses multi-line similar features around the epipolar line and enforces disparity consistency between LR and SR representations [2003.08539].

A second family makes disparity itself an explicit partner of SR. "Feedback Network for Mutually Boosted Stereo Image Super-Resolution and Disparity Estimation" proposes SSRDE-FNet, which jointly performs stereo SR and disparity estimation in a unified framework. It first exploits cross-view information in LR space, then estimates HR disparity from SR-produced HR features, uses HR disparity to aggregate HR features for finer SR, and finally feeds HR disparity information back to previous layers through an HR Disparity Information Feedback mechanism [2106.00985]. This design treats SR and disparity as mutually reinforcing tasks rather than separate modules.

A third family emphasizes simplicity and efficient baselines. "NAFSSR: Stereo Image Super-Resolution Using NAFNet" adopts NAFNet as a shared intra-view backbone and adds a Stereo Cross-Attention Module (SCAM) after NAFBlocks, producing a deliberately simple yet strong stereo SR baseline. It reports that NAFSSR outperforms previous state-of-the-art methods on KITTI 2012, KITTI 2015, Middlebury, and Flickr1024, and that it won 1st place in the NTIRE 2022 Stereo Image Super-resolution Challenge [2204.08714]. "NAFRSSR: a Lightweight Recursive Network for Efficient Stereo Image Super-Resolution" continues this efficiency-oriented line with NAFGCBlocks, DSSCAM, recursion, and a trainable edge detector; the smallest variant, NAFRSSR-M, has 0.28M parameters and 50 ms inference time while reaching 24.657 dB / 0.7622 average PSNR/SSIM on the benchmark datasets [2405.08423].

More recent CNN models strengthen intra-view modeling and selective fusion rather than merely enlarging stereo attention. "Cross-View Hierarchy Network for Stereo Image Super-Resolution" emphasizes that many prior methods over-prioritized cross-view fusion and underused intra-view hierarchy. Its CHIMB and CVIM pair large-kernel convolution attention and channel attention for intra-view modeling with depth-wise-convolution-enhanced cross-view attention [2304.06236]. "Learning Accurate and Enriched Features for Stereo Image Super-Resolution" proposes MSSFNet, combining a Mixed-Scale Block, a Selective Fusion Attention Module, and Fast Fourier Convolution Blocks to preserve spatial detail, enrich context, and filter irrelevant cross-view similarities before attention [2406.16001].

Transformer-based SSR methods explicitly separate or interleave cross-view and intra-view attention. "PFT-SSR: Parallax Fusion Transformer for Stereo Image Super-Resolution" uses a Swin-based backbone with a Parallax Fusion Transformer consisting of a Cross-view Fusion Transformer (CVFT) and an Intra-view Refinement Transformer (IVRT). The design is explicitly motivated by the mismatch between CNN-era stereo fusion modules and Transformer backbones, and by the need to handle varying parallax through alternating cross-view interaction and local refinement [2303.13807].

The most recent extensions move beyond fixed-scale convolutional upsampling and beyond purely deterministic regression. "StereoINR: Cross-View Geometry Consistent Stereo Super Resolution with Implicit Neural Representation" models stereo images as continuous implicit functions, combines a HAT-based encoder with disparity-guided warping and cross-attention, and replaces fixed pixel-shuffle upsampling with coordinate-based arbitrary-scale reconstruction [2505.05509]. "DIffSteISR: Harnessing Diffusion Prior for Superior Real-world Stereo Image Super-Resolution" introduces a diffusion-based real-world SSR framework with time-aware stereo cross attention, stereo ControlNet conditioning, and stereo semantic extraction, targeting texture realism and cross-view semantic consistency under real degradations [2408.07516].

## 3. Correspondence modeling, losses, and optimization objectives

The core mathematical machinery of SSR is cross-view correspondence. In parallax-attention models, a left-view feature attends over candidate positions in the right view along the same row, producing a distribution over disparities. In iPASSR, cross-view converted features are written as
\[
\mathbf{F'}_{R\rightarrow L} = \mathbf{M}_{R\rightarrow L}\otimes \mathbf{F}_R,\qquad
\mathbf{F'}_{L\rightarrow R} = \mathbf{M}_{L\rightarrow R}\otimes \mathbf{F}_L,
\]
and are then fused with intra-view features through validity masks inferred from cycle-consistency of attention maps [2011.03802]. The survey formalizes the same pattern as a generic SSR loss framework built on parallax attention maps \(\mathbf{M}_{left\rightarrow right}\) and \(\mathbf{M}_{right\rightarrow left}\), together with photometric consistency, smoothness, and cycle-consistency losses [2509.22692].

A common reconstruction objective is an \(\ell_1\) or \(\ell_2\) loss over both views. NAFSSR uses the simple stereo \(\ell_1\) objective
\[
\mathcal{L}=
\left\| I^{SR}_L-I^{HR}_L \right\|_1+
\left\| I^{SR}_R-I^{HR}_R \right\|_1,
\]
whereas DCSSRnet uses an MSE reconstruction term plus a disparity-consistency penalty that aligns LR and SR disparity masks:
\[
L_{DC}=
\| \text{ups}(M_{L\to R}^{LR})-M_{L\to R}^{SR}\|_2^2+
\| \text{ups}(M_{R\to L}^{LR})-M_{R\to L}^{SR}\|_2^2.
\]
The latter explicitly ties the stereo geometry of the SR output to the input stereo pair [2204.08714][2003.08539].

Disparity-aware models add dedicated geometry objectives. SSRDE-FNet combines an SR loss, a BiPAM loss, and a disparity loss:
\[
\mathcal{L}=\mathcal{L}_{SR}+\lambda_1\mathcal{L}_{BiPAM}+\lambda_2\mathcal{L}_{Disp},
\]
with \(\lambda_1=\lambda_2=0.1\). Its disparity module uses HR features generated by SR to estimate HR disparity through a coarse-to-fine cost-volume refinement, then feeds HR disparity back into earlier layers [2106.00985]. This establishes a stronger form of geometric coupling than attention-only methods.

Perception-oriented SSR replaces generic perceptual supervision with stereo-specific quality supervision. "Perception-Oriented Stereo Image Super-Resolution" introduces StereoSRQA and trains the SR network with a pixel loss plus image-level and feature-level IQP losses in the learned StereoSRQA feature space:
\[
\mathcal{L}=\| I^{SR}-I^{GT} \|_2 + 0.1\, \mathcal{L}_{IQP_{im}} + 0.1\, \mathcal{L}_{IQP_f}.
\]
This design is motivated by the observation that VGG- or GAN-based perceptual objectives can introduce stereo-inconsistent artifacts even when single-view sharpness improves [2207.06617].

Diffusion-based real-world SSR changes the optimization regime again. DiffSteISR uses a diffusion noise-prediction loss over stereo latents conditioned on LR stereo latents and semantic prompts:
\[
\mathcal{L}=
\mathbb{E}_{z^{L}, z^{R}, t, \epsilon}
\left[
\left\|
\epsilon-
\epsilon_\theta\big(
z_t^{L}, z_t^{R}, z_{lr}^{L}, z_{lr}^{R}, t, p_h, p_s
\big)
\right\|_2^2
\right].
\]
Here cross-view consistency is not imposed by a separate disparity loss, but by stereo-conditioned denoising, time-aware stereo cross attention, and stereo-aware control features [2408.07516].

## 4. Datasets, benchmarks, and evaluation protocols

The modern empirical foundation of SSR is Flickr1024, a dataset of 1024 high-quality stereo pairs collected from Flickr and processed for stereo SR. The dataset is split into 800 training pairs, 112 validation pairs, and 112 test pairs. Its processing includes reordering cross-eye stereo into standard left-right pairs, discarding vertically misaligned images, cropping to remove margins, and enforcing a disparity configuration in which close-shot images satisfy \(d_{\min}>40\) pixels [1903.06332]. Cross-dataset experiments in the Flickr1024 paper show that training StereoSR and PASSRnet on Flickr1024 yields the best PSNR and SSIM on KITTI2015, Middlebury, Flickr1024, and ETH3D, and that the larger, more diverse dataset mitigates over-fitting [1903.06332].

Beyond Flickr1024, the standard SSR benchmarks are KITTI 2012, KITTI 2015, Middlebury, and sometimes Tsukuba. Many later methods train on 800 Flickr1024 pairs plus 60 Middlebury pairs and evaluate on KITTI 2012, KITTI 2015, Middlebury, and Flickr1024 at \(\times2\) and \(\times4\) scale factors [2303.13807]. MSSFNet follows this protocol and also reports two evaluation styles: Left-only PSNR/SSIM with a 64-pixel left boundary crop, and stereo average \((\text{Left}+\text{Right})/2\) without boundary cropping [2406.16001].

PSNR and SSIM remain the default distortion metrics, but recent work broadens evaluation to stereo-specific and perception-oriented criteria. The survey writes PSNR as
\[
\text{PSNR}=10\log_{10}\left(\frac{\text{MAX}^2}{\text{MSE}}\right),
\]
and treats SSIM as a standard structural fidelity measure [2509.22692]. PSSR supplements them with NIQE, PI, BRISQUE, SSEQ, CNNIQA, SFA, StereoQA, and StereoSRQA, arguing that PSNR and SSIM alone do not track binocular perceptual quality [2207.06617]. DiffSteISR further uses LPIPS, DISTS, FID, MADE, NIQE, MANIQA, MUSIQ, and CLIPIQA; MADE is defined as a mean absolute disparity error between disparity maps of the super-resolved stereo pair and the ground-truth pair, so it directly measures geometric fidelity [2408.07516].

These choices matter because recent models are no longer optimized for a single notion of quality. GAN- and diffusion-based methods often trade some PSNR for perceptual realism, while geometry-aware methods may improve disparity consistency even when the pixel-wise gain is modest. The survey therefore treats SSR evaluation as intrinsically multi-criteria: distortion, perceptual fidelity, and stereo consistency [2509.22692].

## 5. Domain-specific deployments and downstream uses

One of the clearest domain-specific instantiations of SSR is stereo endoscopy. DCSSRnet was developed for stereo laparoscopic images captured by the stereo camera of the da Vinci surgical system, using 4560 HR stereo pairs of size \(512\times512\). It addresses limited sensor size, narrow field of view, fine tissue structure, deformation, specular highlights, blood, smoke, and small baselines by combining a residual ASPP backbone with APAM and disparity-consistency losses, and it reports improvements over existing SR methods on laparoscopic data [2003.08539]. This medical setting makes explicit a general SSR requirement: SR should enhance resolution without degrading depth perception.

SEGSRNet extends this logic to a task pipeline in which stereo super-resolution precedes surgical instrument segmentation. Its SR module uses CCSB, ASPP, RDBs, and a biPAM-style cross-view interaction module, and its segmentation stage uses an SPP-LinkNet-34 variant. The paper reports that SEGSRNet reaches 42.41 / 0.9879 on MICCAI 2018 at \(\times2\) and 36.01 / 0.9768 at \(\times4\), while the segmentation component achieves 83.65 ± 16.47 IoU and 89.80 ± 13.99 Dice on binary segmentation in EndoVis 2017 [2404.13330]. The broader implication is that stereo-aware SR can be task-oriented even when training remains stage-wise.

Stereo video SR generalizes SSR into a spatio-temporal setting. "A New Dataset and Transformer for Stereoscopic Video Super-Resolution" introduces SVSR-Set, a dataset of 71 full HD stereo videos captured using a professional stereo camera, and proposes Trans-SVSR with a spatio-temporal convolutional self-attention layer, an optical flow-based feed-forward layer, and PAM-based stereo fusion. The method is explicitly motivated by the need to preserve both stereo-consistency and temporal-consistency, and it reports the lowest disparity end-point error, 0.5031, among the compared methods on SVSR-Set [2204.10039].

SSR is also increasingly evaluated by downstream geometry. iPASSR reports that when GwcNet is run on \(\times4\) SR outputs on SceneFlow, the end-point error improves from 1.196 for bicubic-upsampled LR to 0.949 for iPASSR, compared with 0.667 on HR ground truth [2011.03802]. At the system level, "Improving Multi-View Stereo via Super-Resolution" shows that inserting super-resolution before MVS generally improves reconstructed 3D models, especially completeness and especially on textured scenes, even when the SR module is monocular rather than stereo-aware [2107.13261]. This does not make the paper an SSR method, but it clarifies why geometry-consistent SR is operationally important beyond image quality.

## 6. Real-world, perception-oriented, efficient, and arbitrary-scale directions

Recent SSR work has moved toward four partially overlapping goals: perceptual realism, real-world degradation robustness, efficiency, and scale flexibility. PSSR is the first perception-oriented StereoSR approach built around a dedicated StereoSRQA model and a StereoSRQA database. Mid3D_QA contains 3366 stereo SR pairs generated from 66 Middlebury HR stereo pairs, and FRStereoSRQA achieves RMSE 0.3505, SROCC 0.9910, PLCC 0.9918, and KROCC 0.9170 on that benchmark [2207.06617]. This line reframes SSR evaluation as an explicitly learned binocular quality problem.

DiffSteISR addresses real-world stereo image super-resolution by importing Stable Diffusion 2.0 as a texture prior and constraining it with stereo-specific mechanisms: TASCATA, SOA ControlNet, and SSE. On StereoWeb20, which has no ground truth, it reports the best MANIQA, MUSIQ, and CLIPIQA scores among the compared methods, while on synthetic Flickr1024RS it substantially improves MADE over other diffusion-based baselines [2408.07516]. A plausible implication is that diffusion-based SSR will remain competitive primarily when semantic realism and real degradations are dominant concerns, provided stereo consistency is explicitly modeled.

Efficiency remains a parallel research axis rather than a secondary concern. NAFRSSR shows that careful redesign of attention and convolution blocks can improve the accuracy-efficiency trade-off beyond NAFSSR and SwinFIR, and MSSFNet reports state-of-the-art PSNR with fewer FLOPs than SwinFSR, Steformer, and many others, including up to 87% fewer parameters than SwinFSR [2405.08423][2406.16001]. CVHSSR similarly reports that CVHSSR-S matches or exceeds NAFSSR-B while using roughly 70% fewer parameters, emphasizing that stronger intra-view modeling can replace some of the complexity of heavy stereo fusion [2304.06236].

Arbitrary-scale SSR is emerging as a distinct subproblem. StereoINR replaces fixed-scale pixel-shuffle upsampling with continuous implicit neural representations conditioned on disparity-guided cross-view fusion, allowing scales such as \(\times2,\times3,\times4,\times6,\times12\) and larger without architectural change. It reports that StereoINR outperforms arbitrary-scale single-image INR baselines on Middlebury and matches state-of-the-art fixed-scale SSR methods within training-distribution scales while improving stereo consistency scores [2505.05509].

The current survey identifies the resulting open directions with unusual clarity: real-world blind SSR under unknown view-dependent degradations, joint SSR and depth estimation, arbitrary-scale SSR, larger and more diverse stereo datasets, and unsupervised or self-supervised SSR that exploits left-right photometric constancy, smoothness, and cycle-consistency without requiring HR supervision [2509.22692]. This suggests that the field is converging on a synthesis of geometry-aware correspondence, stronger generative priors, and task-aware evaluation, rather than on any single backbone family.

Source: https://www.emergentmind.com/topics/stereo-super-resolution-ssr