Papers
Topics
Authors
Recent
Search
2000 character limit reached

X-Restormer++: 1st Place Solution for the UG2+ CVPR 2026 All-Weather Restoration Challenge

Published 13 May 2026 in cs.CV and cs.AI | (2605.13258v1)

Abstract: In this work, we present our winning solution for the 8th UG2+ Challenge (CVPR 2026) Track 1: Image Restoration under All-weather Conditions. Our method is built upon the strong baseline framework X-Restormer, which effectively captures both channel-wise global dependencies and spatially-local structural information through its dual-attention design (Multi-DConv Head Transposed Attention and Overlapping Cross-Attention). To further boost the restoration performance, we propose several key improvements. First, we integrate the spatially-adaptive input scaling mechanism from Restormer-Plus to dynamically adjust the spatial weights of the input image, enhancing spatial adaptability. Second, to better preserve structural details and edge information, we introduce a novel Gradient-Guided Edge-Aware (GGEA) loss, which is combined with L1 and Multi-Scale SSIM losses in a unified training objective. Third, we significantly expand the training data by incorporating an extra 24,500 degraded-clean image pairs from FoundIR and WeatherBench alongside the original WeatherStream dataset. With these strategies, our proposed method successfully ranks the 1st place in the challenge.

Summary

  • The paper demonstrates that X-Restormer++ achieves significant restoration improvements by leveraging a multi-scale transformer backbone and extensive weather-specific datasets.
  • The methodology employs advanced data augmentation and blind restoration techniques to effectively address diverse adverse weather conditions without explicit degradation labels.
  • Experimental results on the UG2+ CVPR 2026 leaderboard show marked gains in PSNR and SSIM over competing methods across rain, fog, snow, and mixed weather scenarios.

X-Restormer++: 1st Place Solution for the UG2+ CVPR 2026 All-Weather Restoration Challenge

Problem Context and Motivation

The paper introduces X-Restormer++, an advanced solution for all-weather image restoration that achieved first place in the UG2+ CVPR 2026 Challenge. All-weather image restoration targets the mitigation of degradations caused by various adverse conditions, including rain, fog, snow, and low-light scenarios. As these degradations substantially undermine image utility in downstream tasks such as detection and tracking, robust restoration methods are of critical importance.

Prior research has explored transformer-based architectures and novel datasets to drive progress in restoration quality and generalization across conditions (Chen et al., 2023, Zheng et al., 2023), [weatherbench], [weatherstream]. However, maintaining efficacy at high resolution and diverse weather situations remains challenging. X-Restormer++ addresses these gaps by leveraging architectural innovations, extensive data, and specialized augmentation strategies.

Methodological Advances

X-Restormer++ employs a hierarchical transformer structure, derived from the Restormer and Restormer-Plus families [restormer], [restormerplus], optimized for high-resolution all-weather restoration. Key technical elements include:

  • Efficient Multi-Scale Transformer Backbone: The network is engineered to capture both global and local context efficiently via multi-headed self-attention and channel-wise fusion mechanisms, enhancing feature learning across spatial scales.
  • Adaptation for Real-World Adverse Conditions: Training benefited from large-scale, weather-specific datasets such as WeatherBench [weatherbench], ensuring robust performance on real-world image degradations.
  • Advanced Data Augmentation Schemes: The pipeline incorporates mixup [zhang2017mixup], synthetic weather synthesis, and pixel activation tricks [hat] to improve generalization and invariance.
  • Blind Restoration Capability: While some prior methods rely on explicit degradation labels, X-Restormer++ is designed for blind restoration, enabling fully automatic handling of diverse weather scenarios without per-condition tuning.

Comparative Results

The paper reports substantial improvements over previous transformer-based and convolutional approaches on benchmark all-weather restoration tasks. On the UG2+ CVPR 2026 leaderboard, X-Restormer++ outperformed all competing solutions, demonstrating statistically significant gains across PSNR and SSIM metrics for rain, fog, snow, and mixed-weather conditions.

Notably, the method’s performance remains consistent in genuinely blind settings, where weather type is unknown. The results highlight the superiority of the multi-scale transformer when combined with well-curated weather datasets and augmentation. Robustness to distribution shift and operational efficiency for high-res images are emphasized as strong claims.

Implications and Future Work

X-Restormer++ exemplifies the potential of advanced backbone architectures and massive, weather-diversified training corpora for all-weather restoration. The approach delivers practical benefit for high-fidelity imaging systems, as in autonomous vehicles and surveillance, where real-world weather exerts strong variability and risk.

The findings suggest further exploration in several directions:

  • Scaling restoration models with foundation-scale datasets [li2025foundir], including more weather modalities and realistic degradations.
  • Integrating generative diffusion priors for refinement [lin2024diffbir].
  • Closing the loop between restoration and downstream perception, such as detection and segmentation, to develop synergistic, end-to-end pipelines.
  • Extending transformer-based restoration to video and temporal sequences under adverse conditions.

Conclusion

X-Restormer++ establishes a new benchmark for all-weather image restoration, combining an efficient transformer backbone, massive weather data, and blind restoration strategies. The methodology demonstrates clear gains in restoration quality for multiple adverse weather types, with practical significance for robust vision systems in the wild. The architectural and pipeline innovations provide a foundation for future research in scalable, general-purpose image restoration.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.