---
title: 'AeroDeshadow: Physics-Guided ASI Shadow Removal'
url: https://www.emergentmind.com/topics/aerodeshadow
type: topic
---

# AeroDeshadow: Physics-Guided ASI Shadow Removal

Searching arXiv for the focal paper and closely related remote-sensing deshadowing work.
AeroDeshadow is a two-stage shadow-removal framework for high-resolution aerospace imagery (ASI) that combines physics-guided shadow synthesis with penumbra-aware restoration. It is formulated around two ASI-specific constraints: strictly paired real shadow/shadow-free data are severely lacking, and homogeneous shadow assumptions fail in the broad penumbra transition zones produced by complex scene geometry, long-distance light propagation, and atmospheric scattering. The framework therefore couples the Physics-aware Degradation Shadow Synthesis Network (PDSS-Net), the AeroDS benchmark, and the Penumbra-aware Cascaded DeShadowing Network (PCDS-Net) in order to restore illumination consistency while reducing spectral distortion, texture suppression, and boundary ambiguity in satellite and aerial imagery [2604.15903].

## 1. Domain formulation and shadow model

AeroDeshadow treats shadows in ASI as a radiometric and structural degradation rather than a merely aesthetic artifact. The paper identifies illumination inconsistency, spectral distortion, texture suppression, and information loss as direct consequences of shadows, with downstream impact on urban analysis, disaster monitoring, object detection, segmentation, and remote-sensing interpretation. In this formulation, ASI shadow removal is materially different from natural-image shadow removal because the same scene is rarely available under matched acquisition conditions with and without shadows, and because ASI shadows often contain both a darker umbra core and a broad penumbra where illumination changes continuously rather than abruptly [2604.15903].

A central premise is that binary or homogeneous shadow models are too crude for aerospace scenes. Uniform correction can over-brighten the umbra, under-restore the penumbra, and introduce spectral inconsistency or visible artifacts at soft boundaries. A common misconception in adjacent literature is that natural-image shadow removal pipelines can be transferred directly to aerospace imagery; AeroDeshadow explicitly rejects that assumption by making penumbra modeling and synthetic paired-data construction first-class components of the method.

The physical shadow-formation prior is written as a linear illumination degradation between adjacent lit pixels \(I_l\) and shadow pixels \(I_s\):
\[
I_s = w \cdot I_l + b,
\]
where \(w \in \mathbb{R}^3\) is a channel-wise illumination scaling factor and \(b \in \mathbb{R}^3\) is a channel-wise environmental light shift bias. The illumination decay parameters are estimated from real ASI by isolating a shadow core region and an adjacent lit region:
\[
w = \frac{\sigma_{sc}}{\sigma_{lit}}, \quad b = \mu_{sc} - w \cdot \mu_{lit}.
\]
These \((w,b)\) values form the physical prior library used by the synthesis stage.

## 2. Two-stage architecture and data flow

The framework is organized as a synthesis stage followed by a restoration stage. In Stage 1, PDSS-Net takes a shadow-free ASI image and a pseudo-shadow mask and produces a realistic synthetic shadow image. In Stage 2, PCDS-Net takes a shadowed image and its mask and predicts a restored shadow-free image. The paper describes this as a bridge from clean real aerospace images to synthetic shadowed paired samples and then to real-world deshadowing [2604.15903].

The stage-level data flow is:
\[
\text{shadow-free ASI} + \text{pseudo-shadow mask} \xrightarrow{\text{PDSS-Net}} \text{synthetic shadowed ASI},
\]
followed by
\[
(\text{shadowed ASI}, \text{mask}) \xrightarrow{\text{PCDS-Net}} \text{restored shadow-free ASI}.
\]

This division of labor is fundamental. PDSS-Net addresses the absence of paired real data by constructing synthetic supervision with soft boundary transitions, while PCDS-Net addresses the failure of homogeneous restoration by explicitly separating umbra and penumbra. The two-stage design is therefore not a generic cascade; it encodes the claim that data realism and restoration bias must be solved jointly, but not necessarily by a single end-to-end model.

## 3. Physics-guided synthesis and the AeroDS benchmark

PDSS-Net begins by transforming a hard pseudo-shadow mask into a soft mask with a guided filter:
\[
I_{psm}^{soft} = \text{GuidedFilter}(I_{psm}^{hard}, I_{free}).
\]
A sampled \((w,b)\) pair is then applied to produce a physics-guided initial shadow image:
\[
I_{ds} = I_{free} \odot (\mathbf{1} - I_{psm}^{soft}) + \text{Clip}(w \cdot I_{free} + b) \odot I_{psm}^{soft}.
\]
This initial synthesis is refined by a CycleGAN-style generator built on a U-Net-style encoder-decoder, yielding
\[
I_{gs} = G(I_{ds}, I_{psm}).
\]

The main spatial prior inside PDSS-Net is the Spatial-Decay Coordinate Attention (SDCA) module. For a feature map \(F \in \mathbb{R}^{C \times H \times W}\), SDCA reweights features by horizontal and vertical attention:
\[
F' = F \odot A_h \odot A_w.
\]
Coordinate pooling is defined by
\[
X_h = \text{AvgPool}_H(F), \quad X_w = \text{AvgPool}_W(F),
\]
followed by
\[
Y = \text{Concat}(X_h, X_w^\top).
\]
The local perception branch is
\[
Y_{\text{local}} = \text{Conv}_{1 \times 1}(Y), \qquad M = \max(8, C/r), \quad r=32,
\]
and the decay simulation branch is
\[
Y_{\text{decay}} = \text{StripConv}_{\text{1D}}(\text{Conv}_{1\times 1}(Y)).
\]
After fusion,
\[
Y_{\text{fused}} = \text{BN}(\text{h-swish}(Y_{\text{local}} + Y_{\text{decay}})),
\]
the attention maps are
\[
A_h = \sigma(\text{Conv}_{1\times 1}(Y_h)), \quad A_w = \sigma(\text{Conv}_{1\times 1}(Y_w^\top)).
\]
The paper interprets the local branch as preserving umbra edge sharpness and the decay branch as simulating non-linear spatial attenuation in the penumbra.

PDSS-Net is trained with
\[
\mathcal{L}_{PDSS} = \mathcal{L}_{adv} + \lambda_{cyc}\mathcal{L}_{cyc} + \lambda_{back}\mathcal{L}_{back} + \lambda_{idt}\mathcal{L}_{idt},
\]
with \(\lambda_{cyc}=10\), \(\lambda_{back}=10\), and \(\lambda_{idt}=5\). The adversarial term is
\[
\mathcal{L}_{adv} = \mathbb{E}_{I_{rs}}\left[(D(I_{rs}) - 1)^2\right] + \mathbb{E}_{I_{ds},I_{psm}}\left[(D(I_{gs}))^2\right].
\]
Cycle consistency is
\[
\mathcal{L}_{cyc} = \mathbb{E}_{I_{ds},I_{psm}} \left[\|F(I_{gs}) - I_{ds}\|_1\right]
+ \mathbb{E}_{I_{rs},I_m} \left[\|G(F(I_{rs}), I_m) - I_{rs}\|_1\right].
\]
Background consistency is
\[
\mathcal{L}_{back} = \mathbb{E}_{I_{ds},I_{psm}} \left[ \|(I_{ds} - I_{gs}) \odot (\mathbf{1} - I_{psm})\|_1 \right],
\]
and identity preservation is
\[
\mathcal{L}_{idt} = \mathbb{E}_{I_{rs},I_m} \left[ \|G(I_{rs}, I_m) - I_{rs}\|_1 \right].
\]

The resulting benchmark, AeroDS, contains two subsets. All images come from diverse regions worldwide, have original spatial resolution of \(0.3\) m, are initially cropped to \(256\times256\), and are then normalized to \(512\times512\) using Real-ESRGAN.

| Subset | Content | Split |
|---|---|---|
| AeroDS-Syn | 2,260 triplets from real shadow-free images and pseudo-shadow masks | 2,000 train / 260 test |
| AeroDS-Real | 260 real shadowed ASI samples with manually annotated masks | test only |

AeroDS as a whole contains 2,260 real shadowed images, 2,260 unpaired shadow-free images, and 2,260 manually annotated pseudo-shadow masks [2604.15903].

## 4. Penumbra-aware restoration in PCDS-Net

PCDS-Net begins by decomposing the input mask into an umbra mask \(I_{um}\) and a penumbra mask \(I_{pm}\) through dynamic morphological erosion and dilation. The architectural claim is that umbra and penumbra obey different restoration dynamics: the umbra requires stronger illumination compensation and texture recovery, whereas the penumbra requires smooth boundary handling and contextual compensation [2604.15903].

The Umbra Feature Encoder (UFE) extracts high-frequency core-shadow features:
\[
F_u^i = 
\begin{cases}
\text{ConvBlock}_i([I_s, I_{um}]), & i = 1 \\
\text{ConvBlock}_i(F_u^{i-1}), & i > 1,
\end{cases}
\]
while the Penumbra Feature Encoder (PFE) uses dilated convolutions:
\[
F_p^i = 
\begin{cases}
\text{DilaConvBlock}_i([I_s, I_{pm}]), & i = 1 \\
\text{DilaConvBlock}_i(F_p^{i-1}), & i > 1.
\end{cases}
\]

At each scale, the two streams are fused by Attention Feature Fusion (AFF). Starting from
\[
X = F_u^i + F_p^i,
\]
the module computes
\[
W = \sigma\left(\mathcal{F}_{local}(X) + \mathcal{F}_{global}(\text{GAP}(X))\right),
\]
and fuses the branches as
\[
F_{fuse}^i = F_u^i \odot W + F_p^i \odot (\mathbf{1} - W).
\]
This gives the model a way to prefer umbra features where texture recovery is critical and penumbra features where smooth transition modeling is dominant.

The decoder first forms a semantic feature
\[
F_{sem} = \mathcal{F}_{DSA}(F_{fuse}^4),
\]
and then restores progressively:
\[
F_{rec}^k = \mathcal{F}_{conv} \left( \text{Concat}(\text{Up}(F_{rec}^{k-1}), F_{fuse}^{4-k+1}) \right).
\]
The final prediction is denoted
\[
I_{sr} = G(I_s, I_m).
\]

PCDS-Net is trained with
\[
\mathcal{L}_{PCDS} = \mathcal{L}_{adv} + \mathcal{L}_{rec} + \lambda_c \mathcal{L}_{color} + \lambda_p \mathcal{L}_{phy},
\]
where \(\lambda_c = 200\) and \(\lambda_p = 10\). The adversarial term is
\[
\mathcal{L}_{adv} = \mathbb{E}_{I_{sf}}\left[(D(I_{sf}) - 1)^2\right] + \mathbb{E}_{I_s,I_m}\left[(D(I_{sr}))^2\right].
\]
The reconstruction term is
\[
\mathcal{L}_{rec} = \lambda_{L1}\|I_{sr} - I_{sf}\|_1 + \lambda_{per}\sum_k \|\phi_k(I_{sr}) - \phi_k(I_{sf})\|_1,
\]
with \(\lambda_{L1}=80\) and \(\lambda_{per}=7\). To preserve spectral fidelity, the color consistency loss is
\[
\mathcal{L}_{color} = \frac{1}{N}\sum_p \left\| \frac{I_{sr,p}}{\sum_c I_{sr,p}^c + \epsilon} - \frac{I_{sf,p}}{\sum_c I_{sf,p}^c + \epsilon} \right\|_1.
\]
The boundary-aware physical smoothness term uses
\[
L_{est} = \frac{I_s}{I_{sr} + \epsilon},
\]
and is written as
\[
\mathcal{L}_{phy} = \sum \|\nabla L_{est} \odot (\mathbf{1} - I_{pm})\|_1 + \sum \|\nabla I_{sr} \odot I_{pm}\|_1.
\]
This enforces smooth illumination outside penumbra while preserving texture and transition behavior inside penumbra.

## 5. Benchmarking, ablations, and reported performance

The evaluation covers AeroDS-Syn, AeroDS-Real, AISD, and SRGTA. For synthesis, the paper reports Shadow-to-Lit Intensity Ratio (SLR) and chromaticity deviation in Lab \(a\)-channel \((\Delta a)\). For paired shadow removal it uses PSNR, SSIM, and RMSE, and for real ASI without ground truth it uses Entropy and BRISQUE [2604.15903].

The headline removal results are organized below.

| Dataset | Metrics | AeroDeshadow |
|---|---|---|
| AeroDS-Syn | PSNR-S / SSIM-S / RMSE-S | 21.91 / 0.79 / 11.35 |
| AeroDS-Real | Entropy / BRISQUE | 7.40 / 12.70 |
| AISD | Entropy / BRISQUE | 7.17 / 11.56 |
| SRGTA | PSNR-S / SSIM-S / RMSE-S | 22.37 / 0.78 / 9.41 |

On AeroDS-Syn, the strongest baseline RS-GSSR is listed at \(20.25 / 0.73 / 12.88\). On SRGTA, RS-GSSR is \(21.57 / 0.80 / 11.28\). On AeroDS-Real, RS-GSSR has a slightly better BRISQUE of \(11.84\), while PCDS-Net remains highly competitive at \(12.70\). This makes the performance profile mixed rather than uniformly dominant: AeroDeshadow leads on the paired synthetic and transferred synthetic benchmarks and on AISD, but does not produce the lowest BRISQUE on AeroDS-Real.

For synthesis realism, the real reference shadow distribution has MeanSLR \(0.366\), SLR Range \((0.282, 0.436)\), and \(\Delta a = -0.385\). PDSS-Net reports MeanSLR \(0.353\), SLR Range \((0.219, 0.519)\), and \(\Delta a = 0.803\). RS-GSSR is numerically close on MeanSLR and range, with MeanSLR \(0.346\) and SLR Range \((0.224, 0.491)\). The paper nevertheless argues that PDSS-Net better captures local physical realism and non-linear penumbra transitions, and that global chromatic metrics can miss local transition fidelity.

The ablation study separates the roles of DEP, SDCA, UFE, PFE, and AFF. Without DEP, PDSS-Net drops to MeanSLR \(0.296\), SLR Range \((0.220, 0.369)\), and \(\Delta a = 0.105\). For restoration, UFE only gives \(19.69 / 0.73 / 13.84\) on AeroDS-Syn and BRISQUE \(25.02\) on AeroDS-Real; PFE only gives \(18.41 / 0.66 / 16.18\) and BRISQUE \(22.94\); UFE + PFE without AFF gives \(20.82 / 0.78 / 13.06\) and BRISQUE \(23.98\). These results support the paper’s main architectural claim: umbra-specific recovery, penumbra-specific context, and adaptive fusion are all necessary, and AFF is especially important for real-image quality.

The qualitative analysis reported in the paper attributes the final gains to smoother non-linear boundary attenuation, fewer step-like transitions, reduced halo artifacts, stronger texture preservation inside core shadows, and fewer blue-greenish distortions than competing baselines. The method is also evaluated in a downstream vehicle-detection setting with SCAF-Net, where the paper argues that the restoration is preferable to GAN-based removal because it preserves small-object structure more faithfully.

## 6. Position within remote-sensing deshadowing research

AeroDeshadow belongs to the line of remote-sensing deshadowing methods that respond to the lack of paired real supervision by constructing synthetic or weakly paired training data, but its distinctive claim is that the synthetic data must encode penumbra physics rather than only hard shadow masks. This places it near, but not identical to, other recent RSI frameworks. SARU unifies detection and removal through DBCSF-Net and the training-free N\(^2\)SGSR algorithm, emphasizing single-image restoration without paired training data [2604.25432]. deSEO addresses the satellite case by turning S-EO into a geometry-aware weakly paired benchmark and pairing it with a DSM-aware deshadowing model [2605.03610]. ShadowGS moves in a different direction, using 3D Gaussian Splatting to disentangle geometry, albedo, and shadow-consistent illumination in multi-temporal satellite reconstruction [2601.00939].

This suggests that AeroDeshadow is best understood as an optical ASI framework centered on synthetic paired supervision and explicit penumbra modeling, rather than as a training-free single-image method or a 3D inverse-rendering system. Its nearest conceptual neighbors outside remote sensing are shadow-removal models that challenge hard-mask assumptions, such as DeS3’s adaptive attention for soft and self shadows [2211.08089], but AeroDeshadow relocates that concern to the much larger spatial scales and radiometric constraints of aerospace imagery.

The paper is relatively light on an explicit limitations section, but several limitations are implicit. The framework depends on shadow masks and morphological decomposition; its physical shadow model is still simplified, primarily a linear channel-wise attenuation plus bias; it is targeted at cast shadows in optical ASI and is less directly framed for cloud shadows or stronger atmospheric interactions; and the two-stage design increases system complexity. The authors accordingly identify two future directions: integrating deshadowing into downstream ASI tasks such as object detection and segmentation, and extending the physical degradation model to more complex atmospheric occlusions, especially cloud shadows [2604.15903].

Source: https://www.emergentmind.com/topics/aerodeshadow