---
title: 'NSLSR: Nearshore Ship SWIR-LWIR Registration'
url: https://www.emergentmind.com/topics/nearshore-ship-long-short-wave-registration-nslsr
type: topic
---

# NSLSR: Nearshore Ship SWIR-LWIR Registration

Nearshore Ship Long-Short Wave Registration (NSLSR) is a registered nearshore ship dataset of paired short-wave infrared (SWIR) and long-wave infrared (LWIR) images introduced as the data foundation for the single-stage fusion-and-detection framework LSFDNet. In current arXiv usage, NSLSR denotes a benchmark for joint SWIR–LWIR image fusion and ship detection in complex coastal scenes rather than a ship hydrodynamics algorithm. The dataset contains **1,205 registered SWIR–LWIR image pairs** at **640 × 512** resolution and **2,818 annotated objects**, and was created to address the scarcity of practical SWIR–LWIR registered ship datasets and the lack of benchmarks for multimodal nearshore ship perception under variable illumination, fog, shoreline clutter, and partial occlusion [2507.20574].

## 1. Definition, nomenclature, and problem setting

NSLSR is introduced in the paper “LSFDNet: A Single-Stage Fusion and Detection Network for Ships Using SWIR and LWIR” as **“Nearshore Ship Long-Short Wave Registration”**, and the text also refers to it as the **“Nearshore Ship Long-Short Wave Registered Dataset”** [2507.20574]. The operational content of the acronym is the pairing and registration of **LWIR** and **SWIR** image modalities for nearshore ship detection. This suggests that “long-short wave” in this context refers to infrared wavelength bands rather than a coastal hydrodynamic long-wave/short-wave decomposition.

The dataset addresses two gaps identified by the authors. The first is a **data gap**: publicly available registered SWIR–LWIR maritime datasets are described as scarce, with the **Infrared Ship Dataset (ISD)** from Shandong University identified as the only public dataset available before NSLSR for this direction, but limited in scale and diversity. The second is a **task gap**: prior multimodal fusion work is described as concentrating on visible–infrared fusion rather than **SWIR–LWIR fusion**, while maritime ship detection work is described as relying mainly on single-modal imagery [2507.20574].

The target environment is explicitly **nearshore marine scenes** collected over **different time periods** and under **diverse lighting conditions**. The dataset is intended for realistic coastal detection problems where ships must be detected against complex shorelines, sea-surface clutter, weak visibility, and partial occlusion. In the paper’s formulation, NSLSR is not merely an archive of paired imagery; it is the principal benchmark used to train and evaluate a coupled fusion-and-detection network, so dataset design and task design are inseparable [2507.20574].

## 2. Data acquisition, registration, and annotation

NSLSR was collected with a **binocular synchronous system** comprising one SWIR camera and one LWIR camera, both producing images at **640 × 512** resolution [2507.20574]. The SWIR sensor is specified as an **uncooled InGaAs infrared FPA detector** with **15 μm** pixel pitch and **0.9–1.7 μm** spectral response. The LWIR sensor is specified as an **uncooled VOx infrared FPA detector** with **12 μm** pixel pitch and **8–14 μm** spectral response [2507.20574]. The paper does not specify whether this binocular platform was shore-based, vessel-mounted, tripod-mounted, or airborne.

Registration is central to the dataset’s definition. Each SWIR image and LWIR image in a pair is spatially aligned so that corresponding scene content, especially ship targets, occupies matching positions across modalities. The alignment procedure has two stages. First, **rigid transformation correction** between SWIR and LWIR image pairs was **manually corrected**. Second, **soft deformations** were aligned using a **heterogeneous image registration algorithm**, specifically **MINIMA: Modality Invariant Image Matching**. After this two-stage process, the authors **discarded poorly registered pairs** [2507.20574]. The paper does not report a numerical registration-accuracy metric or a separate registration-quality benchmark.

The final dataset contains **1,205 registered SWIR–LWIR image pairs** and **2,818 annotated objects**, with the paper stating that **all ship objects in the images are annotated** [2507.20574]. The annotation regime is effectively single-class ship detection; no multi-class taxonomy is reported. The paper does not specify the annotation file format.

A notable practical issue is the split specification. In the dataset section, NSLSR is said to be divided into **training and testing subsets with a 9:1 ratio**. In the experimental section, however, the reported split is **844 images for training** and **361 images for testing**, which sums to 1,205 but does not match a 9:1 ratio [2507.20574]. The experimentally used split is therefore clearly **844/361**, while the textual ratio statement remains inconsistent. Within the 361-image test set, **118 images** are used for fusion evaluation, whereas the full **361-image** test set is used for detection evaluation. No validation split is described.

## 3. Modal complementarity and nearshore scene content

The rationale for NSLSR rests on the complementary sensing properties of SWIR and LWIR. The paper describes SWIR in general as approximately **0.9–2.5 μm**, while the specific dataset camera operates over **0.9–1.7 μm**; LWIR is given as **8–14 μm** [2507.20574]. SWIR is said to preserve more **texture and structural detail** and to provide strong target-to-water contrast because seawater strongly absorbs SWIR radiation, making the background darker and ships relatively bright. SWIR is also described as having better **fog penetration** than visible imagery and maintaining clarity in thin fog, smoke, and aerosol conditions [2507.20574].

LWIR supplies a different advantage profile. Because it is based on **thermal emission**, it is much less sensitive to illumination changes and remains useful in evening and nighttime conditions. Its weakness is reduced **fine detail and edge sharpness**, attributed in the paper to thermal diffusion and noise [2507.20574]. The fusion problem therefore has a physically grounded objective: preserve **thermal saliency from LWIR** while preserving **detail and texture from SWIR**.

NSLSR’s scene content is defined by the practical difficulties of nearshore detection. The paper repeatedly emphasizes **complex coastal scenarios** and **diverse lighting conditions**, with qualitative examples including **normal lighting**, **evening**, **nighttime**, **fog / low visibility**, **sea-surface clutter/noise**, **complex coastal backgrounds**, **small or weak targets**, and **partial occlusion** [2507.20574]. One highlighted qualitative case involves a small distant boat partly blocked by the mast of a larger nearby vessel. The paper does not provide a finer-grained metadata taxonomy such as exact locations, harbor names, weather labels, or sea-state labels.

The comparison with ISD further clarifies NSLSR’s intended role. ISD is reported to contain **1,044 image pairs** at **300 × 300** resolution, only **28 unique ship instances**, and long-range imagery at **10–12 km** with monotonous backgrounds and limited diversity. NSLSR is positioned instead as a nearshore dataset with more object instances, more diverse backgrounds, and more practical utility for learning both fusion and detection in cluttered coastal settings [2507.20574].

## 4. Use of NSLSR in LSFDNet

NSLSR is the principal benchmark for **LSFDNet**, a **single-stage multimodal fusion-detection network** designed to exploit registered SWIR/LWIR pairs [2507.20574]. The architecture has three named components: **Multi-Task Feature Extraction (MTFE)**, the **Multi-Level Cross-Fusion (MLCF) branch**, and the **Object Detection branch**. The central design decision is to avoid a sequential “fuse first, detect later” pipeline. Instead, fusion and detection are jointly optimized with bidirectional cross-task interaction.

Given registered inputs \(I_{SW}\) and \(I_{LW}\), a base extractor produces shallow features \(F_{SW}\) and \(F_{LW}\). A fusion extractor produces modality-specific fusion features \(\tilde{F}_{SW}\) and \(\tilde{F}_{LW}\), while a YOLO-based detection backbone, cited in the paper as **YOLOv12**, processes the detection stream [2507.20574]. A preliminary fused feature \(F_f\) is passed into the detector, and an attention-weighted detection feature \(F_{det\_attn}\) is returned to the fusion branch. Because NSLSR pairs are spatially registered, these cross-modal and cross-task feature transfers are meaningful at the pixel and feature levels.

The **MLCF** module is the core fusion mechanism. It is composed of **three Multi-Feature Attention (MFA) blocks** and is intended to aggregate complementarity across three axes: **multimodal**, **multiscale**, and **multitask** [2507.20574]. The first MFA fuses \(\tilde{F}_{SW}\) and \(\tilde{F}_{LW}\) into \(F_{f\_H}\); a second path produces \(F_{f\_L}\); a third MFA combines them into the preliminary fused feature \(F_f\). The MFA itself operates at the patch level and uses self-attention within modality and cross-attention across modalities. The paper gives, for example, the SWIR self-attention update as
\[
\overline{F}_{SW}^{p} = \tilde{F}_{SW}^{p} + \mathrm{softmax}\left( \frac{\tilde{Q}_{SW}^{p} \left( \tilde{K}_{SW}^{p} \right)^T}{\sqrt{d_p}} \right)\tilde{V}_{SW}^{p},
\]
with an analogous expression for LWIR, followed by cross-attention between modalities [2507.20574].

NSLSR annotations are used not only for detection supervision but also to shape the fusion objective through the **Object Enhancement (OE) loss**. The total loss is
\[
L = (1-\lambda)L_f + \lambda L_{det},
\]
where \(L_f\) is the fusion loss and \(L_{det}\) is the YOLO detection loss [2507.20574]. The fusion loss is decomposed as
\[
L_f = (1-\sigma)L_f^{global} + \sigma L_f^{object},
\]
with reported hyperparameters
\[
\sigma = 0.2,\qquad \alpha = 0.5,\qquad \beta = 0.5.
\]
A gamma-enhanced LWIR image is defined as
\[
I'_{LW} = 255 \times \left(\frac{I_{LW}}{255}\right)^{\gamma},
\]
and the object-focused loss is built over annotated ship regions. This design is motivated by the claim that generic fusion losses may preserve excessive sea-surface background structure such as undulations, highlights, and glare, whereas NSLSR requires object-sensitive fusion [2507.20574].

## 5. Benchmark protocol, reported performance, and ablation findings

On NSLSR, LSFDNet is trained end-to-end with **Adam**, learning rate \(1 \times 10^{-4}\), **linear decay**, **500 warm-up iterations**, **30,000 total iterations**, and **batch size 8**, on **NVIDIA GeForce RTX 4090** hardware [2507.20574]. Fusion is evaluated on **118 test images** using **EN**, **SF**, **SD**, **SCD**, **VIF/VI**, and **Qabf**. Detection is evaluated on the full **361-image** test set using **Precision (P)**, **Recall (R)**, **mAP\(_{50}\)**, and **mAP\(_{50:95}\)** [2507.20574].

For fusion on NSLSR, LSFDNet reports:
- **EN**: **7.181**
- **SF**: **21.022**
- **SD**: **64.723**
- **SCD**: **1.427**
- **VIF/VI**: **0.611**
- **Qabf**: **0.520**

The paper states that LSFDNet is either best or second-best on all six metrics on NSLSR, and best on **SF**, **SD**, **SCD**, **VIF**, and **Qabf**, while second-best on **EN**, behind DifFusion’s **7.216** [2507.20574]. Qualitatively, the reported interpretation is that LSFDNet suppresses sea-surface noise while preserving ship contours, detail, and brightness.

For detection on NSLSR, the reported results are:
- **SWIR only**: \(P=0.911\), \(R=0.893\), \(mAP_{50}=0.942\), \(mAP_{50:95}=0.666\)
- **LWIR only**: \(P=0.903\), \(R=0.870\), \(mAP_{50}=0.929\), \(mAP_{50:95}=0.628\)
- **SeA + YOLOv12s**: \(P=0.920\), \(R=0.864\), \(mAP_{50}=0.943\), \(mAP_{50:95}=0.689\)
- **IGNet + YOLOv12s**: \(P=0.946\), \(R=0.851\), \(mAP_{50}=0.942\), \(mAP_{50:95}=0.676\)
- **Fusiondif + YOLOv12s**: \(P=0.925\), \(R=0.889\), \(mAP_{50}=0.952\), \(mAP_{50:95}=0.698\)
- **Swin + YOLOv12s**: \(P=0.918\), \(R=0.881\), \(mAP_{50}=0.949\), \(mAP_{50:95}=0.674\)
- **CAFF-DINO**: \(P=0.925\), \(R=0.905\), \(mAP_{50}=0.958\), \(mAP_{50:95}=0.706\)
- **DEYOLO**: \(P=0.938\), \(R=0.885\), \(mAP_{50}=0.956\), \(mAP_{50:95}=0.702\)
- **LSFDNet**: \(P=0.934\), \(R=0.887\), \(mAP_{50}=0.962\), \(mAP_{50:95}=0.770\)

Thus LSFDNet achieves the best reported **mAP\(_{50}=0.962\)** and **mAP\(_{50:95}=0.770\)** on NSLSR [2507.20574]. The strongest listed competitor in \(mAP_{50:95}\) is **CAFF-DINO** at **0.706**, so LSFDNet’s gain is **0.064 absolute**, which the paper describes as about **10%**.

The ablation study is also entirely on NSLSR. For fusion, the full model **M7** reaches the same fusion metrics listed above. The paper states that removing **OE loss** reduces performance, especially **SD**, while removing the entire **MLCF** causes much larger degradation; the authors further state that multimodal aggregation is especially crucial and that feeding detection features back to fusion improves fusion quality [2507.20574]. For detection, removing fusion feature \(F_f\) yields
\[
P=0.905,\quad R=0.854,\quad mAP_{50}=0.953,\quad mAP_{50:95}=0.725,
\]
whereas full LSFDNet gives
\[
P=0.934,\quad R=0.887,\quad mAP_{50}=0.962,\quad mAP_{50:95}=0.770.
\]
This corresponds to gains of **+0.009** in \(mAP_{50}\) and **+0.045** in \(mAP_{50:95}\), supporting the paper’s claim that fusion features materially improve downstream detection on NSLSR [2507.20574].

## 6. Interpretive boundaries, limitations, and relation to adjacent nearshore research

A recurrent source of ambiguity is the acronym itself. In the current literature, NSLSR denotes a **registered SWIR–LWIR nearshore ship dataset** and benchmark [2507.20574]. This can be confused with physically grounded “long-wave/short-wave” ship–wave analysis. The distinction matters because several nearby research directions concern actual nearshore hydrodynamics rather than infrared image registration.

For example, “Down-scale marine hydrodynamic analysis at the Norwegian coast — the NORA-SARAH open framework” presents a multiscale coastal hydrodynamic downscaling chain,
\[
\text{NORA} \rightarrow \text{SWAN} \rightarrow \text{REEF3D::FNPF} \rightarrow \text{ALE} \rightarrow \text{HDC} \rightarrow \text{REEF3D::CFD},
\]
for reconstructing nearshore wave conditions and loads around coastal assets, and its relevance to ships is interpretive rather than a definition of NSLSR [2509.21329]. Likewise, single-point breaking-wave classification from nearshore pressure-gauge records [2308.12046], spectrogram-based identification of linear and nonlinear ship-wake components at fixed sensors [1604.05812], and non-hydrostatic modeling of low-frequency response of moored floating structures in coastal waters [2204.04223] all concern physical wave registration in the hydrodynamic sense, not the SWIR–LWIR image-registration benchmark designated by NSLSR.

Within its own domain, NSLSR has several explicit limitations. The paper does not provide:
- geographic coordinates or named collection sites,
- exact platform mounting details,
- a per-condition breakdown such as day/fog/night counts,
- a class taxonomy beyond ship,
- an annotation file format,
- registration error statistics,
- a validation split [2507.20574].

The split discrepancy between the stated **9:1** partition and the experimentally used **844/361** split is another practical limitation. More broadly, NSLSR is presently tied to a single application family: registered **SWIR–LWIR** fusion and detection in nearshore scenes. It does not itself encode ship dynamics, sea-state metadata, hydrodynamic long-wave/short-wave decomposition, or multimodal synchronization with radar, LiDAR, AIS, GNSS, or wave gauges. A plausible implication is that NSLSR should be viewed as a perception benchmark rather than a complete maritime situational-awareness corpus.

The paper states that **the source code and dataset are available at https://github.com/Yanyin-Guo/LSFDNet** [2507.20574]. That public-release claim is important because NSLSR’s primary significance lies in enabling reproducible work on a modality pairing that had been largely absent from public maritime benchmarks: **registered SWIR + LWIR** under realistic nearshore conditions.

Source: https://www.emergentmind.com/topics/nearshore-ship-long-short-wave-registration-nslsr