---
title: Noise Addition and Removal Process
url: https://www.emergentmind.com/topics/noise-addition-and-removal-process
type: topic
---

# Noise Addition and Removal Process

Noise addition and removal processes are fundamental procedures in signal and image analysis, affecting fields as diverse as digital communications, biomedical imaging, seismic exploration, remote sensing, and quantum-enabled measurement. Contemporary research covers an array of statistical models, transform-domain methods, sparse reconstruction, advanced filtering, diffusion processes, hardware quantum simulation, and even constructive uses of noise. The following sections provide a technical overview of the models, principles, algorithms, and applications referenced in recent research, emphasizing their mathematical structure, typical use-cases, and performance-critical considerations.

## 1. Mathematical Noise Models and Statistical Assumptions

Noise in imaging and signal systems is described statistically, with models tailored to the source and nature of corruption:

- **Additive White Gaussian Noise (AWGN):** The most common, where $y = x + n$ and $n \sim \mathcal{N}(0, \sigma^2)$ are independent identically distributed.
- **Impulse Noise:** Includes “salt-and-pepper” (pixels randomly set to minimum or maximum values) and random-valued impulse noise. Such contamination is non-Gaussian, heavy-tailed, and spatially sparse [0812.2892, 1111.3240].
- **Multiplicative (Speckle) Noise:** Modeled as $y = x \cdot \epsilon$, with $\epsilon$ random—typical in coherent imaging like SAR or ultrasound [2408.10283, 2410.21946].
- **Signal-Dependent Noise:** Found in camera sensors; the model often takes the form $\sigma_y(x) = \sqrt{\sigma_r^2 + \sigma_s^2 x}$, with shot (Poisson) and read (Gaussian) noise components [2306.16052].
- **Periodic, Poisson, Rayleigh, Exponential, Erlang Noise:** Each with distinct probability distributions, representing physical processes such as electrical interference, photon counting, or laser/optical effects [2410.21946].

The suitability of removal or restoration techniques depends critically on these statistical properties. For example, transform-based denoising typically targets additive Gaussian contamination, while sparse component analysis exploits the spatial sparsity of impulse noise.

## 2. Transform-Domain and Sparse Component Analysis Approaches

Many state-of-the-art removal methods leverage transform sparsity:

- **Discrete Cosine Transform (DCT) Sparsity:** Natural images have compact DCT representations; thus, coefficients beyond the effective rank (esp. in zigzag order as in JPEG) are nearly zero [0812.2892]. By modeling the noisy image $X$ as $X = S + E$ and observing $T(X) = T(S) + T(E)$ in the DCT domain, one sets up an underdetermined linear system, $x = H \cdot Z(E)$, where $x$ is the “zero region” of the observed coefficients. Sparse component analysis (SCA) is then used, with algorithms such as basis pursuit, FOCUSS, or smoothed-$\ell_0$ methods, to reconstruct sparse impulse error patterns. The salt-and-pepper variant simplifies the detection and leads to a truncation of the mixing matrix.
- **Wavelet-Based Sparse Signal Processing:** Impulse noise removal (especially salt-and-pepper) can be recast as a sparse reconstruction problem in the wavelet (e.g., dual-tree complex wavelet) domain [1111.3240]. Using the Iterative Method with Adaptive Thresholding (IMAT), a 2D extension of greedy sparse recovery, the method alternates between enforcing data consistency in known “clean” pixel locations and sparsity via hard-thresholding in the wavelet domain.
- **Diffusion Model Adaptations:** Advanced methods adapt denoising diffusion probabilistic models (DDPMs) for spatially-varying, realistic noise [2306.16052]. For example, SVNR assigns each pixel a spatially-dependent noise “time” embedding. The noise removal process is then a series of reverse diffusion steps that begin directly from the noisy image, allowing spatial adaptation and alignment with the underlying sensor noise statistics.

## 3. Filtering, Variational, and Hybrid Regularization Schemes

Noise filtering encompasses both classical and advanced adaptive strategies:

- **Median and Nonlinear Filters:** Median filters are optimal for impulse (salt-and-pepper) noise but are suboptimal at higher densities or for mixed noise; adaptive schemes switch dynamically between median and mean filtering based on local corruption density or window statistics [1504.02856, 2204.09302]. Cascaded approaches (DMF+MDBUTMF, etc.) split the denoising into preliminary (low density) and secondary (high density) filtering stages, significantly improving restoration over classical methods.
- **Variational Regularization:** For mixed noise (AWGN + impulse), standard pipelines apply a rank order filter followed by a Gaussian denoiser. However, the presence of heavy-tailed residuals degrades performance [1811.00244]. A variational step with an $\ell_1$-norm data fidelity term (robust to outliers) and local, edge-preserving regularizer significantly “Gaussianizes” the noise and improves subsequent denoising.
- **Joint Adaptive Statistical Priors (JASP):** The De-JASP variational scheme [1508.07415] integrates both local (curvelet transform–based) and non-local statistical priors (grouped 3D transform–based self-similarity). An alternating minimization (split Bregman) algorithm alternates between quadratic, soft-thresholding, and shrinkage steps, achieving strong results (PSNR, SSIM) across Gaussian–impulse mixtures.
- **Minimum Mean Square Error (MMSE) Estimation:** Classical MMSE estimators combine local statistics (sample covariance) with assumed noise models, often requiring pseudo-inverse solvers and SVD-based computation to account for local structure and noise [1907.06834].

## 4. Algorithmic Innovations in Complex or Physical Domains

Recent research extends beyond standard digital filtering:

- **Entropy Quantum Computing (EQC):** A hardware-based method observes that in quantum-limited measurements (e.g., LiDAR), noise quanta (photons) obey Poissonian statistics [2502.08591]. The EQC approach reconstructs the noise photon distribution across measurement modes by minimizing a Hamiltonian whose ground state represents maximum spatial (or temporal) signal correlation under the Poissonian constraint. Optimization is carried out physically (e.g., Dirac-3 hardware with quantum Zeno effect), providing a hardware acceleration over NP-hard classical optimization for strong-noise regimes.
- **SDE-based Perception-Oriented Despeckling:** Multiplicative (speckle) noise is modeled as a Geometric Brownian Motion SDE in the log-domain, enabling the reverse (denoising) process to be derived analytically via the Fokker-Planck and Anderson theorems [2408.10283]. The forward process increments in log-space represent Gaussian noise, thereby reducing the task to score-matching as in classic diffusion models. Probabilistic or ODE-based reverse sampling then yields denoised images.
- **Universal Sampling Denoising (USD):** For non-Cartesian MRI data, noise after regridding is spatially inhomogeneous and correlated. The USD pipeline first “whitens” channels via coil noise covariance estimation, then spatially decorrelates via a regridding covariance (obtained from the kernel), next applies PCA-based denoising (MPPCA) under restored i.i.d. conditions, and finally renormalizes for signal amplitude [2311.16316]. This enables previously inapplicable matrix-projection denoising to be used in MRI with arbitrary $k$-space trajectories.

## 5. Noise Addition as an Information Preservation Technique

Counterintuitively, adding noise can in some cases enhance signal processing:

- **Dithering in Digitization:** When reducing quantization levels (e.g., to binary or ternary images), adding controlled randomization prior to quantization (dithering) smooths out contours and preserves perceived tones that would be lost by strict thresholding [1608.04824]. The model $x_d = Q(x + \eta)$, with $Q$ quantization and $\eta$ dither noise, ensures that, in aggregates, the local mean matches the original grey level.
- **Stochastic Resonance:** In biological and physical threshold systems, added noise allows weak subthreshold signals to be amplified or become detectable. This principle is modeled by $dx/dt = -dU/dx + Asin(\omega t) + \xi(t)$, with transitions over energy barriers optimally driven by a finite noise “temperature”. Ant colony foraging and neural detection are cited as systems optimized for resonance-like information throughput [1608.04824].
- **Intentional Noise Generation in Rendering/Compression:** Physically and biologically inspired methods extract and store a compact, intensity-dependent noise model during image encoding (e.g., a power law in gamma-corrected color channels), and at decoding regenerate synthetic, high-frequency, perceptually plausible noise aligned with the original scene’s statistics [1803.09165]. This recreates “grain” lost in lossy compression—user studies show preferences align with levels inferred from the model.

## 6. Pattern Recognition, Deep Learning, and Hybrid Solutions

Noise removal for complex or real-world signals often requires data-driven and adaptive techniques:

- **Deep CNNs and Autoencoders:** Fully convolutional denoising autoencoders (FCN-DAE), U-Nets, and encoder-decoder architectures have been applied to tasks such as removing coherent seismic noise [2110.13192], EEG artifact correction [2308.02437], and self-supervised hyperspectral denoising [2403.17757]. In these, paired or self-supervised training regimes (e.g., Noise2Noise) allow effective learning even without access to clean ground truth.
- **Canonical Correlation Analysis (CCA) with Reference Noise:** The iCanClean algorithm applies CCA to find shared subspaces between multichannel data and explicit reference noise measurements, removing strongly correlated components via least-squares projection. The method’s efficiency makes it practical for real-time BCI preprocessing [2201.11798].
- **Advanced Filtering in Biomedical and Remote Sensing:** Adaptive approaches combine empirical mode decomposition (EMD), wavelet boost/thresholding, least squares regression with sparsity (DLSR), and Kalman filtering, sometimes in hybrid combinations tailored to artifact signature and measurement context (e.g., motion, muscle, line noise in EEG) [2308.02437].

## 7. Comparative Assessments and Application Domains

Table: Match of Filtering Algorithms to Noise Types and Application Domains

| Noise Type         | Optimal Filtering Strategy         | Application Domains                                               |
|--------------------|-----------------------------------|------------------------------------------------------------------|
| Gaussian           | Wiener, Gaussian                  | Medical imaging, FTIR spectroscopy, communications, radar        |
| Salt & Pepper      | Median, cascaded median–mean      | Photography, surveillance, medical imaging, remote sensing       |
| Impulse/Random     | SCA, sparse signal reconstruction | Satellite, MRI, transmission with erasure (channel coding)       |
| Speckle            | SDE-based, bilateral, BM3D        | SAR Imaging, laser/ultrasound, satellite, optical instrumentation|
| Mixed Gaussian+Imp | De-JASP, variational split-Bregman| General imaging, remote sensing, consumer photography            |
| Coherent noise     | CNN encoder-decoder, CCA          | Seismic, EEG, BCI, aircraft/remote sensing telemetry             |
| Quantum noise      | Entropy Quantum Computing         | LiDAR, astrophysics, quantum-limited sensor systems              |

Noise removal is highly context- and model-sensitive: for instance, transform-based SCA schemes are superior for low-rank, locally sparse impulse events; bilateral and non-local means tackle signal-dependent noise; perception-based approaches maximize fidelity in generative or simulation-driven visual tasks.

## References

- Sparse Component Analysis (SCA) in Random-valued and Salt and Pepper Noise Removal [0812.2892]
- Salt-and-Pepper Noise Removal Based on Sparse Signal Processing [1111.3240]
- High Density Noise Removal by Cascading Algorithms [1504.02856]
- Mixed Gaussian-Impulse Noise Removal from Highly Corrupted Images via Adaptive Local and Nonlocal Statistical Priors [1508.07415]
- Noise and Function [1608.04824]
- Noise generation for compression algorithms [1803.09165]
- A Variational Step for Reduction of Mixed Gaussian-Impulse Noise from Images [1811.00244]
- Image De-Noising For Salt and Pepper Noise by Introducing New Enhanced Filter [1901.06528]
- Noise Removal of FTIR Hyperspectral Images via MMSE [1907.06834]
- Sentinel-1 Additive Noise Removal from Cross-Polarization Extra-Wide TOPSAR with Dynamic Least-Squares [2107.05437]
- Convolutional encoder decoder network for the removal of coherent seismic noise [2110.13192]
- The iCanClean Algorithm: How to Remove Artifacts using Reference Noise Recordings [2201.11798]
- Adaptive Non-linear Filtering Technique for Image Restoration [2204.09302]
- SVNR: Spatially-variant Noise Removal with Denoising Diffusion [2306.16052]
- Noise removal methods on ambulatory EEG: A Survey [2308.02437]
- Universal Sampling Denoising (USD) for noise mapping and noise removal of non-Cartesian MRI [2311.16316]
- Noise2Noise Denoising of CRISM Hyperspectral Data [2403.17757]
- Perception-based multiplicative noise removal using SDEs [2408.10283]
- Analyzing Noise Models and Advanced Filtering Algorithms for Image Enhancement [2410.21946]
- Noise Reversal by Entropy Quantum Computing [2502.08591]

Source: https://www.emergentmind.com/topics/noise-addition-and-removal-process