---
title: Widely Linear Models in Complex Signal Processing
url: https://www.emergentmind.com/topics/widely-linear-models
type: topic
---

# Widely Linear Models in Complex Signal Processing

Widely linear models are complex-domain models that process an observation together with its complex conjugate, replacing the strictly linear form \(\hat{x}=Wy\) by \(\hat{x}=Wy+Vy^*\). They are the natural second-order models for improper or noncircular data, because covariance alone does not characterize such processes and the pseudo-covariance must also be retained. In classical estimation, this framework is especially important when real-valued parameter vectors are inferred from complex measurements, where conventional BLUE or LS estimators can return complex-valued estimates and fail to exploit the known real structure [1612.04060] [1704.08825].

## 1. Statistical structure and the basic widely linear form

In complex-valued signal processing, an estimator or filter is usually called strictly linear if it has the form
\[
\hat{x} = Wy,
\]
where \(y\in\mathbb{C}^{N_y}\) is a complex measurement vector. A widely linear estimator uses both \(y\) and its complex conjugate:
\[
\hat{x} = Wy + Vy^*.
\]
This is strictly more general, since \(V=0\) recovers the conventional linear estimator. The construction is not complex-linear, but it is real-linear; equivalently, it is linear on the augmented pair \((y,y^*)\) [1612.04060].

The relevant second-order statistics are the covariance and pseudo-covariance. For a complex random vector \(y\) with mean \(m_y=E[y]\),
\[
C_y = E\big[(y-m_y)(y-m_y)^H\big], \qquad
P_y = E\big[(y-m_y)(y-m_y)^T\big].
\]
If \(P_y=0\), \(y\) is proper or circular; if \(P_y\neq 0\), \(y\) is improper or noncircular. Real-valued vectors form the extreme case of impropriety in the complex embedding, since for \(a\in\mathbb{R}^N\), covariance and complementary covariance coincide [1704.08825].

A compact way to encode these statistics is the augmented vector
\[
\underline{y}=
\begin{bmatrix}
y\\
y^*
\end{bmatrix},
\]
with augmented covariance
\[
\underline{C}_{yy}=
\begin{bmatrix}
C_y & P_y\\
P_y^* & C_y^*
\end{bmatrix}.
\]
Strictly linear processing uses only \(C_y\), whereas widely linear processing accesses the full augmented covariance. This is why widely linear estimators can achieve lower MSE or lower variance than strictly linear estimators when the data are improper [1612.04060].

## 2. Classical linear estimation and the limitation of strictly linear models

A central model in the literature is the classical linear measurement equation
\[
y = Hx + n,
\]
with \(x\in\mathbb{R}^{N_x}\) a deterministic but unknown real-valued parameter vector, \(y\in\mathbb{C}^{N_y}\) a complex measurement vector, \(H\in\mathbb{C}^{N_y\times N_x}\) a complex measurement matrix, and \(n\) zero-mean complex noise [1612.04060].

If the estimator is restricted to be linear in \(y\) and unbiased, the standard BLUE is
\[
\hat{x}_{\mathrm{B}}=
\left(H^H C_{nn}^{-1}H\right)^{-1}H^H C_{nn}^{-1}y.
\]
Under proper noise, the standard BWLUE for complex parameters collapses to the same expression. However, when \(H\) and \(n\) are complex while \(x\) is known to be real, this estimator is generally complex-valued. Its imaginary part cannot correspond to any true parameter value, and taking only \(\Re\{\hat{x}_{\mathrm{B}}\}\) is only a heuristic correction; it is optimal only in special cases, such as when \(H^H C_{nn}^{-1}H\) is real [1704.08825].

The same structural issue appears for least squares. Treating \(x\) as complex yields the standard LS solution
\[
\hat{x}_{\mathrm{LS}}=(H^H H)^{-1}H^H y,
\]
but this is not the true LS solution under the real-valued constraint on \(x\). A purely real composite model, obtained by stacking real and imaginary parts, is equivalent to the correct constrained problem, but it obscures the compact complex-domain structure. Widely linear models preserve that structure while enforcing the real-valued nature of the estimate [1704.08825].

## 3. Best widely linear unbiased estimation for real-valued parameter vectors

The main estimator derived in "Best Widely Linear Unbiased Estimator for Real Valued Parameter Vectors" addresses the case \(x\in\mathbb{R}^{N_x}\) directly. Starting from the componentwise widely linear form
\[
\hat{x}_i = e_i^H y + f_i^H y^*,
\]
the condition for \(\hat{x}_i\) to be real-valued for all realizations of \(y\) is
\[
e_i^H = f_i^T.
\]
Hence the estimator becomes
\[
\hat{x}_i = e_i^H y + e_i^T y^*,
\qquad
\hat{x}=Ey+E^*y^*.
\]
Classical unbiasedness requires
\[
E_n[\hat{x}_i]=x_i \quad \text{for all } x,
\]
which yields the constraint
\[
e_i^H H + e_i^T H^* = u_i^T,
\]
where \(u_i^T\) is the \(i\)-th canonical row vector [1612.04060].

For proper noise, minimizing the estimator variance under this constraint produces
\[
E=
\left(
H^H C_{nn}^{-1}H + H^T (C_{nn}^{-1})^* H^*
\right)^{-1}
H^H C_{nn}^{-1},
\]
and therefore
\[
\hat{x}=Ey+E^*y^*.
\]
The most transparent expression is
\[
\hat{x}
=
\left(\Re\{H^H C_{nn}^{-1}H\}\right)^{-1}
\Re\{H^H C_{nn}^{-1}y\}.
\]
This estimator is real-valued by construction and unbiased in the classical sense [1612.04060].

Its covariance matrix simplifies to
\[
C_{\hat{x}\hat{x}}
=
\left(
H^H C_{nn}^{-1}H + H^T (C_{nn}^{-1})^* H^*
\right)^{-1}
=
\left(2\Re\{H^H C_{nn}^{-1}H\}\right)^{-1}.
\]
By contrast, the BLUE covariance is
\[
C_{\hat{x}\hat{x}}^{(\mathrm{BLUE})}
=
\left(H^H C_{nn}^{-1}H\right)^{-1}.
\]
The proposed estimator therefore exploits the real-valued parameter structure that BLUE and the standard proper-noise BWLUE do not use; the paper states that it in general outperforms BLUE and BWLUE in terms of the variances of the vector estimator’s elements [1612.04060].

A broader formulation in [1704.08825] allows improper noise by replacing the ordinary covariance with the augmented noise covariance
\[
\underline{C}_{nn}=
\begin{bmatrix}
C_{nn} & \tilde C_{nn}\\
\tilde C_{nn}^* & C_{nn}^*
\end{bmatrix},
\]
and writing
\[
\hat{x}_{\mathrm{BWLUE\mbox{-}real}}
=
G_{\mathrm{BW}}\, y,
\qquad
G_{\mathrm{BW}}
=
\left(\widetilde{H}^H \underline{C}_{nn}^{-1}\widetilde{H}\right)^{-1}
\widetilde{H}^H \underline{C}_{nn}^{-1},
\]
with \(\widetilde{H}=[\,H\;\;H^*\,]\). Under proper noise this reduces to the compact real-part formula above [1704.08825].

## 4. Widely linear least squares and measurement efficiency

The least-squares analogue of the real-valued constrained estimator is the widely linear least squares estimator. For the real-valued parameter vector \(x\), minimizing
\[
J(x)=(y-Hx)^H(y-Hx)
\]
over \(x\in\mathbb{R}^{N_x}\) gives
\[
\hat{x}_{\mathrm{WLLS}}
=
(\widetilde{H}^H\widetilde{H})^{-1}\widetilde{H}^H y,
\qquad
\widetilde{H}=[\,H\;\;H^*\,].
\]
Using \(\widetilde{H}^H\widetilde{H}=2\Re\{H^H H\}\) and \(\widetilde{H}^H y = 2\Re\{H^H y\}\), this becomes
\[
\hat{x}_{\mathrm{WLLS}}
=
\big(\Re\{H^H H\}\big)^{-1}\Re\{H^H y\}.
\]
Thus WLLS is the LS solution that respects the real-valued structure without leaving complex notation [1704.08825].

The weighted version is
\[
\hat{x}_{\mathrm{WWLLS}}
=
(\widetilde{H}^H W \widetilde{H})^{-1}\widetilde{H}^H W y
=
\big(\Re\{H^H W H\}\big)^{-1}\Re\{H^H W y\},
\]
with \(W=W^H\). If \(H^H H\) is real, then
\[
\hat{x}_{\mathrm{WLLS}} = \Re\{\hat{x}_{\mathrm{LS}}\},
\]
but otherwise WLLS strictly improves upon the real-part heuristic [1704.08825].

The same paper emphasizes a measurement-efficiency consequence. In the equivalent real-composite model, full column rank requires
\[
2N_y \ge N_x.
\]
Hence only half as many complex measurements as real parameters are needed:
\[
N_y \ge \frac{N_x}{2}.
\]
This is a structural gain: widely linear estimators tailored to real-valued \(x\) use \(2N_y\) real equations, whereas standard estimators designed for complex \(x\) effectively estimate \(2N_x\) real unknowns [1704.08825].

## 5. Applications in communication and signal processing

Widely linear models are used whenever data or impairments create noncircularity. The core signal-processing examples listed in the literature include communications with noncircular constellations, IQ imbalance and mixer imperfections, array processing with noncircular sources, adaptive filtering, and widely linear MMSE filtering in MIMO systems [1612.04060].

A recurrent estimation example is the recovery of a real-valued impulse response from complex spectral measurements. In [1612.04060], the proposed BWLUE for real parameter vectors was evaluated for a discrete-time impulse response \(x\in\mathbb{R}^5\) using 20 equidistant frequency-response measurements. The new estimator provided a significant performance improvement, almost matching WLMMSE for moderate noise variances, and outperformed BLUE/BWLUE by about two orders of magnitude in average BMSE across the full range of \(\sigma_n^2\) considered. In [1704.08825], the same problem was revisited in a more involved setting with noisy magnitude and phase measurements, where a two-step "WLLS + BWLUE-real" approach nearly attained an oracle bound obtained from true noise statistics.

In full-duplex direct-conversion radio, transmitter and receiver IQ imbalance make the dominant digital self-interference waveform widely linear in the transmitted data, rather than purely linear. The paper "Widely-Linear Digital Self-Interference Cancellation in Direct-Conversion Full-Duplex Transceiver" models the residual self-interference as
\[
y_{\mathrm{ADC}}(n)\approx h_1(n)\star x(n)+h_2(n)\star x^*(n)+z(n),
\]
and shows that classical linear cancellation leaves the conjugate component essentially untouched, whereas widely linear digital cancellation suppresses both terms [1402.6083].

In downlink precoding, widely linear processing is particularly effective when the transmitted symbols are real-valued. "Low-Complexity Widely-Linear Precoding for Downlink Large-Scale MU-MISO Systems" formulates WL-MMSE precoding in an augmented real-valued model and reports that, in overloaded systems, a polynomial-expansion WL-MMSE precoder with only a few terms achieves a substantially higher sum rate than conventional MMSE precoding [1502.01924]. Closely related work on large-scale MIMO with transmitter IQ imbalance develops WL-ZF, WL-MF, WL-MMSE, and WL-BD precoders, and shows that WL-ZF preserves the same multiplexing gain as ideal ZF while incurring only a minor power loss related to the system scale and IQ parameters [1702.08703].

One-dimensional signalling provides another canonical use case. For multiuser MISO with PAM symbols and widely linear estimation at the receivers, the real-part constraints in WL-ZF and WL-MMSE allow the transmitter to exploit \(2M\) real spatial degrees of freedom. The paper "User Selection and Widely Linear Multiuser Precoding for One-dimensional Signalling" states that widely linear processing can potentially double the number of simultaneous users compared to linear processing of one-dimensionally modulated signals, and proposes a user-selection algorithm that can likewise double the number of simultaneously selected users [1705.09985].

Receiver design for noncircular modulation follows the same logic. In DS-CDMA with BPSK and jamming, a widely linear augmented MMSE receiver combined with multiple-candidate SIC and vector space projection improves both MAI suppression and jamming suppression, because the receiver processes both \(\mathbf{r}\) and \(\mathbf{r}^*\) and explicitly includes the complementary covariance \(E[\mathbf{r}\mathbf{r}^T]\) [1407.1442]. In DFT-precoded OFDM over wideband frequency-selective channels, the WL front-end for real constellations combines \(\mathbf{y}(k)\) and \(\mathbf{y}^*(M-k)\), leading to post-SNR expressions that are closer to the matched-filter bound than those of conventional linear equalizers and DFEs [1307.3724].

## 6. Extensions to machine learning and hypercomplex domains

The same augmented-variable principle extends beyond classical estimators. In complex-valued neural networks, a widely linear layer replaces the strictly linear map \(z=Wa\) with
\[
z = W_1 a + W_2 a^*.
\]
The paper "Widely Linear Complex-valued Autoencoder: Dealing with Noncircularity in Generative-Discriminative Models" uses this transform in every layer of an autoencoder and develops the corresponding backpropagation with \(\mathbb{CR}\) calculus. Its motivation is explicit: strictly linear complex autoencoders are optimal only when the outputs of each layer are independent of the conjugate of the inputs, whereas the widely linear model allows the network to consider all second-order statistics of the inputs [1903.02014].

Hypercomplex generalizations replace conjugation by a larger augmented set. In quaternion processing, a widely linear estimator uses the quaternion regressor together with its three involutions:
\[
\hat{y} = \mathbf{g}^T \mathbf{z}
+ \mathbf{h}^T \mathbf{z}^{\imath}
+ \mathbf{u}^T \mathbf{z}^{\jmath}
+ \mathbf{v}^T \mathbf{z}^{\kappa}.
\]
The augmented quaternion vector
\[
\mathbf{q}^a=
\begin{bmatrix}
\mathbf{q}\\
\mathbf{q}^{\imath}\\
\mathbf{q}^{\jmath}\\
\mathbf{q}^{\kappa}
\end{bmatrix}
\]
plays the same role as \([z;z^*]\) in the complex case: it provides a sufficient representation of second-order structure for quaternion-valued random processes and leads to widely linear MMSE and QLMS constructions [2603.11835].

A different extension appears in low-bit quantization for large language models. "FAIRY2I" proves a lossless mathematical equivalence between a real linear map
\[
\tilde{\mathbf{y}} = \mathbf{R}\tilde{\mathbf{x}}
\]
and a widely linear complex map
\[
\mathbf{y} = \mathbf{U}\mathbf{x} + \mathbf{W}\overline{\mathbf{x}},
\]
with a unique pair \((\mathbf{U},\mathbf{W})\). This equivalence is used to transform pre-trained real-valued Transformer layers into widely linear complex form before phase-aware quantization [2512.02901].

A communications-oriented machine-learning example is "Widely Linear Augmented Extreme Learning Machine Based Impairments Compensation for Satellite Communications," where a complex ELM with augmented hidden layer is combined with a tailored widely linear least-squares output stage. In the reported experiments, CELM-WLLS improved BER performance by approximately \(0.8\) dB over CELMAH while also achieving a two-thirds reduction in computational complexity [2506.14557].

## 7. Scope, misconceptions, and terminological variation

A common misconception is that widely linear processing is only relevant when the noise is improper. The classical estimators in [1612.04060] and [1704.08825] show otherwise: even with proper noise, widely linear processing becomes useful when the parameter vector is known to be real-valued but the observation model is complex-valued. In that setting, the extra structure comes from the parameter space rather than from an improper disturbance.

Another misconception is that widely linear estimation is equivalent to computing a conventional complex estimator and then taking its real part. This is true only in special cases, such as when \(H^H H\) or \(H^H C_{nn}^{-1}H\) is real. In general, WLLS and BWLUE-real impose different optimality conditions and deliver lower variance than \(\Re\{\hat{x}_{\mathrm{LS}}\}\) or \(\Re\{\hat{x}_{\mathrm{BLUE}}\}\) [1704.08825].

The term itself also has a distinct usage outside complex statistical signal processing. In "Transition to Linearity of Wide Neural Networks is an Emerging Property of Assembling Weak Models," "widely linear models" refers to wide neural networks that become approximately linear in parameter space in an \(O(1)\) neighborhood of initialization, with a nearly constant NTK along training. That usage concerns an emergent parameter-space linearization of wide networks, rather than the augmented \((y,y^*)\) framework of complex-valued estimation [2203.05104].

In the signal-processing sense, however, the unifying idea is stable across domains: once the full second-order structure is not captured by a strictly complex-linear map, the model must be augmented. In the complex case this means \(y\) and \(y^*\); in the quaternion case it means the signal and its involutions; in structured estimation with real-valued parameters it means matching the estimator class to the real subspace while retaining compact complex notation. Widely linear models are therefore best understood as the second-order complete linear models for improper or structurally constrained complex data.

Source: https://www.emergentmind.com/topics/widely-linear-models