Matrix-Field Weighted MSE Model

• The matrix-field weighted MSE model is a framework that generalizes classical MSE by using a linear matrix functional to account for both diagonal and off-diagonal elements.
• It enables optimal transceiver design in MIMO systems by leveraging water-filling strategies and exploiting matrix-monotonicity properties.
• Key applications include sum-MSE minimization, capacity maximization, and high-dimensional Bayesian inference with performance concentration guarantees.

The matrix-field weighted mean-square-error (MSE) model is a framework for generalizing classical mean-square-error-based design from scalar or vector forms to the full matrix field, enabling richer design criteria and analysis in multi-antenna signal processing, Bayesian inference, and high-dimensional statistical models. The core concept replaces traditional vector-field weighting—where only diagonal elements are considered—with a linear matrix operation that incorporates all entries, including off-diagonals, of the MSE matrix. This framework has been formalized for MIMO transceiver design (Xing et al., 2013) and studied in high-dimensional Bayesian inference (Barbier, 2019).

1. Mathematical Definition and Formulation

The traditional MSE matrix in a linear MIMO system with transmit signal $s\in\mathbb{C}^{N_{\rm Dat}\times 1}$, precoder $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$, channel matrix $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$, and noise $n\sim\mathcal{CN}(0,R_n)$ is given for a linear equalizer $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$ by

$$\Phi(G,F) = \mathbb{E}\left\{(Gy-s)(Gy-s)^H\right\}.$$

The matrix-field weighted MSE model introduces a linear matrix functional $\Psi$:

$$\Psi(G,F) = \mathcal{W}\bigl(\Phi(G,F)\bigr) = \sum_{k=1}^K W_k^H \Phi(G,F) W_k + \Pi,$$

where $W_k$ are design-specified weighting matrices (not necessarily square) and $\Pi \succeq 0$ is a Hermitian constant matrix. This operation enables the mixing of all entries of the original MSE matrix, in contrast to vector-field weighting which only assigns weights to individual MSE outputs. In a Bayesian inference setting, the analogous object is the random posterior covariance field:

$F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$0

with $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$1 the signal and $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$2 the observations (Barbier, 2019).

2. General Transceiver Design Objective

The matrix-field weighted MSE model underpins a broad class of transceiver optimization problems. The general design objective is to minimize an increasing matrix-monotone function $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$3 (that is, $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$4) of $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$5, subject to a transmit power constraint:

$F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$6

It is well established that the linear minimum mean-square-error (LMMSE) equalizer

$F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$7

minimizes $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$8 in the Loewner order for any $F\in\mathbb{C}^{N_{\rm Tx}\times N_{\rm Dat}}$9. Due to the matrix-monotonicity of both $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$0 and $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$1, the optimal equalizer is always $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$2. Thus the problem reduces to:

$H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$3

where $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$4 is a matrix-monotone decreasing function derived from $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$5 (Xing et al., 2013).

3. Structure of Optimal Solutions

Optimal precoders $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$6 in the matrix-field weighted MSE framework have a unitary-diagonal structure. Let $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$7 be the singular value decomposition (SVD), where $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$8 is diagonal with non-negative singular values in decreasing order. Then, the optimal $H\in\mathbb{C}^{N_{\rm Rx}\times N_{\rm Tx}}$9 admits the structure

$n\sim\mathcal{CN}(0,R_n)$0

where $n\sim\mathcal{CN}(0,R_n)$1 is a rectangular diagonal matrix of singular values $n\sim\mathcal{CN}(0,R_n)$2, and $n\sim\mathcal{CN}(0,R_n)$3 is a unitary matrix whose columns are chosen to align the eigen-directions associated with the weighting matrices $n\sim\mathcal{CN}(0,R_n)$4 and $n\sim\mathcal{CN}(0,R_n)$5 to minimize the objective. This structure allows for simultaneous diagonalization and efficient solution via water-filling (Xing et al., 2013).

4. Key Special Cases and Relation to System Design

Two notable specializations of the matrix-monotone objective yield established system design problems:

• Sum-MSE Minimization: For $n\sim\mathcal{CN}(0,R_n)$6, the problem reduces to a classical weighted sum-MSE transceiver design, with solution via water-filling on the channel singular values. The optimal $n\sim\mathcal{CN}(0,R_n)$7 diagonalizes $n\sim\mathcal{CN}(0,R_n)$8, leading to independently weighted channels.
• Capacity Maximization: For $n\sim\mathcal{CN}(0,R_n)$9, the objective is equivalent to minimizing the output covariance determinant, i.e., maximizing mutual information. Optimal $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$0 diagonalizes $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$1, and water-filling again produces the closed-form power allocation. This formulation coincides exactly with dual-hop amplify-and-forward (AF) MIMO relaying capacity maximization (Xing et al., 2013).

The following table summarizes these cases:

Objective	$G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$2	Optimal $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$3 aligns with
Sum-MSE Minimization	$G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$4	EVD of $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$5
Capacity Maximization	$G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$6	EVD of $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$7

5. Interpretations, Insights, and Generalizations

The matrix-field weighting framework substantially extends the versatility of linear transceiver designs and high-dimensional inference models. For dual-hop AF MIMO systems, the first-hop preprocessing at the relay effectively implements a matrix-field weighting of the second-hop MSE. This observation explains the formally identical transceiver architectures between AF-MIMO relaying and the point-to-point MIMO case, and reveals AF relaying as an explicit instance of matrix-field weighting (Xing et al., 2013).

In Bayesian inference tasks where the signal is a random matrix (e.g., committee machine neural networks, spiked matrix or tensor models), the matrix-field MSE, defined as the posterior covariance

$G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$8

can be analyzed for its concentration properties in the high-dimensional regime. Under appropriate assumptions, each entry of $G\in\mathbb{C}^{N_{\rm Dat}\times N_{\rm Rx}}$9 concentrates exponentially around its mean as $$\Phi(G,F) = \mathbb{E}\left\{(Gy-s)(Gy-s)^H\right\}.$$0:

$$\Phi(G,F) = \mathbb{E}\left\{(Gy-s)(Gy-s)^H\right\}.$$1

allowing single-letter characterizations of mutual information and MSE in such models (Barbier, 2019).

6. Applications and Broader Implications

The matrix-field weighted MSE model subsumes a wide array of performance criteria—beyond classical sum-MSE and capacity—including those relevant to error rates, fairness, and information-theoretic quantities, all handled within a single optimal design paradigm. It provides the mathematical machinery for the rigorous analysis and optimization of modern multi-antenna transceivers, multi-hop relaying, and statistical learning in high-dimensional settings.

• MIMO Transceiver Design: Unified framework for optimizing performance criteria under transmit power constraints.
• Dual-hop AF MIMO Relaying: Exact equivalence between relay preprocessing and matrix-field weighting.
• High-dimensional Bayesian Inference: Enables concentration of the posterior MSE and single-letter formulas for mutual information, critical for spiked matrix models, tensor PCA, multi-layer GLMs, and committee machines (Xing et al., 2013, Barbier, 2019).

The development and formalization of the matrix-field weighted MSE model have facilitated significant progress in both communication theory and statistical inference by leveraging majorization, matrix inequalities, and monotonicity properties to produce tractable, low-complexity, yet comprehensive solutions.