---
title: Discriminant Gain in ISAC and Edge AI Systems
url: https://www.emergentmind.com/topics/discriminant-gain-dg
type: topic
---

# Discriminant Gain in ISAC and Edge AI Systems

Discriminant Gain (DG) quantifies class separability in feature space and has recently become a core metric for characterizing inference performance in task-oriented integrated sensing and communication (ISAC) and integrated sensing and edge AI (ISEA) systems. Unlike classical mean squared error (MSE)-based criteria, DG directly connects with detection-theoretic limits, admitting tractable expressions and closed-form optimization in Gaussian mixture settings. It governs the tradeoff between sensing and communication resources, optimally allocates power to maximize inference accuracy, and enables the principled design and benchmarking of ISAC/ISEA pipelines.

## 1. Formal Definition and Mathematical Foundations

DG is defined under the assumption that feature vectors $\bm{x} \in \mathbb{C}^M$ for each class $\ell$ follow a complex Gaussian distribution. The pairwise discriminant gain between classes $i$ and $j$ is
\[
\mathrm{DG}(i,j) = (\bm{\mu}_i - \bm{\mu}_j)^\top \bm{\Sigma}^{-1}(\bm{\mu}_i - \bm{\mu}_j) = \sum_{m=0}^{M-1} \frac{(\mu_{i,m} - \mu_{j,m})^2}{\sigma_m^2}
\]
where $\bm{\mu}_i$ is the mean of class $i$ and $\bm{\Sigma} = \operatorname{diag}(\sigma_0^2, \ldots, \sigma_{M-1}^2)$ the feature covariance.

For multiclass problems, $\mathrm{DG}_{\min} \triangleq \min_{i \neq j} \mathrm{DG}(i, j)$ governs the worst-case separability, serving as a lower-complexity surrogate for inference-oriented system design [2510.20429].

Alternative formulations use the symmetric Kullback-Leibler divergence in multi-view edge AI settings. For views indexed by $k$ and $P_k$ as the subspace projection at sensor $k$,
\[
G_k(\ell, \ell') = (\mu_\ell - \mu_{\ell'})^\top P_k\, C^{-1}\, P_k (\mu_\ell - \mu_{\ell'})
\]
with $C$ the shared covariance [2311.07986].

## 2. Connection to Inference Error Bounds

DG provides a tight link to Bayesian inference errors. For two classes and one-dimensional features,
\[
P_e^{(2)} = Q\left(\sqrt{\frac{\mathrm{DG}}{2}}\right), \qquad \mathrm{DG} = \frac{(\mu_0 - \mu_1)^2}{\sigma^2}
\]
where $Q(x)$ is the Gaussian Q-function. The relation extends to vector features and multiclass cases using the minimum pairwise DG, confining the inference error probability as
\[
P_e \geq (L-1) Q\left(\sqrt{\tfrac{\mathrm{DG}_{\min}}{2}}\right)
\]
Thus, increasing DG—particularly $\mathrm{DG}_{\min}$—monotonically decreases a lower bound on the inference error probability, establishing DG as a critical system-level surrogate [2510.20429].

In multi-view settings, DG predicts the exponential rate at which the entropy (uncertainty) of the predicted class distribution decays with the number of aggregated views $K$. The global DG exponent controls how rapidly
\[
H_s \approx (L - 1) \exp(-\kappa\,\xi\,K), \quad K \gg 1
\]
where $H_s$ is an entropy surrogate, $\kappa$ a constant, and $\xi$ the asymptotic average DG [2311.07986].

## 3. Task-Oriented DG Maximization and System Models

DG-centric system optimization replaces MSE with the direct maximization of DG under power/resource constraints. In the compress-and-estimate ISAC link, each transformed feature $\tilde{x}_n$ is transmitted over a fading channel, and the effective per-subcarrier DG is
\[
\mathrm{DG}_n = \frac{|h_n b_n|^2(\mu_{0,n} - \mu_{1,n})^2}{|h_n b_n|^2 \sigma_n^2 + \sigma_w^2}
\]
where $b_n$ is the transmission gain, $h_n$ the channel coefficient, and $\sigma_w^2$ the communication noise.

The DG-maximization under a total power budget $P_{\sf c}$ becomes
\[
\max_{\{b_n\}} \sum_{n=0}^{N-1} \mathrm{DG}_n \qquad \text{s.t. } \sum_{n=0}^{N-1} |b_n|^2 \nu_n^2 \le P_{\sf c}
\]
with $\nu_n^2 = \mathbb{E}[|\tilde{x}_n|^2]$ [2510.20429].

In edge AI, local and global DGs are constructed via symmetric KL divergence in the projected subspace, and DG's subspace geometry determines how well class means are separated across the pooled sensor network [2311.07986]. 

## 4. Closed-Form DG-Optimal Power Allocation and Water-Filling Structure

The DG-maximization problem is convex in the allocated per-feature powers $\{|b_n|^2\}$ and admits a closed-form, water-filling-type solution:
\[
b_n^{\rm DG} = \frac{e^{-j \angle h_n}}{|h_n|} \sqrt{\left[ \frac{\sigma_w |h_n| |\mu_{0, n}-\mu_{1, n}|}{\nu_n \sqrt{\lambda} \sigma_n^2} - \frac{\sigma_w^2}{\sigma_n^2} \right]^+}
\]
with $\lambda$ a Lagrange multiplier for the power constraint.

Letting $p_n = |b_n|^2 \nu_n^2$,
\[
p_n^{\rm DG} = \left[\frac{|\mu_{0,n}-\mu_{1,n}|}{\sigma_n^2} \frac{\sigma_w}{\sqrt{\lambda}} - \frac{\sigma_w^2}{\nu_n^2} \right]^+
\]
Power is assigned only to features with sufficiently high discrimination-to-noise ratios, turning off weak subcarriers and concentrating resources on the most informative dimensions. This distinguishes DG-water-filling from its MSE-based counterpart, which allocates power more uniformly, even to low-informative features [2510.20429].

## 5. Comparison with MSE-Optimal and Traditional Criteria

Under MSE-optimal design, the system solves
\[
\min_{\{b_n\}} \sum_n \mathrm{MSE}_n \quad \text{s.t.} \ \sum_n |b_n|^2 \nu_n^2 \le P_{\sf c}
\]
with a similar water-filling solution but lacking the emphasis on discrimination power:
\[
b_n^{\rm MSE} = \frac{e^{-j \angle h_n}}{|h_n|} \sqrt{\left[ \frac{\sigma_w |h_n|}{\nu_n \sqrt{\lambda}} - \frac{\sigma_w^2}{\sigma_n^2} \right]^+}
\]
The DG-optimal approach introduces an extra factor $\tfrac{|\mu_{0, n} - \mu_{1, n}|}{\sigma_n^2}$, biasing power allocation toward features with higher class separability. In the low-SNR regime, DG-maximization achieves substantially better power efficiency by shutting off weak subcarriers. In the high-SNR regime, the distinction between DG- and MSE-optimal allocations vanishes as all channels are used and the benefit per dB equalizes [2510.20429].

## 6. Multi-View Aggregation, Channel Effects, and Discriminant Loss

In ISEA, aggregated DG grows linearly with the number of views/sensors, and the geometry of the pooled subspace (as determined by $\bar{P} = \tfrac{1}{K} \sum_k P_k$) controls overall class separability:
\[
G_{\ell, \ell'} = K D_{\ell, \ell'}, \quad D_{\ell, \ell'} = (\mu_\ell - \mu_{\ell'})^\top \bar{P}\,C^{-1}\,\bar{P}\,(\mu_\ell - \mu_{\ell'})
\]
Sensing uncertainty, measured by entropy surrogates, decays exponentially with the product of the global discriminant gain and the number of views:
\[
H_s \approx (L-1) \exp(-\kappa\,\xi\,K)
\]
When transmission occurs over noisy (e.g., AirComp) channels, channel-induced discriminant loss attenuates DG:
\[
A_{\rm loss} = \frac{\tilde{D}(\gamma_{\rm air})}{\bar{D}}
\]
The uncertainty scaling law becomes $H_s(\gamma_{\rm air}) \approx (L-1) \exp(-\kappa\,\xi\,A_{\rm loss}\,K)$, where $A_{\rm loss}\leq 1$ quantifies the effective reduction in discriminability caused by channel noise or distortion [2311.07986].

## 7. Operational Insights: Power-Efficient Inference and Resource Tradeoffs

DG-optimal designs yield several system-level advantages:
- **Selective Feature Activation:** Simulation and empirical studies confirm that for fixed inference accuracy, DG-based resource allocation requires substantially less power than MSE-optimal design by focusing on the most discriminative features or views [2510.20429].
- **Sensing-Communication Tradeoff:** Power savings achieved by DG-optimal communication can be redirected to improve sensing quality, leading to joint design strategies for radar and communication subsystems [2510.20429].
- **Adaptive Aggregation and Access Mode:** In multi-view settings, the exponential convergence rate remains until attenuated by channel effects. Adaptive switching between over-the-air computing and orthogonal access based on the ratio $N/K$ (number of antennas to sensors) allows the system to maintain high global DG and rapid uncertainty decay [2311.07986].

DG thus underpins the design of resource-constrained, inference-optimal ISAC and ISEA links, establishing a unified metric that generalizes across model classes, channel effects, and practical hardware constraints. 

**References**: [2510.20429], [2311.07986]

Source: https://www.emergentmind.com/topics/discriminant-gain-dg