---
title: 'Scoring ISAC: Benchmarking Integrated Sensing'
url: https://www.emergentmind.com/topics/scoring-isac
type: topic
---

# Scoring ISAC: Benchmarking Integrated Sensing

Searching arXiv for the specified paper and closely related ISAC benchmarking work.
Scoring ISAC is a tutorial-style framework for benchmarking integrated sensing and communications (ISAC) systems through score-based generative modeling, introduced in “Scoring ISAC: Benchmarking Integrated Sensing and Communications via Score-Based Generative Modeling” [2508.02117]. In this framework, score functions—gradients of log densities—are learned from data and then used to estimate classical performance metrics such as mutual information (MI), minimum mean squared error (MMSE), Fisher information (FIM), Bayesian Cramér–Rao bound (BCRB), and Kullback–Leibler divergence (KLD) under realistic ISAC conditions. The motivation is that practical ISAC environments involve hardware impairments, multipath propagation, interference, clutter, and scene priors that induce nonlinear, heavy-tailed, multimodal, and non-Gaussian statistics, making analytical evaluation of these metrics intractable or severely mismatched under simplified models [2508.02117].

## 1. Problem Setting and Rationale

Integrated sensing and communications systems share spectrum, signals, and often hardware to simultaneously deliver high-throughput communication and high-accuracy sensing. A canonical model is
$$
y_c = H_c x + z_c
$$
for communication and
$$
y_s = H_s x + z_s
$$
for sensing, where $x$ is the transmit signal, $H_c$ and $H_s$ are the communication and sensing channels, and $z_c, z_s$ are additive noises [2508.02117].

The central benchmarking problem addressed by Scoring ISAC arises because practical operating conditions depart sharply from linear-Gaussian assumptions. The data summary identifies hardware impairments such as PA nonlinearity, IQ imbalance, phase noise, and ADC quantization, as well as multipath, clutter, interference, and scene priors constrained to low-dimensional manifolds. Under such conditions, analytical expressions for MI, MMSE, FIM, and BCRB become difficult to derive or unreliable as performance surrogates [2508.02117].

These metrics are not peripheral quantities. MI is tied both to communication capacity and to expected information gain about the environment; MMSE measures estimation accuracy for quantities such as channels or target parameters; FIM and BCRB quantify fundamental estimation limits and inform waveform, beamforming, precoding, and resource allocation design [2508.02117]. This positions Scoring ISAC as a benchmarking methodology rather than merely a generative-modeling application.

A plausible implication is that the framework is intended to replace assumption-driven performance analysis with data-driven performance analysis when the underlying distributions are unavailable in closed form. This interpretation follows from the paper’s explicit statement that the key idea is to “replace fragile analytical assumptions with data-driven score-based generative modeling” [2508.02117].

## 2. Score-Based Formulation and Metric Identities

The core object is the score function
$$
s(x) = \nabla_x \log p(x),
$$
defined for a random vector $x$ with density $p(x)$ [2508.02117]. Scoring ISAC uses learned approximations of such scores in observation space, parameter space, and posterior space.

The learning mechanism is based on Noise Conditional Score Networks and denoising score matching. Gaussian noise is injected according to
$$
x_t = x + \sigma n,\quad n \sim \mathcal{N}(0,I),
$$
and the practical training objective is the denoising score matching surrogate
$$
L_{\mathrm{DSM}}(\theta)=\mathbb{E}_{\sigma,x,n}\!\left[\lambda(\sigma)\left\|s_\theta(x+\sigma n,\sigma)+\frac{1}{\sigma^2}n\right\|^2\right].
$$
The summary states that $\lambda(\sigma)$ is often chosen as $\sigma^2$, and that learning $s_\theta(\cdot,\sigma)$ at multiple $\sigma$ yields access to score gradients across noise scales [2508.02117].

The framework’s importance rests on exact identities linking classical metrics to score functions. The de Bruijn identity gives
$$
\frac{d}{d\sigma^2} h(Y)=\frac{1}{2}\mathbb{E}\!\left[\|\nabla_y \log p_Y(y)\|^2\right]=\frac{1}{2}J(Y),
$$
for $Y=X+\sqrt{\sigma^2}Z$ with $Z\sim\mathcal{N}(0,I)$, thereby connecting learned observation-space scores to Fisher information and, through entropy, to MI [2508.02117]. For additive Gaussian channels, the I–MMSE relationship is
$$
\frac{d}{d\,\mathrm{snr}} I(X;Y)=\frac{1}{2}\mathrm{MMSE}(\mathrm{snr}),\qquad
I(X;Y)=\frac{1}{2}\int_0^{\mathrm{snr}} \mathrm{MMSE}(t)\,dt,
$$
which allows MI to be recovered from MMSE once MMSE itself is estimated from learned scores [2508.02117].

For estimation-theoretic limits, the parameter-space Fisher information is
$$
J(\theta)=\mathbb{E}_{y|\theta}\!\left[(\nabla_\theta \log p(y|\theta))(\nabla_\theta \log p(y|\theta))^T\right],
$$
and the Bayesian FIM satisfies
$$
J_b=J_d+J_{\mathrm{prior}},
$$
with
$$
J_{\mathrm{prior}}=\mathbb{E}_{p(\theta)}\!\left[(\nabla_\theta \log p(\theta))(\nabla_\theta \log p(\theta))^T\right],\qquad
J_d=\mathbb{E}_{p(\theta)}[J(\theta)].
$$
The corresponding BCRB is
$$
\mathrm{Cov}(\hat\theta)\succeq (J_d+J_{\mathrm{prior}})^{-1}.
$$
The posterior form
$$
J_b=\mathbb{E}_{p(\theta,y)}\!\left[\nabla_\theta \log p(\theta|y)\nabla_\theta \log p(\theta|y)^T\right]
$$
shows that learning the conditional or posterior score alone suffices for BCRB estimation [2508.02117].

The same summary also records the small-perturbation KLD curvature identity
$$
D_{\mathrm{KL}}(p(y|\theta)\|p(y|\theta+\delta))\approx \delta^T J(\theta)\delta,
$$
which links local KLD geometry to Fisher information [2508.02117].

## 3. Practical Estimators and Training Procedure

Scoring ISAC turns the preceding identities into Monte Carlo estimators driven by learned score networks. In observation space, the trace of Fisher information is approximated from samples $\{y_i\}$ by
$$
J(Y)\approx \frac{1}{N}\sum_i \|s_\theta(y_i,\sigma)\|^2,
$$
which then supports entropy and MI estimation via the de Bruijn identity [2508.02117].

For Gaussian denoising models, Tweedie’s formula gives the MMSE estimator
$$
\mathbb{E}[X|Y=y]=y+\sigma^2 \nabla_y \log p_Y(y),
$$
so with a learned score $s_Y(y)\approx \nabla_y\log p_Y(y)$ one forms
$$
\hat X_{\mathrm{mmse}}(y)=y+\sigma^2 s_Y(y),
$$
and estimates
$$
\mathrm{MMSE}(\mathrm{snr})=\mathbb{E}\!\left[\|X-\hat X_{\mathrm{mmse}}(Y)\|^2\right]
$$
by Monte Carlo before integrating over SNR to obtain MI [2508.02117].

For BCRB estimation, the framework supports two implementations. In the posterior approach, one learns $s_\theta(\theta|y)\approx \nabla_\theta \log p(\theta|y)$ and computes
$$
J_b\approx \mathbb{E}[s_\theta(\theta|y)s_\theta(\theta|y)^T].
$$
In the measurement-prior approach, one separately learns a prior score $s_{\mathrm{prior}}(\theta)$ and a measurement score $s_{\mathrm{meas}}(y|\theta)\approx \nabla_\theta \log p(y|\theta)$, obtaining
$$
J_{\mathrm{prior}}\approx \mathbb{E}[s_{\mathrm{prior}}s_{\mathrm{prior}}^T],\qquad
J_d\approx \mathbb{E}[s_{\mathrm{meas}}s_{\mathrm{meas}}^T],
$$
and then
$$
\mathrm{BCRB}=\mathrm{Tr}\!\big((J_{\mathrm{prior}}+J_d)^{-1}\big).
$$
When the likelihood is unknown, the measurement score may be trained via Fisher Score Matching using
$$
L_{\mathrm{FSM}}(\phi)=\mathbb{E}_{p(y)p(\theta)}\!\left[\mathrm{Tr}(\nabla_\theta s_\phi(y|\theta))+\frac{1}{2}\|s_\phi(y|\theta)\|^2+s_\phi(y|\theta)^T \nabla_\theta \log p(\theta)\right]
$$
[2508.02117].

For general MI and KLD estimation beyond standard AWGN settings, the paper introduces a DSM-based path-integral estimator over a virtual AWGN channel $x_t=x+\sigma n$. The identity reported is
$$
-\log p(x)=\int_0^\infty \sigma^{-1}\mathbb{E}_n\!\left[\|n+\sigma \nabla_{x_t}\log p(x_t)\|^2\right]\,d\sigma + C_G,
$$
with a corresponding conditional form, leading to
$$
I(X;Y)=\mathbb{E}_{x,y}\int_0^\infty \sigma^{-1}\mathbb{E}_n\!\left[\|n+\sigma \nabla \log p(x_t)\|^2-\|n+\sigma \nabla \log p(x_t|y)\|^2\right]\,d\sigma.
$$
Replacing the exact gradients with DSM-trained scores yields a practical estimator for MI, and the same integrand supports KLD estimation as well [2508.02117].

The paper’s benchmarking protocol is explicitly staged: dataset creation, score training, metric estimation, validation against analytical or high-accuracy Monte Carlo references where available, and reporting with point estimates, confidence intervals from bootstrap, calibration checks based on denoising residuals, and score-norm diagnostics [2508.02117].

## 4. ISAC-Specific Training Considerations

The framework is tailored to both communication and sensing data generation. For communication, the summary specifies generating $(x,y_c,H_c)$ under realistic waveforms including OFDM and DFT-s-OFDM, together with hardware impairments, interference, and multipath channels. For sensing, it specifies generating $(H_s,y_s,x)$ under near-/far-field geometry, array response, clutter, target RCS models such as Swerling I, motion constraints, and interference [2508.02117]. Conditioning variables can include $H_c$, SNR, bandwidth, array geometry, waveform index, and known parts of the measurement model.

Complex-valued data are handled by stacking real and imaginary parts, a step the summary calls “realification” [2508.02117]. Noise schedules are geometrically discretized between $\sigma_{\min}$ and $\sigma_{\max}$, and classifier-free conditioning is used by dropping $y$ with probability $p_{\mathrm{uncond}}$ so that one network can output unconditional and conditional or posterior scores [2508.02117].

Architecturally, the paper states that U-Nets or MLPs suffice in low- to moderate-dimensional ISAC examples, while 1D or 2D CNNs can exploit array structure. Calibration is emphasized: denoising consistency requires $s(x_t,\sigma)$ to predict $-n/\sigma^2$ on average, and the summary specifically lists EMA weights, spectral normalization, and consistency regularizers as stabilizing techniques [2508.02117]. Heavy-tailed and multimodal statistics are treated as a central use case rather than an edge case; VE SDE training with large $\sigma_{\max}$ is identified as helping global coverage in such settings [2508.02117].

This training guidance aligns with broader ISAC benchmarking efforts that emphasize the mismatch between deterministic or Gaussianized objectives and realistic signal statistics. For example, “Random ISAC Signals Deserve Dedicated Precoding” [2311.01822] formalizes ergodic linear minimum mean square error under finite-frame random signaling, while “Modeling and Analysis of Near-Field ISAC” [2310.10917] shows that accurate electromagnetic modeling can materially alter attainable sensing and communication rates. Scoring ISAC extends this general trend by shifting the benchmarking object from explicitly modeled moments or rates to learned score fields [2508.02117].

## 5. Proof-of-Concept Experiments

The proof-of-concept validation in Scoring ISAC focuses on target detection and target localization [2508.02117]. In the detection experiment, the binary hypotheses are
$$
H_0: y_s[k]=z_s[k],\qquad
H_1: y_s[k]=H_s x+z_s[k],\quad k=1,\ldots,K,
$$
with $z_s[k]\sim \mathcal{CN}(0,\sigma_s^2 I)$ [2508.02117]. The Neyman–Pearson likelihood-ratio test is
$$
\Lambda=\prod_{k=1}^K \frac{p_1(y_s[k])}{p_0(y_s[k])}\mathop{\gtrless}_{H_0}^{H_1}\eta.
$$
When both hypotheses are Gaussian, the analytical relation
$$
D_{\mathrm{KL}}(p_0\|p_1)=\frac{\|H_s x\|^2}{\sigma_s^2}
$$
holds, together with the asymptotic law
$$
-\frac{1}{K}\log(1-P_d)\to D_{\mathrm{KL}}(p_0\|p_1).
$$
With learned scores, the likelihood ratio is approximated by a line integral of score differences,
$$
\Lambda(y)\approx \exp\!\left(\int (s_1(y)-s_0(y))^T\,dy\right),
$$
computed in practice along a diffusion path or straight-line path with trapezoid-rule discretization [2508.02117].

Two cases are reported. When the reflection is known, $\gamma=1$, analytical KLD and analytical $P_d$ match the score-based KLD and the detection performance curve, and $P_d$ grows with KLD as predicted by theory. When the reflection is unknown, $\gamma\sim \mathrm{Exp}(1)$, no closed form is available; a DSM-trained class-conditional score network estimates KLD numerically, and empirical plots show a clear positive correlation between KLD and $P_d$ at fixed $P_{fa}$ [2508.02117].

The localization experiments use parameter vectors $\theta=[x,y]^T$ or $\theta=[x,y,\gamma]^T$ with measurement model
$$
y_s[k]=f(\theta)+z_s[k],\qquad z_s[k]\sim \mathcal{CN}(0,\sigma_s^2 I).
$$
For $\gamma=1$ and Gaussian prior $p(r)=\mathcal{N}(\mu_r,\sigma_r^2 I)$, the analytical expressions are
$$
J_{\mathrm{prior},r}=\frac{1}{\sigma_r^2}I,\qquad
J(r)=\sum_{k=1}^K \frac{2}{\sigma_s^2}\mathrm{Re}\!\left\{\left(\frac{\partial f}{\partial r}\right)^H\left(\frac{\partial f}{\partial r}\right)\right\},
$$
with
$$
J_{b,r}=J_{\mathrm{prior},r}+\mathbb{E}_{p(r)}[J(r)],
$$
and
$$
\mathrm{CRB}=\mathrm{Tr}(J_{d,r}^{-1}),\qquad
\mathrm{BCRB}=\mathrm{Tr}(J_{b,r}^{-1}).
$$
The learned BCRB tracks the analytical BCRB closely for both $\gamma=1$ and $\gamma\sim \mathrm{Exp}(1)$; the summary adds that CRB without a prior is looser at low SNR and that average bounds slightly improve in the exponential-reflection case because $\mathbb{E}[\gamma^2]=2$ increases average SNR [2508.02117].

These experiments are deliberately proof-of-concept rather than large-scale benchmarks. Their role is to validate that score-based estimators reproduce known analytical results in tractable settings and extend to cases where closed forms are absent [2508.02117].

## 6. Benchmarking Role, Advantages, and Limitations

The paper identifies three principal advantages. First, score-based estimators handle nonlinear, multimodal, heavy-tailed, and hardware-impaired regimes where closed forms are unavailable. Second, the same learned score functions can support MI, MMSE, FIM, BCRB, and KLD estimation. Third, the framework unifies communication and sensing by using the same engine for observation-space metrics such as MMSE and MI and parameter-space metrics such as FIM and BCRB [2508.02117].

This benchmarking orientation situates Scoring ISAC alongside other ISAC performance frameworks but with a different methodological emphasis. “MIMO-ISAC: Performance Analysis and Rate Region Characterization” [2209.01028] analyzes sensing rate, communication rate, high-SNR slope, and rate-region inclusion under tractable Gaussian models. “Downlink and Uplink NOMA-ISAC with Signal Alignment” [2308.16352] similarly studies sensing rate, communication rate, outage probability, high-SNR slope, and diversity order through structured analytical models. By contrast, Scoring ISAC is designed for cases where such explicit analysis becomes unreliable or impossible [2508.02117].

The paper also makes a specific comparative claim against variational MI or MMSE estimators: score-based estimators exploit exact identities such as I–MMSE, de Bruijn, Tweedie, and posterior Fisher identities, avoid estimating partition functions, and are trained via DSM or ISM, which the summary describes as stable and scalable [2508.02117].

The limitations are equally explicit. Accurate score learning may have high sample complexity, especially in high dimensions or under severe out-of-distribution shifts. Score magnitude miscalibration induces biased metric estimates. Unknown-likelihood settings can make Fisher Score Matching sensitive to inaccuracies in the prior score. Numerical integration over $\sigma$ requires careful quadrature and variance reduction [2508.02117].

The summary also gives practical guidance rather than guarantees: DSM with 10–20 $\sigma$ levels often suffices for metric estimation; classifier-free guidance can share weights between unconditional and conditional branches; and for linear inverse problems, score-based turbo message passing can accelerate MMSE or posterior mean estimation by alternating LMMSE updates and score-based denoising [2508.02117]. Since these points are framed as practical tips in the source summary, they should be understood as reported guidance rather than universal prescriptions.

## 7. Best Practices and Open Directions

The stated best practices include EMA of weights, gradient clipping, and spectral norm regularization; validation of score quality via denoising residuals across $\sigma$; uncertainty quantification through bootstrap over datasets, ensembles of score networks, and jackknife over $\sigma$ grids; and conditioning on SNR, bandwidth, array geometry, waveform index, and known channel components for ISAC-specific models [2508.02117]. Reproducibility recommendations include releasing datasets with controlled impairments, scripts for DSM and FSM training, and fixed random seeds and $\sigma$ schedules [2508.02117].

The open problems listed in the summary delineate the present boundary of the framework. These include learned measurement models for unknown high-dimensional sensing likelihoods such as massive MIMO and near-field holographic arrays; Pareto optimization of communication MI versus sensing BCRB in multi-user and multi-target scenes; dynamic or sequential score models for time-varying channels and targets; native complex-valued diffusion models to avoid realification; and finite-sample error bounds, optimal $\sigma$ schedules, and tightness comparisons with variational estimators [2508.02117].

A plausible implication is that Scoring ISAC is best viewed not as a replacement for classical analysis in all settings, but as a complementary benchmarking layer for settings in which analytical benchmarks cease to be trustworthy. That interpretation is consistent with the paper’s claim that the framework “replicates and extends traditional analyses in more complex, realistic settings” [2508.02117].

Source: https://www.emergentmind.com/topics/scoring-isac