---
title: Response-Vector Method Overview
url: https://www.emergentmind.com/topics/response-vector-method
type: topic
---

# Response-Vector Method Overview

Searching arXiv for papers relevant to “Response-Vector Method” to ground the article in published work.
The response-vector method denotes a family of procedures in which observable responses are taken as the primary mathematical object of modeling, inference, or optimization. In the literature represented here, the term does not identify a single universally standardized algorithm. Instead, it appears in several technically distinct settings: data-driven reduced-order modeling from sampled transfer-function responses; direction-aware response-function estimation from spatiotemporal field data; Hilbert-space optimization of perturbations via the Riesz representative of a linear response operator; response-based vector embeddings of black-box generative models; and related regression frameworks in which low-dimensional response vectors, latent response vectors, or vector-valued response fields are modeled directly [1908.08977] [2303.17785] [2501.02395] [2511.08307] [2203.15170] [2101.08436] [2501.11019].

## 1. Conceptual scope

Across these usages, the common structural feature is that the method begins from responses rather than from a full mechanistic state description. In linear time-invariant system identification, the response object is a set of sampled transfer-function values \(H(\mathrm{j}\omega_k)\). In active-material mechanics, it is a localized response function \(U_p(\mathbf{R},\tau)\) built from perturbation-conditioned ensemble averages. In uniformly hyperbolic dynamics, it is a bounded linear response functional \(R\) represented by a vector \(v\) in a Hilbert space. In black-box generative-model analysis, it is a model-specific matrix of mean responses to a fixed query set, subsequently embedded by CMDS. In atomistic machine learning, the target is the vector field \(\partial n_e(\mathbf r)/\partial E_k\), the electrostatic linear response of the electron density to an applied field [1908.08977] [2303.17785] [2501.02395] [2511.08307] [2501.11019].

| Domain | Response object | Core operation |
|---|---|---|
| LTI reduced-order modeling | \(H(\mathrm{j}\omega_k)\) | Rational fitting with pole relocation |
| Active materials | \(\chi_p(\mathbf{R},\tau)\), \(U_p\) | Direction-aligned ensemble averaging |
| Hyperbolic dynamics | \(R(X)=\langle X,v\rangle_{\mathcal H}\) | Riesz representation and convex optimization |
| Black-box generative models | Sample response matrices | Dissimilarity construction and CMDS |
| Atomistic ML | \(\partial n_e(\mathbf r)/\partial E_k\) | Symmetry-adapted equivariant kernel regression |
| Statistical regression/VAR | Response factor vectors or latent Gaussian response vectors | Low-rank factorization or likelihood-based estimation |

A plausible unifying interpretation is that these methods replace inaccessible or unwieldy internal structure by response-level observables that can be estimated from data, simulated trajectories, or perturbative calculations. This interpretation is explicit in some cases: Vector Fitting is presented as a response-data-based reduced-order modeling method, and the active-material framework is presented as a directionally rectified extension of correlation analysis that measures response functions directly from observations [1908.08977] [2303.17785].

## 2. Data-driven reduced-order modeling from sampled responses

In the system-theoretic usage, the response-vector method is exemplified by Vector Fitting (VF), a data-driven algorithm for constructing reduced-order models of linear time-invariant systems from sampled input-output responses. The starting point is
\[
Y(s)=H(s)U(s),
\]
with sampled frequency-response data
\[
H_k = H(\mathrm{j}\omega_k), \qquad k=1,\dots,\bar{k}.
\]
VF seeks a rational approximation \(\widetilde H(s)\) satisfying \(\widetilde H(\mathrm{j}\omega_k)\simeq H_k\), typically in pole-residue form,
\[
\widetilde H(s)=R_0+\sum_n \frac{R_n}{s-p_n}.
\]
For MIMO systems, the transfer function is matrix-valued, the poles are shared across all transfer-matrix entries, and the fitting error is measured with the Frobenius norm
\[
e^2=\frac{1}{\bar k\,\bar q\,\bar m}\sum_{k=1}^{\bar k}\left\|H_k-\widetilde H(\mathrm{j}\omega_k)\right\|_F^2.
\]
The algorithm iterates between linear least-squares coefficient estimation and pole relocation via the zeros of the updated denominator, followed by a final fixed-pole residue refit [1908.08977].

The key numerical advantage is conditioning. VF avoids direct monomial-basis polynomial fitting and instead uses a partial-fraction basis. Pole relocation is written as
\[
\{p_n^{(i)}\}=\operatorname{eig}\!\left(A^{(i-1)}-b_w(c_w^{(i)})^T\right),
\]
which is the step that gives the method its name. Stability is enforced by requiring \(\Re\{p_n\}\le 0\), typically by reflecting unstable poles into the left half-plane. Once the fit is obtained, the model can be converted into state-space form,
\[
\dot x(t)=Ax(t)+Bu(t), \qquad y(t)=Cx(t)+Du(t),
\]
or into time-domain impulse responses and equivalent circuits. The paper states that VF usually converges in about 4–5 iterations for clean data, and describes Fast VF for large MIMO systems through block-structured QR-based reductions [1908.08977].

This usage is explicitly response-data-driven: the method is particularly useful when the system is known only through experimental measurements, such as aortic impedance from in-vivo pressure/flow measurements, RF and microwave devices measured with vector network analyzers, and interconnects or printed circuit boards characterized only experimentally. In this sense, the response vector is not an internal state estimate but the measured response itself, from which a simulation-ready dynamical surrogate is constructed.

## 3. Direction-aware response functions in active materials

A second major usage treats the response vector as a localized, orientation-resolved response function inferred directly from field data. The active-material framework extends standard correlation analysis by incorporating the internal headings of displacement fields. For a perturbation field \(p\) and response field \(q\), the paper defines
\[
C_{pq}(\mathbf{R},\tau) = \left\langle p(\mathbf{r}_1,t)\, q(\mathbf{r}_2,t+\tau)\, \delta(\mathbf{R}-\mathbf{r}_{12}) \right\rangle_{\mathbf{r}_1,\mathbf{r}_2,t},
\]
and then introduces the modified response function
\[
\chi_p(\mathbf{R},\tau) = \left\langle p(\mathbf{r}_1,t)\, \mathbf{u}(\mathbf{r}_2,t+\tau)\, \delta(\mathbf{R}-\mathbf{r}'_{12}) \right\rangle_{\mathbf{r}_1,\mathbf{r}_2,t},
\qquad
U_p = \frac{\chi_p}{\sqrt{\langle p^2\rangle}}.
\]
The coordinate \(\mathbf{r}'_{12}\) is measured in a perturbation-aligned frame: for vector perturbations the local axis is aligned with the source heading, and for tensor perturbations it is aligned with an eigenvector of the source tensor. Scalar perturbations use the lab frame [2303.17785].

The framework decomposes the displacement gradient into physically distinct modes,
\[
\partial_i u_j = S_{ij} + D_{ij} + \Omega_{ij},
\]
where \(S_{ij}\) is pure shear, \(D_{ij}\) is isotropic compression/extension, and \(\Omega_{ij}\) is rotation/vorticity. This produces response functions \(U_S\), \(U_D\), and \(U_\nu\). For shear, the response can be written in polar form as
\[
\mathbf{U}_S = \left[ - U_{S,\mathrm{aniso}} \cos 2\theta + U_{S,\mathrm{iso}} \right]\hat{\mathbf{e}}_R
+ U_{S,\theta,\mathrm{aniso}} \sin 2\theta\,\hat{\mathbf{e}}_\theta.
\]
The isotropic shear contribution is especially informative in contractile systems: the paper finds that
\[
\frac{U_{S,\mathrm{iso}}(R_S^*)}{R_S^*}
\]
matches the mean divergence \(\langle \nabla \cdot \mathbf{u} \rangle\) [2303.17785].

The applications are explicitly mechanical rather than merely descriptive. In an active nematic, the azimuthal average of the vorticity response exhibits a peak at a characteristic length \(R_\nu^*\), with \(R_\nu^*\approx 14.1\,\mu\mathrm{m}\), consistent with the average vortex radius from standard vortex analysis. In a contractile active gel, the ratio \(R_\nu^*/R_S^*\) rises over time and peaks just before the onset of bulk contraction, which the paper interprets as a precursor of contractility. Temporal behavior differentiates dissipation mechanisms: in the active nematic, \(U_S(\tau)\) decays monotonically with \(\tau\), consistent with viscous dissipation, whereas in the contractile gel it becomes negative at intermediate \(\tau\), an anticorrelation signature of elasticity and hence viscoelastic dissipation. In living cells, the method distinguishes transverse arcs from ventral stress fibers and resolves the altered response induced by optogenetic RhoA activation [2303.17785].

A common misconception would be to view these objects as ordinary scalar correlations. The construction is explicitly richer: it separates shear, compression, and rotation; retains directional anisotropy; and yields model-free characteristic lengths and temporal relaxation descriptors.

## 4. Statistical models centered on response vectors

In multivariate time series, the response vector becomes a low-dimensional latent factor representation. For the VAR(1) model
\[
y_t = Ay_{t-1}+\varepsilon_t,\qquad y_t\in\mathbb{R}^p,
\]
a low-rank coefficient matrix \(A\) is written as
\[
A = USV^\top,\qquad U,V\in\mathbb{O}^{p\times r},\ S\in\mathbb{R}^{r\times r},
\]
so that
\[
U^\top y_t = S V^\top y_{t-1} + U^\top \varepsilon_t.
\]
Here \(U^\top y_t\) is the response factor vector and \(V^\top y_{t-1}\) is the predictor factor vector. The extension with common response and predictor factors decomposes the latent spaces into a common subspace \(C\), a response-specific subspace \(R\), and a predictor-specific subspace \(P\), with
\[
UO_1=[C\ R],\qquad VO_2=[C\ P],
\]
and
\[
A = [C\ R]\,D\,[C\ P]^\top.
\]
The parameter count is reduced from
\[
d_{\mathrm{RR}}(p,r)=r(2p-r)
\]
to
\[
d_{\mathrm{CS}}(p,r,d)=r(2p-r)-d\bigl(p-(d+1)/2\bigr),
\]
and the paper develops regularized gradient-descent estimation, higher-order tensor VAR extensions, a transformation for pervasive cross-sectional dependence, and row-sparse loading constraints for ultra-high dimensions [2203.15170].

A second statistically oriented usage appears in mixed-type multivariate response regression. There the observed response vector \(Y_i\) is connected to a latent Gaussian response vector \(W_i\) through
\[
g\{E(Y_i\mid W_i)\}=W_i,
\qquad
W_i \sim N_r(X_i\beta,\Sigma).
\]
The model allows mixed continuous and discrete responses while imposing no parametric restrictions on \(\Sigma\) other than positive definiteness. Identifiability is established when the componentwise links are identity, log, or logit, provided \(\Sigma_{jj}\) is fixed and known for every \(j\) corresponding to logit \(g_j\), and \(\mathcal{X}^T\mathcal{X}\) is invertible. Estimation uses a PQL/Laplace-type working likelihood with blockwise updates of \(\beta\), \(\Sigma\), and latent modes \(w_i\), including projected-gradient covariance updates and trust-region optimization. The framework also supports approximate likelihood ratio testing, for example by encoding response independence as \(\Sigma_{12}=\Sigma_{21}=0\) [2101.08436].

A narrower binary-response variant converts the soft-margin SVM into a fully probabilistic binary-response regression model with likelihood
\[
\Pr\left(Y_{i}=y_{i}\mid\bm{X}_{i}=\bm{x}_{i}\right)
=
\frac{\exp\left(-\left[1-y_{i}\tilde{\bm{x}}_{i}^{\top}\bm{\theta}\right]_{+}\right)}
{\exp\left(-\left[1-\tilde{\bm{x}}_{i}^{\top}\bm{\theta}\right]_{+}\right)+
\exp\left(-\left[1+\tilde{\bm{x}}_{i}^{\top}\bm{\theta}\right]_{+}\right)}.
\]
The paper proves existence, consistency, and asymptotic normality of the MLE, with sandwich covariance
\[
\mathbf{A}^{-1}\left(\bm{\theta}_{0}\right)\mathbf{B}\left(\bm{\theta}_{0}\right)\mathbf{A}^{-1}\left(\bm{\theta}_{0}\right),
\]
and emphasizes that, unlike standard SVMs, the model directly provides posterior class probabilities and likelihood-based inference [2007.11902].

These examples show that, in statistics, the response vector often denotes either a latent compressed representation of multivariate outcomes or an explicitly modeled probabilistic response object. This suggests a broader response-vector viewpoint in which dimensionality reduction and inferential structure are imposed on the response side rather than only on predictors.

## 5. Symmetry-adapted and functional response vectors in scientific computing

In atomistic machine learning, the response vector is a genuine vector field in real space: the first-order change in electron density under a homogeneous electric field. The target is
\[
\frac{\partial n_e(\boldsymbol{r})}{\partial E_k}
=
\sum_{i n \lambda\mu} c^k_{i n \lambda\mu}\,\phi_{n \lambda\mu}(\boldsymbol{r}-\boldsymbol{r}_i),
\]
with coefficients \(c^k_{i n \lambda\mu}\) learned in an atom-centered basis. Because the response transforms jointly under rotations of structure and field direction, the method uses symmetry-adapted kernels for the coupled angular channel \(\lambda\otimes 1\):
\[
K^{\lambda \otimes 1}_{\mu k,\, \mu'k'}
=
\sum^{\lambda+1}_{l=|\lambda-1|} 
\langle \lambda\mu,1k \vert lm\rangle
\langle \lambda\mu',1k' \vert lm'\rangle
K^l_{m m'}.
\]
For full \(O(3)\) equivariance, the paper requires symmetric \(K^l\) for \(l=|\lambda\pm 1|\) and antisymmetric \(K^l\) for \(l=\lambda\). Efficiency is obtained through sparse representative environments and the decay rule
\[
M_\lambda = M_0\, e^{-0.05\lambda^2}.
\]
On rotated water molecules, the equivariant model gives the same prediction error for rotated copies of the same molecule, is about \(100\times\) more accurate on the rotated conformer comparison and about \(50\times\) better over the full validation set than the previous SALTER approach, and scales to gold nanoparticles with more than 2000 atoms. For nanoparticle polarizability it reports about \(1.2\%\) RMSE for the isotropic component \(\alpha_0\) and about \(11.9\%\) RMSE for the anisotropic component [2501.11019].

In uniformly hyperbolic dynamics, by contrast, the response vector is not a field over physical space but the Riesz representative of a bounded linear functional on a perturbation space. For an observable \(\Phi\), the linear response to perturbation \(X\) is
\[
R(X):=\lim_{\gamma\to 0}\frac{\int \Phi\,d\mu_{X,\gamma}-\int \Phi\,d\mu}{\gamma}.
\]
Using the fast adjoint response formula, the response operator is shown to be bounded in the \(C^{1,\alpha}\) norm, hence continuous on a Hilbert space \(\mathcal H\). The Riesz representation theorem then yields a unique \(v\in\mathcal H\) such that
\[
R(w)=\langle w,v\rangle_{\mathcal H}\quad \text{for all } w\in \mathcal H.
\]
If the feasible set \(P\) is the unit ball of \(\mathcal H\), the unique optimal perturbation is
\[
X_{\mathrm{opt}}=\frac{v}{\|v\|_{\mathcal H}}.
\]
The paper develops a Fourier-basis computation of \(v\) on \(\mathbb T^M\) and demonstrates the method numerically in dimensions 2, 3, and 21 [2501.02395].

The two cases are mathematically different but structurally analogous. In both, the response object is vector-valued and symmetry or geometry is built into the estimator: rotational equivariance in the electron-density problem, and Hilbert-space duality plus convex geometry in the hyperbolic-response problem.

## 6. Response-based embeddings, related methods, and terminological status

For black-box generative models, the response vector becomes a Euclidean embedding derived from sampled outputs on a fixed query set. Each model \(f_i\) is represented by a population mean response matrix
\[
\boldsymbol{\mu}_i \in \mathbb R^{m\times p},
\]
or, in practice, by a sample response matrix
\[
\bar{\mathbf X}_i \in \mathbb R^{m\times p},
\]
formed by averaging embedded responses over \(r\) replicates for each of \(m\) queries. Pairwise dissimilarities between these response profiles are double-centered to form a Gram matrix, and CMDS yields the model perspectives \(\boldsymbol{\psi}_i\). The main theoretical contribution is a concentration analysis: if \(\sup_{i,j}\gamma_{ij}=O(1)\) and \(r=\omega(n^3)\), then
\[
\left\|\hat{\mathbf B}-\mathbf B\right\| < \left(\frac{n^3}{r}\right)^{\frac12-\delta}
\]
with high probability, and there exists an orthogonal matrix \(\mathbf W_*\) such that
\[
\left\| \hat{\boldsymbol{\psi}}\mathbf W_* - \boldsymbol{\psi} \right\|_{2,\infty}
\le
\operatorname{Poly}_3\!\left( \left(\frac{n^3}{r}\right)^{\frac12-\delta} \right).
\]
The sample embedding is therefore consistent up to rotation, with error controlled by the replicate-to-model scaling \(r\) versus \(n^3\) [2511.08307].

A related but broader geometric strategy appears in Faraway’s regression with distance matrices. There the response need not live in a vector space at all. Object-valued predictors and responses are represented by distance matrices, embedded by classical multidimensional scaling, related by an internal regression model such as SIMPLS, and connected back to the original object spaces by scoring and backscoring [1303.3750]. This is not presented as a response-vector method in the narrow sense, but it is closely adjacent: observed responses are first converted into coordinates in a response space, and inference proceeds in that induced geometry.

The principal terminological point is therefore negative: “response-vector method” is not a single canonical procedure across disciplines. In one literature it means a response-data-based rational fitting algorithm; in another, a perturbation-aligned response-function estimator; in another, the Riesz representative of a linear response operator; and in another, a response-based embedding of black-box models. The literature summarized here suggests that the phrase is best understood as a family resemblance term for methods that elevate responses to the status of primary representation.

This heterogeneity also resolves a common source of confusion. A response vector need not be a finite Euclidean parameter vector. It may be a sampled transfer-function array, a localized tensor- or vector-valued response field, a latent low-rank factor vector, a Hilbert-space element, or a CMDS coordinate. What unifies these objects is not their ambient space, but their role: each is a compressed, operationally useful encoding of how a system responds.

Source: https://www.emergentmind.com/topics/response-vector-method