Response orthogonality is a family of criteria defining system responses via residual moment conditions, fidelity decay, and norm-derivative functionals.
In convex regression, it enables identification through KKT-implied moment relations and hybrid control functions to address endogeneity.
In quantum and complex normed spaces, it quantifies many-body state changes and geometric properties using fidelity measures and angular norm derivatives.
Searching arXiv for the primary paper and closely related orthogonality uses of the term.
{"query":"arXiv (Dai et al., 26 Jun 2025) Orthogonality conditions for convex regression response orthogonality", "max_results": 5}
{"query":"Response orthogonality orthogonality catastrophe localized disordered lattices arXiv (Cosco et al., 2018) multifractal orthogonality catastrophe arXiv (Vasseur et al., 2015)", "max_results": 10}
Response orthogonality denotes a family of response-based orthogonality notions whose precise mathematical content depends on context. In convex regression, it is a set of sample moment relations between residuals and regressors, or scaled regressors, implied by the Karush–Kuhn–Tucker system of the estimator and used for identification. In localized quantum systems, it refers to the orthogonal response of many-body states to a local perturbation, typically diagnosed by ground-state fidelity, Loschmidt amplitudes, or threshold power laws. In complex normed spaces, it is defined by the vanishing of an angularly averaged norm derivative ρ∞(x,y) and serves as an orthogonality relation derived from first-order norm response rather than from an inner product (Dai et al., 26 Jun 2025, Cosco et al., 2018, Enderami et al., 2022).
1. Convex-regression orthogonality as an identification condition
In convex regression, response orthogonality is the sample analogue of exogeneity moments familiar from linear regression. The additive model is
yi=f(xi)+εi,
with f:R+k→R concave or convex, and the infinite-dimensional estimator is represented as a constrained nonlinear least-squares program with Afriat-type inequalities,
For the additive concavity-only case, the population moment restriction is
E[εxk]=0∀k,
and the sample orthogonality condition is
∑i=1neixik=0∀k,
together with yi=f(xi)+εi,0. For the multiplicative concavity-only case, orthogonality is scaled by the fitted value: yi=f(xi)+εi,1
and
yi=f(xi)+εi,2
These equalities are derived from Lagrangian duality and KKT stationarity. In the additive case, with multipliers yi=f(xi)+εi,3 for the regression equations and yi=f(xi)+εi,4 for Afriat inequalities,
yi=f(xi)+εi,5
stationarity yields yi=f(xi)+εi,6, as well as linear relations in yi=f(xi)+εi,7 and yi=f(xi)+εi,8. Summing and relabeling indices produces yi=f(xi)+εi,9. In the multiplicative case, the corresponding stationarity equations introduce the scale factor f:R+k→R0, which is why the orthogonality moments involve f:R+k→R1 rather than f:R+k→R2 alone (Dai et al., 26 Jun 2025).
2. Shape constraints, endogeneity, and hybrid control functions
Monotonicity and homogeneity affect these orthogonality relations differently. When monotonicity is imposed through f:R+k→R3, the Lagrangian acquires an additional term
f:R+k→R4
with f:R+k→R5. This alters the slope stationarity condition and yields strict negative sample correlations. In the additive case,
f:R+k→R6
hence the population implication becomes
f:R+k→R7
In the multiplicative case,
f:R+k→R8
The paper’s intuition is that binding monotonicity constraints push some fitted hyperplanes upward in directions of increasing inputs, so residuals become negatively correlated with inputs. By contrast, linear homogeneity, imposed as f:R+k→R9, does not change the orthogonality conditions, although α,β,εmin21i=1∑nεi2s.t.yi=αi+βi′xi+εi∀iαi+βi′xi≤αh+βh′xi∀i,h,0 need not vanish, analogously to OLS through the origin.
The same paper introduces a hybrid instrumental variable control function approach for endogeneity in convex regression. With an endogenous regressor α,β,εmin21i=1∑nεi2s.t.yi=αi+βi′xi+εi∀iαi+βi′xi≤αh+βh′xi∀i,h,1 and instruments α,β,εmin21i=1∑nεi2s.t.yi=αi+βi′xi+εi∀iαi+βi′xi≤αh+βh′xi∀i,h,2,
estimation proceeds in two stages. The first stage uses OLS to obtain α,β,εmin21i=1∑nεi2s.t.yi=αi+βi′xi+εi∀iαi+βi′xi≤αh+βh′xi∀i,h,5. The second stage estimates
by convex regression without monotonicity, preserving equality orthogonality: α,β,εmin21i=1∑nεi2s.t.yi=αi+βi′xi+εi∀iαi+βi′xi≤αh+βh′xi∀i,h,7
Identification is then tied to
The empirical and simulation results reported for this framework are specific. In Monte Carlo experiments based on Cobb–Douglas data-generating processes, OLS in logs performs best without endogeneity, but under endogeneity its RMSE and bias deteriorate quickly. Convex regression is more robust to endogeneity than misspecified OLS in levels. When monotonicity is absent, both IV-based convex regression and the hybrid IV control function mitigate endogeneity, but the hybrid control function consistently yields lower RMSE and bias than 2SLS, especially in larger samples. With monotonicity, equality orthogonality does not hold, yet IV and IV–control function methods still improve performance. In the Chilean manufacturing application, capital is found to be endogenous across industries, and instrumenting capital with lagged investment via the hybrid control function increases estimated capital elasticities relative to convex regression without endogeneity correction (Dai et al., 26 Jun 2025).
3. Fidelity-based response orthogonality in localized insulators
In localized lattice systems, response orthogonality is expressed through ground-state fidelity after an adiabatically switched local impurity. The many-body response is quantified by
where an impurity of strength βi≥01 is placed at site βi≥02. An orthogonality event is declared when this overlap falls below a threshold βi≥03, with βi≥04, and the event probability is
βi≥05
The underlying single-particle Hamiltonian is
βi≥06
Two choices of βi≥07 are central. In the Anderson insulator, βi≥08 is i.i.d. uniform in βi≥09. In the Aubry–André model,
αi=00
with localization for αi=01 when αi=02 is irrational. The many-body ground state is a Slater determinant, and the overlap is computed as
αi=03
using the occupied single-particle eigenstates before and after the perturbation.
Several response diagnostics accompany fidelity. The radius of disturbance is
αi=04
and the density witnesses are
αi=05
For Aubry–André experiments, the odd-even imbalance
αi=06
is proposed as a directly accessible observable.
The statistical behavior depends sharply on the localization mechanism. In both Anderson and Aubry–André insulators, αi=07 rises with αi=08 and saturates at αi=09 at half filling when yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,0. In the Anderson case the increase is smooth and monotonic. In the Aubry–André case, yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,1 develops pronounced plateaux, with the principal plateau centered at
yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,2
and spanning approximately
yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,3
In the strong-localization regime yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,4, the site energies are approximated by
yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,5
and the main gap centers are
yi=f(xi)exp(εi),lnyi=lnf(xi)+εi,6
The mechanism is controlled by quasi-resonant neighbors satisfying
with width of order α,β,εmin21i=1∑nεi2s.t.lnyi=ln(αi+βi′xi)+εi∀iαi+βi′xi≤αh+βh′xi∀i,h.1, produce a hierarchical devil’s-staircase structure in principle. The contrast with the Anderson model is also visible in the correlation function
which exhibits ordered spectral-spatial patterns in Aubry–André systems and random off-diagonal structure in Anderson systems (Cosco et al., 2018).
4. Orthogonality catastrophes in random critical chains and local impurity quenches
A distinct quantum use of response orthogonality appears in orthogonality catastrophes generated by local perturbations. At one-dimensional random singlet quantum critical points, the relevant quantity is the overlap
between the ground states with and without a local cut. Although these systems are insulating, the overlap vanishes algebraically with system size. In the random antiferromagnetic spin-α,β,εmin21i=1∑nεi2s.t.lnyi=ln(αi+βi′xi)+εi∀iαi+βi′xi≤αh+βh′xi∀i,h.4 Heisenberg and XXZ chains,
satisfying α,β,εmin21i=1∑nεi2s.t.lnyi=ln(αi+βi′xi)+εi∀iαi+βi′xi≤αh+βh′xi∀i,h.9 as E[εxk]=0∀k,0 and E[εxk]=0∀k,1. In the strong-disorder renormalization group description, the overlap is expressed through singlet counts: E[εxk]=0∀k,2
with E[εxk]=0∀k,3 for Heisenberg/XXZ and E[εxk]=0∀k,4 for Ising. The average singlet counts satisfy
E[εxk]=0∀k,5
The same framework predicts ultra-slow local-quench dynamics,
E[εxk]=0∀k,6
and a low-frequency work-distribution singularity
E[εxk]=0∀k,7
A central limitation is that the algebraic catastrophe occurs only at the strict cut; weakening a single bond by a factor E[εxk]=0∀k,8 leads instead to a crossover scale
In trapped Fermi gases, a sudden impurity quench produces the same broad orthogonality-catastrophe phenomenology in a discrete-spectrum setting. The central dynamical quantity is the Loschmidt, or vacuum-persistence, amplitude
∑i=1neixik=0∀k,1
whose linked-cluster expansion separates into energy shifts, a Gaussian thermal term, and a periodic contribution: ∑i=1neixik=0∀k,2
The Gaussian envelope is
∑i=1neixik=0∀k,3
while the trap-induced periodic term is
∑i=1neixik=0∀k,4
At zero temperature this becomes
∑i=1neixik=0∀k,5
and in the continuum limit ∑i=1neixik=0∀k,6,
∑i=1neixik=0∀k,7
The trap therefore turns the continuum power law into a periodic structure with revivals at ∑i=1neixik=0∀k,8 and a ladder of spectral subpeaks separated by ∑i=1neixik=0∀k,9 (Sindona et al., 2012).
In quantum impurity models with Fermi-liquid leads, Anderson orthogonality also governs threshold exponents and post-quench dynamics. For a local operator yi=f(xi)+εi,00, the generalized Hopfield rule gives
yi=f(xi)+εi,01
where yi=f(xi)+εi,02 is the phase-shift change in channel yi=f(xi)+εi,03, and yi=f(xi)+εi,04 is the locally created or annihilated charge in that channel. For a type-1 quench,
yi=f(xi)+εi,05
In the interacting resonant level model, this framework identifies intermediate-frequency AO windows distinct from low-frequency Fermi-liquid regimes. In population-switching problems, an added charge-sensor lead contributes an extra yi=f(xi)+εi,06 to the pseudospin-flip scaling dimension; once the total dimension exceeds yi=f(xi)+εi,07, the perturbation becomes irrelevant and the population switch becomes abrupt (Münder et al., 2011).
5. Norm-derivative response orthogonality in complex normed spaces
In Banach-space geometry, response orthogonality is defined through directional norm derivatives rather than through state overlaps or moment equations. For a complex normed space yi=f(xi)+εi,08, the right and left norm derivatives are
yi=f(xi)+εi,09
and the angularly averaged functional is
yi=f(xi)+εi,10
This averaging removes the real-part bias of yi=f(xi)+εi,11 and recovers the full complex behavior in Hilbertian settings.
The basic structural identities are direct. One has
yi=f(xi)+εi,12
and
yi=f(xi)+εi,13
A quantitative bound is
yi=f(xi)+εi,14
where yi=f(xi)+εi,15 is the rotundity index of the dual space. A cruder bound,
yi=f(xi)+εi,16
also follows from the one-sided derivative estimates.
The associated orthogonality relation is
yi=f(xi)+εi,17
For every yi=f(xi)+εi,18, there exists yi=f(xi)+εi,19 such that
yi=f(xi)+εi,20
namely with yi=f(xi)+εi,21. The relation interacts sharply with standard Banach-space orthogonalities. The equivalence
yi=f(xi)+εi,22
connects yi=f(xi)+εi,23-orthogonality to Birkhoff–James orthogonality. In general, yi=f(xi)+εi,24 and yi=f(xi)+εi,25 are not comparable.
The principal characterization theorem states that
yi=f(xi)+εi,26
If the norm is induced by yi=f(xi)+εi,27, then
yi=f(xi)+εi,28
Thus symmetry of the response functional is exceptional rather than generic. The same functional also yields a linear-preserver theorem: a nonzero bounded linear map yi=f(xi)+εi,29 preserves yi=f(xi)+εi,30-orthogonality if and only if it is a scalar multiple of an isometry, equivalently
yi=f(xi)+εi,31
or
yi=f(xi)+εi,32
The paper computes yi=f(xi)+εi,33 explicitly in standard spaces. In yi=f(xi)+εi,34,
yi=f(xi)+εi,35
which already shows non-symmetry: for yi=f(xi)+εi,36 and yi=f(xi)+εi,37,
yi=f(xi)+εi,38
For yi=f(xi)+εi,39,
yi=f(xi)+εi,40
and in yi=f(xi)+εi,41,
yi=f(xi)+εi,42
Only when yi=f(xi)+εi,43 do these coincide with the Hilbert inner product (Enderami et al., 2022).
6. Comparative interpretation and recurrent points of confusion
Across these literatures, response orthogonality is not a single invariant construction but a family of response-defined orthogonality criteria. In convex regression, it is a KKT-implied residual moment relation: yi=f(xi)+εi,44
with identification tied to corresponding population moments. In localized quantum systems, it is encoded by fidelity decay, overlap exponents, or long-time quench responses such as
yi=f(xi)+εi,45
In complex normed spaces, it is the vanishing of a first-order norm-response functional,
yi=f(xi)+εi,46
Several contrasts are especially important. First, orthogonality need not be symmetric. In Banach-space geometry, symmetry of yi=f(xi)+εi,47 is equivalent to the norm’s being induced by an inner product; outside Hilbert spaces, symmetry generally fails. Second, orthogonality need not mean equality moments. In convex regression, equality orthogonality is broken systematically by binding monotonicity constraints and replaced by inequality moments. Third, orthogonality catastrophe is not confined to metals. Localized disordered lattices, random singlet critical points, and trapped insulating systems all exhibit orthogonal many-body responses to local perturbations, though the scaling laws differ: exponential decay of typical overlaps in localized insulators, algebraic decay at random singlet infinite-randomness fixed points, and trap-modulated MND behavior in harmonic Fermi gases (Dai et al., 26 Jun 2025, Cosco et al., 2018, Vasseur et al., 2015, Sindona et al., 2012, Enderami et al., 2022).
A related misconception is that every local perturbation generates the same orthogonality phenomenon. The cited work shows otherwise. In random singlet systems, the algebraic catastrophe occurs for a strict cut, whereas softened bond perturbations cross over to a non-universal constant overlap. In convex regression, orthogonality-based identification generally requires concavity-only specifications, because monotonicity constraints alter the moment structure. In Banach spaces, the conjectured sharp bound
yi=f(xi)+εi,48
remains an open problem in full generality, even though it holds in several important classes of spaces. These distinctions indicate that the unifying feature is not a common formula but a common logic: orthogonality is extracted from how a system responds, at first order or asymptotically, to a local perturbation, constraint, or directional variation.