Papers
Topics
Authors
Recent
Search
2000 character limit reached

Iterative Dual Orthogonal Projections

Updated 9 July 2026
  • Iterative DOP is an alternating method that projects between two closed subspaces in a Hilbert space, converging to their intersection per von Neumann’s theorem.
  • It leverages properties like linearity, idempotence, self-adjointness, and nonexpansiveness to ensure robust and quantifiable convergence.
  • Applications span feasibility problems, PDE solvers, and beamforming in MIMO systems, demonstrating both theoretical rigor and practical effectiveness.

Searching arXiv for the cited papers and closely related terminology. Iterative Dual Orthogonal Projections (DOP) refers to the iterative method of alternating orthogonal projections between two closed subspaces of a Hilbert space. In the terminology used for alternating projections, “dual” refers to the case of two closed subspaces: given M,NHM,N\subset H, orthogonal projections PM,PNP_M,P_N, and x0Hx_0\in H, one studies the iteration xk+1=PNPMxkx_{k+1}=P_NP_Mx_k, or equivalently x1=PMx0x_1=P_Mx_0, x2=PNx1x_2=P_Nx_1, x3=PMx2x_3=P_Mx_2, and so on. Its foundational property is von Neumann’s theorem: repeated alternation converges in norm to the orthogonal projection of the initial point onto MNM\cap N, making the dual case the mathematically cleanest and most robust component of the method of alternating projections (Ginat, 2018).

1. Hilbert-space formulation and basic operators

The ambient setting is a real or complex Hilbert space HH with inner product ,\langle \cdot,\cdot\rangle and norm PM,PNP_M,P_N0. For a closed subspace PM,PNP_M,P_N1, the orthogonal projection PM,PNP_M,P_N2 is defined by the decomposition

PM,PNP_M,P_N3

so every PM,PNP_M,P_N4 can be written uniquely as

PM,PNP_M,P_N5

and

PM,PNP_M,P_N6

Orthogonal projections satisfy the standard identities emphasized in the alternating-projection literature: linearity and idempotence, PM,PNP_M,P_N7; self-adjointness, PM,PNP_M,P_N8; norm nonexpansiveness, PM,PNP_M,P_N9, with equality iff x0Hx_0\in H0; and the best-approximation property, namely that x0Hx_0\in H1 is the unique nearest point in x0Hx_0\in H2 to x0Hx_0\in H3 (Ginat, 2018).

In the dual case one fixes two closed subspaces x0Hx_0\in H4, with orthogonal projections

x0Hx_0\in H5

their intersection x0Hx_0\in H6, and the associated orthogonal projection x0Hx_0\in H7. This two-subspace configuration already contains the central geometric and operator-theoretic phenomena of the general theory.

2. Alternating iteration and von Neumann convergence

The general alternating-projection sequence attached to a family x0Hx_0\in H8 and an index sequence x0Hx_0\in H9 is defined by

xk+1=PNPMxkx_{k+1}=P_NP_Mx_k0

Iterative DOP specializes this to xk+1=PNPMxkx_{k+1}=P_NP_Mx_k1. A standard dual alternating projection scheme is

xk+1=PNPMxkx_{k+1}=P_NP_Mx_k2

or, equivalently,

xk+1=PNPMxkx_{k+1}=P_NP_Mx_k3

Because xk+1=PNPMxkx_{k+1}=P_NP_Mx_k4 and xk+1=PNPMxkx_{k+1}=P_NP_Mx_k5, any sequence of xk+1=PNPMxkx_{k+1}=P_NP_Mx_k6 and xk+1=PNPMxkx_{k+1}=P_NP_Mx_k7 can be reduced to a composition where they alternate, so the two-subspace theorem applies to any order of xk+1=PNPMxkx_{k+1}=P_NP_Mx_k8 (Ginat, 2018).

The core convergence statement is von Neumann’s theorem. For closed subspaces xk+1=PNPMxkx_{k+1}=P_NP_Mx_k9, with projections x1=PMx0x_1=P_Mx_00, and x1=PMx0x_1=P_Mx_01, one has

x1=PMx0x_1=P_Mx_02

In dual notation,

x1=PMx0x_1=P_Mx_03

Thus the limit is the unique point in x1=PMx0x_1=P_Mx_04 closest to the initial datum. Algorithmically, this means that if projections onto x1=PMx0x_1=P_Mx_05 and x1=PMx0x_1=P_Mx_06 are easier to compute than the projection onto x1=PMx0x_1=P_Mx_07, the latter can be approximated by repeated dual projections.

A technically important proof route passes through the self-adjoint operator

x1=PMx0x_1=P_Mx_08

The argument uses the spectral theorem for self-adjoint operators, the fact that the associated multiplier satisfies x1=PMx0x_1=P_Mx_09 almost everywhere, dominated convergence for x2=PNx1x_2=P_Nx_10, and the decomposition

x2=PNx1x_2=P_Nx_11

From this one obtains x2=PNx1x_2=P_Nx_12, hence the norm convergence of the alternating-projection iterates. The significance of this proof is that it works directly with orthogonal projections rather than with general contractions (Ginat, 2018).

3. Product structure, canonical factorization, and invariant decomposition

A complementary operator-theoretic description studies the product

x2=PNx1x_2=P_Nx_13

In general, x2=PNx1x_2=P_Nx_14 is not a projection and need not be selfadjoint or normal, but it is always a contraction. The modern structural characterization of such operators is especially useful for iterative DOP. For x2=PNx1x_2=P_Nx_15, the following are equivalent:

x2=PNx1x_2=P_Nx_16

x2=PNx1x_2=P_Nx_17

x2=PNx1x_2=P_Nx_18

x2=PNx1x_2=P_Nx_19

Accordingly, whenever x3=PMx2x_3=P_Mx_20, the canonical projections are

x3=PMx2x_3=P_Mx_21

and the product is recovered as

x3=PMx2x_3=P_Mx_22

This gives a purely algebraic and range-based test for whether a contraction arises from a dual projection pair. A further identity describes the kernel: x3=PMx2x_3=P_Mx_23 These formulas identify precisely where the product acts injectively, where it annihilates vectors, and how the geometry of the two ranges controls the operator (Bhattacharjee et al., 2024).

The contraction x3=PMx2x_3=P_Mx_24 also admits the Sz.-Nagy–Foiaş–Langer canonical decomposition

x3=PMx2x_3=P_Mx_25

where x3=PMx2x_3=P_Mx_26 reduces x3=PMx2x_3=P_Mx_27 and x3=PMx2x_3=P_Mx_28 is unitary, while x3=PMx2x_3=P_Mx_29 is completely non-unitary. In the special case of a product of two orthogonal projections, these subspaces become explicit: MNM\cap N0 and

MNM\cap N1

Moreover,

MNM\cap N2

and the restriction MNM\cap N3 is a MNM\cap N4-contraction, so its powers and adjoint powers converge strongly to MNM\cap N5. From the DOP perspective, this means that the iterates preserve exactly the component lying in the intersection of the two target subspaces and asymptotically suppress the completely non-unitary component (Bhattacharjee et al., 2024).

4. Geometry, angle, and quantitative convergence

The geometry of iterative DOP is governed by the relative position of the two subspaces outside their intersection. For MNM\cap N6, with MNM\cap N7, the Friedrichs angle is the angle MNM\cap N8 whose cosine is

MNM\cap N9

A sharp estimate due to Aronszajn and Kayalar–Weinert is

HH0

Hence, if HH1, convergence is uniform and geometric; if HH2, convergence still holds by von Neumann’s theorem but can be arbitrarily slow (Ginat, 2018).

The same phenomenon is visible in Halmos’ two-projection theorem. For orthogonal projections HH3, Halmos’ canonical form decomposes the Hilbert space into trivial blocks

HH4

and a generic part HH5, on which

HH6

with HH7 selfadjoint and HH8. On this generic part, the product HH9 acts fiberwise via

,\langle \cdot,\cdot\rangle0

so each fiber is governed by eigenvalues ,\langle \cdot,\cdot\rangle1. This provides an explicit spectral model for the contraction factors that appear in alternating projections and, in finite dimensions, identifies the scalar parameter with ,\langle \cdot,\cdot\rangle2 for the relevant principal angle (Boettcher et al., 2017).

A related refinement concerns the choice of projection pair representing a fixed product ,\langle \cdot,\cdot\rangle3. Corach and Maestripieri show that the canonical factorization

,\langle \cdot,\cdot\rangle4

is optimal in the sense that, among all pairs ,\langle \cdot,\cdot\rangle5 with product ,\langle \cdot,\cdot\rangle6, it minimizes ,\langle \cdot,\cdot\rangle7. If ,\langle \cdot,\cdot\rangle8 is closed, this is the unique pair with ,\langle \cdot,\cdot\rangle9; if PM,PNP_M,P_N00 is not closed, then PM,PNP_M,P_N01 for all such pairs. This identifies the canonical pair as the geometry with maximal angular separation and therefore the one most favorable for contraction-based iteration (Corach et al., 2010).

5. Generalizations beyond two subspaces and failure of norm convergence

The dual case is unusually strong because norm convergence is unconditional. For a family of closed subspaces PM,PNP_M,P_N02, periodic and quasiperiodic projection orders still yield norm convergence, but arbitrary orders do not.

In the periodic case, with

PM,PNP_M,P_N03

Halperin’s theorem gives

PM,PNP_M,P_N04

In the quasiperiodic case, each index appears infinitely often and the gaps between successive occurrences are uniformly bounded; Sakai’s theorem then implies that

PM,PNP_M,P_N05

converges in norm to PM,PNP_M,P_N06. A useful analytical criterion is the estimate

PM,PNP_M,P_N07

which forces the sequence to be Cauchy (Ginat, 2018).

For arbitrary projection orders, one always retains weak convergence. The Amemiya–Ando theorem states that for any Hilbert space, any finite family of closed subspaces, and any sequence of indices PM,PNP_M,P_N08, the sequence

PM,PNP_M,P_N09

converges weakly in PM,PNP_M,P_N10. This requires no periodicity, no finite-dimensionality, and no special condition on the intersection. However, weak convergence does not imply norm convergence in infinite dimensions (Ginat, 2018).

The limitation is sharp. There exists a sequence PM,PNP_M,P_N11 such that for any infinite-dimensional Hilbert space PM,PNP_M,P_N12 and any non-zero PM,PNP_M,P_N13, one can choose three closed subspaces PM,PNP_M,P_N14, intersecting only at the origin, for which

PM,PNP_M,P_N15

does not converge in norm. The construction builds words in three projections that move an orthonormal vector PM,PNP_M,P_N16 arbitrarily close to PM,PNP_M,P_N17, producing a subsequence that remains within a fixed distance of distinct orthonormal vectors and therefore cannot be norm convergent. The same counterexample shows that Sakai’s inequality does not hold uniformly for arbitrary projection sequences. This delineates the special robustness of iterative DOP: the pathology occurs for PM,PNP_M,P_N18, not for PM,PNP_M,P_N19 (Ginat, 2018).

6. Applications, specialized variants, and terminological ambiguity

In its classical Hilbert-space meaning, iterative DOP is a projection algorithm for computing

PM,PNP_M,P_N20

by alternating between the easier projections PM,PNP_M,P_N21 and PM,PNP_M,P_N22. The literature explicitly identifies several application domains: feasibility problems, projection onto intersections, solving systems of linear equations, and the Schwarz alternating method for PDEs. In the PDE example, two overlapping subdomains PM,PNP_M,P_N23 define subspaces in a Sobolev space, projections onto their orthogonal complements encode local solution operators, and alternating these projections converges in norm to the global weak solution (Ginat, 2018).

A recent engineering specialization uses the phrase “iterative dual orthogonal projections” for a linear beamforming algorithm in downlink multiuser mmWave XL-MIMO systems. There, the method alternates between two orthogonal projections: one onto the orthogonal complement of an interference subspace to eliminate multiuser interference, and one onto a desired-signal subspace to refine the receive combiners. The paper proves that, with each iteration, the signal power for each user increases monotonically, the equivalent noise power after receive combining decreases monotonically, and the spectral efficiency improves accordingly and converges; simulations report rapid convergence, with per-user spectral efficiency curves flattening near their maxima within around 10 iterations, and sum spectral efficiency closely approaching the dirty paper coding benchmark (Li et al., 23 Aug 2025).

The acronym is not uniform across the literature. In distributed fixed-point theory, “DOP” stands for “Distributed quasi-averaged Operator Playing,” a block-separable multi-agent algorithm over directed and unbalanced networks; that paper explicitly states that this DOP is not “Dual Orthogonal Projections” (Li et al., 2020). Accordingly, the phrase “Iterative Dual Orthogonal Projections” is most precise when reserved for the two-subspace alternating-projection method and for later application papers that explicitly adopt that name for algorithms built from alternating orthogonal projections.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Iterative Dual Orthogonal Projections (DOP).