---
title: Iterative Source Steering (ISS)
url: https://www.emergentmind.com/topics/iterative-source-steering-iss
type: topic
---

# Iterative Source Steering (ISS)

Searching arXiv for the specified paper and closely related work on Iterative Source Steering.
Iterative Source Steering (ISS) is an inverse-free update strategy for blind source separation, most prominently in majorization-minimization-based independent vector analysis (IVA) and AuxIVA, in which the demixing or separation matrix is modified by steering-type rank-1 corrections rather than by iterative projection (IP) with explicit matrix inversion [2209.00937][2202.00875]. In common notation, the observed multichannel signal is modeled as \(x=\sum_k a_k s_k = As\), the demixing matrix is \(W=[w_1,\dots,w_K]^H\), and the separated signal is \(y=Wx\) [2209.00937]. Depending on the formulation, ISS is described either as updating one column of the mixing matrix \(A=W^{-1}\) in each iteration or as updating the demixing matrix directly through a steering correction of the form \(W_f \gets W_f - v_{kf} w_{kf}^H\) [2202.00875][2209.00937]. Its principal significance is algorithmic: it avoids matrix inversions, reduces computational cost, and in several settings exposes a steering-vector interpretation that is useful in dynamic acoustic scenes and in extensions beyond standard IVA.

## 1. Optimization setting and algebraic form

In MM-based IVA, ISS appears in the minimization of the surrogate objective
\[
\mathcal{L}(W)=\sum_{i=1}^m w_i^{\mathsf H} V_i w_i - \log |\det W|^2,
\]
where \(W \in \mathbb{C}^{m\times m}\) is the separation matrix and \(V_i\) are positive definite or Hermitian positive semidefinite matrices constructed in each MM iteration [2202.00875]. For \(m \geq 3\), no algorithm has been found to obtain a global minimum of this surrogate, so practical optimization relies on block coordinate descent with closed-form updates [2202.00875]. Within that landscape, IP updates rows of \(W\), whereas ISS updates columns of the mixing matrix \(A=W^{-1}\) [2202.00875].

In online AuxIVA and related formulations, the same mechanism is written directly as a rank-1 demixing update. The central operation is
\[
W_f \gets W_f - v_{kf} w_{kf}^{H},
\]
with source-dependent steering coefficients \(v_{kf}\) chosen so that the update remains closed form and does not require matrix inversion [2209.00937]. This makes ISS an inverse-free alternative to the standard IP update used in auxiliary-function-based IVA [2209.00937].

A key conceptual point established for online IVA is that this demixing-matrix update “corresponds to the update of the steering vector” [2209.00937]. That statement is not merely interpretive terminology. It explains why ISS is useful in dynamic conditions: the update is structurally aligned with changes in the mixing geometry, rather than only with row-wise re-estimation of the demixing matrix.

## 2. Online AuxIVA and dynamic source motion

The 2022 online IVA formulation introduces ISS specifically for real-time blind source separation, where the demixing matrix \(W_f\) must be estimated frame by frame from only the current and past observations [2209.00937]. Standard online AuxIVA inherits the per-frame inversion burden of IP, which is costly for real-time or embedded systems such as hearing aids [2209.00937]. ISS removes that burden because it “does not require any matrix inversions,” while retaining the separation quality of AuxIVA-style processing [2209.00937].

The same paper emphasizes a second motivation that is specific to dynamic environments. When only part of the sources move, ISS enables the algorithm to update only the parts of the demixing model associated with the moving sources [2209.00937]. Before convergence, the update index set \(I\) should be all sources \(\{1,\dots,K\}\); after convergence, once the moving sources are known, \(I\) can include only those moving-source indices [2209.00937]. This selective updating is the mathematical expression of the steering-vector viewpoint.

The dynamic three-speaker simulation in that work used an “instantaneously move[d]” source at 30 seconds and compared IP (all), IP (one), ISS (all), and ISS (one), where “all” denotes continual updating of all sources and “one” denotes updating all sources in the first half and only the moving source in the second half [2209.00937]. The reported runtimes and overall SDR improvements for the 60-second mixture were as follows.

| Method | Runtime | SDR improvement |
|---|---:|---:|
| ISS (all) | 11.001142 s | 9.850487 dB |
| ISS (one) | 8.660962 s | 10.147417 dB |
| IP (all) | 11.544285 s | 8.130473 dB |
| IP (one) | 9.004813 s | 3.843095 dB |

The main findings were that ISS (all) and IP (all) achieved similar separation performance with nearly overlapping segmental SDR curves, while ISS (one) maintained performance comparable to ISS (all) after the motion event and IP (one) failed to recover separation quality [2209.00937]. The most important experimental conclusion was therefore that ISS (one) achieved almost the same SDR improvement as ISS (all) while updating only the moving source [2209.00937].

## 3. ISS, IP, and the ISS2 extension in MM-based IVA

The 2022 ISS2 paper places ISS within a broader MM and block-coordinate framework for IVA and makes the complexity trade-off explicit [2202.00875]. Conventional ISS, denoted ISS\(_1\), updates one column of \(A=W^{-1}\) per iteration. Conventional IP has one-row and two-row variants, IP\(_1\) and IP\(_2\), and IP\(_2\) is described there as the current fastest IP that updates two rows of \(W\) in each iteration [2202.00875].

The central limitation of conventional ISS in that comparison is not objective quality but convergence speed: although the time complexity per iteration of ISS is \(m\) times smaller than that of IP, conventional ISS converges slower than IP\(_2\) [2202.00875]. ISS2 addresses that limitation by updating two columns of the mixing matrix \(A\) in each iteration while maintaining the small time complexity characteristic of ISS [2202.00875]. The paper develops a unified way of constructing ISS-type methods, denoted ISS\(_d\), from which both ISS\(_1\) and ISS2 are obtained systematically [2202.00875].

The asymptotic per-MM-iteration complexity stated for ISS1 and ISS2 is \(\mathcal{O}(K m^2 n)\), whereas IP1 and IP2 require \(\mathcal{O}(K m^3 n + K m^4)\) [2202.00875]. Numerical experiments on reverberant speech mixtures with \(m \in \{4,6,8,10\}\) showed that ISS2 converges in fewer MM iterations than conventional ISS and is comparable to IP\(_2\) [2202.00875]. The same experiments also noted that the lower asymptotic cost of ISS2 did not clearly translate into a wall-clock advantage in the authors’ Python implementation, which they identified as an implementation-efficiency issue rather than a contradiction of the complexity analysis [2202.00875].

This places ISS in a specific methodological role. It is not merely an algebraic rewrite of IP; it is a distinct BCD family that trades inverse-based row updates for structured steering updates on \(A\) or \(W\), and that can itself be block-extended.

## 4. Unified dereverberation and separation

ISS was subsequently incorporated into joint dereverberation and blind source separation through the ILRMA-T framework [2102.06322]. In that setting, the unified filter combines separation and dereverberation, and the objective remains the ILRMA/ILRMA-T negative log-likelihood with NMF source variance modeling [2102.06322]. The computational problem is that ILRMA-T-IP requires two inverse matrices per source row update, which is expensive and potentially numerically fragile [2102.06322].

The ISS-based reformulation preserves the same probabilistic model and objective but replaces the inversion-heavy row updates with rank-1 steering updates [2102.06322]. Two variants were proposed. ILRMA-T-ISS-JOINT alternates a separation-like ISS update for the first \(N\) rows with a joint dereverberation update for the remaining taps; this reduces the inversion burden to one \(NL \times NL\) matrix inversion per iteration and source [2102.06322]. ILRMA-T-ISS-SEQ updates dereverberation-related coefficients sequentially and requires no matrix inversion at all; its implementation is described as straightforward and memory efficient [2102.06322].

The experiments used simulated multichannel reverberant mixtures of WSJ speech in random rectangular rooms with reverberation times of 200–600 ms, CHiME3 background noise, SNR 10–30 dB, source counts 2, 3, and 4, 333 mixtures total, and a 1024-point STFT at 16 kHz with 75% overlap [2102.06322]. The reported metrics were SI-SDR improvement, SI-SIR improvement, CD, and SRMR [2102.06322]. Both ILRMA-T-ISS-JOINT and ILRMA-T-ISS-SEQ achieved comparable final performance to ILRMA-T-IP, dereverberation improved separation performance, and performance remained comparable even without matrix inversions [2102.06322]. For the two-source case, the runtime of ILRMA-T-ISS-SEQ was about the same as ILRMA-T-IP, whereas for three and four sources it was much faster [2102.06322]. The paper also reports that ISS-based methods converge slightly more slowly than ILRMA-T-IP but reach the same final performance [2102.06322].

A plausible implication is that ISS is especially effective when the target filter is already unified and structurally large, because inverse elimination then affects not only arithmetic cost but also numerical robustness and memory footprint.

## 5. Learned surrogates and accelerated descendants

ISS has also been used as the computational backbone for methods that are not limited to conventional source priors or standard AuxIVA updates. In “Surrogate Source Model Learning for Determined Source Separation,” ISS is used because of its lower complexity and lack of matrix inversion, which make it suitable for backpropagation through many iterations of AuxIVA [2011.05540]. The paper replaces the surrogate weights \(u_{fn}(\hat{\mY})\) in the ISS/AuxIVA update by a DNN, trains end-to-end through multiple ISS iterations, and reports large improvements in scale invariant SDR and word error rate, with the abstract highlighting as much as 36% reduction in WER [2011.05540]. Training is done on two-speaker mixtures, and the learned approximate surrogate generalizes to mixtures of three and four speakers without modification [2011.05540].

A later extension inserts ISS into convolutive transfer function-based multichannel NMF. In “Accelerated Convolutive Transfer Function-Based Multichannel NMF Using Iterative Source Steering,” ISS replaces the IP demixing update in CTF-MNMF by the rank-one update \(\mathbf{W}_i \leftarrow \mathbf{W}_i - \mathbf{z}_{r,i}\mathbf{w}_{r,i}^{H}\) [2510.02382]. The paper states that IP has complexity \(\mathcal{O}(ILM^3)\) and ISS has complexity \(\mathcal{O}(ILM^2)\) [2510.02382]. In experiments, CTF-ISS achieved comparable median SDR improvement to CTF-IP, with differences never exceeding 1 dB, and reduced runtime by about 41% for 4 microphones, 51% for 6 microphones, and 33% for 8 microphones [2510.02382].

An element-wise derivative of the same idea appears in semi-blind acoustic echo cancellation. “A computationally efficient semi-blind source separation based approach for nonlinear echo cancellation based on an element-wise iterative source steering” proposes EISS, which replaces a \((PL+1)\times(PL+1)\) inverse in IP-based SBSS-AEC by sequential scalar steering-parameter updates [2312.08610]. The complexity statement there is \(\mathcal{C}_{\mathrm{IP}} \propto \mathcal{O}[(PL)^3]\) versus \(\mathcal{C}_{\mathrm{EISS}} \propto \mathcal{O}[(PL)^2]\) [2312.08610]. On 30 signals from the AEC Challenge synthetic dataset, the reported average results were PESQ 1.89, STOI 0.93, tERLE 12.89 for IP and PESQ 1.90, STOI 0.94, tERLE 12.63 for EISS, supporting the claim that EISS achieves nearly the same AEC performance as IP while being much more computationally efficient [2312.08610].

| Variant | Setting | Reported property |
|---|---|---|
| Learned ISS-AuxIVA surrogate | Determined source separation | Up to 36% WER reduction |
| CTF-MNMF-ISS | Reverberant multichannel BSS | \(\mathcal{O}(ILM^2)\) vs. \(\mathcal{O}(ILM^3)\) |
| EISS | Nonlinear SBSS-AEC | \(\mathcal{O}[(PL)^2]\) vs. \(\mathcal{O}[(PL)^3]\) |

Across these descendants, the recurring pattern is stable: ISS is adopted when inverse-free updates are needed not only for speed, but also for differentiability, memory efficiency, or implementation on embedded hardware.

## 6. Terminological scope and common confusions

The acronym “ISS” is not unique to iterative source steering. In “Informed Source Separation using Iterative Reconstruction,” ISS refers to informed source separation of a single-channel mixture using Multiple Input Spectrogram Inversion, alternating time-frequency consistency enforcement and a remixing constraint [1202.2075]. That framework begins from side information in the form of source spectrograms, initializes with mixture phase, and iteratively reconstructs waveforms; it is unrelated to the inverse-free demixing-matrix updates that define iterative source steering in IVA and related BSS models [1202.2075].

A second ambiguity arises from the broader use of the word “steering” in recent machine learning literature. “Self-Improving Model Steering” is about inference-time steering of large language models and is explicitly “not exactly” iterative source steering in the narrow sense; its strongest analogue is iterative curation of prompt-response pairs through prompt ranking and contrast sampling [2507.08967]. “SHIFT: Steering Hidden Intermediates in Flow Transformers” is described as very close in spirit to ISS because it learns source-conditioned steering directions and applies them across diffusion timesteps, but it is not an iterative optimization method in the usual sense [2604.09213]. These works are conceptually adjacent only at the level of hidden-state intervention and repeated inference-time application.

The narrow technical meaning of Iterative Source Steering in source separation therefore remains specific: an inverse-free, steering-style update rule for separation filters or demixing matrices, derived within MM or auxiliary-function frameworks and used to replace iterative projection in computationally demanding separation, dereverberation, and echo-cancellation problems [2209.00937][2202.00875].

Source: https://www.emergentmind.com/topics/iterative-source-steering-iss