---
title: Differentiable Auditory Loop (DAL)
url: https://www.emergentmind.com/topics/differentiable-auditory-loop-dal
type: topic
---

# Differentiable Auditory Loop (DAL)

Searching arXiv for the cited DAL-related papers and topic context.
The Differentiable Auditory Loop (DAL) is an end-to-end differentiable framework in which an audio processor, an auditory or acoustic model, and an objective are coupled so that gradients can propagate through the entire loop and update processor parameters by gradient-based optimization. In the literature, DAL appears in at least three closely related forms: as a differentiable recursive audio processor such as a Feedback Delay Network (FDN), as a hearing-aid optimization loop in which a differentiable auditory periphery defines the loss domain, and as a broader closed-loop predictive system in which prediction errors are fed back to update latent states. A distinctive recent development is that DAL is no longer confined to offline training: ADAC makes the optimization loop audible by recompiling and hot-swapping a trained differentiable audio graph into a running real-time plugin after each optimizer step [2404.00082], [2507.09372], [2606.04103], [2606.21277].

## 1. Terminology and conceptual scope

One explicit definition describes DAL as “an audio feedback loop whose parameters (e.g., delays, gains, and mixing/feedback matrices) are optimized end-to-end via backpropagation and automatic differentiation against perceptual objectives,” with all loop components exposed to gradient flow by making their signal operations differentiable [2404.00082]. A second formulation defines DAL as placing “a differentiable computational auditory model inside the training loop so that gradients can propagate from a perceptual-domain objective back to the signal-processing network” [2507.09372]. In hearing-aid work, this usually means comparing an impaired auditory pathway driven by processed audio against a normal-hearing pathway driven by a reference signal, then backpropagating through the impaired model to optimize the processor [2103.08569], [2207.07091], [2606.04103].

The term is not used identically in all papers. In the biomimetic frontend literature, the “loop” is not a physical feedback loop but a learning loop in which task losses drive parameter updates through a fully differentiable auditory pipeline [2409.08997]. In auditory working-memory modeling, the relevant architecture is introduced as a “close-loop predictive coding” framework rather than DAL, but it is described as functionally equivalent because predictions, errors, and state updates form a differentiable closed loop [2503.12506]. This suggests that DAL is best understood as a family of differentiable closed-loop auditory systems rather than a single fixed architecture.

A compact way to organize the literature is the following.

| Formulation | Representative papers | Characteristic loop |
|---|---|---|
| Differentiable recursive DSP | [2404.00082], [2606.21277], [2510.00238] | Trainable delays, gains, filters, and feedback |
| Differentiable auditory supervision | [2103.08569], [2207.07091], [2507.09372], [2606.04103] | Processor optimized through auditory-model losses |
| Closed-loop predictive coding | [2503.12506] | Prediction error fed back to latent-state updates |

## 2. Canonical computational pattern

Despite domain differences, DAL systems share a common computational structure. An input waveform is transformed by a parametric processor, the processor output is analyzed by a differentiable auditory or acoustic model, and a loss is computed against a reference representation. Optimization then follows standard gradient-based updates such as
$$
\theta_{t+1}=\theta_t-\eta\nabla_\theta L(\theta_t),
$$
with Adam used in several implementations [2606.21277], [2404.00082].

In DHASP, the hearing-aid processor $P_\theta$ produces $y(t)=P_\theta(x)$, and the loss compares envelope-based representations from a normal-hearing path $A_{\mathrm{NH}}(x)$ and a hearing-impaired path $A_{\mathrm{HI}}(P_\theta(x))$. The training objective is implemented as
$$
L(\theta;\phi)= -\frac{1}{5}\sum_{j=2}^{6}R(j)+\alpha\sum_i L_e^{(i)},
$$
where $R(j)$ is a normalized cepstral correlation and $L_e^{(i)}$ is an energy-control penalty [2103.08569]. In the controllable joint NR+HLC framework, the processor outputs two waveforms, $\hat{y}_{\mathrm{NR}}$ and $\hat{y}_{\mathrm{HLC}}$, and losses are computed in the output space of a differentiable auditory model:
$$
\mathcal{L}_{\mathrm{NR}}=\ell\!\big(\mathcal{A}_{\mathrm{NH}}(\hat{y}_{\mathrm{NR}}),\mathcal{A}_{\mathrm{NH}}(y)\big),
$$
$$
\mathcal{L}_{\mathrm{HLC}}=\ell\!\big(\mathcal{A}_{\mathrm{HI}}(\hat{y}_{\mathrm{HLC}},a),\mathcal{A}_{\mathrm{NH}}(x)\big).
$$
A trainable uncertainty-weighted multi-task objective combines these terms [2507.09372].

In the CARFAC-based DAL, the normal-hearing path produces target Neural Activity Patterns (NAPs) and Stabilized Auditory Images (SAIs), while the impaired path passes the output of a causal SEANet through an impaired CARFAC model. A generic DAL loss is written as
$$
\mathcal{L}= \lambda_{\mathrm{NAP}}\|\mathrm{NAP}_{\mathrm{imp}}(\hat{x})-\mathrm{NAP}_{\mathrm{norm}}(x_{\mathrm{clean}})\|_1
+\lambda_{\mathrm{SAI}}D_{\mathrm{SAI}}\big(\mathrm{SAI}_{\mathrm{imp}}(\hat{x}),\mathrm{SAI}_{\mathrm{norm}}(x_{\mathrm{clean}})\big),
$$
with $D_{\mathrm{SAI}}$ instantiated by SSIM- or PN-based distances [2606.04103].

The same pattern also appears outside hearing aids. In the predictive-coding memory model, the hidden state is updated by minimizing a local free-energy-like objective,
$$
\tilde{\mathbf{h}}^\mu \propto -\, e^{\mathbf{h},\mu}+f'(\mathbf{h}^\mu)\odot \mathbf{W}_{\text{out}}^\top e^{\mathbf{x},\mu},
$$
and the observation error during read is computed relative to the most recently recalled segment, creating an explicitly closed loop [2503.12506].

Framework support reflects this generality. PyTorch is used in DHASP and differentiable FDN work; TensorFlow/Keras is used in CoNNear-based hearing-loss compensation; JAX/Flax is used in CARFAC-based DAL and in the biomimetic differentiable frontend [2103.08569], [2404.00082], [2207.07091], [2409.08997], [2606.04103].

## 3. Differentiable recursion, delay lines, and stability

A central technical problem in DAL research is differentiability through recursive audio structures. The clearest examples arise in FDN-based reverberation and room-acoustic modeling. For an FDN with delay vector $\mathbf{m}$, feedback matrix $\mathbf{A}$, input/output gains $\mathbf{B},\mathbf{C}$, and direct path $D$, the transfer function is
$$
H(z)=\mathbf{C}\bigl(\boldsymbol{\Delta}(z)^{-1}-\mathbf{A}\bigr)^{-1}\mathbf{B}+D,
$$
with
$$
\boldsymbol{\Delta}(z)=\mathrm{diag}(z^{-m_1},\ldots,z^{-m_N}).
$$
In differentiable FDN training, all parameters in $\theta\in\{\mathbf{b},\mathbf{c},d,\mathbf{A},\bm{m}\}$ may be learned by backpropagation [2404.00082], [2606.21277].

The most distinctive difficulty is the delay length. In the learnable-delay FDN, fractional delays are implemented in the frequency domain through a phase factor $e^{-j\omega_k m}$ applied to the FFT of a buffer, so that gradients can flow through the delay via
$$
\frac{\partial}{\partial m}\left[e^{-j\omega_k m}\right]=-j\,\omega_k e^{-j\omega_k m}.
$$
This is combined with constrained parameterizations for stability and causality: nonnegative gains are obtained with $f_{\ge 0}(x)=|x|$, delays satisfy $m_i\in\mathbb{R}_{\ge 0}$, and the feedback matrix is factorized as $\mathbf{A}=\mathbf{U}\bm{\Gamma}$ with $\mathbf{U}=\exp(\mathbf{S})$ orthogonal and $\gamma_i=\frac{1}{1+e^{-\tilde{\gamma}_i}}$ in $(0,1)$ [2404.00082].

ADAC addresses a different stage of the same problem: faithful lowering of a trained differentiable audio graph to real-time DSP. It extracts a framework-agnostic JSON intermediate representation with Series, Parallel, and Recursion nodes and emits FAUST code. Structural mapping is explicit: Series maps to `:`, Parallel to shared-input split, and Recursion to `~`. Because FAUST recursion introduces one implicit sample delay, ADAC corrects loop timing by replacing each in-loop delay $m_i$ by $m_i-1$ and restoring absolute arrival time with an external $z^{-1}$, using
$$
z^{-1}z^{-(m_i-1)}=z^{-m_i}.
$$
For integer delays, the emitted graph matches the source sample-for-sample up to float arithmetic; across stereo FDNs and mono FDNs with direct paths, the residual is at or below $7\times 10^{-5}$ of peak, and the magnitude-response difference is at or below $-80$ dB of peak [2606.21277].

Stability is treated as a first-class DAL concern. ADAC computes a small-gain certificate on shipped parameters,
$$
\sup_{\omega}\prod_{k=1}^{K}\sigma_{\max}\bigl(E_k(e^{j\omega})\bigr)<1 \implies \text{stable},
$$
and also runs pole checks on every recursive filter section. The certificate is written as JSON and checked before building; the exporter refuses to build a model whose certificate is unstable or unproven unless explicitly overridden [2606.21277]. In the metric-driven room-rendering FDN, stability is obtained by the specialization $A=\alpha I$ with $0<\alpha<1$, which yields a parallel-loop DAL with $O(M)$ complexity and reported cost of 63 FLOPs/sample for the tail and 149 FLOPs/sample including early reflections and their HRIR application [2510.00238].

## 4. Audible optimization, compilation, and sound quality

DAL initially referred primarily to differentiable optimization, but recent work made the optimization process itself audible. ADAC operationalizes this by hot-swapping the processor into a running plugin after each optimizer step. After each step, ADAC re-emits FAUST `.dsp` code and atomically rewrites a watched file; a resident plugin built on the FAUST interpreter detects file changes and reloads or recompiles the DSP graph on the fly. Recompilation of the emitted network is under 10 ms on an Apple M2, ADAC’s re-emission time is approximately 0.2 ms, and audible changes occur within a few audio buffers after each gradient step. Publishing is deduplicated and rate-limited, atomic replacement avoids torn reads, and slider values survive reloads “by address” [2606.21277].

The same system couples audibility with deployment. FAUST code can be compiled to audio plugins, web, embedded boards, and FPGA targets, including VST3, AU, CLAP, WebAssembly, Bela, Daisy, ESP32, and VHDL via Syfala. A single call executes code generation, certification, JUCE project generation, release compilation, and installation of validated binaries into plugin folders. Three macro-controls are shipped—reverberation time, dry/wet balance, and pre-delay—and the reverberation-time control uses Jot’s homogeneous decay,
$$
g_i=10^{-3m_i/(f_s\,\mathrm{RT})},
$$
which was validated in the compiled plugin: measured via Schroeder integration, $\mathrm{RT}=0.5$ s yields exactly 0.5000 s [2606.21277].

Closed-loop sound quality has also motivated architectural redesign. The dCoNNear framework was introduced because earlier DNN-based closed-loop systems suffered from aliasing, tonal artifacts, and imaging artifacts caused by strided downsampling and transposed or subpixel upsampling. dCoNNear removes all downsampling and upsampling between layers and uses FIR-like memory blocks with dilated depthwise convolutions at a single sampling rate. In the reported artifact measurements, the hearing-aid model’s fractional-harmonic THD improved from $-28.06$ dB for prior CoNNear to $-39.78$ dB for dCoNNear, and SRMR on noisy speech improved from 5.17 to 6.24, although music SRMR remained slightly higher for prior CoNNear [2501.04116]. This is important because DAL objectives can otherwise be spuriously improved by artifact-generating architectures rather than by genuinely better auditory processing.

## 5. Hearing-aid personalization and auditory-model supervision

The most extensive DAL literature concerns hearing aids and hearing-loss compensation. DHASP established an explicitly differentiable hearing-aid speech-processing pipeline in which a frequency-dependent linear amplifier, parameterized at six audiogram frequencies $\{250,500,1000,2000,4000,6000\}$ Hz, is optimized using a differentiable HASPI-inspired auditory model. The processor is realized as an FIR filter constructed by frequency-response interpolation and IFFT, and the objective is based on cepstral correlation between normal-hearing and hearing-impaired auditory envelopes plus an energy-control penalty. Training used Adam with learning rate 0.001, batch size 128, and 4000 epochs on 0.5 s TIMIT segments normalized to 65 dB SPL equivalent. Across 10 standard audiograms, the optimized filters achieved higher HASPI intelligibility than NAL-R, with improvements significant at paired $t$-test $p<.005$ [2103.08569].

A more physiologically detailed DAL is built from CoNNear models of cochlea, inner hair cell, and auditory nerve. In that framework, a DNN-based hearing-aid processor $g_\theta$ is trained so that the hearing-impaired periphery response $f_{\mathrm{HL}}(g_\theta(x))$ matches the normal-hearing response $f_{\mathrm{NH}}(x)$ under losses on neurograms, population responses, and STFT magnitudes. The 16-layer encoder–decoder CNN has about 5,197,633 trainable parameters. Results show that outer-hair-cell loss is easier to compensate than cochlear synaptopathy: for the OHC-only Slope25 profile, the DNN-HA achieved average NRMSE below 1% at conversational levels, whereas CS-only restoration was partial; for the mixed Slope35-7,0,0 profile, the best EFR restoration increased the simulated response from 4.31 nV unprocessed to 7.75 nV, near the 8.39 nV normal-hearing reference [2207.07091].

The artifact-free dCoNNear closed-loop system takes a related but distinct route. It replaces non-DNN biophysical models with differentiable DNN surrogates of cochlea, IHC, and ANF processing, freezes those auditory modules, and trains a dCoNNear hearing-aid processor to minimize
$$
\ell_{\mathrm{HA}}=\alpha\cdot \mathrm{MSE}\{r_f,\hat{r}_f\}+\beta\cdot \mathrm{MSE}\{p,\hat{p}\},
$$
with $\alpha=30$ and $\beta=1$. Both prior CoNNear HA and dCoNNear HA reduce NRMSE between NH and HI AN population responses, but the paper argues that prior CoNNear’s slightly better NRMSE is partly artifact-driven, whereas dCoNNear provides better sound quality [2501.04116].

Later DAL systems integrate personalization, denoising, and controllability. The controllable joint NR+HLC model uses a BSRNN backbone conditioned on audiograms via FiLM and optimized against a differentiable simplified CASP model. It outputs $\hat{y}_{\mathrm{NR}}$ and $\hat{y}_{\mathrm{HLC}}$ and exposes an inference-time mixing control
$$
\hat{y}(t)=\alpha \hat{y}_{\mathrm{NR}}(t)+(1-\alpha)\hat{y}_{\mathrm{HLC}}(t),\qquad \alpha\in[0,1].
$$
On NH evaluation at $\alpha=1.0$, the controllable joint model reached SDR 13.00, PESQ 2.14, and ESTOI 0.85. On HI evaluation, $\alpha=0.0$ gave HASPI 0.77, while $\alpha=0.6$ gave the best HASQI at 0.61 [2507.09372].

The CARFAC-based DAL pushes this trajectory further by using a subject-specific impaired cochlear model and a causal SEANet waveform-to-waveform UNet generator. CARFAC v3 was ported to JAX/Flax with 77 channels up to 14.4 kHz at 32 kHz sampling, and the proof-of-concept impairment was modeled by setting OHC health to 0.5, producing a mild but significant loss with more than 30 dB HL around 3–4 kHz. On NAP metrics, the noisy baseline had L1 0.099, correlation 0.428, and SI-SDR $-6.009$ dB, while SEANet trained with L1-NAP achieved L1 0.073, correlation 0.706, and SI-SDR $-0.261$ dB. On SAI metrics, SEANet variants improved correlation to 0.853–0.870, outperforming the tested MHA baselines [2606.04103].

## 6. Extensions, misconceptions, and open problems

DAL should not be reduced to hearing-aid fitting or to explicit time-domain recursion. The biomimetic frontend for differentiable audio processing is a strictly feedforward, vectorized auditory pipeline comprising a constant-Q cochlear filterbank, hair-cell-like compression, lateral inhibition, short-term integration, and cortical STRFs. The paper explicitly notes that the loop is a learning loop rather than a physical feedback loop. The frontend has about 212 learnable parameters and serves classification and enhancement tasks; in enhancement, the fully differentiable frontend achieved SI-SDR 8.31±0.23 in the Original condition and 16.2±0.19 in the NewNoise condition, with the best or near-best performance across conditions [2409.08997].

Similarly, the closed-loop predictive-coding framework for auditory working memory does not introduce the term DAL explicitly, but it matches the functional description of a differentiable closed loop. It uses a hidden size of 1,600 neurons, processes 200 ms segments, retains the first 20 steps corresponding to 4 s for memory, writes for 100 epochs with $N_1=100$ inner inference iterations, and reads with $N_2=500$ iterations. On ESC-50, most classes showed median semantic similarity above 0.7; on LibriSpeech, median semantic similarity was above 0.8, and closed-loop feedback substantially improved waveform alignment and recognition consistency relative to recall without feedback [2503.12506].

A common misconception is that differentiability alone guarantees equivalence, stability, or perceptual validity. The literature repeatedly qualifies such claims. ADAC’s equivalence and stability guarantees are tied to the linear setting, even though FAUST can express nonlinear and time-varying operators [2606.21277]. The differentiable FDN room-acoustics model is time-invariant and frequency-independent, and the paper states that none of the tested models matched the target magnitude response well [2404.00082]. The controllable NR+HLC model removes outer-ear and modulation-filterbank stages from CASP for simplicity and runtime [2507.09372]. The CARFAC-based DAL currently reports only simulated OHC loss in experiments, while broader etiologies, clinical listening tests, and deployment measurements remain future work [2606.04103].

Open problems are correspondingly clear. Extending guarantees from LTI graphs to nonlinear or time-varying processors, incorporating fractional-delay implementations rather than emission-time rounding, adding oversampling or ADAA-like approaches for nonlinear blocks, broadening impairment models beyond OHC loss, and validating auditory-domain objectives against human studies are all presented as future work rather than completed results [2606.21277], [2404.00082], [2507.09372], [2606.04103]. The current literature therefore establishes DAL less as a finished standard than as a differentiable systems framework whose concrete realization depends on how recursion, auditory modeling, stability, and deployment are jointly handled.

Source: https://www.emergentmind.com/topics/differentiable-auditory-loop-dal