Acoustic Memory: Mechanisms and Applications
- Acoustic memory is the retention and retrieval of acoustic signals, capturing the history-dependent behavior of systems through physical, computational, or biological mechanisms.
- In integrated photonics and dispersive media, acoustic memory maps optical data onto traveling acoustic phonons, achieving high bandwidth storage with tunable delay and phase coherence.
- In machine learning, acoustic memory supports ASR and audio-language models by preserving non-linguistic cues over long contexts, enhancing recognition accuracy and model efficiency.
Searching arXiv for recent and foundational papers on acoustic memory across physical, mathematical, and machine-learning contexts. arXiv search query: "acoustic memory" Acoustic memory denotes a set of mechanisms by which acoustic degrees of freedom, acoustic propagation histories, or acoustic representations are retained and later re-accessed. In integrated photonics it refers to coherent mapping of optical information onto traveling acoustic phonons and its subsequent retrieval; in dispersive wave theory it refers to after-effect terms represented by temporal convolutions and memory-type boundary conditions; in contemporary audio-language modeling it refers to retention of non-linguistic audio cues such as environmental sounds across multiple conversational turns (Merklein et al., 2016, Totieva et al., 12 May 2025, Xiao et al., 26 May 2026). Across these literatures, the term names a common functional role—history retention—rather than a single physical implementation.
1. Conceptual scope
The literature uses “acoustic memory” in several technically distinct senses. In dispersive and viscoelastic media, memory is constitutive: the present wave field depends on the entire history of deformation, and this dependence is written explicitly through convolution kernels in the governing equations and in acoustic boundary conditions. In transcranial optoacoustics, memory is a propagation invariant: nearby intracranial sources experience nearly the same skull-induced spatio-temporal distortion, so the medium “memorizes” a local distortion kernel. In large audio LLMs, acoustic memory is representational: the model must retain non-linguistic audio cues heard earlier and later answer a probe about them (Totieva et al., 12 May 2025, Dean-Ben et al., 2021, Xiao et al., 26 May 2026).
A common source of confusion is the conflation of acoustic memory with semantic memory for speech. EnvMem separates these explicitly: semantic memory concerns spoken linguistic content such as words and numeric facts, whereas acoustic memory concerns later recognition or classification of an earlier environmental sound. This distinction is operational rather than philosophical, because the benchmark evaluates the two with matched multi-turn dialogue structure and multiple context lengths (Xiao et al., 26 May 2026).
Another common simplification is to treat acoustic memory as necessarily a resonant storage cavity. The broader record includes traveling-wave Brillouin buffers, multimode bulk-acoustic systems, inverse problems for memory kernels, acoustically trained suspensions, and temporally modulated electroacoustic media. This suggests that acoustic memory is best understood as a family resemblance across storage, constitutive history dependence, and invariant propagation effects rather than as a single device class.
2. Coherent phononic storage of optical information
In chip-integrated stimulated Brillouin scattering (SBS), acoustic memory is realized by transferring optical information to a coherent hypersound wave and recovering it by the reverse process. The waveguide platform of sputtered chalcogenide glass AsS embedded in silica confines both light and GHz-frequency longitudinal acoustic modes through refractive-index and acoustic-impedance mismatch. In the demonstrated rib waveguide, the cross-section is , spiral lengths are $9$– on a footprint, the effective area is , the optical loss is , the Brillouin shift is , and the acoustic lifetime is . The coupled-mode dynamics are written as
0
1
2
The memory cycle is correspondingly write, decay, and read: the optical data and write pulses excite 3, the acoustic envelope decays as 4, and a read pulse generates the retrieved field 5 (Merklein et al., 2016).
The experimentally demonstrated performance establishes a distinctive regime: pulses as short as 6 were stored and retrieved, corresponding to 7 instantaneous bandwidth, even though the intrinsic Brillouin linewidth is 8. The storage time was continuously tunable from 9 to 0 the pulse width or up to 1; retrieval efficiency decayed exponentially, with 2 at 3 and 4 at 5. Multi-wavelength operation was demonstrated on two channels separated by 6, with cross-talk suppression 7 and no measurable depletion of channel 2 when writing channel 1. Because the phase-matching condition 8 assigns a unique acoustic wavevector to each wavelength pair, the retrieved photon emerges at the original 9, enabling frequency-multiplexed buffering (Merklein et al., 2016).
The short native phonon lifetime motivated refreshed-phonon storage. In the refreshed scheme, synchronized optical pulses resonantly reinforce the acoustic wave and counteract intrinsic decay. The minimal model writes the acoustic amplitude $9$0 as
$9$1
and under periodic refresh the recursion
$9$2
yields a steady-state amplitude $9$3. If $9$4, each refresh step exactly compensates the preceding decay. Experimentally, a chalcogenide rib waveguide of length $9$5 with $9$6, group velocity $9$7, and intrinsic phonon lifetime $9$8 was driven with $9$9 data/write/read pulses and 0 refresh pulses. At 1, unrefreshed readout efficiency was 2; with 3 or 4 refresh pulses it rose to 5 and 6, respectively. With 7 refresh pulses spaced by 8, clear readout was achieved at 9, four times the intrinsic lifetime, and homodyne detection verified phase preservation after 0. The same analysis estimates storage times on the order of 1 without changing the apparatus and anticipates microsecond storage under improved extinction, reduced spontaneous Brillouin noise, and chirped refresh pulses (Stiller et al., 2019).
Taken together, these results show that traveling-wave acoustic memory can combine GHz-class bandwidth with coherent phase retention. A plausible implication is that the usual bandwidth–delay constraint is not intrinsic to phonon-based storage, but depends on how the phonon population is generated, refreshed, and read out.
3. Quantum acoustic memories and phonon-mode control
In superconducting and optomechanical platforms, acoustic memory is often a genuine quantum memory: a long-lived phonon mode stores a qubit or bosonic state and is accessed through a nonlinear ancilla. A representative example is the multimode bulk-acoustic system comprising an Xmon-type transmon coupled to equally spaced HBAR modes on sapphire. Under low-frequency longitudinal modulation,
2
and the effective sideband interaction for the 3-th branch is 4. This permits selective access to individual modes despite their uniform spacing. The measured parameters are 5, 6, qubit 7, acoustic-mode lifetime 8, maximum 9, and 0-swap time 1. The initialize–write–store–read protocol uses a qubit 2-pulse, a sideband-mediated phonon swap, optional switch-off modulation, a storage interval 3, and a reverse swap followed by dispersive readout. The demonstrated storage window extends to 4 (Kervinen et al., 2020).
At the opposite lifetime extreme, a crystalline-silicon optomechanical crystal nanobeam cavity with a phononic bandgap shield localizes a 5 breathing mode and suppresses radiation loss exponentially with shield length. At 6 shield periods, all excitation protocols yielded the same intrinsic damping rate 7, corresponding to 8, 9, and 0; the implied effective phonon propagation length is 1. The measured damping is consistent with non-resonant two-level systems on etched silicon surfaces rather than three-phonon scattering. Because red and blue sideband pulses support write/read operations and 2 can reach 3, the corresponding cooperativity can reach 4, implying near-unity write/read fidelity and a storage time of 5 in the idealized quantum-memory picture described in the study (MacCabe et al., 2019).
Multimode acoustic storage also enables memory architectures beyond simple delay. In the proposed hybrid QRAM, a single transmon is piezoelectrically coupled to many high-6 acoustic modes, with off-resonant drives engineering effective beamsplitter and three-mode interactions. The platform admits BAW resonators with 7, SAW resonators with 8, and phononic-crystal resonators with 9; engineered couplings satisfy 0–1 and 2–3. For 4, 5, 6, and 7, the virtual-gate fidelity exceeds 8. The same work uses designated address modes and a bucket-brigade routing scheme to realize QRAM on a single chip, with quantum information stored directly in phonon Fock states (Hann et al., 2019).
A more specialized proposal stores photonic orbital angular momentum in a mechanical shear mode on a cavity mirror. The optoacoustic interaction
9
enforces the selection rule 0, since the optical intensity profile carries 1. Under linearization and resolved-sideband conditions, a 2-pulse state swap has duration 3. With 4–5, 6, 7, 8, and 9, the analysis yields fidelities 00 for 01, and 02 up to 03 or higher with optimized radial indices (Shi et al., 2013).
These platforms span traveling hypersound, multimode HBARs, phononic-crystal cavities, and optomechanical shear modes. Taken together, they indicate that acoustic memory can be engineered either for large bandwidth and modest delay or for extreme coherence and discrete quantum access, depending on whether the relevant phonons are traveling waves or highly shielded cavity modes.
4. Wave-propagation memory, imaging, and inverse problems
Acoustic memory also appears when propagation distortions persist locally across nearby source positions. In transcranial optoacoustic imaging, broadband ultrasonic pulses generated at neighboring intracranial locations traverse the skull with nearly identical mode conversions, reverberations, and attenuation profiles; the measured waveforms differ primarily by a delay. This “optoacoustic memory effect” is modeled through the wave equation
04
discretized as 05. The local memory effect is quantified by cross-correlation 06 and by the normalized peak correlation 07. Experimentally, 08 for lateral shifts up to 09, and a memory-based inversion that approximates each forward-model column as a delayed version of a measured reference sinogram resolves 10 spheres separated by 11, matching the 12 skull-free resolution. In three-dimensional random microsphere phantoms, the same method restores point-like foci with peak-to-sidelobe ratio 13, whereas homogeneous-acoustics reconstructions remain grossly distorted (Dean-Ben et al., 2021).
A different use of the term concerns permanent shifts generated by nonlinear sound waves. For a one-dimensional barotropic perfect fluid, the exact Riemann-wave equation
14
implies that if the initial profile has a constant tail 15, then the density after the wave has passed is permanently shifted to
16
with acoustic memory
17
For weak disturbances, 18. The proposed experimental realization uses a box-trapped Bose–Einstein condensate, a phase-imprinted pulse with an oscillatory front and constant tail, and in situ absorption imaging before the shock time 19. The effect is presented as an acoustic analogue of gravitational-wave memory whose nonlinearity comes from the perfect-fluid equations rather than from Einstein’s equations (Datta et al., 2020).
In PDE analysis, acoustic memory is formalized through integral terms and acoustic boundary conditions. The one-dimensional inverse problem for a dispersive bar uses
20
on 21, with 22 and boundary conditions at 23,
24
where 25. The inverse task is to recover the kernel 26 from the overdetermination
27
After reduction to homogeneous boundary conditions via 28 and 29, contraction arguments in Sobolev spaces yield global existence and uniqueness: 30 The non-degeneracy condition 31 ensures invertibility of the Volterra equation for 32 (Totieva et al., 12 May 2025).
These studies show that acoustic memory can be a local propagation invariance, a permanent nonlinear remnant, or a constitutive kernel to be identified from data. A plausible implication is that “memory” in wave acoustics is often less about storing a signal in a separate register than about preserving a history-dependent transformation law.
5. Material and biological embodiments
In dense suspensions under shear, acoustic memory can be embedded directly into the rheological microstructure. The training protocol uses a stress-controlled rheometer with a piezoelectric disk applying a 33 sine wave at nominal acoustic power 34. At volume fraction 35, a constant shear stress 36 is applied while an acoustic power 37 is maintained for 38; when 39 at 40, every trained sample shear-jams within 41. The stress is decomposed as
42
with primary force chains aligned with the maximum compressive axis and secondary chains aligned with the orthogonal extensional axis. During shear cessation, the normalized stress is fit by
43
where 44, 45, and 46, and 47, 48. Different training powers produce markedly different responses: after shear reversal, the minimum viscosity rises from 49 at 50 to 51 at 52, while the reverse strain needed to re-jam decreases from 53 to 54. The same training can induce shear jamming below the conventional threshold, both by lowering 55 to 56 and by lowering the applied stress to 57 (Ong et al., 2024).
The proposed electroacoustic model of the neuron relocates acoustic memory into a temporally modulated biological medium. In that framework, Coulomb forces associated with the action potential deform the membrane and modulate the compressibility of the axoplasm-plus-shell system. The effective stiffness satisfies
58
and with 59 the acoustic speed becomes
60
at half-depolarization. The resulting one-dimensional acoustic equation is
61
or equivalently
62
For a periodic train of action potentials with period 63, 64 admits a Floquet expansion and yields an infinite-dimensional system for the harmonic amplitudes 65; numerical treatment produces allowed bands and forbidden temporal gaps. The study proposes that repeated pulse trains may open or close these dynamic band gaps and thereby modulate pathway selectivity, with possible relevance to plasticity, memory consolidation, and brain-field resonances, but presents this as a theoretical framework rather than an established neurophysiological mechanism (Meseguer et al., 2023).
These material and biological examples emphasize that acoustic memory need not be a localized resonator. It may instead be encoded in anisotropic contact networks or in a time-periodic medium whose transmission properties depend on prior excitation history.
6. Acoustic memory in machine learning and audio-LLMs
In machine learning, “acoustic memory” has two distinct uses. In streaming ASR it usually denotes mechanisms for carrying long-range acoustic context with bounded latency and bounded memory complexity; in large audio LLMs it denotes the ability to remember non-speech sounds across turns. The augmented-memory transformer for acoustic modeling segments the frame sequence into blocks 66, augments each with left and right context, and appends a bank of summary vectors 67. Self-attention is then performed jointly over current frames and memory slots, with the final summarization query producing the new memory 68. With 69-dimensional log-Mel features, a VGG front-end, 70, 71 heads, segment length 72 frames, left context 73, right context 74, and memory-bank sizes up to 75, the 76M-parameter AMTrf attains 77 test-clean and 78 test-other WER at 79 look-ahead, outperforming the 80M LC-BLSTM baseline at 81 and 82, while retaining strict streaming behavior (Wu et al., 2020).
Emformer modifies this idea by distilling long-range context into a fixed-size augmented memory bank and caching left-context key/value projections. For a sequence of length 83, full self-attention costs 84 time and 85 space, whereas blockwise attention with memory of size 86 and block length 87 costs approximately 88 per block and becomes quasi-linear in 89 when 90. The memory summary is
91
with a FIFO update 92. In LibriSpeech hybrid modeling at medium latency, Emformer 24L reaches 93 / 94 WER on clean/other with RTF 95 and training 96, compared with AM-TRF at 97 / 98, RTF 99, and 00; the reported gains are a 01 training speedup and an 02 RTF reduction (Shi et al., 2020).
Earlier acoustic models treated memory as recurrent state or as a computational bottleneck. The TC-DNN-BLSTM-DNN architecture uses BLSTM cell state to “remember” features across tens to hundreds of frames and reduces WSJ eval92 WER from 03 for a 04 ReLU DNN baseline to 05 for the full model. Self-attentional acoustic models highlight a different issue: raw self-attention memory grows as 06 for utterances up to 07 frames, which is mitigated through downsampling and Gaussian biasing, yielding a best TEDLIUM WER of 08 / 09 for dev/test while training at 10k characters/s compared with 11k for LSTM baselines. A separate line of work pursues memory efficiency of the model itself rather than memory of context: binary hidden-layer weights reduce weight storage by roughly 12, shrinking a WSJ 13-unit network from 14 to 15, at the cost of WER degradation from 16 / 17 to 18 / 19 on dev93/eval92 (Chan et al., 2015, Sperber et al., 2018, Lu, 2017).
The recent multi-turn literature returns to acoustic memory in the literal sense of recalling non-linguistic sounds. EnvMem constructs dialogues of length 20 in which only the first user turn contains a sound mixed with speech at fixed 21 SNR, and the final turn asks either an acoustic question or a matched semantic question. The benchmark contains 22 acoustic-probe cases and 23 semantic-probe cases. Latent analyses define drift 24, use 25-way linear probes, and compute linear CKA across layers. The central finding is that representational trajectory drift, rather than retrieval failure, explains most degradation: failed long-context trials align with short-context trajectories in mid-layers, and attention interventions change accuracy by only 26 with confidence intervals spanning zero. By contrast, activation patching at the best-probe layer can raise accuracy on failed 27 cases from near chance 28 to up to 29 for Qwen2.5-Omni, provided the donor representation is format-compatible and from the same acoustic class (Xiao et al., 26 May 2026).
A more speculative computational proposal is Phonetic Trajectory Memory, which replaces growing key–value caches with a fixed-size state 30 evolving under irrational rotations and phonetic injections. The architecture reports bridge-token updates of 31 bytes versus 32 for dense FP16 key–value storage, compression 33 for bridges, overall compression 34 when 35 of tokens are bridged, and retrieval latency approximately 36 independent of context depth. The work frames retrieval as “Signal Consensus” between semantic prior and geometric likelihood, and reports up to approximately 37 factual accuracy, but it should be read as a proposed biomimetic memory architecture rather than as an established acoustic-memory benchmark (Houichime et al., 23 Dec 2025).
Across these computational literatures, acoustic memory ranges from explicit memory banks for frame sequences, to recurrent state for acoustic context, to the retention of environmental sound cues in long-context audio dialogue. This suggests that the computational question has shifted from whether a model can carry acoustic history at all to which internal representation format remains decodable after long temporal separation.