Papers
Topics
Authors
Recent
Search
2000 character limit reached

MUFFIN: User-Adaptive Frequency Filtering

Updated 4 July 2026
  • The paper introduces MUFFIN, which integrates global total-spectrum and local band-sensitive filtering with a user-adaptive module to enhance next-item predictions.
  • It employs a dual-branch architecture to separately capture long-term stable interests (low-frequency) and short-term intent shifts (high-frequency) in user behavior.
  • Experimental results across multiple benchmarks show significant performance gains over state-of-the-art models, validating the personalized spectral filtering approach.

Mixture of User-adaptive Frequency FIlteriNg (MUFFIN) is a frequency-domain sequential recommendation model that predicts a user’s next interaction by combining full-spectrum modeling, local band-sensitive emphasis, and user-specific frequency filtering. It is designed for the standard next-item sequential recommendation setting, where a user sequence Su=[i1,i2,,iSu]S_u = [i_1, i_2, \dots, i_{|S_u|}] is used to estimate Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u). The model is motivated by two stated limitations of earlier frequency-domain sequential recommenders: limited frequency band coverage and lack of personalized frequency filtering. MUFFIN addresses these through a dual-branch architecture composed of a Global Filtering Module (GFM), a Local Filtering Module (LFM), and a User-Adaptive Filter (UAF) used in both branches (Baek et al., 19 Aug 2025).

1. Problem formulation and conceptual basis

MUFFIN treats user behavior sequences as objects with informative spectral structure. In the formulation used by the model, low-frequency components correspond to slow, smooth, long-term preference changes; high-frequency components correspond to abrupt transitions, short-term intent changes, or rapid item switching; and mixed spectra can reflect users who exhibit both stable core interests and intermittent exploration (Baek et al., 19 Aug 2025). This spectral interpretation is used to motivate a recommendation architecture operating directly in the frequency domain rather than relying only on time-domain sequence encoders.

The model is introduced for the standard sequential recommendation problem. Let U\mathcal U and I\mathcal I denote the user and item sets, and let the observed interaction sequence for user uu be

Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],

with ijIi_j \in \mathcal I. The learning objective is written as

θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).

Within this setting, MUFFIN argues that sequential behavior often requires both a comprehensive view over the full spectrum and selective emphasis on informative local frequency regions, because useful recommendation signals are not restricted to a single frequency range (Baek et al., 19 Aug 2025).

A central premise is that earlier frequency-domain sequential recommenders typically learn one shared spectral filter and apply it to every user. MUFFIN identifies this as a personalization deficiency: a filter that boosts low frequencies may help users with stable long-term interests but harm users whose behavior is dominated by high-frequency fluctuations. The model therefore combines three elements: global full-spectrum modeling, local band-sensitive emphasis, and user-adaptive filtering (Baek et al., 19 Aug 2025).

2. Dual-branch architecture

MUFFIN consists of two parallel filtering branches. The Global Filtering Module processes the entire frequency spectrum at once to capture overall behavioral patterns across all frequency ranges. The Local Filtering Module partitions the spectrum into multiple contiguous bands and softly emphasizes the most important ones while preserving information from all bands. Both branches use the same User-Adaptive Filter, which generates user-specific modulation weights from the user’s initial frequency representation (Baek et al., 19 Aug 2025).

The input sequence is embedded into

H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},

where nn is the maximum sequence length and Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)0 is the hidden dimension. MUFFIN then transforms Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)1 into the frequency domain, generates a user-adaptive filter from the resulting spectrum, applies multiple layers of GFM and LFM processing with FFN refinement, concatenates the final branch outputs, projects them, adds a residual connection from the input embeddings, and predicts the next item (Baek et al., 19 Aug 2025).

The frequency transform is based on RFFT. For a real-valued sequence Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)2, the model writes

Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)3

For sequence embeddings, the initial frequency-domain representation is

Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)4

The generic filtering operation is

Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)5

where Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)6 is a learnable complex-valued filter and Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)7 denotes element-wise multiplication (Baek et al., 19 Aug 2025).

In GFM, the layer-Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)8 input Pθ(i=iSu+1Su)P_\theta(i = i_{|S_u|+1} \mid S_u)9 is transformed to U\mathcal U0, modulated by a personalized complex filter, returned to the time domain, and passed through residual, dropout, and normalization: U\mathcal U1

U\mathcal U2

The stated role of GFM is to ensure that no useful signal is missed because all frequencies are processed together (Baek et al., 19 Aug 2025).

In LFM, the spectrum is partitioned into U\mathcal U3 contiguous bands: U\mathcal U4 The band widths are defined by

U\mathcal U5

For each band U\mathcal U6, the model filters only that band, zero-pads the remainder of the spectrum, applies inverse FFT, and obtains a band-specific time-domain representation. These band outputs are then softly aggregated rather than hard-selected (Baek et al., 19 Aug 2025).

This dual structure is the reason the model is described as a “mixture.” The term refers both to the combination of global and local filtering modules and to the soft gating mixture over multiple local frequency-band outputs within LFM (Baek et al., 19 Aug 2025).

3. User-Adaptive Filter and local band gating

The User-Adaptive Filter is the principal personalization mechanism in MUFFIN. It is generated from the initial frequency representation U\mathcal U7, not from the layer-wise spectral states, and it uses only the amplitude of the complex spectrum: U\mathcal U8 The construction is

U\mathcal U9

I\mathcal I0

where I\mathcal I1 is the sigmoid and the convolution uses kernel I\mathcal I2 with kernel size I\mathcal I3 (Baek et al., 19 Aug 2025).

This produces a real-valued, user-specific modulation map over frequency bins and channels. The map is then applied to the learnable complex filters in both branches: I\mathcal I4

I\mathcal I5

The model therefore personalizes spectral processing by modulating base filters using the user’s initial frequency-domain profile (Baek et al., 19 Aug 2025).

The paper explicitly compares this convolutional UAF with an MLP-based variant and reports that the convolutional version performs better. The explanation given is that convolution aggregates neighboring frequency amplitudes and captures local structure in the spectrum more effectively than an MLP that treats components more independently (Baek et al., 19 Aug 2025). This suggests that MUFFIN’s notion of user adaptation is not merely per-user scaling, but localized adaptation over adjacent spectral bins.

The local branch supplements UAF with a second gating mechanism over the I\mathcal I6 contiguous bands. Using the amplitude spectrum at layer I\mathcal I7,

I\mathcal I8

the model computes soft weights

I\mathcal I9

where uu0 is a three-layer MLP with GeLU. The final local output is

uu1

The paper emphasizes that this is not hard band selection. All bands remain active; the model changes only their relative emphasis. This is used to mitigate information loss that could arise from rigid band pruning (Baek et al., 19 Aug 2025).

A load balancing term is added to avoid local-gate collapse onto a small number of bands: uu2 This regularizer encourages more balanced band usage while preserving selectivity (Baek et al., 19 Aug 2025).

4. Forward computation, losses, and optimization

After branch-specific filtering, each branch uses the same feed-forward block: uu3 with

uu4

For branch uu5,

uu6

After uu7 layers, the two outputs are concatenated and projected: uu8 A residual connection from the original embeddings is then added: uu9 The representation at the last interacted position is used for prediction: Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],0 where the item embedding matrix Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],1 is shared between input embedding and output projection (Baek et al., 19 Aug 2025).

MUFFIN is trained with a three-part objective. The recommendation loss is cross-entropy: Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],2 The model also adds branch-specific auxiliary supervision,

Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],3

Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],4

to ensure that both branches learn predictive representations individually. The total loss is

Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],5

where Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],6 and Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],7 weight the auxiliary and balancing losses (Baek et al., 19 Aug 2025).

The implementation details reported in the paper are specific. The framework is RecBole and RecBole-DA; the optimizer is Adam; the learning rate is Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],8; the batch size is Su=[i1,i2,,iSu],S_u = [i_1, i_2, \dots, i_{|S_u|}],9; the hidden dimension is ijIi_j \in \mathcal I0; the number of layers for frequency-based models is ijIi_j \in \mathcal I1; the number of frequency bands satisfies

ijIi_j \in \mathcal I2

the auxiliary loss weight satisfies

ijIi_j \in \mathcal I3

the balancing loss weight satisfies

ijIi_j \in \mathcal I4

the UAF kernel size satisfies

ijIi_j \in \mathcal I5

dropout is ijIi_j \in \mathcal I6 on ML-1M and ijIi_j \in \mathcal I7 on the other datasets; the maximum sequence length is ijIi_j \in \mathcal I8; the validation metric is N@20; and early stopping uses patience of 15 epochs (Baek et al., 19 Aug 2025).

5. Experimental results and analytical findings

MUFFIN is evaluated on five benchmark datasets after 5-core preprocessing: Amazon Beauty, Amazon Toys, Amazon Sports, Yelp, and ML-1M. The reported statistics are Beauty: 22,363 users, 12,101 items, 198,502 interactions, avg length 8.9; Toys: 19,412 users, 11,924 items, 167,597 interactions, avg length 8.6; Sports: 35,598 users, 18,357 items, 296,337 interactions, avg length 8.3; Yelp: 30,499 users, 20,068 items, 317,182 interactions, avg length 10.4; and ML-1M: 6,041 users, 3,417 items, 999,611 interactions, avg length 165.5 (Baek et al., 19 Aug 2025).

The evaluation protocol is leave-one-out, using the last item for test, the second-last item for validation, and earlier items for training. Metrics are Recall@ijIi_j \in \mathcal I9 and NDCG@θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).0 with θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).1, averaged over all test users and over five random runs. Baselines include GRU4Rec, SASRec, BERT4Rec, DuoRec, FMLPRec, FEARec, BSARec, and SLIME4Rec (Baek et al., 19 Aug 2025).

MUFFIN is reported as achieving the best performance on all five datasets across nearly all metrics. Representative values listed in the paper include:

Dataset MUFFIN R@10 Second-best R@10 MUFFIN N@10 Second-best N@10
Beauty 0.0919 0.0885 0.0487 0.0460
Toys 0.1005 0.0995 0.0542 0.0506
Sports 0.0570 0.0530 0.0281 0.0271
Yelp 0.0755 0.0729 0.0429 0.0412
ML-1M 0.3187 0.3103 0.1848 0.1798

The paper summarizes the average gains as θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).2 in R@10 and θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).3 in N@10 over the strongest transformer baseline DuoRec, and θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).4 in R@10 and θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).5 in N@10 over the strongest frequency-domain competitor SLIME4Rec (Baek et al., 19 Aug 2025).

The ablation studies on Beauty and ML-1M isolate the contributions of the main components. Removing UAF degrades performance: on Beauty, MUFFIN R@10/N@10 is θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).6 versus θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).7 without UAF; on ML-1M, MUFFIN is θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).8 versus θ=argmaxθPθ(i=iSu+1Su).\theta^* = \arg\max_\theta P_\theta(i = i_{|S_u|+1} \mid S_u).9 without UAF. Removing GFM gives H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},0 on Beauty and H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},1 on ML-1M. Removing LFM gives H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},2 on Beauty and H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},3 on ML-1M. Removing auxiliary loss causes one of the largest drops, and removing balancing loss also reduces performance (Baek et al., 19 Aug 2025).

The hyperparameter analysis reported in the paper shows that performance improves as H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},4 increases from 1 to a moderate value and then declines when too many bands are used. The stated interpretation is that H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},5 makes LFM equivalent to GFM, best values were around 4 or 6 depending on dataset, too few bands reduce granularity, and too many bands can overfit (Baek et al., 19 Aug 2025).

Runtime analysis in the paper states that Fourier transform via FFT/RFFT is H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},6, generally cheaper than quadratic self-attention over length H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},7. MUFFIN trains faster than SLIME4Rec in the reported runtime table: on Beauty, H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},8s versus H0Rn×d,\mathbf H^0 \in \mathbb R^{n \times d},9s per epoch; on ML-1M, nn0s versus nn1s. Evaluation is slower than some baselines because MUFFIN runs both global and local branches: on Beauty, nn2s versus nn3s for SLIME4Rec; on ML-1M, nn4s versus nn5s (Baek et al., 19 Aug 2025).

6. Position within frequency-aware recommendation and common points of confusion

MUFFIN belongs to a line of recommendation research that interprets recommendation models through spectral filtering. In sequential recommendation, “Filtering with Time-frequency Analysis: An Adaptive and Lightweight Model for Sequential Recommender Systems Based on Discrete Wavelet Transform” introduces DWTRec, which replaces self-attention with an adaptive time-frequency filter based on discrete wavelet transform. DWTRec decomposes user-interest representations into approximation and detail components, adaptively weights the detail components, and reconstructs the filtered sequence representation. Its central claim is that self-attention behaves as a low-pass filter and tends to suppress high-frequency information corresponding to abrupt interest shifts. This places DWTRec close to MUFFIN in the broad sense that both models reject a single shared low-pass view of user behavior and instead emphasize multiband spectral structure (Lu et al., 30 Mar 2025).

The difference is architectural and conceptual. DWTRec uses wavelet-domain coefficient masks over localized time-frequency components and is not explicitly user-adaptive in the sense of a user-conditioned gating network. MUFFIN, by contrast, generates a user-specific modulation map nn6 and applies it to both global and local frequency-domain filters. This suggests that DWTRec is best viewed as adaptive multiscale filtering, whereas MUFFIN is explicitly framed as user-adaptive frequency filtering (Lu et al., 30 Mar 2025).

A second related direction appears in graph-based collaborative filtering. “Frequency-aware Graph Signal Processing for Collaborative Filtering” proposes FaGSP, which combines an ideal high-pass filter, an ideal low-pass filter, and high-order neighborhood filters. FaGSP interprets low-frequency components as common characteristics and high-frequency components as unique characteristics, but it uses fixed global coefficients such as nn7 and nn8 rather than per-user adaptive weighting. This makes it a close conceptual precursor for multi-filter frequency-aware recommendation, but not for user-adaptive mixture filtering in the strict MUFFIN sense (Xia et al., 2024).

Subsequent work extends adaptive spectral filtering into other recommendation settings. “TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendation” constructs a bank of time-conditioned graph operators and mixes them through soft gating derived from temporal context. This suggests a different path toward adaptive spectral recommendation: instead of mixing contiguous Fourier bands, the model mixes temporal smoothing operators defined on different time-weighted graphs. A plausible implication is that MUFFIN and TimeMM exemplify two distinct forms of adaptive spectral modeling—one centered on explicit frequency-domain filtering over sequences, the other on operator-based graph filtering with temporal conditioning (Yang et al., 29 Apr 2026).

A recurring source of confusion is acronym reuse. “MUFFIN” is not unique to sequential recommendation. In “Multi-band Frequency Reconstruction for Neural Psychoacoustic Coding,” MUFFIN denotes a neural audio codec built around psychoacoustically guided multi-band frequency reconstruction and Multi-Band Spectral Residual Vector Quantization. That work does not refer to Mixture of User-adaptive Frequency Filtering and belongs to neural audio coding rather than recommender systems (Ng et al., 12 May 2025).

Within recommendation research, the defining features of MUFFIN are therefore precise: a dual-branch frequency-domain encoder, soft local band aggregation without hard band exclusion, and user-specific spectral modulation derived from the amplitude of the initial sequence spectrum (Baek et al., 19 Aug 2025).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Mixture of User-adaptive Frequency Filtering (MUFFIN).