Band-Selective Attention

• Band-selective attention is a mechanism that assigns targeted weights to spectral bands or frequency channels, emphasizing informative signals while suppressing noise.
• In domains like hyperspectral imaging and speech enhancement, models use learnable attention modules or local spectral masks to dynamically reweight inputs, improving classification and enhancement performance.
• Applications span fMRI, EEG, ensemble rehearsal, and music decoding, highlighting that structured, context-aware band selection is critical for effective signal interpretation and robust feature extraction.

Band-selective attention denotes a family of mechanisms and observational constructs in which attention is allocated selectively over bands, channels, frequency regimes, or other structured targets rather than uniformly over the full input. In hyperspectral imaging, it refers to learnable band-wise weights over spectral channels so that informative wavelengths are emphasized and redundant or noisy bands are suppressed (Dong et al., 2019). In speech enhancement, the same idea appears as local spectral attention, which restricts frequency-wise self-attention to a neighborhood around each frequency bin instead of the whole spectrum (Hou et al., 2023). In fMRI, band-selective attention is a frequency-resolved self-attention mechanism operating on ultralow, low, and high BOLD bands after biologically grounded frequency decomposition (Bae et al., 30 Mar 2025). In EEG diagnosis, the term is used for explicit prioritization of canonical EEG bands such as delta, theta, alpha, beta, and gamma (Jawad et al., 14 May 2026). The expression also has domain-specific meanings outside machine learning: in ensemble rehearsal it denotes the selective allocation of visual gaze among bandmates and salient objects, and in music-attention decoding it pertains primarily to stimulus-side musical elements with characteristic spectral content rather than to EEG frequency bands (Srinivasan et al., 2 Jun 2026, Akama et al., 5 Dec 2025).

1. Terminological scope and domain-specific meanings

The term is not monosemous. Its most common technical use in the cited literature concerns selective weighting along a spectral or channel axis, but the target of selection varies by modality and task.

Domain	Selected target	Representative mechanism or observable
Hyperspectral imaging	spectral bands	band-wise weights, attention heatmaps, band masks
Speech enhancement	local frequency neighborhoods	local spectral attention mask $M_F$
fMRI	ultralow, low, and high BOLD bands	multi-band self-attention and band-specific connectivity
EEG diagnosis	delta, theta, alpha, beta, gamma	spectrally selective feature construction or band-specific inputs
Ensemble rehearsal	bandmates and salient objects	fixation matrices, transition matrices, scarf plots
Music attention decoding	musical elements with characteristic spectral content	contrastive alignment between EEG and stem embeddings

This variation matters because the methodological role of attention differs across settings. In hyperspectral imaging and speech enhancement, attention is part of the forward model and acts directly on the input or intermediate representation (Dong et al., 2019, Hou et al., 2023). In fMRI, it is a frequency-resolved modeling strategy for spatiotemporal dynamics (Bae et al., 30 Mar 2025). In ensemble rehearsal, it is an empirical descriptor derived from eye tracking rather than a neural-network module (Srinivasan et al., 2 Jun 2026). In music attention decoding, the relevant “bands” are not canonical EEG bands; the study explicitly states that no delta/theta/alpha/beta/gamma band analyses are performed, and “band-selective” pertains to stimulus-side element stems (Akama et al., 5 Dec 2025).

A common misconception is to treat all uses as interchangeable. The rehearsal study explicitly distinguishes its visual and social usage from “band-selective attention” in auditory neuroscience, which refers to selecting frequency bands in the acoustic signal (Srinivasan et al., 2 Jun 2026). The music EEG study likewise distinguishes stimulus-side musical frequency content from EEG-side spectral-band analysis (Akama et al., 5 Dec 2025).

2. Hyperspectral imaging: from spectral heatmaps to end-to-end band gating

In hyperspectral image classification, band-selective attention addresses a canonical problem: HSIs are 3D data cubes with hundreds of narrow, contiguous spectral bands, and many bands are redundant or noisy. The 2018 attention-based CNN formulation treats each pixel as a 1D signal of length $b$ and inserts an attention module after each max-pooled activation in a 1D spectral CNN (Lorenzo et al., 2018). A building block consists of 1D convolution with kernel size $k=5$, stride $1$, padding $2$, followed by ReLU, batch normalization, and 1D max pooling with window $k=2$, stride $2$. At depth $l$, the attention estimator maps

$$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$

using a 1D convolution with one kernel across feature maps, followed by ReLU and a softmax over spectral positions. The resulting heatmap $\hat{Z}^l$ gates the activation tensor $b$0 bandwise, and the compact representation is

$b$1

Each depth yields local class scores $b$2 and a confidence gate $b$3, which are fused with the network head: $b$4 After end-to-end training, the averaged attention heatmap is treated as a 1D vector of length $b$5, and band selection is cast as anomaly detection with an Elliptical Envelope using the Mahalanobis distance

$b$6

With contamination rates $b$7 to $b$8, the method selected $b$9 bands on Salinas Valley and $k=5$0 on Pavia University, while retaining classification performance on reduced spectra (Lorenzo et al., 2018).

The 2019 Band Attention Module (BAM) generalizes the same objective to sample-specific band reweighting in a 2D-CNN pipeline tailored to hyperspectral cubes (Dong et al., 2019). Let $k=5$1 denote an HSI. BAM learns a band-wise attention vector $k=5$2 from an input patch and applies it once, early in the network, before classification. The module first aggregates spatial context through five $k=5$3 2D convolution layers grouped into three stages with depths $k=5$4, $k=5$5, and $k=5$6, separated by two pooling layers. Global spatial pooling produces a descriptor $k=5$7,

$k=5$8

which is then passed through two $k=5$9 convolutions over the band dimension. With ReLU $1$0 and sigmoid $1$1, BAM computes

$1$2

Sigmoid was used in the experiments and outperformed softmax and ReLU alternatives; no explicit sparsity regularizer was added, and the loss remained $1$3 (Dong et al., 2019).

With a VGG-style classifier module, BAM improved both Indian Pines and Kennedy Space Center benchmarks (Dong et al., 2019).

Dataset	CM	BAM+CM
Indian Pines	OA 90.39% (±0.70), AA 94.84% (±0.40), $1$4 88.94% (±0.81)	OA 93.22% (±0.49), AA 96.44% (±0.21), $1$5 92.17% (±0.56)
KSC	OA 91.38% (±0.95), AA 86.86% (±1.31), $1$6 90.40% (±1.06)	OA 95.06% (±0.51), AA 91.66% (±0.95), $1$7 94.50% (±0.57)

These comparisons are informative because the paper also evaluated an SE block and a 1D-only band weighting baseline. On Indian Pines, SE+CM reached OA $1$8 and the 1D Band Weighting baseline OA $1$9; on KSC, SE+CM reached OA $2$0 and BW+CM $2$1. The stated interpretation is that spatial global context is important for learning meaningful band masks, and BAM is designed specifically to inject that context before band selection (Dong et al., 2019).

A later unsupervised formulation integrates HSI band attention with LiDAR-derived spatial attention in a reconstruction-based framework (Yang et al., 2024). For each spatial position $2$2 in a patch, an HSI MLP produces a band-wise mask

$2$3

and a LiDAR MLP produces a scalar gate

$2$4

The fused mask is

$2$5

and the masked patch is reconstructed with a convolutional autoencoder under

$2$6

Band scores are then aggregated, combined with spectral dissimilarity, clustered hierarchically, and refined with K-means to obtain a compact subset (Yang et al., 2024). On Houston 2013 with $2$7, the fused method reported OA $2$8 with SVM, OA $2$9 with KNN, and OA $k=2$0 with a 5-layer CNN; on Trento it reported OA $k=2$1, $k=2$2, and $k=2$3, respectively (Yang et al., 2024). This suggests that band-selective attention in hyperspectral learning has evolved from post hoc ranking of attention peaks to joint spatial-spectral gating and multimodal fusion.

3. Spectral locality and stimulus-defined bands in audio and music

In full-band speech enhancement, band-selective attention appears as a locality constraint on spectral self-attention rather than as explicit band ranking. The local spectral attention (LSA) mechanism was introduced for 48 kHz speech enhancement on complex STFT features $k=2$4 (Hou et al., 2023). Standard spectral attention computes, for each time frame $k=2$5,

$k=2$6

whereas LSA adds a fixed band mask $k=2$7,

$k=2$8

so that

$k=2$9

The motivation is explicit: low frequencies exhibit structured harmonics, while high bands contain more randomly distributed components, and global frequency attention can encourage long-range interactions between bins with weak similarity, leading to excessive residual noise (Hou et al., 2023).

The computational consequence is also explicit. Global spectral attention scales as $2$0, while LSA scales as $2$1 with $2$2. The method was inserted into all axial self-attention frequency modules of MTFAA and into the spectral attention of DPARN. For causal MTFAA, the local interaction dimensions were $2$3; for DPARN, $2$4 (Hou et al., 2023). On VoiceBank+DEMAND, replacing global frequency attention with LSA improved MTFAA from PESQ $2$5 to $2$6, CSIG $2$7 to $2$8, CBAK $2$9 to $l$0, COVL $l$1 to $l$2, STOI $l$3 to $l$4, and SI-SDR $l$5 dB to $l$6 dB. For DPARN, PESQ improved from $l$7 to $l$8, and SI-SDR from $l$9 dB to $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$0 dB (Hou et al., 2023). In this domain, “band-selective” therefore means local frequency neighborhoods rather than a sparse subset of fixed bands.

A different usage appears in EEG-based decoding of attention to musical elements during ecologically valid listening (Akama et al., 5 Dec 2025). Each 15-second trial begins with an explicit instruction such as “Focus on vocals,” and the attended element is one of Vocal, Drum, Bass, or Others. The study states that attention is “band-selective” with respect to musical frequency content insofar as each stem isolates particular spectral regions and temporal structures of the music. However, the EEG pipeline does not perform band-pass filtering into canonical EEG bands, does not extract bandpower features, and does not report which EEG frequency bands contribute most to decoding (Akama et al., 5 Dec 2025). EEG is acquired with a Muse 2 headband at TP9, AF7, AF8, TP10 with hardware reference at FPz and 256 Hz sampling; preprocessing uses RobustScaler per channel and clamping to $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$1, with no explicit artifact rejection (Akama et al., 5 Dec 2025).

The decoding objective is cross-modal contrastive alignment. For task $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$2, the task-specific InfoNCE loss is

$$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$3

with

$$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$4

The best-performing model was “all-0 ms.” Within-subject mean global accuracy reached $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$5 on all-data evaluation, and cross-subject mean global accuracies were $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$6 and $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$7, above chance (Akama et al., 5 Dec 2025). The study thus operationalizes band-selective attention at the level of stem-defined musical elements, not EEG spectral-band mechanisms.

4. Frequency-resolved neuroimaging and explicit spectral priors in EEG

In fMRI, band-selective attention has been formalized as a transformer architecture that models frequency-specific spatiotemporal brain dynamics in distinct spectral bands of the BOLD signal (Bae et al., 30 Mar 2025). Multi-Band Brain Net (MBBN) begins from the premise that BOLD dynamics are scale-free and multifractal. Two knee frequencies are estimated per participant: $$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$8 from a Lorentzian fit,

$$\mathcal{F}: \mathbb{R}^{b \times n} \rightarrow \mathbb{R}^{b \times 1},$$9

and $\hat{Z}^l$0 from a spline multifractal model with smooth transition weight $\hat{Z}^l$1. The bands are defined as ultralow $\hat{Z}^l$2, low $\hat{Z}^l$3, and high $\hat{Z}^l$4 (Bae et al., 30 Mar 2025). Cohort means were reported as $\hat{Z}^l$5 Hz and $\hat{Z}^l$6 Hz for ABCD, $\hat{Z}^l$7 Hz and $\hat{Z}^l$8 Hz for UKB, and $\hat{Z}^l$9 Hz and $b$00 Hz for ABIDE (Bae et al., 30 Mar 2025).

The architecture couples a shared temporal BERT encoder with a band-specific spatial attention module. For each band $b$01, the spatial module computes

$b$02

where $b$03. Band logits are averaged,

$b$04

and a spatial regularizer enforces band distinctiveness: $b$05 Total loss is

$b$06

The model was evaluated on UKB, ABCD, and ABIDE, with cohort sample sizes $b$07, $b$08, and $b$09, respectively (Bae et al., 30 Mar 2025). On UKB sex classification with HCP-MMP1, MBBN reported AUROC $b$10 and accuracy $b$11; on ABCD sex classification it reported AUROC $b$12 and accuracy $b$13. For ASD on ABIDE, AUROC reached $b$14 on Schaefer-400 after communicability-based pretraining (Bae et al., 30 Mar 2025). The interpretability analysis further linked ADHD to attenuated high-frequency fronto-sensorimotor connectivity and ultralow hypercoupling, and ASD to focal high-frequency orbitofrontal–parietal disruption together with altered ultra-low-frequency integration (Bae et al., 30 Mar 2025).

A sharply contrasting conclusion appears in EEG-based diagnosis, where explicit spectral priors were found to outperform attention-based deep models (Jawad et al., 14 May 2026). The paper defines band-selective attention as explicit prioritization of canonical EEG frequency bands—delta $b$15–$b$16 Hz, theta $b$17–$b$18 Hz, alpha $b$19–$b$20 Hz, beta $b$21–$b$22 Hz, gamma $b$23–$b$24 Hz—within the representation and learning pipeline. Preprocessing downsamples to $b$25 Hz, applies a $b$26–$b$27 Hz band-pass filter, centers each channel, and z-score normalizes features using training-set statistics only (Jawad et al., 14 May 2026). Frequency-domain features are computed using Welch PSD,

$b$28

band power

$b$29

relative band power

$b$30

and discrete wavelet energies

$b$31

The empirical finding is not that attention recovers these stable spectral signatures, but that it largely fails to do so in resting EEG (Jawad et al., 14 May 2026). On APAVA, QDA achieved Acc/Prec/Rec/F1/AUROC/AUPRC all $b$32, while Medformer reached Acc $b$33 and F1 $b$34. On TDBrain, RF achieved Acc/Prec/Rec/F1/AUROC/AUPRC all $b$35, while Medformer reached Acc $b$36 and F1 $b$37. On ADFTD, QDA reached Acc $b$38, F1 $b$39, AUROC $b$40, and AUPRC $b$41, whereas Medformer reached Acc $b$42, F1 $b$43, AUROC $b$44, and AUPRC $b$45. Even when Medformer was trained on per-band time-domain signals, accuracy declined on every dataset: ADFTD $b$46, APAVA $b$47, TDBrain $b$48, ADHD $b$49 (Jawad et al., 14 May 2026). The paper interprets this as “Attention Dilution,” namely that multi-band inputs inflate hypothesis dimensionality and reinforce redundant inter-frequency correlations. This suggests that frequency-resolved modeling can be highly effective when the decomposition is built into the architecture and objective, as in MBBN, but explicit spectral features may remain more stable than generic attention in low-SNR resting EEG.

5. Visual and social band-selective attention in ensemble rehearsal

In ensemble rehearsal, band-selective attention is defined as the selective allocation of visual gaze among bandmates and salient objects such as instruments and score displays (Srinivasan et al., 2 Jun 2026). This usage is explicitly visual and social, and the study distinguishes it from auditory-neuroscience uses of the term. The experiment involved four amateur musicians—Vocalist, Drummer, Guitarist, Lead/session leader—rehearsing three songs in fixed order: S1 familiar, S2 new with active teaching, S3 moderately familiar, each performed twice (Srinivasan et al., 2 Jun 2026). Each musician wore a Pupil Labs Neon binocular eye tracker with gaze sampling frequency $b$50 Hz and a 30 fps scene camera at $b$51 px. AOIs comprised the four band members, a monitor, and an “Other” category. Scene videos were processed with a fine-tuned YOLOv8n detector; after three epochs, performance was precision $b$52, recall $b$53, mAP@50 $b$54, and mAP@50–95 $b$55 (Srinivasan et al., 2 Jun 2026).

The analysis pipeline formalized dwell, entropy, and transitions. For participant $b$56, dwell proportion on target $b$57 is

$b$58

with “Other” excluded and values renormalized over named AOIs. Entropy of gaze allocation is

$b$59

where $b$60. Consecutive fixation pairs define transition counts

$b$61

and row-normalized transition probabilities

$b$62

The study also computed Pearson correlations between maximum single-target dwell and total transitions (Srinivasan et al., 2 Jun 2026).

The central finding was a hub-and-spoke attention topology centered on the Lead. Across all six sessions, the Vocalist directed $b$63–$b$64 of classified-target dwell toward the Lead, and the Guitarist $b$65–$b$66. Under interpersonal normalization, the Guitarist allocated $b$67–$b$68 of person-directed dwell to the Lead, peaking at $b$69 in S3 A2. The Drummer received only $b$70 of other members’ dwell on average, while the Lead’s own gaze was distributed but consistently prioritized the Guitarist at $b$71–$b$72 dwell (Srinivasan et al., 2 Jun 2026). Transition counts ranged from $b$73 for Guitarist in S3 A2 to $b$74 for Vocalist in S2 A1. Between attempts, S2 showed a $b$75 mean drop in transitions and S3 a $b$76 drop, whereas S1 increased slightly by $b$77. In S2, the $b$78 drop far exceeded the $b$79 duration reduction from $b$80 to $b$81 minutes, which the paper interprets as genuine stabilization of scanning (Srinivasan et al., 2 Jun 2026).

Attention concentration and transition volume were moderately negatively correlated across 24 recordings, with $b$82 and $b$83 (Srinivasan et al., 2 Jun 2026). The Guitarist occupied the high-dwell, low-transition quadrant, consistent with attentional narrowing. Structural teaching altered this pattern. In S2, dwell on the Lead dropped from $b$84 to $b$85, while monitor dwell surged from $b$86 to $b$87; yet interpersonal concentration on the Lead increased from $b$88 to $b$89 because the shift was away from people to the monitor, not toward other people (Srinivasan et al., 2 Jun 2026). The study therefore associates structural teaching with a shift from person-dependent to reference-dependent cueing. Scarf plots further showed fragmentation near stops and teaching segments, and consolidation during uninterrupted runs.

This social usage broadens the concept of band-selective attention beyond signal processing. Rather than weighting spectral channels, it operationalizes selective coupling among agents and objects through dwell distributions, transition matrices, and temporal event alignment. A plausible implication is that “band-selective attention” can denote structured selectivity over any constrained set of relevant targets when the task is coordination under uncertainty.

6. Cross-cutting principles, interpretability, and limitations

Across domains, band-selective attention takes at least four recurrent forms. First, it can be a smooth weighting mechanism, as in BAM’s sigmoid-generated $b$90 for hyperspectral bands and in the fused HSI–LiDAR masks aggregated into $b$91 and $b$92 (Dong et al., 2019, Yang et al., 2024). Second, it can be a hard or quasi-hard locality constraint, as in LSA’s band mask $b$93 that restricts each frequency bin to neighboring bins only (Hou et al., 2023). Third, it can be a decomposition strategy in which attention is learned separately in predefined or data-driven bands, as in canonical EEG bands or in MBBN’s ultralow/low/high BOLD bands (Jawad et al., 14 May 2026, Bae et al., 30 Mar 2025). Fourth, it can be an empirical observable over a discrete target set, as in gaze dwell and transition matrices in rehearsal (Srinivasan et al., 2 Jun 2026).

A second recurrent principle is that successful band selection rarely ignores context. BAM uses 2D convolutions and pooling so that spatial information contributes to band selection, and the HSI–LiDAR framework multiplies band attention by a LiDAR-derived spatial gate (Dong et al., 2019, Yang et al., 2024). MBBN separates frequency bands before applying band-specific spatial attention, and its spatial loss forces the resulting connectivity patterns to differ across bands (Bae et al., 30 Mar 2025). LSA retains a unified full-band representation but limits interactions to physically plausible local neighborhoods (Hou et al., 2023). By contrast, the 1D-only hyperspectral band weighting baseline underperformed even a 2D CNN without band processing, and EEG attention models given per-band inputs did not improve, which the papers attribute to missing spatial context or attention dilution, respectively (Dong et al., 2019, Jawad et al., 14 May 2026).

Interpretability is one of the strongest motives for these formulations. BAM yields a band-wise weight vector $b$94, with high-weight bands indicating informative spectral regions (Dong et al., 2019). The 2018 HSI model produces averaged attention heatmaps whose peaks remain stable across 30 Monte Carlo splits, and the final selected bands are obtained by Elliptical Envelope thresholding (Lorenzo et al., 2018). The fused HSI–LiDAR model aggregates masks into normalized attention scores and combines them with Pearson-correlation dissimilarity before clustering (Yang et al., 2024). MBBN exposes band-specific attention matrices $b$95 and uses Grad-CAM–inspired attribution to derive frequency-resolved connectivity heatmaps (Bae et al., 30 Mar 2025). The rehearsal study visualizes scarf plots and hub-and-spoke transition structure, while the music EEG study interprets decoding through cosine similarity between EEG embeddings and stem embeddings (Srinivasan et al., 2 Jun 2026, Akama et al., 5 Dec 2025).

The limitations are equally domain-specific. In hyperspectral BAM, no explicit sparsity regularizer is used, and overfitting remains a concern for very small training sets or cross-domain shifts (Dong et al., 2019). In fused HSI–LiDAR selection, accurate co-registration is assumed, and the correlation matrix plus hierarchical clustering scales quadratically or cubically in the number of bands (Yang et al., 2024). In speech enhancement, LSA may under-model very long-range spectral dependencies, even though multi-stage processing and multi-scale $b$96 partly compensate (Hou et al., 2023). In MBBN, band boundaries depend on knee fits and filters can leak across edges; the paper also notes that TRs are not reported (Bae et al., 30 Mar 2025). In EEG-based music attention decoding, no EEG spectral-band analysis is provided, so conclusions concern stimulus-side band structure rather than neural frequency bands (Akama et al., 5 Dec 2025). In rehearsal eye tracking, occlusions, motion, lighting variability, detector confusion, and calibration drift contribute to a sizable “Other” category with mean $b$97 dwell (Srinivasan et al., 2 Jun 2026). In resting EEG diagnosis, the authors argue that the limitations of attention-based models in finding relevant spectral features “appear to be fundamental,” at least under the tested conditions (Jawad et al., 14 May 2026).

Taken together, the literature does not support a single universal mechanism under the label. Instead, band-selective attention functions as a domain-dependent strategy for imposing structured selectivity: over wavelengths, frequency neighborhoods, canonical oscillatory bands, decomposed BOLD regimes, musical stems, or socially salient targets. The strongest positive results occur when the target structure matches the task’s intrinsic organization—raw spectral bands in hyperspectral imaging, local spectral neighborhoods in speech enhancement, and frequency-resolved network interactions in fMRI—whereas weaker results appear when generic attention is expected to discover stable spectral biomarkers without sufficiently strong inductive bias (Dong et al., 2019, Hou et al., 2023, Bae et al., 30 Mar 2025, Jawad et al., 14 May 2026).