---
title: Unlearnable Event Streams (UEvs)
url: https://www.emergentmind.com/topics/unlearnable-event-streams-uevs
type: topic
---

# Unlearnable Event Streams (UEvs)

Searching arXiv for the cited UEv and related unlearnable-examples papers to ground the article in current literature.
Unlearnable Event Streams (UEvs) are perturbed event-stream datasets constructed so that unauthorized models trained on the released data fail to learn the underlying semantics, while legitimate use is intended to remain viable. In the asynchronous event-camera setting, UEvs are defined by a workflow that combines Event-Error-Minimizing Noise (\(\text{E}^2\text{MN}\)), a sparsifying projection compatible with event stacks, and a retrieval strategy that reconstructs perturbed raw streams from the modified representation [2507.05728]. A related sequential formulation extends the same unlearnability principle to time series by adding small, selectively applied error-minimizing perturbations that nullify the training signal of deep sequence learners [2402.02028].

## 1. Event-stream data model and protection objective

Event cameras output asynchronous event streams rather than dense frames. A single event is a tuple
\[
e_k = (x_k,y_k,t_k,p_k),
\]
where \((x_k,y_k)\) are pixel coordinates, \(t_k\) is the timestamp, and \(p_k\in\{\pm1\}\) is the binary polarity indicating brightness increase or decrease. Over a time window, these events form a sparse spatio-temporal point cloud
\[
\mathcal{E} = \{\,e_k\}_{k=1}^K.
\]
This representation differs fundamentally from frame-based imagery in both sparsity and asynchrony [2507.05728].

The protection problem arises once an event dataset is released online. Although event data offers high dynamic range and low latency, the release of such datasets raises privacy and security concerns because malicious parties can train powerful DNNs on them for unauthorized purposes. The UEv objective is therefore to publish a modified dataset that causes downstream learners to acquire an artificial, easy-to-fit feature rather than the genuine semantic structure of the data.

The event-camera formulation adapts the broader notion of Unlearnable Examples from the image domain to asynchronous streams. The central difficulty is that extending image-style perturbations is non-trivial: events are binary and sparse, simple additive noise may destroy the polarity pattern, and event-based networks consume binned event representations rather than raw event tuples. As a result, the perturbation must be compatible with the conversion pipeline and invertible back to an event stream [2507.05728].

A related sequential-data viewpoint defines labeled streams \((x,y)\) with \(x\in\mathbb{R}^{T\times d}\) and seeks a released dataset \(\{(x_i+\delta_i,y_i)\}\) such that any RNN trained on it achieves near-random performance on clean test streams, subject to a small perturbation budget \(\|\delta_i\|_p \le \rho_u\), with \(\rho_u\ll\|x_i\|\) [2402.02028]. This suggests that UEvs are best understood as a data-protection mechanism for stream-like modalities rather than as a sensor-specific artifact.

## 2. Min-min optimization and shortcut formation

The asynchronous event-stream method adopts a bilevel min-min optimization. Let \(\mathcal{D}=\{(\mathcal{E}_i,l_i)\}\) be the clean event dataset, and let \(\mathcal{R}(\mathcal{E})\in\mathbb{R}^{C\times H\times W}\) denote the \(C\)-channel event-stack representation, with values in \(\{0,0.5,1\}\) for polarity \(-1,0,+1\). Using a surrogate model \(f'_\theta\), the optimization is
\[
\min_{\theta}\;\mathbb{E}_{(\mathcal{E},l)\sim\mathcal{D}\Big[\;
\min_{\|\delta\|_\infty\le\epsilon}
\mathcal{L}\bigl(f'_\theta(\mathcal{R}(\mathcal{E})+\delta),\,l\bigr) \Big],
\]
where \(\mathcal{L}\) is cross-entropy [2507.05728].

The inner minimization searches for an \(L_\infty\)-bounded noise \(\delta\) that drives the surrogate to low loss on the perturbed stack. Once \(\delta\) succeeds in driving loss below a threshold, expressed operationally as accuracy \(\ge\gamma\), the noise enforces reliance on \(\delta\)-features rather than semantics. In practice, optimization alternates between updating the surrogate parameters \(\theta\) and updating \(\delta\) by one-step PGD:
\[
\delta \leftarrow \mathrm{Proj}_{\|\cdot\|_\infty\le\epsilon}\Bigl(
\delta - \alpha\,\mathrm{sign}\bigl(\nabla_{\delta}\,\mathcal{L}(f'_\theta(\mathcal{R}(\mathcal{E})+\delta),l)\bigr)
\Bigr).
\]
The surrogate update includes both the task loss and a similarity loss \(\mathcal{L}_{\mathrm{sim}}\), weighted by \(\lambda_1\) and \(\lambda_2\), where \(\mathcal{L}_{\mathrm{sim}}\) encourages the model to discriminate clean versus perturbed features and thereby boosts the shortcut effect [2507.05728].

Two perturbation granularities are defined. Sample-wise noise \(\Delta_s=\{\delta_i\}\) assigns one perturbation per stream, whereas class-wise noise \(\Delta_c=\{\delta_l\}\) shares a perturbation within a class. The paper’s interpretation is explicit: \(\text{E}^2\text{MN}\) becomes an “easy-learnable” feature that the surrogate model captures instead of true semantics, and downstream models trained on perturbed streams inherit this reliance on the noise shortcut.

The sequential formulation in the time-series setting makes the same conceptual distinction from adversarial attacks. Rather than a min-max objective, UE generation is described as a bi-level min-min problem:
\[
\min_{\theta'}\;\frac1n\sum_{i=1}^n\;\min_{\|\delta_i\|\le \rho_u}\;\ell\bigl(f'_{\theta'}(x_i+\delta_i),y_i\bigr),
\]
with the final poisoned stream given by
\[
x'_i \;=\; x_i + \arg\min_{\|\delta\|\le\rho_u}\;\ell\bigl(f'_{\theta'}(x_i+\delta),y_i\bigr).
\]
This framing matters because UEvs are not intended to induce immediate test-time misclassification; they are designed to poison the training signal itself [2402.02028].

## 3. Event-Error-Minimizing Noise, projection, and retrieval

Directly adding continuous noise to an event stack breaks the binary-polarity pattern. The asynchronous event-stream method therefore introduces a projection
\[
\mathbf{P}(\delta_{i,j}) =
\begin{cases}
-0.5, & \delta_{i,j}<\mu - \tau\pi,\\
0,    & \mu - \tau\pi\le \delta_{i,j}\le \mu + \tau\pi,\\
+0.5, & \delta_{i,j}>\mu + \tau\pi,
\end{cases}
\]
where \(\mu\) and \(\pi\) are the mean and half-range of raw \(\delta\), and \(\tau\in(0,1)\) balances stealth versus effectiveness [2507.05728].

The projected values \(\{-0.5,0,+0.5\}\) are chosen to combine with original stack values \(\{0,0.5,1\}\). Their operational role is to delete, leave, or generate events. This is the central compatibility mechanism: the perturbation is sparse, polarity-compatible, and remains expressible in the event-stack representation used by downstream event-based networks.

The full procedure initializes \(\delta\) randomly, alternates surrogate training and PGD noise updates until the surrogate accuracy on perturbed stacks reaches the target \(\gamma\), then projects the noise, clips the resulting stack to \([0,1]\), and reconstructs the unlearnable raw stream \(\mathcal{E}'_j = \mathcal{R}'(\hat S,\mathcal{E}_j)\) via timestamp retrieval. The output is an unlearnable dataset \(\mathcal{D}_u=\{(\mathcal{E}'_j,l_j)\}\) [2507.05728].

The key hyperparameters reported for this pipeline are stack channels \(C=16\), surrogate training epochs \(30\), batch size \(16\), PGD steps \(S=10\), \(\epsilon=0.5\), \(\alpha=0.8/255\), projection balance \(\tau=3/4\), and target accuracy \(\gamma=0.99\). The method’s significance lies in preserving compatibility with the raw-stream and stack-based processing chain. A plausible implication is that this compatibility requirement is the main distinction between UEvs for event cameras and unlearnable perturbations in dense domains.

## 4. Empirical results on asynchronous event-camera datasets

The event-stream study evaluates UEvs on N-Caltech101, CIFAR10-DVS, DVS128 Gesture, and N-ImageNet, using ResNet-18/50, VGG16, DenseNet121, EfficientNet-B1, ViT-B, and Swin-B. Protection strength is measured by test accuracy on perturbed versus clean data, where lower perturbed accuracy indicates stronger defense. Imperceptibility is measured by PSNR, SSIM, and MSE computed on event stacks [2507.05728].

On N-Caltech101 with ResNet-18, the clean test accuracy is \(78.3\%\). Event pollution baselines—coordinate shift, timestamp shift, polarity inversion, pattern injection, and block shuffle—yield perturbed accuracies of approximately \(37\%\) to \(50\%\). By contrast, class-wise noise \(\Delta_c\) produces \(1.9\%\) accuracy, corresponding to a \(76.6\%\) drop, and sample-wise noise \(\Delta_s\) produces \(0.5\%\), corresponding to a \(77.6\%\) drop [2507.05728].

The paper further reports that all seven architectures suffer more than a \(40\%\) accuracy drop under \(\Delta_c\) or \(\Delta_s\). Imperceptibility remains comparatively strong: PSNR is approximately \(20.4\,\mathrm{dB}\) for \(\Delta_c\) and \(18.2\,\mathrm{dB}\) for \(\Delta_s\); SSIM is \(0.79\) and \(0.57\); MSE is \(0.028\) and \(0.040\). The pollution baselines yield \(\mathrm{PSNR}<16\,\mathrm{dB}\) or visible distortions [2507.05728].

Ablation results refine the picture. Removing the similarity loss \(\mathcal{L}_{\mathrm{sim}}\) raises perturbed accuracy from \(0.5\%\) to \(3.9\%\). Mixed noise configurations, written as \(\Delta_c\vee\Delta_s\) or \(\Delta_c+\Delta_s\), remain effective while increasing stealthiness or flexibility. The defense is reported as robust under standard augmentations, including random shift, flip, crop, and EventDrop. Alternative attacks such as FGSM, CW, and MIFGSM also yield low test accuracy, below \(15\%\). Varying the time-bin size by \(1/2\times\) or \(2\times\), or changing representation to event frame or time surface, has minor effect [2507.05728].

These findings support the paper’s conclusion that UEvs provide strong protection while remaining visually restrained in the event-stack domain. The concrete numerical pattern also clarifies a frequent misunderstanding: lower perceptibility metrics do not, in this setting, automatically imply weaker protection, because the defense mechanism depends on the learnability of the injected shortcut rather than on conspicuous corruption.

## 5. Sequential and time-series formulations

A neighboring line of work extends unlearnability from images to time series and summarizes it in terms of “Unlearnable Event Streams” for labeled streams \(x\in\mathbb{R}^{T\times d}\) processed by RNNs [2402.02028]. The downstream learner is trained by empirical risk minimization,
\[
\min_{\theta}\; \mathbb{E}_{(x,y)\sim D}\bigl[\ell\bigl(f_\theta(x),y\bigr)\bigr],
\]
and the released dataset is constructed so that models trained on \(\{(x_i+\delta_i,y_i)\}\) perform near-randomly on clean data.

The distinctive mechanism in this formulation is selective segment-wise perturbation. A binary control vector \(v_i\in\{0,1\}^T\) specifies where the noise is applied, yielding the objective
\[
\min_{\theta'}\frac1n\sum_{i=1}^n\;\min_{\|\delta_i\|\le\rho_u}
\Bigl|\;\ell\bigl(f'_{\theta'}(x_i + (\delta_i\odot v_i)),y_i\bigr)\;-\;\alpha\,\ell\bigl(f'_{\theta'}(x_i\odot(1-v_i)),y_i\bigr)\Bigr|,
\]
with \(\alpha=1\). In practice, the imperceptibility constraint is \(\|\delta_i\|_\infty\le0.05\times\max\text{-magnitude}(x_i)\), and Eq. 5 acts as a regularizer that forces the RNN to see “no signal” in the protected segments [2402.02028].

The theoretical justification given is gradient-based: by driving \(\ell(f_\theta(x+\delta),y)\to0\) for each poisoned sample, the gradient contribution \(\nabla_\theta\ell\) from that sample vanishes. Over training, the RNN never learns to discriminate patterns in the protected segments; when evaluated on clean data, performance therefore collapses toward chance. This account closely parallels the shortcut interpretation used in the event-camera literature, although the perturbation locus differs.

Empirically, classification experiments use a vanilla RNN with three 64-unit hidden layers, batch size \(256\), Adam with learning rate \(0.01\), noise learning rate \(\gamma=0.01\), \(\rho_u=0.05\times\max\) per sample, warm-start \(5\) epochs, and total \(50\) epochs. Across \(6\) univariate UCR and \(4\) multivariate MTS datasets, masking alone drops accuracy by approximately \(14\%\), UAP by approximately \(57\%\), whereas the UEv method with only \(20\%\) noise causes an approximately \(72\%\) drop; with \(50\%\) noise, accuracy falls below \(8\%\), and with \(100\%\) noise below \(5\%\). Multivariate streams often fall below \(2\%\) accuracy [2402.02028].

For generation tasks, the setup trains RGAN or QGAN on class-0 samples only, with \(50\%\) of those samples perturbed, and evaluates with Train on Synthetic, Test on Real using LSTM or FCN classifiers. Generators trained on clean data yield TSTR accuracies of approximately \(75\%\) to \(90\%\), whereas generators trained on UEvs produce synthetic streams that give below \(10\%\) accuracy, an average drop greater than \(60\%\) [2402.02028]. This suggests that unlearnability can affect both discriminative and generative downstream usage.

## 6. Utility preservation, limitations, and future directions

The event-camera study states that perturbations are sparse and imperceptible in the event-stack domain and that, for authorized users who know the original streams or have proprietary reconstruction keys, the noise can be filtered or ignored, preserving legitimate performance [2507.05728]. In the time-series setting, a closely related utility claim is that by protecting only key segments through \(v\), the rest of the stream remains fully learnable for legitimate tasks [2402.02028]. In both cases, the intended operating point is not universal data destruction but selective denial of unauthorized learning.

Best-practice guidance is also explicit. For new event datasets, one should choose a representative surrogate \(f'\), such as ResNet-18, and limit its training to \(M\) steps to avoid overfitting; tune \(\epsilon\) and \(\tau\) to trade off stealth versus strength; choose class-wise noise for scalability and sample-wise noise for slightly stronger defense; and validate under target adversarial training or augmentations [2507.05728]. The time-series work similarly emphasizes model mismatch tolerance, stating that UEvs require only rough knowledge of the target RNN and that noise generated on one architecture transfers to others [2402.02028].

Limitations and countermeasures are not absent from the literature. The time-series paper notes that UEvs can be partially undone by strong countermeasures such as “UEraser” aggressive data augmentation, and that they rely on a small perturbation budget, since extremely noisy settings may degrade both privacy and downstream utility [2402.02028]. This qualifies any interpretation of UEvs as an absolute protection mechanism.

Future directions identified in the event-camera work include improving noise generation efficiency via a generative noise network, exploring defense-aware noise, and extending to other event tasks such as detection and segmentation via foundation-model surrogates [2507.05728]. The time-series work points to theoretical analysis of convergence and generalization under UEv poisoning, certified guarantees in the style of randomized smoothing for segment-wise unlearnability, and federated or collaborative settings in which users protect their own data in a pooled stream [2402.02028]. Taken together, these directions indicate that UEvs are evolving from a narrowly defined poisoning construction into a broader framework for consent-based data protection in streaming machine learning.

Source: https://www.emergentmind.com/topics/unlearnable-event-streams-uevs