Papers
Topics
Authors
Recent
Search
2000 character limit reached

Unlearnable Event Streams (UEvs)

Updated 6 July 2026
  • UEvs are perturbed event-stream datasets designed to force models to learn artificial shortcuts rather than genuine semantic features.
  • The approach integrates Event-Error-Minimizing Noise, sparsifying projections, and bilevel min-min optimization to effectively poison the training signal.
  • Empirical evaluations on event-camera and time-series datasets demonstrate drastic accuracy drops while preserving data imperceptibility for authorized use.

Searching arXiv for the cited UEv and related unlearnable-examples papers to ground the article in current literature. Unlearnable Event Streams (UEvs) are perturbed event-stream datasets constructed so that unauthorized models trained on the released data fail to learn the underlying semantics, while legitimate use is intended to remain viable. In the asynchronous event-camera setting, UEvs are defined by a workflow that combines Event-Error-Minimizing Noise (E2MN\text{E}^2\text{MN}), a sparsifying projection compatible with event stacks, and a retrieval strategy that reconstructs perturbed raw streams from the modified representation (Wang et al., 8 Jul 2025). A related sequential formulation extends the same unlearnability principle to time series by adding small, selectively applied error-minimizing perturbations that nullify the training signal of deep sequence learners (Jiang et al., 2024).

1. Event-stream data model and protection objective

Event cameras output asynchronous event streams rather than dense frames. A single event is a tuple

ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),

where (xk,yk)(x_k,y_k) are pixel coordinates, tkt_k is the timestamp, and pk{±1}p_k\in\{\pm1\} is the binary polarity indicating brightness increase or decrease. Over a time window, these events form a sparse spatio-temporal point cloud

E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.

This representation differs fundamentally from frame-based imagery in both sparsity and asynchrony (Wang et al., 8 Jul 2025).

The protection problem arises once an event dataset is released online. Although event data offers high dynamic range and low latency, the release of such datasets raises privacy and security concerns because malicious parties can train powerful DNNs on them for unauthorized purposes. The UEv objective is therefore to publish a modified dataset that causes downstream learners to acquire an artificial, easy-to-fit feature rather than the genuine semantic structure of the data.

The event-camera formulation adapts the broader notion of Unlearnable Examples from the image domain to asynchronous streams. The central difficulty is that extending image-style perturbations is non-trivial: events are binary and sparse, simple additive noise may destroy the polarity pattern, and event-based networks consume binned event representations rather than raw event tuples. As a result, the perturbation must be compatible with the conversion pipeline and invertible back to an event stream (Wang et al., 8 Jul 2025).

A related sequential-data viewpoint defines labeled streams (x,y)(x,y) with xRT×dx\in\mathbb{R}^{T\times d} and seeks a released dataset {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\} such that any RNN trained on it achieves near-random performance on clean test streams, subject to a small perturbation budget δipρu\|\delta_i\|_p \le \rho_u, with ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),0 (Jiang et al., 2024). This suggests that UEvs are best understood as a data-protection mechanism for stream-like modalities rather than as a sensor-specific artifact.

2. Min-min optimization and shortcut formation

The asynchronous event-stream method adopts a bilevel min-min optimization. Let ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),1 be the clean event dataset, and let ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),2 denote the ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),3-channel event-stack representation, with values in ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),4 for polarity ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),5. Using a surrogate model ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),6, the optimization is

ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),7

where ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),8 is cross-entropy (Wang et al., 8 Jul 2025).

The inner minimization searches for an ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),9-bounded noise (xk,yk)(x_k,y_k)0 that drives the surrogate to low loss on the perturbed stack. Once (xk,yk)(x_k,y_k)1 succeeds in driving loss below a threshold, expressed operationally as accuracy (xk,yk)(x_k,y_k)2, the noise enforces reliance on (xk,yk)(x_k,y_k)3-features rather than semantics. In practice, optimization alternates between updating the surrogate parameters (xk,yk)(x_k,y_k)4 and updating (xk,yk)(x_k,y_k)5 by one-step PGD: (xk,yk)(x_k,y_k)6 The surrogate update includes both the task loss and a similarity loss (xk,yk)(x_k,y_k)7, weighted by (xk,yk)(x_k,y_k)8 and (xk,yk)(x_k,y_k)9, where tkt_k0 encourages the model to discriminate clean versus perturbed features and thereby boosts the shortcut effect (Wang et al., 8 Jul 2025).

Two perturbation granularities are defined. Sample-wise noise tkt_k1 assigns one perturbation per stream, whereas class-wise noise tkt_k2 shares a perturbation within a class. The paper’s interpretation is explicit: tkt_k3 becomes an “easy-learnable” feature that the surrogate model captures instead of true semantics, and downstream models trained on perturbed streams inherit this reliance on the noise shortcut.

The sequential formulation in the time-series setting makes the same conceptual distinction from adversarial attacks. Rather than a min-max objective, UE generation is described as a bi-level min-min problem: tkt_k4 with the final poisoned stream given by

tkt_k5

This framing matters because UEvs are not intended to induce immediate test-time misclassification; they are designed to poison the training signal itself (Jiang et al., 2024).

3. Event-Error-Minimizing Noise, projection, and retrieval

Directly adding continuous noise to an event stack breaks the binary-polarity pattern. The asynchronous event-stream method therefore introduces a projection

tkt_k6

where tkt_k7 and tkt_k8 are the mean and half-range of raw tkt_k9, and pk{±1}p_k\in\{\pm1\}0 balances stealth versus effectiveness (Wang et al., 8 Jul 2025).

The projected values pk{±1}p_k\in\{\pm1\}1 are chosen to combine with original stack values pk{±1}p_k\in\{\pm1\}2. Their operational role is to delete, leave, or generate events. This is the central compatibility mechanism: the perturbation is sparse, polarity-compatible, and remains expressible in the event-stack representation used by downstream event-based networks.

The full procedure initializes pk{±1}p_k\in\{\pm1\}3 randomly, alternates surrogate training and PGD noise updates until the surrogate accuracy on perturbed stacks reaches the target pk{±1}p_k\in\{\pm1\}4, then projects the noise, clips the resulting stack to pk{±1}p_k\in\{\pm1\}5, and reconstructs the unlearnable raw stream pk{±1}p_k\in\{\pm1\}6 via timestamp retrieval. The output is an unlearnable dataset pk{±1}p_k\in\{\pm1\}7 (Wang et al., 8 Jul 2025).

The key hyperparameters reported for this pipeline are stack channels pk{±1}p_k\in\{\pm1\}8, surrogate training epochs pk{±1}p_k\in\{\pm1\}9, batch size E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.0, PGD steps E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.1, E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.2, E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.3, projection balance E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.4, and target accuracy E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.5. The method’s significance lies in preserving compatibility with the raw-stream and stack-based processing chain. A plausible implication is that this compatibility requirement is the main distinction between UEvs for event cameras and unlearnable perturbations in dense domains.

4. Empirical results on asynchronous event-camera datasets

The event-stream study evaluates UEvs on N-Caltech101, CIFAR10-DVS, DVS128 Gesture, and N-ImageNet, using ResNet-18/50, VGG16, DenseNet121, EfficientNet-B1, ViT-B, and Swin-B. Protection strength is measured by test accuracy on perturbed versus clean data, where lower perturbed accuracy indicates stronger defense. Imperceptibility is measured by PSNR, SSIM, and MSE computed on event stacks (Wang et al., 8 Jul 2025).

On N-Caltech101 with ResNet-18, the clean test accuracy is E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.6. Event pollution baselines—coordinate shift, timestamp shift, polarity inversion, pattern injection, and block shuffle—yield perturbed accuracies of approximately E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.7 to E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.8. By contrast, class-wise noise E={ek}k=1K.\mathcal{E} = \{\,e_k\}_{k=1}^K.9 produces (x,y)(x,y)0 accuracy, corresponding to a (x,y)(x,y)1 drop, and sample-wise noise (x,y)(x,y)2 produces (x,y)(x,y)3, corresponding to a (x,y)(x,y)4 drop (Wang et al., 8 Jul 2025).

The paper further reports that all seven architectures suffer more than a (x,y)(x,y)5 accuracy drop under (x,y)(x,y)6 or (x,y)(x,y)7. Imperceptibility remains comparatively strong: PSNR is approximately (x,y)(x,y)8 for (x,y)(x,y)9 and xRT×dx\in\mathbb{R}^{T\times d}0 for xRT×dx\in\mathbb{R}^{T\times d}1; SSIM is xRT×dx\in\mathbb{R}^{T\times d}2 and xRT×dx\in\mathbb{R}^{T\times d}3; MSE is xRT×dx\in\mathbb{R}^{T\times d}4 and xRT×dx\in\mathbb{R}^{T\times d}5. The pollution baselines yield xRT×dx\in\mathbb{R}^{T\times d}6 or visible distortions (Wang et al., 8 Jul 2025).

Ablation results refine the picture. Removing the similarity loss xRT×dx\in\mathbb{R}^{T\times d}7 raises perturbed accuracy from xRT×dx\in\mathbb{R}^{T\times d}8 to xRT×dx\in\mathbb{R}^{T\times d}9. Mixed noise configurations, written as {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}0 or {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}1, remain effective while increasing stealthiness or flexibility. The defense is reported as robust under standard augmentations, including random shift, flip, crop, and EventDrop. Alternative attacks such as FGSM, CW, and MIFGSM also yield low test accuracy, below {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}2. Varying the time-bin size by {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}3 or {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}4, or changing representation to event frame or time surface, has minor effect (Wang et al., 8 Jul 2025).

These findings support the paper’s conclusion that UEvs provide strong protection while remaining visually restrained in the event-stack domain. The concrete numerical pattern also clarifies a frequent misunderstanding: lower perceptibility metrics do not, in this setting, automatically imply weaker protection, because the defense mechanism depends on the learnability of the injected shortcut rather than on conspicuous corruption.

5. Sequential and time-series formulations

A neighboring line of work extends unlearnability from images to time series and summarizes it in terms of “Unlearnable Event Streams” for labeled streams {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}5 processed by RNNs (Jiang et al., 2024). The downstream learner is trained by empirical risk minimization,

{(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}6

and the released dataset is constructed so that models trained on {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}7 perform near-randomly on clean data.

The distinctive mechanism in this formulation is selective segment-wise perturbation. A binary control vector {(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}8 specifies where the noise is applied, yielding the objective

{(xi+δi,yi)}\{(x_i+\delta_i,y_i)\}9

with δipρu\|\delta_i\|_p \le \rho_u0. In practice, the imperceptibility constraint is δipρu\|\delta_i\|_p \le \rho_u1, and Eq. 5 acts as a regularizer that forces the RNN to see “no signal” in the protected segments (Jiang et al., 2024).

The theoretical justification given is gradient-based: by driving δipρu\|\delta_i\|_p \le \rho_u2 for each poisoned sample, the gradient contribution δipρu\|\delta_i\|_p \le \rho_u3 from that sample vanishes. Over training, the RNN never learns to discriminate patterns in the protected segments; when evaluated on clean data, performance therefore collapses toward chance. This account closely parallels the shortcut interpretation used in the event-camera literature, although the perturbation locus differs.

Empirically, classification experiments use a vanilla RNN with three 64-unit hidden layers, batch size δipρu\|\delta_i\|_p \le \rho_u4, Adam with learning rate δipρu\|\delta_i\|_p \le \rho_u5, noise learning rate δipρu\|\delta_i\|_p \le \rho_u6, δipρu\|\delta_i\|_p \le \rho_u7 per sample, warm-start δipρu\|\delta_i\|_p \le \rho_u8 epochs, and total δipρu\|\delta_i\|_p \le \rho_u9 epochs. Across ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),00 univariate UCR and ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),01 multivariate MTS datasets, masking alone drops accuracy by approximately ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),02, UAP by approximately ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),03, whereas the UEv method with only ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),04 noise causes an approximately ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),05 drop; with ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),06 noise, accuracy falls below ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),07, and with ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),08 noise below ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),09. Multivariate streams often fall below ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),10 accuracy (Jiang et al., 2024).

For generation tasks, the setup trains RGAN or QGAN on class-0 samples only, with ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),11 of those samples perturbed, and evaluates with Train on Synthetic, Test on Real using LSTM or FCN classifiers. Generators trained on clean data yield TSTR accuracies of approximately ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),12 to ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),13, whereas generators trained on UEvs produce synthetic streams that give below ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),14 accuracy, an average drop greater than ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),15 (Jiang et al., 2024). This suggests that unlearnability can affect both discriminative and generative downstream usage.

6. Utility preservation, limitations, and future directions

The event-camera study states that perturbations are sparse and imperceptible in the event-stack domain and that, for authorized users who know the original streams or have proprietary reconstruction keys, the noise can be filtered or ignored, preserving legitimate performance (Wang et al., 8 Jul 2025). In the time-series setting, a closely related utility claim is that by protecting only key segments through ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),16, the rest of the stream remains fully learnable for legitimate tasks (Jiang et al., 2024). In both cases, the intended operating point is not universal data destruction but selective denial of unauthorized learning.

Best-practice guidance is also explicit. For new event datasets, one should choose a representative surrogate ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),17, such as ResNet-18, and limit its training to ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),18 steps to avoid overfitting; tune ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),19 and ek=(xk,yk,tk,pk),e_k = (x_k,y_k,t_k,p_k),20 to trade off stealth versus strength; choose class-wise noise for scalability and sample-wise noise for slightly stronger defense; and validate under target adversarial training or augmentations (Wang et al., 8 Jul 2025). The time-series work similarly emphasizes model mismatch tolerance, stating that UEvs require only rough knowledge of the target RNN and that noise generated on one architecture transfers to others (Jiang et al., 2024).

Limitations and countermeasures are not absent from the literature. The time-series paper notes that UEvs can be partially undone by strong countermeasures such as “UEraser” aggressive data augmentation, and that they rely on a small perturbation budget, since extremely noisy settings may degrade both privacy and downstream utility (Jiang et al., 2024). This qualifies any interpretation of UEvs as an absolute protection mechanism.

Future directions identified in the event-camera work include improving noise generation efficiency via a generative noise network, exploring defense-aware noise, and extending to other event tasks such as detection and segmentation via foundation-model surrogates (Wang et al., 8 Jul 2025). The time-series work points to theoretical analysis of convergence and generalization under UEv poisoning, certified guarantees in the style of randomized smoothing for segment-wise unlearnability, and federated or collaborative settings in which users protect their own data in a pooled stream (Jiang et al., 2024). Taken together, these directions indicate that UEvs are evolving from a narrowly defined poisoning construction into a broader framework for consent-based data protection in streaming machine learning.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Unlearnable Event Streams (UEvs).