Papers
Topics
Authors
Recent
Search
2000 character limit reached

Active Membership Inference Test (aMINT)

Updated 10 July 2026
  • The paper introduces aMINT as a proactive auditing method that amplifies member/non-member separability using adversarial perturbations and multi-task learning.
  • It details various constructions such as black-box canary queries, proactive reprogramming, white-box perceptual probing, and federated-learning attacks.
  • Empirical results demonstrate that aMINT achieves higher AUC and TPR, especially in low false-positive regimes compared to passive inference methods.

Active Membership Inference Test (aMINT) denotes a class of active membership-inference methods that determine whether a sample was used in model training by intervening in the auditing process rather than only reading unmodified outputs. In the cited literature, the term is used for several non-identical constructions: adversarially optimized black-box query sets, training-time multi-task auditability heads, proactive model-reprogramming probes, white-box perceptual interrogation procedures, and a federated-learning attack in which a dishonest server embeds malicious parameters into the global model (Wen et al., 2022, DeAlcala et al., 9 Sep 2025, Huang et al., 30 Mar 2026, Nguyen et al., 2023, Taub et al., 5 Feb 2026). Across these formulations, the unifying idea is to amplify member/non-member separability so that inference remains effective in regimes where passive scores degrade, especially at low false-positive rates.

1. Terminology and problem formulations

A basic distinction in the literature is between passive membership inference and proactive or active membership inference. In the ReproMIA formulation, passive MIA takes a fixed sample xx, computes a score Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x)), and predicts membership if Score0(x)>τ\mathrm{Score}_0(x)>\tau. The proactive variant first learns an input-space perturbation δ\delta^* on shadow data and then queries Mθ(xδ)M_\theta(x\oplus\delta^*), with

δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].

Membership is then predicted from Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*)) relative to a threshold τ\tau (Huang et al., 30 Mar 2026).

A second formulation, titled "Active Membership Inference Test (aMINT)," casts auditability as a multi-task learning objective. Here the primary model fθf_\theta solves the main task while a secondary MINT model gϕg_\phi predicts the membership label Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))0 from intermediate activations Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))1, using

Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))2

with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))3 implemented as a binary cross-entropy loss on the membership label (DeAlcala et al., 9 Sep 2025).

A third usage treats aMINT as an active black-box test for a particular record Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))4, where the attacker optimizes adversarial queries in a small Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))5 ball around Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))6 so that models trained with the point and models trained without it respond differently (Wen et al., 2022). A fourth usage appears in federated learning, where a dishonest server embeds a chosen neuron into the transmitted model and decides membership from whether the corresponding gradient component is zero or nonzero after local client training (Nguyen et al., 2023). A fifth usage, inspired by LeakBoost, synthesizes an interrogation image Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))7 by minimizing an activation-space perceptual loss and then feeds Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))8 into an existing detector (Taub et al., 5 Feb 2026).

Formulation Active mechanism Representative source
Black-box canary aMINT Adversarially optimized canary queries near Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))9 (Wen et al., 2022)
Training-time Active MINT Joint optimization of task head and membership head (DeAlcala et al., 9 Sep 2025)
ReproMIA / proactive MIA Learned perturbation Score0(x)>τ\mathrm{Score}_0(x)>\tau0 applied at audit time (Huang et al., 30 Mar 2026)
FL active attack Chosen neuron revealed by gradient component (Nguyen et al., 2023)
White-box perceptual probing Optimized interrogation image Score0(x)>τ\mathrm{Score}_0(x)>\tau1 (Taub et al., 5 Feb 2026)

This multiplicity of definitions makes the term partly contextual rather than fully standardized. A plausible implication is that “active” identifies a design principle—deliberate amplification of privacy leakage—more than a single canonical algorithm.

2. Active probing in black-box and white-box settings

In the black-box canary framework, the attacker assumes a known training algorithm Score0(x)>τ\mathrm{Score}_0(x)>\tau2 and only black-box access to the target model’s confidence or logits. The attacker trains Score0(x)>τ\mathrm{Score}_0(x)>\tau3 shadow models on an auxiliary dataset Score0(x)>τ\mathrm{Score}_0(x)>\tau4, partitions them into Score0(x)>τ\mathrm{Score}_0(x)>\tau5 and Score0(x)>τ\mathrm{Score}_0(x)>\tau6 depending on whether Score0(x)>τ\mathrm{Score}_0(x)>\tau7 is present, and then solves an adversarial optimization within Score0(x)>τ\mathrm{Score}_0(x)>\tau8 to obtain canary queries Score0(x)>τ\mathrm{Score}_0(x)>\tau9 that maximize separation between IN and OUT models. In practice, the method uses the pre-softmax logit of the true label, with δ\delta^*0 and δ\delta^*1, optimized by projected gradient descent. Diversity is induced by sampling random subsets of IN and OUT shadows during optimization, and the final inference score averages likelihood-ratio statistics across δ\delta^*2 canaries after fitting Gaussians to transformed confidences δ\delta^*3 (Wen et al., 2022).

The reported hyperparameters are explicitly modest: δ\delta^*4 for CIFAR-10 images or δ\delta^*5 for MNIST, minibatch size δ\delta^*6, δ\delta^*7 optimization steps, and δ\delta^*8 canaries. In the online CIFAR-10 setting, LiRA achieves δ\delta^*9 and Mθ(xδ)M_\theta(x\oplus\delta^*)0, whereas aMINT reaches Mθ(xδ)M_\theta(x\oplus\delta^*)1 and Mθ(xδ)M_\theta(x\oplus\delta^*)2. In the offline CIFAR-10 setting, LiRA achieves Mθ(xδ)M_\theta(x\oplus\delta^*)3 and Mθ(xδ)M_\theta(x\oplus\delta^*)4, while aMINT reaches Mθ(xδ)M_\theta(x\oplus\delta^*)5 and Mθ(xδ)M_\theta(x\oplus\delta^*)6. The gains are described as especially relevant in low-FPR legal settings, and the method is explicitly model-agnostic and black-box (Wen et al., 2022).

The white-box perceptual formulation replaces adversarial logits with activation matching. Given a target sample Mθ(xδ)M_\theta(x\oplus\delta^*)7, it synthesizes an interrogation image Mθ(xδ)M_\theta(x\oplus\delta^*)8 by minimizing

Mθ(xδ)M_\theta(x\oplus\delta^*)9

where δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].0 is the activation at layer δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].1. Starting from δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].2 or δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].3, the method performs δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].4 steps of gradient descent,

δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].5

and then feeds δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].6 to an off-the-shelf detector such as GLiR (Taub et al., 5 Feb 2026).

The sensitivity analysis is specific: mid and late layers leak the strongest signals, early layers leak almost nothing, short runs with δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].7 are most effective, and lower learning rates δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].8 outperform higher rates, especially at small δ=argmaxδΩExDms,  zDnms[Φ(Mθ(xδ),Mθ(zδ))].\delta^*=\arg\max_{\delta\in\Omega}\mathbb{E}_{x\sim D_m^s,\;z\sim D_{nm}^s}\big[\Phi(M_\theta(x\oplus\delta),M_\theta(z\oplus\delta))\big].9. On CIFAR-10, LeakBoost+GLiR raises ViT-4 AUC from Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))0 to Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))1 and Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))2 from Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))3 to Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))4; on AlexNet, it raises AUC from Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))5 to Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))6 and Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))7 from Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))8 to Scorea(x)=g(Mθ(xδ))\mathrm{Score}_a(x)=g(M_\theta(x\oplus\delta^*))9. On CIFAR-100, ViT-4 AUC rises from τ\tau0 to τ\tau1, while for AlexNet AUC is approximately τ\tau2 with a much larger τ\tau3 increase from τ\tau4 to τ\tau5 (Taub et al., 5 Feb 2026).

Together, these two strands show that active querying does not require a unique mechanism. It may operate through local adversarial neighborhoods in black-box settings or through direct activation-space optimization in white-box settings.

3. ReproMIA and proactive model reprogramming

ReproMIA defines proactive membership inference as a bilevel model-reprogramming problem in which a perturbation is trained to enlarge member/non-member score differences on a shadow model and then transferred to the audited target. The score-difference objective uses τ\tau6, with τ\tau7 mapping model outputs to a scalar score and τ\tau8 a smooth, increasing function such as softplus. The optimization is performed over the perturbation alone while freezing model weights, under constraints such as τ\tau9, fθf_\theta0, or a masked border-patch constraint. A surrogate loss is given by

fθf_\theta1

optimized by gradient ascent or, equivalently in the pseudocode, gradient descent on fθf_\theta2 with projection back into fθf_\theta3 when needed (Huang et al., 30 Mar 2026).

The theoretical analysis is organized around three propositions. Proposition 1 states a loss-landscape curvature gap: under mild overfitting assumptions, the input-space Hessian at non-members has a strictly larger top eigenvalue than at members, with

fθf_\theta4

where fθf_\theta5. Proposition 2 decomposes the gradient of the reprogramming objective into member and non-member streams, fθf_\theta6, and shows under overfitting that fθf_\theta7, so fθf_\theta8 is driven to degrade non-member outputs much more than member outputs. Proposition 3 states that, under a location-family noise model, the mutual information between membership and the perturbed outputs exceeds that of the vanilla outputs: if fθf_\theta9 and gϕg_\phi0, then gϕg_\phi1 for all gϕg_\phi2 (Huang et al., 30 Mar 2026).

The framework is instantiated across LLMs, diffusion models, and classification models. For LLMs, ReproMIA learns a continuous soft prompt gϕg_\phi3 prepended to token embeddings, uses per-token calibrated gϕg_\phi4-scores

gϕg_\phi5

and defines the sample score as the mean of the gϕg_\phi6 smallest token scores, with prompt length gϕg_\phi7, token selection gϕg_\phi8, shadow set size approximately gϕg_\phi9–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))00 samples, AdamW with learning rate Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))01, and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))02–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))03 optimization steps. For diffusion models, it uses proximal initialization with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))04, one DDIM inversion step at time Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))05, a normalized reconstruction error Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))06, and Adam with learning rate Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))07 for Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))08 iterations, with the perturbation bound approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))09–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))10 and optimal around Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))11. For image classification, it learns a global border perturbation Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))12 on a Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))13 border mask; for graphs, it learns a feature perturbation Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))14 added to each node’s feature vector. The total classification loss combines preservation, separation, and regularization terms, with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))15, Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))16, Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))17 steps, and learning rate Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))18 with cosine decay. The final score vector Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))19 is fed to a small MLP with two hidden layers of size Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))20, ReLU, and sigmoid output. All experiments were run on NVIDIA A100/H800 GPUs with PyTorch (Huang et al., 30 Mar 2026).

The empirical emphasis is low-FPR auditing. The reported metrics are balanced accuracy, AUC, and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))21. On WikiMIA with length Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))22, averaged over six LLMs, the best passive baseline ReCaLL obtains approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))23 AUC and approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))24 Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))25, while ReproMIA obtains approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))26 AUC and approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))27 Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))28. On MIMIR, the average AUC gain is Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))29 and TPR gain Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))30 for Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))31B models. Under logits noise with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))32 up to Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))33, ReproMIA retains Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))34 and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))35. For diffusion DDPM, the runner-up RePIAN has approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))36 AUC and approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))37 Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))38, while ReproMIA reaches approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))39 AUC and approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))40 Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))41 using only two queries. For Stable Diffusion, ReproMIA achieves approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))42 AUC versus a best baseline of Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))43, and approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))44 Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))45 versus Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))46. For classification models, average Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))47 rises from Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))48 to Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))49, Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))50 from Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))51 to Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))52, and AUC from Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))53 to Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))54; on Cora, PubMed, and Citeseer, GNN AUC is approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))55–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))56 versus baseline approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))57–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))58 (Huang et al., 30 Mar 2026).

The framework’s practical recommendations are also explicit. Query budgets are small: LLMs and diffusion attacks require only one or two queries per sample, and classification uses one forward pass. Only a small shadow set of approximately Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))59–Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))60 known members and non-members is stated to be sufficient to train Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))61, and auditors are advised to maintain a small shadow audit set, learn Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))62 offline on cheaper surrogate models if necessary, and deploy the method by appending Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))63 to user queries and thresholding the output score (Huang et al., 30 Mar 2026).

4. Auditability as a training objective

The multi-task Active MINT formulation treats membership detection not as a post-hoc attack but as an optimization objective coupled to normal supervised learning. Let Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))64 be the audited model’s training set and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))65 its held-out test set. For any sample Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))66, the membership label is Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))67 if Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))68 and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))69 if Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))70, for example if Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))71. The goal is to learn a predictor of Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))72 (DeAlcala et al., 9 Sep 2025).

The architecture is a two-headed network with audited-model parameters Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))73 and MINT-model parameters Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))74. The primary classifier is Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))75, while Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))76 denotes intermediate activations—called “Auxiliary Auditable Data” (AAD)—extracted from shared layers and passed to the MINT head Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))77. The MINT loss is binary cross-entropy on the membership label, the task loss is standard classification loss, and the total objective adds an Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))78 regularizer Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))79. During back-propagation, gradients of Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))80 update Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))81 in layers downstream of the shared layers, while gradients of Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))82 update both Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))83 and the shared trunk in Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))84 (DeAlcala et al., 9 Sep 2025).

The audited architectures evaluated include MobileNet, ResNet50, ResNet101, DenseNet121, Xception, and ViT. Two split points are used in the network, “Entry” and “Middle,” yielding activation maps Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))85 and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))86. The MINT model has two parallel CNN branches, or FC branches for ViT. In the E1 configuration, each branch has one convolution layer with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))87 filters, kernel Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))88, stride Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))89, ReLU, and global average pooling to produce a Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))90-dimensional vector. In the E2 configuration, each branch has two convolution layers with Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))91 filters, kernel Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))92, stride Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))93, ReLU, and global pooling to produce a Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))94-dimensional vector. The branch outputs are concatenated and passed through two FC layers with dropout Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))95 for E1 and Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))96 for E2, ReLU activations, and a scalar membership logit whose sigmoid is the membership probability (DeAlcala et al., 9 Sep 2025).

The training procedure samples batches from the audited training set and from an external set Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))97, concatenates them, computes class loss only on Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))98 samples and membership loss on both, and optimizes the total loss with Adam or SGD. The experimental setup uses MNIST, CIFAR-10, GTSRB, Tiny-ImageNet, and CASIA-WebFace. For each dataset, the original training set is split Score0(x)=g(Mθ(x))\mathrm{Score}_0(x)=g(M_\theta(x))99 into audited training Score0(x)>τ\mathrm{Score}_0(x)>\tau00 and external Score0(x)>τ\mathrm{Score}_0(x)>\tau01. The optimizer is Adam with Score0(x)>τ\mathrm{Score}_0(x)>\tau02, Score0(x)>τ\mathrm{Score}_0(x)>\tau03, batch size Score0(x)>τ\mathrm{Score}_0(x)>\tau04, learning rate Score0(x)>τ\mathrm{Score}_0(x)>\tau05 for MNIST and Score0(x)>τ\mathrm{Score}_0(x)>\tau06 for larger tasks, loss weighting Score0(x)>τ\mathrm{Score}_0(x)>\tau07 for simple tasks and Score0(x)>τ\mathrm{Score}_0(x)>\tau08 for complex tasks, regularization Score0(x)>τ\mathrm{Score}_0(x)>\tau09 or Score0(x)>τ\mathrm{Score}_0(x)>\tau10, and early stopping after Score0(x)>τ\mathrm{Score}_0(x)>\tau11–Score0(x)>τ\mathrm{Score}_0(x)>\tau12 epochs based on validation (DeAlcala et al., 9 Sep 2025).

The reported membership-detection accuracies in the Entry setup all exceed Score0(x)>τ\mathrm{Score}_0(x)>\tau13. On MNIST, values range from Score0(x)>τ\mathrm{Score}_0(x)>\tau14 for ViT to Score0(x)>τ\mathrm{Score}_0(x)>\tau15 for MobileNet; on CIFAR-10, values range from Score0(x)>τ\mathrm{Score}_0(x)>\tau16 to Score0(x)>τ\mathrm{Score}_0(x)>\tau17 across all listed architectures except no drop below Score0(x)>τ\mathrm{Score}_0(x)>\tau18; on GTSRB, MobileNet reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau19 and ViT reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau20; on Tiny-ImageNet, Xception reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau21 and ViT reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau22; on CASIA-WebFace, MobileNet reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau23 and ViT reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau24, while the text states that all exceed Score0(x)>τ\mathrm{Score}_0(x)>\tau25 membership-detection accuracy. Audited-model accuracy dropped less than Score0(x)>τ\mathrm{Score}_0(x)>\tau26 relative to standalone training. On ResNet50, the comparison to earlier methods is explicit: on CIFAR-10, Shokri et al. MIA achieves Score0(x)>τ\mathrm{Score}_0(x)>\tau27, Passive MINT Score0(x)>τ\mathrm{Score}_0(x)>\tau28, and Active MINT Score0(x)>τ\mathrm{Score}_0(x)>\tau29; on GTSRB, Shokri et al. MIA achieves Score0(x)>τ\mathrm{Score}_0(x)>\tau30, Passive MINT Score0(x)>τ\mathrm{Score}_0(x)>\tau31, and Active MINT Score0(x)>τ\mathrm{Score}_0(x)>\tau32 (DeAlcala et al., 9 Sep 2025).

The ablation results identify activation-point choice and task-weighting as central controls. Entry and Middle setups yield comparable high MINT accuracy, whereas Output or late layers consistently underperform with values below Score0(x)>τ\mathrm{Score}_0(x)>\tau33. Higher Score0(x)>τ\mathrm{Score}_0(x)>\tau34 favors MINT at a slight cost to classification, and the stated limitation is the small less-than-Score0(x)>τ\mathrm{Score}_0(x)>\tau35 drop in primary-task performance, which can be managed by reducing shared layers or tuning Score0(x)>τ\mathrm{Score}_0(x)>\tau36. Suggested deployment strategies include cryptographically signed logs, Docker containers with deterministic hashes, and secure MPC setups where the auditor controls the MINT branch (DeAlcala et al., 9 Sep 2025).

5. Federated-learning aMINT under local differential privacy

In federated learning, the active threat model is structurally different because the attacker is the coordinating server. The server broadcasts a global model, collects clients’ gradients, and is allowed to be actively dishonest rather than merely honest-but-curious. The goal is to decide whether a target point Score0(x)>τ\mathrm{Score}_0(x)>\tau37 belonged to a chosen client’s private batch Score0(x)>τ\mathrm{Score}_0(x)>\tau38. The paper formalizes this as a security game with an initialization oracle Score0(x)>τ\mathrm{Score}_0(x)>\tau39 that returns a modified model Score0(x)>τ\mathrm{Score}_0(x)>\tau40, a client gradient computation Score0(x)>τ\mathrm{Score}_0(x)>\tau41 on possibly LDP-noised data, and an inference oracle Score0(x)>τ\mathrm{Score}_0(x)>\tau42 that outputs a membership bit. The server’s advantage is

Score0(x)>τ\mathrm{Score}_0(x)>\tau43

The client may also be forced to use a local differential privacy mechanism Score0(x)>τ\mathrm{Score}_0(x)>\tau44 specified by the server (Nguyen et al., 2023).

The core attack is to inject a chosen neuron whose activation isolates the target sample. Let Score0(x)>τ\mathrm{Score}_0(x)>\tau45 be first-layer weights, Score0(x)>τ\mathrm{Score}_0(x)>\tau46 the second-layer weights, and

Score0(x)>τ\mathrm{Score}_0(x)>\tau47

If the chosen neuron activates only on Score0(x)>τ\mathrm{Score}_0(x)>\tau48 and not on other elements of Score0(x)>τ\mathrm{Score}_0(x)>\tau49, then its gradient is nonzero if Score0(x)>τ\mathrm{Score}_0(x)>\tau50 and zero if Score0(x)>τ\mathrm{Score}_0(x)>\tau51. The test statistic is therefore the extracted gradient component Score0(x)>τ\mathrm{Score}_0(x)>\tau52, with

Score0(x)>τ\mathrm{Score}_0(x)>\tau53

The server’s construction routine samples decoy negatives from a public distribution, forms an auxiliary dataset with Score0(x)>τ\mathrm{Score}_0(x)>\tau54 labeled positive and the decoys labeled negative, trains Score0(x)>τ\mathrm{Score}_0(x)>\tau55 by cross-entropy so that Score0(x)>τ\mathrm{Score}_0(x)>\tau56 and Score0(x)>τ\mathrm{Score}_0(x)>\tau57 for Score0(x)>τ\mathrm{Score}_0(x)>\tau58, embeds these parameters into the global model, and later extracts the chosen neuron’s gradient after local client training. Under LDP, the server instead trains the neuron on multiple noised copies Score0(x)>τ\mathrm{Score}_0(x)>\tau59 of the target so that it remains active on noised versions of Score0(x)>τ\mathrm{Score}_0(x)>\tau60 but inactive on other samples (Nguyen et al., 2023).

The theoretical guarantee is expressed through the expected activation of the chosen neuron under noising. Let Score0(x)>τ\mathrm{Score}_0(x)>\tau61 and Score0(x)>τ\mathrm{Score}_0(x)>\tau62. Using Monte Carlo estimates and Hoeffding bounds, the paper defines lower and upper confidence bounds on Score0(x)>τ\mathrm{Score}_0(x)>\tau63 and Score0(x)>τ\mathrm{Score}_0(x)>\tau64 and states a certified guarantee: if the lower bound on the target’s expected activation is strictly positive and the supremum of the upper bounds on all non-target activations is nonpositive, then with probability at least Score0(x)>τ\mathrm{Score}_0(x)>\tau65 the server’s aMINT test will succeed (Nguyen et al., 2023).

The experiments use CelebA with batch size Score0(x)>τ\mathrm{Score}_0(x)>\tau66, ImageNet-10 with batch size Score0(x)>τ\mathrm{Score}_0(x)>\tau67, and CIFAR-10 with batch size Score0(x)>τ\mathrm{Score}_0(x)>\tau68, all on a two-layer fully connected network over frozen ResNet-18 embeddings of dimension Score0(x)>τ\mathrm{Score}_0(x)>\tau69. The LDP mechanisms are BitRand and OME on Score0(x)>τ\mathrm{Score}_0(x)>\tau70-bit-quantized embeddings, with attack parameters Score0(x)>τ\mathrm{Score}_0(x)>\tau71 neurons in the first layer and one chosen neuron in the second. The reported metrics are advantage, true positive rate, and true negative rate. Without LDP, aMINT reaches Score0(x)>τ\mathrm{Score}_0(x)>\tau72 success within a single round. Under BitRand, even at Score0(x)>τ\mathrm{Score}_0(x)>\tau73 the advantage is at least Score0(x)>τ\mathrm{Score}_0(x)>\tau74 on all three datasets, and for Score0(x)>τ\mathrm{Score}_0(x)>\tau75 it exceeds Score0(x)>τ\mathrm{Score}_0(x)>\tau76. Under OME, success rates remain above Score0(x)>τ\mathrm{Score}_0(x)>\tau77 for Score0(x)>τ\mathrm{Score}_0(x)>\tau78. The paper further states that pushing Score0(x)>τ\mathrm{Score}_0(x)>\tau79 very low, such as Score0(x)>τ\mathrm{Score}_0(x)>\tau80, drives attack success toward Score0(x)>τ\mathrm{Score}_0(x)>\tau81 but collapses model utility; that DP-SGD with sufficiently small privacy budgets prevents ConvNet training from converging on CIFAR-10 or ImageNet; and that malicious weights are empirically statistically indistinguishable from clean weights by KDE overlap (Nguyen et al., 2023).

This formulation broadens the meaning of aMINT beyond test-time query synthesis. Here “active” refers to malicious intervention in the training loop itself, with gradient observability substituting for direct black-box scoring.

6. Evaluation criteria, defenses, and interpretive issues

Evaluation protocols differ across formulations, but all focus on separability between member and non-member responses. ReproMIA reports balanced accuracy, ROC AUC, and Score0(x)>τ\mathrm{Score}_0(x)>\tau82, with a specific emphasis on low-FPR gains (Huang et al., 30 Mar 2026). The black-box canary framework reports AUC and Score0(x)>τ\mathrm{Score}_0(x)>\tau83, emphasizing online and offline settings and low-FPR utility in legal contexts (Wen et al., 2022). The multi-task Active MINT work reports membership-detection accuracy across architectures and datasets (DeAlcala et al., 9 Sep 2025). The federated-learning attack reports advantage, TPR, and TNR (Nguyen et al., 2023). The perceptual probing framework reports AUC together with Score0(x)>τ\mathrm{Score}_0(x)>\tau84 and Score0(x)>τ\mathrm{Score}_0(x)>\tau85 (Taub et al., 5 Feb 2026).

A recurrent finding is that active procedures preserve or enlarge separation where passive methods weaken. ReproMIA explicitly attributes its gains to overfitting-induced curvature and gradient asymmetries, and states that the largest relative gains occur in low-FPR regimes because mutual information and score separation are increased so that ROC tails spread apart (Huang et al., 30 Mar 2026). The canary method likewise reports its strongest practical relevance in low-FPR settings (Wen et al., 2022). The perceptual probing results concentrate improvements in gradient-based detectors and in mid/late layers rather than early representations (Taub et al., 5 Feb 2026). This suggests that active membership inference is best understood as a signal-amplification strategy rather than as a single detector family.

A common misconception is that active membership inference is necessarily black-box. The literature does not support that restriction. The canary and ReproMIA approaches are black-box or black-box-compatible (Wen et al., 2022, Huang et al., 30 Mar 2026), the perceptual interrogation framework assumes white-box access to activations and gradients (Taub et al., 5 Feb 2026), the multi-task formulation is intrinsic to the training procedure (DeAlcala et al., 9 Sep 2025), and the federated-learning attack relies on server control over model transmission and access to returned gradients (Nguyen et al., 2023).

Another common misconception is that differential privacy or injected noise categorically neutralize active tests. The cited papers instead report partial robustness and privacy–utility trade-offs. ReproMIA retains Score0(x)>τ\mathrm{Score}_0(x)>\tau86 and Score0(x)>τ\mathrm{Score}_0(x)>\tau87 under logits noise Score0(x)>τ\mathrm{Score}_0(x)>\tau88 up to Score0(x)>τ\mathrm{Score}_0(x)>\tau89 for LLM defenses, and on diffusion defenses under DP-SGD with Score0(x)>τ\mathrm{Score}_0(x)>\tau90 still reaches approximately Score0(x)>τ\mathrm{Score}_0(x)>\tau91–Score0(x)>τ\mathrm{Score}_0(x)>\tau92 AUC and approximately Score0(x)>τ\mathrm{Score}_0(x)>\tau93–Score0(x)>τ\mathrm{Score}_0(x)>\tau94 Score0(x)>τ\mathrm{Score}_0(x)>\tau95; for classification defenses, AUC under DP-SGD with Score0(x)>τ\mathrm{Score}_0(x)>\tau96 drops to Score0(x)>τ\mathrm{Score}_0(x)>\tau97 but remains above baselines, while under smoothing Score0(x)>τ\mathrm{Score}_0(x)>\tau98 it remains above Score0(x)>τ\mathrm{Score}_0(x)>\tau99 (Huang et al., 30 Mar 2026). The canary framework states that under DP defenses it still improves LiRA by δ\delta^*00–δ\delta^*01 AUC with TPR gains up to δ\delta^*02 (Wen et al., 2022). The federated-learning work reports that sufficiently strong noise to suppress the attack substantially damages utility or training convergence (Nguyen et al., 2023).

The practical implications therefore vary by setting. In post-hoc black-box auditing, active probes can be precomputed and then reused, including in offline settings (Wen et al., 2022). In proactive privacy auditing, a learned perturbation can be trained on small shadow sets and deployed with one or two queries per sample (Huang et al., 30 Mar 2026). In training-time governance, auditability can be made an explicit optimization target with only a small drop in primary accuracy (DeAlcala et al., 9 Sep 2025). In federated learning, the same active principle exposes the risk that privacy guarantees can fail under a malicious coordinator even when local differential privacy is present (Nguyen et al., 2023).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Active Membership Inference Test (aMINT).