Active Membership Inference Test (aMINT)
- The paper introduces aMINT as a proactive auditing method that amplifies member/non-member separability using adversarial perturbations and multi-task learning.
- It details various constructions such as black-box canary queries, proactive reprogramming, white-box perceptual probing, and federated-learning attacks.
- Empirical results demonstrate that aMINT achieves higher AUC and TPR, especially in low false-positive regimes compared to passive inference methods.
Active Membership Inference Test (aMINT) denotes a class of active membership-inference methods that determine whether a sample was used in model training by intervening in the auditing process rather than only reading unmodified outputs. In the cited literature, the term is used for several non-identical constructions: adversarially optimized black-box query sets, training-time multi-task auditability heads, proactive model-reprogramming probes, white-box perceptual interrogation procedures, and a federated-learning attack in which a dishonest server embeds malicious parameters into the global model (Wen et al., 2022, DeAlcala et al., 9 Sep 2025, Huang et al., 30 Mar 2026, Nguyen et al., 2023, Taub et al., 5 Feb 2026). Across these formulations, the unifying idea is to amplify member/non-member separability so that inference remains effective in regimes where passive scores degrade, especially at low false-positive rates.
1. Terminology and problem formulations
A basic distinction in the literature is between passive membership inference and proactive or active membership inference. In the ReproMIA formulation, passive MIA takes a fixed sample , computes a score , and predicts membership if . The proactive variant first learns an input-space perturbation on shadow data and then queries , with
Membership is then predicted from relative to a threshold (Huang et al., 30 Mar 2026).
A second formulation, titled "Active Membership Inference Test (aMINT)," casts auditability as a multi-task learning objective. Here the primary model solves the main task while a secondary MINT model predicts the membership label 0 from intermediate activations 1, using
2
with 3 implemented as a binary cross-entropy loss on the membership label (DeAlcala et al., 9 Sep 2025).
A third usage treats aMINT as an active black-box test for a particular record 4, where the attacker optimizes adversarial queries in a small 5 ball around 6 so that models trained with the point and models trained without it respond differently (Wen et al., 2022). A fourth usage appears in federated learning, where a dishonest server embeds a chosen neuron into the transmitted model and decides membership from whether the corresponding gradient component is zero or nonzero after local client training (Nguyen et al., 2023). A fifth usage, inspired by LeakBoost, synthesizes an interrogation image 7 by minimizing an activation-space perceptual loss and then feeds 8 into an existing detector (Taub et al., 5 Feb 2026).
| Formulation | Active mechanism | Representative source |
|---|---|---|
| Black-box canary aMINT | Adversarially optimized canary queries near 9 | (Wen et al., 2022) |
| Training-time Active MINT | Joint optimization of task head and membership head | (DeAlcala et al., 9 Sep 2025) |
| ReproMIA / proactive MIA | Learned perturbation 0 applied at audit time | (Huang et al., 30 Mar 2026) |
| FL active attack | Chosen neuron revealed by gradient component | (Nguyen et al., 2023) |
| White-box perceptual probing | Optimized interrogation image 1 | (Taub et al., 5 Feb 2026) |
This multiplicity of definitions makes the term partly contextual rather than fully standardized. A plausible implication is that “active” identifies a design principle—deliberate amplification of privacy leakage—more than a single canonical algorithm.
2. Active probing in black-box and white-box settings
In the black-box canary framework, the attacker assumes a known training algorithm 2 and only black-box access to the target model’s confidence or logits. The attacker trains 3 shadow models on an auxiliary dataset 4, partitions them into 5 and 6 depending on whether 7 is present, and then solves an adversarial optimization within 8 to obtain canary queries 9 that maximize separation between IN and OUT models. In practice, the method uses the pre-softmax logit of the true label, with 0 and 1, optimized by projected gradient descent. Diversity is induced by sampling random subsets of IN and OUT shadows during optimization, and the final inference score averages likelihood-ratio statistics across 2 canaries after fitting Gaussians to transformed confidences 3 (Wen et al., 2022).
The reported hyperparameters are explicitly modest: 4 for CIFAR-10 images or 5 for MNIST, minibatch size 6, 7 optimization steps, and 8 canaries. In the online CIFAR-10 setting, LiRA achieves 9 and 0, whereas aMINT reaches 1 and 2. In the offline CIFAR-10 setting, LiRA achieves 3 and 4, while aMINT reaches 5 and 6. The gains are described as especially relevant in low-FPR legal settings, and the method is explicitly model-agnostic and black-box (Wen et al., 2022).
The white-box perceptual formulation replaces adversarial logits with activation matching. Given a target sample 7, it synthesizes an interrogation image 8 by minimizing
9
where 0 is the activation at layer 1. Starting from 2 or 3, the method performs 4 steps of gradient descent,
5
and then feeds 6 to an off-the-shelf detector such as GLiR (Taub et al., 5 Feb 2026).
The sensitivity analysis is specific: mid and late layers leak the strongest signals, early layers leak almost nothing, short runs with 7 are most effective, and lower learning rates 8 outperform higher rates, especially at small 9. On CIFAR-10, LeakBoost+GLiR raises ViT-4 AUC from 0 to 1 and 2 from 3 to 4; on AlexNet, it raises AUC from 5 to 6 and 7 from 8 to 9. On CIFAR-100, ViT-4 AUC rises from 0 to 1, while for AlexNet AUC is approximately 2 with a much larger 3 increase from 4 to 5 (Taub et al., 5 Feb 2026).
Together, these two strands show that active querying does not require a unique mechanism. It may operate through local adversarial neighborhoods in black-box settings or through direct activation-space optimization in white-box settings.
3. ReproMIA and proactive model reprogramming
ReproMIA defines proactive membership inference as a bilevel model-reprogramming problem in which a perturbation is trained to enlarge member/non-member score differences on a shadow model and then transferred to the audited target. The score-difference objective uses 6, with 7 mapping model outputs to a scalar score and 8 a smooth, increasing function such as softplus. The optimization is performed over the perturbation alone while freezing model weights, under constraints such as 9, 0, or a masked border-patch constraint. A surrogate loss is given by
1
optimized by gradient ascent or, equivalently in the pseudocode, gradient descent on 2 with projection back into 3 when needed (Huang et al., 30 Mar 2026).
The theoretical analysis is organized around three propositions. Proposition 1 states a loss-landscape curvature gap: under mild overfitting assumptions, the input-space Hessian at non-members has a strictly larger top eigenvalue than at members, with
4
where 5. Proposition 2 decomposes the gradient of the reprogramming objective into member and non-member streams, 6, and shows under overfitting that 7, so 8 is driven to degrade non-member outputs much more than member outputs. Proposition 3 states that, under a location-family noise model, the mutual information between membership and the perturbed outputs exceeds that of the vanilla outputs: if 9 and 0, then 1 for all 2 (Huang et al., 30 Mar 2026).
The framework is instantiated across LLMs, diffusion models, and classification models. For LLMs, ReproMIA learns a continuous soft prompt 3 prepended to token embeddings, uses per-token calibrated 4-scores
5
and defines the sample score as the mean of the 6 smallest token scores, with prompt length 7, token selection 8, shadow set size approximately 9–00 samples, AdamW with learning rate 01, and 02–03 optimization steps. For diffusion models, it uses proximal initialization with 04, one DDIM inversion step at time 05, a normalized reconstruction error 06, and Adam with learning rate 07 for 08 iterations, with the perturbation bound approximately 09–10 and optimal around 11. For image classification, it learns a global border perturbation 12 on a 13 border mask; for graphs, it learns a feature perturbation 14 added to each node’s feature vector. The total classification loss combines preservation, separation, and regularization terms, with 15, 16, 17 steps, and learning rate 18 with cosine decay. The final score vector 19 is fed to a small MLP with two hidden layers of size 20, ReLU, and sigmoid output. All experiments were run on NVIDIA A100/H800 GPUs with PyTorch (Huang et al., 30 Mar 2026).
The empirical emphasis is low-FPR auditing. The reported metrics are balanced accuracy, AUC, and 21. On WikiMIA with length 22, averaged over six LLMs, the best passive baseline ReCaLL obtains approximately 23 AUC and approximately 24 25, while ReproMIA obtains approximately 26 AUC and approximately 27 28. On MIMIR, the average AUC gain is 29 and TPR gain 30 for 31B models. Under logits noise with 32 up to 33, ReproMIA retains 34 and 35. For diffusion DDPM, the runner-up RePIAN has approximately 36 AUC and approximately 37 38, while ReproMIA reaches approximately 39 AUC and approximately 40 41 using only two queries. For Stable Diffusion, ReproMIA achieves approximately 42 AUC versus a best baseline of 43, and approximately 44 45 versus 46. For classification models, average 47 rises from 48 to 49, 50 from 51 to 52, and AUC from 53 to 54; on Cora, PubMed, and Citeseer, GNN AUC is approximately 55–56 versus baseline approximately 57–58 (Huang et al., 30 Mar 2026).
The framework’s practical recommendations are also explicit. Query budgets are small: LLMs and diffusion attacks require only one or two queries per sample, and classification uses one forward pass. Only a small shadow set of approximately 59–60 known members and non-members is stated to be sufficient to train 61, and auditors are advised to maintain a small shadow audit set, learn 62 offline on cheaper surrogate models if necessary, and deploy the method by appending 63 to user queries and thresholding the output score (Huang et al., 30 Mar 2026).
4. Auditability as a training objective
The multi-task Active MINT formulation treats membership detection not as a post-hoc attack but as an optimization objective coupled to normal supervised learning. Let 64 be the audited model’s training set and 65 its held-out test set. For any sample 66, the membership label is 67 if 68 and 69 if 70, for example if 71. The goal is to learn a predictor of 72 (DeAlcala et al., 9 Sep 2025).
The architecture is a two-headed network with audited-model parameters 73 and MINT-model parameters 74. The primary classifier is 75, while 76 denotes intermediate activations—called “Auxiliary Auditable Data” (AAD)—extracted from shared layers and passed to the MINT head 77. The MINT loss is binary cross-entropy on the membership label, the task loss is standard classification loss, and the total objective adds an 78 regularizer 79. During back-propagation, gradients of 80 update 81 in layers downstream of the shared layers, while gradients of 82 update both 83 and the shared trunk in 84 (DeAlcala et al., 9 Sep 2025).
The audited architectures evaluated include MobileNet, ResNet50, ResNet101, DenseNet121, Xception, and ViT. Two split points are used in the network, “Entry” and “Middle,” yielding activation maps 85 and 86. The MINT model has two parallel CNN branches, or FC branches for ViT. In the E1 configuration, each branch has one convolution layer with 87 filters, kernel 88, stride 89, ReLU, and global average pooling to produce a 90-dimensional vector. In the E2 configuration, each branch has two convolution layers with 91 filters, kernel 92, stride 93, ReLU, and global pooling to produce a 94-dimensional vector. The branch outputs are concatenated and passed through two FC layers with dropout 95 for E1 and 96 for E2, ReLU activations, and a scalar membership logit whose sigmoid is the membership probability (DeAlcala et al., 9 Sep 2025).
The training procedure samples batches from the audited training set and from an external set 97, concatenates them, computes class loss only on 98 samples and membership loss on both, and optimizes the total loss with Adam or SGD. The experimental setup uses MNIST, CIFAR-10, GTSRB, Tiny-ImageNet, and CASIA-WebFace. For each dataset, the original training set is split 99 into audited training 00 and external 01. The optimizer is Adam with 02, 03, batch size 04, learning rate 05 for MNIST and 06 for larger tasks, loss weighting 07 for simple tasks and 08 for complex tasks, regularization 09 or 10, and early stopping after 11–12 epochs based on validation (DeAlcala et al., 9 Sep 2025).
The reported membership-detection accuracies in the Entry setup all exceed 13. On MNIST, values range from 14 for ViT to 15 for MobileNet; on CIFAR-10, values range from 16 to 17 across all listed architectures except no drop below 18; on GTSRB, MobileNet reaches 19 and ViT reaches 20; on Tiny-ImageNet, Xception reaches 21 and ViT reaches 22; on CASIA-WebFace, MobileNet reaches 23 and ViT reaches 24, while the text states that all exceed 25 membership-detection accuracy. Audited-model accuracy dropped less than 26 relative to standalone training. On ResNet50, the comparison to earlier methods is explicit: on CIFAR-10, Shokri et al. MIA achieves 27, Passive MINT 28, and Active MINT 29; on GTSRB, Shokri et al. MIA achieves 30, Passive MINT 31, and Active MINT 32 (DeAlcala et al., 9 Sep 2025).
The ablation results identify activation-point choice and task-weighting as central controls. Entry and Middle setups yield comparable high MINT accuracy, whereas Output or late layers consistently underperform with values below 33. Higher 34 favors MINT at a slight cost to classification, and the stated limitation is the small less-than-35 drop in primary-task performance, which can be managed by reducing shared layers or tuning 36. Suggested deployment strategies include cryptographically signed logs, Docker containers with deterministic hashes, and secure MPC setups where the auditor controls the MINT branch (DeAlcala et al., 9 Sep 2025).
5. Federated-learning aMINT under local differential privacy
In federated learning, the active threat model is structurally different because the attacker is the coordinating server. The server broadcasts a global model, collects clients’ gradients, and is allowed to be actively dishonest rather than merely honest-but-curious. The goal is to decide whether a target point 37 belonged to a chosen client’s private batch 38. The paper formalizes this as a security game with an initialization oracle 39 that returns a modified model 40, a client gradient computation 41 on possibly LDP-noised data, and an inference oracle 42 that outputs a membership bit. The server’s advantage is
43
The client may also be forced to use a local differential privacy mechanism 44 specified by the server (Nguyen et al., 2023).
The core attack is to inject a chosen neuron whose activation isolates the target sample. Let 45 be first-layer weights, 46 the second-layer weights, and
47
If the chosen neuron activates only on 48 and not on other elements of 49, then its gradient is nonzero if 50 and zero if 51. The test statistic is therefore the extracted gradient component 52, with
53
The server’s construction routine samples decoy negatives from a public distribution, forms an auxiliary dataset with 54 labeled positive and the decoys labeled negative, trains 55 by cross-entropy so that 56 and 57 for 58, embeds these parameters into the global model, and later extracts the chosen neuron’s gradient after local client training. Under LDP, the server instead trains the neuron on multiple noised copies 59 of the target so that it remains active on noised versions of 60 but inactive on other samples (Nguyen et al., 2023).
The theoretical guarantee is expressed through the expected activation of the chosen neuron under noising. Let 61 and 62. Using Monte Carlo estimates and Hoeffding bounds, the paper defines lower and upper confidence bounds on 63 and 64 and states a certified guarantee: if the lower bound on the target’s expected activation is strictly positive and the supremum of the upper bounds on all non-target activations is nonpositive, then with probability at least 65 the server’s aMINT test will succeed (Nguyen et al., 2023).
The experiments use CelebA with batch size 66, ImageNet-10 with batch size 67, and CIFAR-10 with batch size 68, all on a two-layer fully connected network over frozen ResNet-18 embeddings of dimension 69. The LDP mechanisms are BitRand and OME on 70-bit-quantized embeddings, with attack parameters 71 neurons in the first layer and one chosen neuron in the second. The reported metrics are advantage, true positive rate, and true negative rate. Without LDP, aMINT reaches 72 success within a single round. Under BitRand, even at 73 the advantage is at least 74 on all three datasets, and for 75 it exceeds 76. Under OME, success rates remain above 77 for 78. The paper further states that pushing 79 very low, such as 80, drives attack success toward 81 but collapses model utility; that DP-SGD with sufficiently small privacy budgets prevents ConvNet training from converging on CIFAR-10 or ImageNet; and that malicious weights are empirically statistically indistinguishable from clean weights by KDE overlap (Nguyen et al., 2023).
This formulation broadens the meaning of aMINT beyond test-time query synthesis. Here “active” refers to malicious intervention in the training loop itself, with gradient observability substituting for direct black-box scoring.
6. Evaluation criteria, defenses, and interpretive issues
Evaluation protocols differ across formulations, but all focus on separability between member and non-member responses. ReproMIA reports balanced accuracy, ROC AUC, and 82, with a specific emphasis on low-FPR gains (Huang et al., 30 Mar 2026). The black-box canary framework reports AUC and 83, emphasizing online and offline settings and low-FPR utility in legal contexts (Wen et al., 2022). The multi-task Active MINT work reports membership-detection accuracy across architectures and datasets (DeAlcala et al., 9 Sep 2025). The federated-learning attack reports advantage, TPR, and TNR (Nguyen et al., 2023). The perceptual probing framework reports AUC together with 84 and 85 (Taub et al., 5 Feb 2026).
A recurrent finding is that active procedures preserve or enlarge separation where passive methods weaken. ReproMIA explicitly attributes its gains to overfitting-induced curvature and gradient asymmetries, and states that the largest relative gains occur in low-FPR regimes because mutual information and score separation are increased so that ROC tails spread apart (Huang et al., 30 Mar 2026). The canary method likewise reports its strongest practical relevance in low-FPR settings (Wen et al., 2022). The perceptual probing results concentrate improvements in gradient-based detectors and in mid/late layers rather than early representations (Taub et al., 5 Feb 2026). This suggests that active membership inference is best understood as a signal-amplification strategy rather than as a single detector family.
A common misconception is that active membership inference is necessarily black-box. The literature does not support that restriction. The canary and ReproMIA approaches are black-box or black-box-compatible (Wen et al., 2022, Huang et al., 30 Mar 2026), the perceptual interrogation framework assumes white-box access to activations and gradients (Taub et al., 5 Feb 2026), the multi-task formulation is intrinsic to the training procedure (DeAlcala et al., 9 Sep 2025), and the federated-learning attack relies on server control over model transmission and access to returned gradients (Nguyen et al., 2023).
Another common misconception is that differential privacy or injected noise categorically neutralize active tests. The cited papers instead report partial robustness and privacy–utility trade-offs. ReproMIA retains 86 and 87 under logits noise 88 up to 89 for LLM defenses, and on diffusion defenses under DP-SGD with 90 still reaches approximately 91–92 AUC and approximately 93–94 95; for classification defenses, AUC under DP-SGD with 96 drops to 97 but remains above baselines, while under smoothing 98 it remains above 99 (Huang et al., 30 Mar 2026). The canary framework states that under DP defenses it still improves LiRA by 00–01 AUC with TPR gains up to 02 (Wen et al., 2022). The federated-learning work reports that sufficiently strong noise to suppress the attack substantially damages utility or training convergence (Nguyen et al., 2023).
The practical implications therefore vary by setting. In post-hoc black-box auditing, active probes can be precomputed and then reused, including in offline settings (Wen et al., 2022). In proactive privacy auditing, a learned perturbation can be trained on small shadow sets and deployed with one or two queries per sample (Huang et al., 30 Mar 2026). In training-time governance, auditability can be made an explicit optimization target with only a small drop in primary accuracy (DeAlcala et al., 9 Sep 2025). In federated learning, the same active principle exposes the risk that privacy guarantees can fail under a malicious coordinator even when local differential privacy is present (Nguyen et al., 2023).