Papers
Topics
Authors
Recent
Search
2000 character limit reached

Perceptual Boundary Sampling in ANNs

Updated 6 July 2026
  • Perceptual boundary sampling is a family of methods that selects or generates borderline cases in a feature space, highlighting regions of high uncertainty.
  • Approaches range from active fine-tuning using pretrained features to classifier-guided diffusion, applied in domains like digit recognition and facial expression analysis.
  • These techniques improve model robustness and human-model alignment by effectively sampling ambiguous instances that central exemplars may miss.

Searching arXiv for papers on perceptual boundary sampling and closely related formulations. Perceptual boundary sampling, in the ANN-centered usage documented here, denotes the deliberate selection or synthesis of samples that lie near a model’s decision frontier in a representation space intended to encode perceptual or semantic structure. In contemporary work, that boundary may be defined in a frozen pretrained feature space for active finetuning, or in the output geometry of a classifier coupled to a diffusion prior for synthesizing ambiguous stimuli that elicit variable human judgments (Lu et al., 2024, Wei et al., 6 May 2025, Deng et al., 19 Jul 2025). Adjacent literatures use closely related boundary-sample constructions for hardware fingerprinting through imperceptible perturbations (Schlögl et al., 2021), while an earlier image-analysis line treats perceptually significant boundaries as salient level lines selected by a-contrario criteria (Tepper et al., 2012). Across these formulations, the unifying operation is to privilege ambiguous or borderline cases rather than only central exemplars, although the operational goal varies substantially.

1. Scope and principal formulations

In the literature represented here, perceptual boundary sampling is not a single algorithm but a family of boundary-oriented procedures. The central distinction is between selection of existing unlabeled samples near a learned boundary and generation of new samples that are driven toward such a boundary. A second distinction concerns what counts as “perceptual”: frozen pretrained features, classifier output probabilities, human response distributions, or salient image contours.

Setting Boundary representation Primary objective
Bi-Level Active Finetuning Frozen pretrained features fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d One-shot annotation selection combining diversity and uncertainty (Lu et al., 2024)
BAM / variMNIST ANN decision boundaries with classifier-guided diffusion Generate ambiguous digit stimuli, align models to group and individual behavior, and manipulate paired decisions (Wei et al., 6 May 2025)
varEmotion ANN emotion-class boundaries with two-stage diffusion Generate ambiguous facial-expression stimuli and align models to human perceptual variability (Deng et al., 19 Jul 2025)
Related boundary-based work Microarchitecture-sensitive label flips; salient level lines Watermarking and perceptual boundary saliency (Schlögl et al., 2021, Tepper et al., 2012)

A plausible implication is that the term now spans both decision-boundary exploitation and boundary-centered stimulus design. The former uses a pretrained model’s geometry as a proxy for informative uncertainty; the latter treats ANN ambiguity as a generator of stimuli that are likely to induce perceptual divergence in humans.

2. Feature-space boundary sampling in bi-level active finetuning

The clearest selection-based formulation appears in the Bi-Level Active Finetuning framework, which defines the goal of boundary sample selection as identifying, within each pseudo-class, those unannotated examples that lie closest to the “decision frontier” separating that class from its neighbors in the pretrained model’s feature space (Lu et al., 2024). Ground-truth labels are unavailable at selection time, so the procedure operates entirely on the geometry of frozen features fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d.

The framework is explicitly two-stage. First, it performs core sample selection for diversity. It chooses KK pseudo-class centers via a diversity-oriented method such as ActiveFT or K-Means; in practice it uses ActiveFT, which solves

θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)

under θj2=1\|\theta^j\|_2=1 for j=1Kj=1\ldots K, and then picks, for each θj\theta^j, the nearest feature

fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).

These KK samples become the initial centers. Every unlabeled feature is then assigned to the nearest center by Euclidean distance, partitioning the pool into pseudo-classes.

The second stage performs boundary sampling for uncertainty. Because the boundary stage is highly sensitive to outliers, BiLAF first applies an unsupervised denoising method termed Iterative Density-based Clustering. For a point xjx_j with feature fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d0, its density distance is defined as the average distance to its fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d1 nearest neighbors within the currently growing cluster: fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d2 Starting from fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d3, the cluster grows by repeatedly adding the fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d4 points with smallest fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d5. After the cluster reaches the full candidate set, the last fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d6 points added are pruned as noise.

Boundary proximity is then quantified by an intra-class distance

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d7

an inter-class distance to the nearest other center

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d8

and the Boundary Score

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d9

A small Boundary Score indicates a point close to another class’s prototype yet not overly deep inside its own cluster. To avoid repeatedly sampling the same inter-class seam, the method adds an opponent penalty: if KK0 is the count of already-selected boundary points that were closest to center KK1, future inter-class distances are inflated by KK2, yielding

KK3

Selection is iterative. Each pseudo-class receives a sub-budget

KK4

and the algorithm repeatedly picks the point with minimum KK5, adds it to the global annotation set, increments the opponent count for the center achieving the minimum, and removes the KK6 nearest neighbors of the selected point to avoid redundancy. The complete procedure is given as Algorithm 1 in the paper (Lu et al., 2024).

The implementation is explicitly intended to scale. The reported feature dimension is KK7 for DeiT-Small/DINO, the unlabeled pool reaches KK8 up to KK9 on ImageNet, and θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)0 is typically set to θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)1 of θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)2. With θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)3, θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)4, θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)5, and optimized vectorized kernels, ImageNet-scale pools are processed in a few hours on two RTX 3090 GPUs. Supervised finetuning uses batch size θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)6, SGD with learning rate θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)7, weight decay θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)8, momentum θ=argminθD(pfu,pθ)λR(θ)\theta^*=\arg\min_\theta D(p_{f_u},p_\theta)-\lambda\cdot R(\theta)9, and cosine decay for θj2=1\|\theta^j\|_2=10 epochs, except θj2=1\|\theta^j\|_2=11 epochs for θj2=1\|\theta^j\|_2=12 ImageNet (Lu et al., 2024).

The empirical motivation for the method is that diversity alone leaves boundary regions undersampled. Across CIFAR10, CIFAR100, and ImageNet with annotation budgets from θj2=1\|\theta^j\|_2=13 to θj2=1\|\theta^j\|_2=14, BiLAF is reported to outperform both purely diversity-based ActiveFT and traditional active learning methods. The paper reports, for example, CIFAR100 at θj2=1\|\theta^j\|_2=15: ActiveFT θj2=1\|\theta^j\|_2=16 versus BiLAF θj2=1\|\theta^j\|_2=17; at θj2=1\|\theta^j\|_2=18: θj2=1\|\theta^j\|_2=19 versus j=1Kj=1\ldots K0; at j=1Kj=1\ldots K1: j=1Kj=1\ldots K2 versus j=1Kj=1\ldots K3; and ImageNet at j=1Kj=1\ldots K4: j=1Kj=1\ldots K5 versus j=1Kj=1\ldots K6. Qualitative t-SNE plots are described as showing that core-only methods leave many boundary regions unsampled, whereas BiLAF “pins down support points along each inter-class seam” (Lu et al., 2024).

This framework explicitly connects itself to perceptual boundary sampling by “lifting” classical uncertainty sampling into the pretrained model’s “perceptual” feature space, where distances encode semantic relations. Under tight annotation budgets, the stated rationale is that a classifier trained only on central exemplars tends to misplace its boundaries; boundary-targeted annotation forces adjustment precisely where errors are likely to occur (Lu et al., 2024).

3. Diffusion-guided perceptual boundaries in digit recognition

A generative and human-centered formulation is introduced by BAM, the Boundary Alignment & Manipulation framework, which combines perceptual boundary sampling in ANNs with human behavioral experiments to study perceptual variability (Wei et al., 6 May 2025). The setup begins with a pre-trained ANN classifier, or two classifiers for controversial sampling, together with a diffusion model j=1Kj=1\ldots K7 serving as a natural-image prior.

At each reverse diffusion step, the sample is updated by

j=1Kj=1\ldots K8

where j=1Kj=1\ldots K9 is the unconditioned denoising step, θj\theta^j0 is a guidance strength, and θj\theta^j1 encourages boundary sampling. Two losses are used. Uncertainty guidance is designed to place a sample near a single model’s decision boundary: θj\theta^j2 Controversial guidance is designed to maximize disagreement between two models: θj\theta^j3 with θj\theta^j4 placing mass on class θj\theta^j5 and θj\theta^j6 on class θj\theta^j7. Optionally, a small MSE regularizer toward a reference MNIST digit θj\theta^j8 can be added: θj\theta^j9 The framework states that it relies on a classifier-guided diffusion prior, specifically classifier-free guidance, rather than direct pixel-space adversarial perturbations, in order to keep samples in-distribution and avoid heavy noise (Wei et al., 6 May 2025).

BAM consists of three stages. The first stage is labeling: approximately fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).0 images are sampled by uncertainty or controversial guidance across all digit pairs fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).1, then shown to many participants in a 10-way digit classification task. For each image, the recorded quantities are the human choice distribution fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).2, response time, and entropy fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).3. After sentinel-trial filtering, fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).4 participants remain out of fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).5, yielding fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).6 valid trials and fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).7 images in the variMNIST dataset; the same description also states that each participant completed fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).8 trials, for a total of fsj=argmaxfkFusim(fk,θj).f_{s_j}=\arg\max_{f_k\in F^u}\mathrm{sim}(f_k,\theta^j).9k trials (Wei et al., 6 May 2025).

The second stage is alignment. Starting from a base classifier trained on MNIST, BAM fine-tunes a GroupNet on MNIST KK0 variMNIST in a KK1 ratio and then an IndivNet per participant using a mix ratio KK2. The training objective is ordinary cross-entropy on human-labeled 10-way target distributions. The reported effect is that GroupNet and IndivNet retain approximately KK3 accuracy on MNIST, gain approximately KK4 on variMNIST, and that IndivNet adds approximately KK5 on the individual subset variMNIST-i. The quantitative summary given later in the paper states BaseNet accuracy of approximately KK6 on variMNIST, GroupNet approximately KK7, and IndivNet approximately KK8 on variMNIST-i; for a VGG example, the Spearman correlation between model-predicted entropy and human entropy increases from KK9 to xjx_j0 after group fine-tuning (Wei et al., 6 May 2025).

The third stage is manipulation. For a pair of participants xjx_j1, BAM takes their two IndivNet models xjx_j2 and generates new controversial images using

xjx_j3

with xjx_j4 pushing toward xjx_j5 and xjx_j6 toward xjx_j7. Approximately xjx_j8 such stimuli are presented to each pair in lab conditions, and the outcome of interest is whether xjx_j9 reports fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d00 while fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d01 reports fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d02. In paired manipulation experiments described as involving fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d03 in-lab participants forming fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d04 pairs, individually generated images improve the “success” rate by approximately fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d05 and the directional “targeted ratio” by approximately fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d06 over vanilla variMNIST stimuli, with fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d07 for both (Wei et al., 6 May 2025).

The behavioral evaluation formalizes three categories for guided class pairs fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d08. A sample is a success if fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d09 and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d10; bias if fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d11 but fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d12; and failure otherwise. Across all variMNIST images, success plus bias is approximately fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d13, and over half of the images have human-response entropy greater than zero (Wei et al., 6 May 2025).

The BAM account explicitly argues that decision-boundary regions of ANNs correspond to maximal classifier uncertainty and that prior psychophysics places maximal human perceptual variability near categorical boundaries. On that basis, images synthesized on ANN boundaries are treated as intrinsically likely to induce high human ambiguity (Wei et al., 6 May 2025).

4. Perceptual-boundary sampling for facial-expression variability

A parallel formulation is developed for facial expressions, where the perceptual boundary is defined for a fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d14-way ANN classifier fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d15 by the locus of inputs fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d16 for which two target emotions fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d17 are balanced, for example when fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d18, equivalently fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d19 (Deng et al., 19 Jul 2025). Perceptual-boundary sampling is then the generation of new face images near such boundaries, so that the classifier assigns both classes high and roughly equal probability.

The formal construction introduces a target distribution fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d20 over emotions with

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d21

and an uncertainty guidance loss

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d22

which is described as maximized when fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d23 and the other probabilities approach zero. The paper also notes an alternative expression, fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d24, interpreted as encouraging high network mass on the two target classes and low mass elsewhere (Deng et al., 19 Jul 2025).

Because direct gradient ascent on fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d25 is reported to produce noisy and non-photorealistic results, the method embeds the loss in a two-stage diffusion pipeline. In Stage 1, an embedding fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d26 is iteratively denoised with uncertainty guidance: fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d27 with the paper reporting fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d28. In Stage 2, the final guided embedding fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d29 is given to Stable Diffusion XL with prompt guidance only, producing a fully rendered RGB face image (Deng et al., 19 Jul 2025).

Post-generation filtering is central to the method. Each candidate image is fed back through the ANN, and an image is kept only if both target-class activations exceed class-specific thresholds fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d30, where each threshold is set to the fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d31th percentile of that class’s activation on the RAF-DB real-image distribution: fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d32 The stated purpose is to retain only samples genuinely in the high-uncertainty overlap region of the two emotions (Deng et al., 19 Jul 2025).

This procedure is used to construct the varEmotion dataset. For each of the fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d33 unordered emotion pairs from six basic classes, the pipeline produces candidate faces; after filtering, fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d34 images remain. These are shown in randomized order to fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d35 online participants, of whom fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d36 pass sentinel trials, in a 6-way forced-choice emotion labeling task. Each image is seen by approximately fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d37 participants, for a total of fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d38 trials. The recorded response for image fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d39 is the empirical human choice distribution

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d40

with fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d41 (Deng et al., 19 Jul 2025).

The evaluation uses both ANN-side and human-side criteria. Human perceptual uncertainty is quantified by entropy

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d42

For guided classes with empirical human fractions fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d43, a sample is categorized as Success if fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d44 and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d45, Bias if fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d46 and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d47, and Failure if fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d48. Roughly fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d49 of the images fall into success plus bias, which the paper interprets as effective two-class guidance (Deng et al., 19 Jul 2025).

The principal empirical claim is that ANN-confusing facial-expression stimuli also provoke heightened human perceptual uncertainty. The entropy distribution over the fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d50 images is described as concentrated above zero, indicating that most boundary images induce split judgments. On the modeling side, three architectures—CLIP + MLP, DAN, and ResEmoNet—are fine-tuned with varEmotion mixed with RAF-DB at a fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d51 ratio under group and individual regimes. Group fine-tuning improves accuracy on varEmotion by fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d52, fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d53, and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d54, respectively, relative to BaseNet; individual-level fine-tuning on fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d55 yields further gains, including fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d56 for DAN. For DAN, the Spearman correlation between model entropy fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d57 and human entropy fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d58 rises from fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d59 before fine-tuning to fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d60 after group fine-tuning (Deng et al., 19 Jul 2025).

The optimization used for alignment is ordinary cross-entropy,

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d61

minimized on the group mixture fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d62 at a fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d63 sample ratio and then on each individual dataset fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d64 at a fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d65 ratio. The reported optimizer is Adam with learning rate fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d66, batch size fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d67, CrossEntropyLoss, and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d68 epochs on an NVIDIA GPU (Deng et al., 19 Jul 2025).

A distinct but technically related use of boundary samples appears in model watermarking. In iNNformant, a boundary sample for two inference environments fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d69 and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d70 around a natural host sample fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d71 is an input fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d72 such that fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d73 is small and the final labels differ, fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d74 (Schlögl et al., 2021). The paper defines fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d75 as the softmax-vector output and

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d76

as an approximate distance to the decision boundary on fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d77. A set of such samples is fully identifying for environments fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d78 if each fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d79 has at least one sample whose label differs from all others. The objective is therefore not annotation efficiency or human ambiguity, but identification of the execution environment through label instability near the boundary.

The optimization view is explicitly constraint-based: minimize perturbation magnitude subject to label disagreement across environments. Distortion is measured by PSNR,

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d80

The generation algorithm uses a local phase to approach a decision boundary of a reference microarchitecture and a remote phase to refine the input until exactly one environment is isolated, using a modified FGSM-style update

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d81

On FMNIST with ResNet20 and CIFAR10 with ResNet32, success rates are reported as fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d82 and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d83, respectively. By selecting the best PSNR sample per microarchitecture, the paper reports fully identifying sets whose worst PSNR exceeds fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d84 on FMNIST or fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d85 on CIFAR (Schlögl et al., 2021). This suggests a boundary-sample regime in which perceptual fidelity is preserved, but the operative ambiguity is between hardware-specific executions rather than between semantic classes or between human observers.

An earlier and conceptually separate formulation is found in the literature on perceptual boundary saliency. There, the target is not a classifier’s decision frontier but the boundary of image level sets extracted by the Fast Level-Set Transform. A level line fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d86 of length fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d87 is declared fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d88-meaningful under the Helmholtz principle if its Number of False Alarms satisfies

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d89

where fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d90 is an empirical tail histogram of gradient magnitudes and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d91 is the number of level lines (Tepper et al., 2012). The method extends earlier a-contrario formulations by allowing partially salient level lines rather than requiring an entire line to be salient.

The paper also introduces a regularity saliency at scale fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d92,

fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d93

and a combined saliency criterion denoted fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d94, which relaxes punctual minima through percentile-based partial saliency. The detection algorithm computes the FLST, evaluates contrast and regularity statistics along each level line, marks curves as meaningful when their NFA is below fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d95, and then performs maximality pruning along FLST branches. The total complexity is reported as approximately fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d96, with standard parameters fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d97, fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d98, and fi=f(xi;w0)Rdf_i=f(x_i;w_0)\in\mathbb R^d99 px (Tepper et al., 2012).

Although this saliency-based work is not a decision-boundary method in the ANN sense, it is relevant for the broader semantics of perceptual boundaries. It treats perceptual significance as improbability under a null model and explicitly allows boundary point sampling on level lines for subsequent tasks such as shape matching, registration, stereo edge linking, and contour extraction (Tepper et al., 2012).

6. Recurrent methodological themes, misconceptions, and open directions

A recurrent theme across these works is that boundary proximity alone is not considered sufficient. Each framework couples boundary seeking with an additional stabilizing mechanism. In BiLAF, uncertainty-oriented boundary selection is preceded by core selection for diversity and by IDC denoising to remove outliers before scoring (Lu et al., 2024). In BAM and the facial-expression pipeline, the model boundary is accessed through a diffusion prior rather than direct pixel-space perturbation, precisely to keep the generated samples in-distribution and recognizable (Wei et al., 6 May 2025, Deng et al., 19 Jul 2025). In iNNformant, imperceptibility is enforced through a PSNR criterion, and in the saliency literature boundary detection is regularized by a-contrario thresholds, partial-saliency criteria, and maximality pruning (Schlögl et al., 2021, Tepper et al., 2012).

A common misconception is to equate boundary sampling with diversity sampling or with naïve uncertainty sampling. The surveyed literature separates these notions. BiLAF is explicitly bi-level: core sample selection covers the space, while boundary sample selection refines class frontiers (Lu et al., 2024). BAM separates uncertainty guidance from controversial guidance, the latter being designed not merely to maximize entropy for one model but to induce disagreement between paired models and, later, between paired participant-specific models (Wei et al., 6 May 2025). The facial-expression work similarly does not stop at balanced probabilities; it filters generated images by class-specific activation thresholds so that retained samples lie in a verified overlap region (Deng et al., 19 Jul 2025).

Another misconception is that “perceptual” always means human-defined. In several of these formulations, the perceptual substrate is initially ANN-internal: pretrained feature geometry in BiLAF, classifier posteriors in BAM, or emotion-class probabilities in varEmotion. Human perceptual variability enters only after behavioral validation and model alignment in the human-facing studies (Lu et al., 2024, Wei et al., 6 May 2025, Deng et al., 19 Jul 2025). This suggests that current usage often begins with model-defined perceptual structure and then asks whether that structure predicts human ambiguity.

The open directions stated in these works are similarly heterogeneous. BAM proposes expansion beyond digit recognition to natural scenes, semantic tasks, and similarity judgments; incorporation of optimal experimental design loops, including active learning, to minimize human trials; and the study of cultural and developmental factors in more diverse participant populations (Wei et al., 6 May 2025). The facial-expression study positions its findings as a route toward personalized modeling of emotional interpretation (Deng et al., 19 Jul 2025). The saliency literature identifies corners and junctions, over-detection in textured areas, and multiscale fusion as unresolved issues (Tepper et al., 2012). The watermarking literature notes that scaling to higher-resolution inputs or deeper networks may require smaller step sizes or adaptive line search (Schlögl et al., 2021).

Taken together, these formulations establish perceptual boundary sampling as a boundary-centered design principle rather than a single canonical technique. Its modern forms range from sample-efficient active finetuning, through controlled synthesis of ambiguous stimuli for behavioral science, to imperceptible near-boundary perturbations and salient contour detection. The common structure is the deliberate exploitation of borderline cases, but the meaning of the boundary, the type of perceptual evidence, and the target downstream use remain domain-specific.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Perceptual Boundary Sampling.