Test-Time Instance Normalization (TTIN)

• Test-Time Instance Normalization (TTIN) is a normalization strategy that recomputes per-sample mean and variance at inference to adapt to varying input characteristics.
• It replaces batch normalization by computing statistics for each test input, thereby improving contrast fidelity and enabling robust performance in image stylization and medical segmentation.
• Empirical results show measurable gains, such as improved Dice scores in medical segmentation and enhanced perceptual quality in real-time stylization, with minimal computational overhead.

Test-Time Instance Normalization (TTIN) is a normalization strategy employed in deep neural networks where statistics (mean and variance) for normalization are recomputed afresh for each test input, enabling per-instance adaptation at inference. Unlike batch normalization, which uses global batch statistics during training and frozen running averages at inference, TTIN enforces per-image or per-slice normalization throughout both training and test phases. This paradigm has proven instrumental in image stylization generators (Ulyanov et al., 2016) and has demonstrated significant utility in domain-adaptive medical segmentation (Zhang et al., 6 Aug 2025).

1. Mathematical Formulation of Test-Time Instance Normalization

TTIN applies instance normalization on each test example independently. For feature maps $x \in \mathbb{R}^{N \times C \times H \times W}$ (where $N$ is batch size, $C$ number of channels, $H \times W$ spatial dimensions), the normalization proceeds as:

• Compute mean for each instance and channel:

$$\mu_{n,c} = \frac{1}{HW} \sum_{h=1}^H \sum_{w=1}^W x_{n,c,h,w}$$

• Compute variance for each instance and channel:

$$\sigma_{n,c}^2 = \frac{1}{HW} \sum_{h=1}^H \sum_{w=1}^W (x_{n,c,h,w} - \mu_{n,c})^2$$

• Normalize:

$$\hat{x}_{n,c,h,w} = \frac{x_{n,c,h,w} - \mu_{n,c}}{\sqrt{\sigma_{n,c}^2 + \epsilon}}$$

• Affine transformation (learned $\gamma_c$, $\beta_c$):

$$y_{n,c,h,w} = \gamma_c \cdot \hat{x}_{n,c,h,w} + \beta_c$$

Typically, $N$0 for numerical stability. In the test phase, the above computations are performed with $N$1, i.e., on a single input or slice (Ulyanov et al., 2016, Zhang et al., 6 Aug 2025).

2. Comparison with Batch Normalization and Other Normalization Variants

Batch normalization (BN) differs in that the mean and variance are aggregated across the entire mini-batch and spatial extent:

$N$2

$N$3

At test time, BN implements normalization using running estimates $N$4 and $N$5 collected during training. TTIN, on the other hand, recalculates mean and variance for every individual test input, eschewing the use of any stored running statistics (Ulyanov et al., 2016, Zhang et al., 6 Aug 2025).

UNISELF further compares TTIN with conditional instance normalization (CondIN; separate $N$6 per contrast subset) and validates that affine parameters learned under CondIN give the best generalization across domain-shifted test cases (Zhang et al., 6 Aug 2025).

3. Integration into Neural Architectures and Inference Procedures

Fast Stylization Generators

In the stylization work of Ulyanov et al., TTIN replaces all BatchNorm2d layers with InstanceNorm2d (affine=True) at the same positions in the convolution → normalization → ReLU pipeline in fully convolutional "texture-nets." During test-time, for an image of shape $N$7, $N$8 and $N$9 are computed directly over $C$0, and normalization is performed per channel with $C$1 and $C$2 fixed from training (Ulyanov et al., 2016). There is no use of "frozen" batch statistics at inference.

Medical Segmentation (UNISELF Example)

In UNISELF’s 2.5D U-Net backbone, normalization layers in each Conv→ReLU block employ either BN, standard IN, or CondIN during training. At inference, all normalization layers are switched to TTIN mode: per-slice, per-channel spatial statistics are computed, and $C$3, $C$4 learned in training are applied. No parameter adaptation is performed; only normalization statistics change at inference (Zhang et al., 6 Aug 2025).

A representative PyTorch inference-time replacement pseudo-code: $H \times W$2 This direct substitution ensures per-instance normalization without reference to batch statistics.

4. Empirical Impact and Performance Gains

Stylization Quality

Replacing batch normalization with TTIN in real-time stylization networks removes characteristic artifacts—low-contrast outputs and border ripples produced by padding—yielding images with improved contrast fidelity and style transfer accuracy. While Ulyanov et al. do not provide formal style loss metrics, they report that TTIN-based inference yields perceptual quality and style-matching error on par with optimization-based Gatys et al., but at interactive speeds (∼20 ms per $C$5 image) (Ulyanov et al., 2016). Model parameter count and throughput remain unchanged.

Medical Segmentation Generalization

Empirical studies in UNISELF demonstrate that TTIN delivers consistent and statistically significant improvements on out-of-domain datasets and scenarios with missing or corrupted input contrasts. Dice score gains of 1–6% are observed in out-of-sample tasks and under missing-contrast or artifact conditions, relative to using running BN stats (Zhang et al., 6 Aug 2025). For example, in the UMCL dataset (T1+T2+FLAIR), Dice improved from $C$6 (BN+contrast dropout) to $C$7 (TTIN+CondIN+contrast dropout); in private datasets with FLAIR motion artifacts, the improvement reached 6.4% absolute ((Zhang et al., 6 Aug 2025), Tables S1–S3).

Table: Representative Impact of TTIN in UNISELF Segmentation

Dataset/Scenario	BN + CD Dice	TTIN + CondIN + CD Dice (Δ)
MICCAI’16 (all contrasts)	0.773 ± 0.067	0.770 ± 0.057 (-0.3%)
UMCL (T1+T2+FLAIR)	0.731 ± 0.078	0.745 ± 0.085 (+1.4%)
Private, FLAIR missing	0.679 ± 0.092	0.722 ± 0.086 (+4.3%)

Results consistently favor TTIN in domain-shifted test conditions.

5. Practical Implementation Considerations

• Statistical Computations: TTIN requires per-instance computation of mean and variance over spatial axes for each feature map. This adds minor compute overhead (e.g., TTIN in UNISELF adds only a few percent to inference time, e.g., 2.5 minutes per 3D volume at 656 MB peak memory on a Quadro RTX 5000 (Zhang et al., 6 Aug 2025)).
• Framework Support: In PyTorch, TTIN is realized by setting nn.InstanceNorm2d(affine=True, track_running_stats=False), or by overriding BN modules at inference. In TensorFlow/Keras, overriding the batch norm layer’s inference-time forward method suffices.
• Affines: The learned $C$8 and $C$9 parameters are fixed from training; no on-the-fly adaptation is performed at test time.
• Batch-size: Inference is run with batch size 1 to ensure true per-instance normalization.
• Numerical Stability: $H \times W$0 is applied throughout for stability (Ulyanov et al., 2016, Zhang et al., 6 Aug 2025).

Best practices recommend training under contrast dropout and, in domains with variable input structure, using a conditional IN layer for $H \times W$1, as in UNISELF.

6. Theoretical and Practical Significance

TTIN enforces invariance to per-sample intensity and contrast statistics at inference. In style transfer, this decouples contrast/illumination of the content image from the stylization process, sharply improving style fidelity. In medical imaging, TTIN mitigates hidden domain shifts between scanners, protocols, and missing contrasts by re-normalizing activations per sample, thereby harmonizing feature distributions across domains without explicit domain adaptation.

t-SNE visualizations in (Zhang et al., 6 Aug 2025) demonstrate that TTIN aligns latent features across varying domains and missing input scenarios, in contrast to the clustering by domain observed for BN with frozen statistics.

TTIN introduces a test-time adaptation mechanism that is entirely statistic-driven and requires no meta-training, auxiliary losses, or run-time parameter updates. Its integration is orthogonal to many other domain adaptation techniques and incurs negligible infrastructure or computational costs in contemporary frameworks.

7. Limitations and Scope of Applicability

TTIN assumes that per-instance normalization is desirable for the task’s invariance objectives. In tasks explicitly dependent on absolute global intensity statistics, TTIN may be undesirable. Neither (Ulyanov et al., 2016) nor (Zhang et al., 6 Aug 2025) report adverse effects in their respective domains, but caution may be warranted in tasks where preserving global image statistics is required. A plausible implication is that excessive application of TTIN could suppress informative sample-specific characteristics in certain diagnostic problems or out-of-distribution detection workflows.

In summary, TTIN replaces reliance on batch-derived running statistics at inference with instance-derived statistics, resulting in robust, domain-invariant normalization behavior that yields measurable quality and generalization benefits in both stylization and medical segmentation contexts (Ulyanov et al., 2016, Zhang et al., 6 Aug 2025).