---
title: Z-Score Normalization
url: https://www.emergentmind.com/topics/z-score-normalization-03cd7042-a538-49b6-8917-9046faa085a1
type: topic
---

# Z-Score Normalization

Z-score normalization, also known as standard-score normalization or standardization, is a transformation that centers and scales data by subtracting the mean and dividing by the standard deviation. This procedure produces normalized values with zero mean and unit variance. Z-score normalization is fundamental to numerous statistical and machine learning algorithms, enabling robust comparison, clustering, and classification across datasets with differing scales and distributions.

## 1. Mathematical Definition and Fundamental Properties

Given a sequence of observations $x = (x_1, x_2, \ldots, x_n)$, standard z-score normalization is defined by:

$$
z_i = \frac{x_i - \mu}{\sigma}
$$

where $\mu = \frac{1}{n}\sum_{i=1}^n x_i$ is the sample mean and $\sigma = \sqrt{\frac{1}{n}\sum_{i=1}^n (x_i - \mu)^2}$ is the sample standard deviation, each computed over the calibration dataset [2205.09301][1601.02213]. The transformation ensures that the distribution of $z$ is centered at zero and scaled to unit variance, facilitating algorithms that assume comparable ranges or distributions.

## 2. Sliding-Window Z-Score Normalization for Real-Time Applications

Sliding-window z-score normalization (SWN) extends the classical approach by dynamically computing $\mu$ and $\sigma$ over a rolling buffer of fixed length $L$:

$$
W_i = \{ x_{i-L+1}, ..., x_i \}
$$
$$
\mu_{w,i} = \frac{1}{L} \sum_{j=i-L+1}^i x_j
$$
$$
\sigma_{w,i} = \sqrt{ \frac{1}{L} \sum_{j=i-L+1}^i (x_j - \mu_{w,i})^2 }
$$
$$
z_{w,i} = \frac{x_i - \mu_{w,i}}{\sigma_{w,i}}
$$

This approach, as demonstrated for EMG-based motion prediction, eliminates the need for an offline calibration phase and adapts to slow shifts in signal baseline and amplitude [2205.09301]. Empirical results show substantial improvements in classification accuracy for both within-user (+15.0%) and cross-user (+11.1%) motion prediction when replacing non-normalized inputs with SWN. Window length $L$ selection is robust within the 100–500 ms range; accuracy was largely insensitive to the precise choice in this interval.

## 3. Application in Time Series Analysis and Distance-Based Methods

Z-score normalization is pivotal for time series analysis, particularly in clustering and nearest-neighbor algorithms utilizing Euclidean distance. For any two time series $x$ and $y$, their z-scored forms $x', y'$ satisfy:

$$
\frac{1}{n}\sum_{i=1}^n (x'_i - y'_i)^2 = 2(1 - \rho(x, y))
$$

where $\rho(x, y)$ is the Pearson correlation coefficient computed on the normalized series [1601.02213]. Thus, average squared Euclidean distance between z-scored sequences is mathematically equivalent to a correlation-based dissimilarity. This property underpins the equivalence between Euclidean-based k-means clustering and “Pearson‐k‐means” with appropriate prototype (centroid) renormalization, though in practice omission of this renormalization produces negligible deviation relative to random initialization variability.

## 4. Z-Score Normalization in Field-Normalized Scientometrics

In scientometric analyses, especially cross-disciplinary citation benchmarking, citation distributions are highly right-skewed. Z-score normalization is effectively applied after a logarithmic transformation to produce field-neutral metrics:

$$
Z_{\text{cln}}(i) = \frac{\ln(c_i+1) - \mu_f}{\sigma_f}
$$

where $c_i$ is the citation count for paper $i$ in field $f$, and $\mu_f, \sigma_f$ are the mean and standard deviation of $\ln(c_j+1)$ over all papers $j$ in field $f$ [2504.14512]. Log transformation regularizes the distribution towards normality, enabling meaningful standardization. Empirical comparison using the Mahalanobis distance-based $d_M$ metric shows that $Z_{\text{cln}}$ substantially reduces cross-field ranking bias relative to alternatives such as raw ratios or source-side weighting (SNIP).

## 5. Implementation and Computational Considerations

For real-time applications (e.g., EMG motion prediction), SWN incurs minimal computational overhead (~18.6%), remaining well within critical time budgets [2205.09301]. Initialization can involve zero-padding or accumulating early samples for the normalization buffer; subsequent updates merely shift the window by adding new data and removing the oldest sample. For field-normalized scientometric pipelines, the procedure involves grouping entities by field, computing transformation and normalization per field, and ranking or evaluating metrics globally [2504.14512].

### Example Table: Z-Score Normalization Use Cases

| Context                               | Formula/Approach                                 | Key Outcome        |
|---------------------------------------|--------------------------------------------------|--------------------|
| Time series clustering                | $z_i = (x_i - \mu)/\sigma$                       | Pearson-equivalent |
| EMG-based motion prediction (SWN)     | $z_{w,i} = (x_i - \mu_{w,i})/\sigma_{w,i}$       | Increased accuracy |
| Field-normalized citation analysis    | $Z_{\text{cln}} = [\ln(c+1) - \mu_f]/\sigma_f$   | Reduced bias       |

## 6. Hyperparameter Selection and Methodological Guidelines

For SWN, window lengths of 100–500 ms are recommended; feature-extraction windows in the same range generally produce optimal accuracy when combined with normalization. All common EMG features benefit similarly, and no additional window overlap is necessary. In citation normalization, field assignment and accurate computation of within-field $\mu$ and $\sigma$ are critical for robust cross-field comparability. When combining source-side and target-side normalization (e.g., SNIP weighting followed by log + z), further reduction in field bias is achieved [2504.14512].

## 7. Limitations, Extensions, and Future Directions

Standard z-score normalization presumes stationarity of the sample distribution; shifting baselines can invalidate the calibration reference, motivating methods like SWN for nonstationary data streams. In time series clustering, prototype renormalization maintains strict equivalence with correlation-based metrics; omission introduces minor deviations. Peak classification accuracy in EMG motion prediction using SWN does not reach the optimal within-user performance in cross-user models, suggesting the need for further integration of transfer-learning or domain-adaptation approaches. In scientometrics, combining log-transformed z-score normalization with source-side weighting yields the lowest measured cross-field bias; yet, uneven paper growth rates and citation overlaps remain challenges for absolute neutrality.

In summary, z-score normalization and its extensions, such as SWN and log-transformed field normalization, offer theoretically sound and empirically validated frameworks for standardizing data, enabling fair comparison, improving robustness, and supporting advanced analytics in diverse domains including time series mining, real-time biomedical sensing, and evaluative bibliometrics.

Source: https://www.emergentmind.com/topics/z-score-normalization-03cd7042-a538-49b6-8917-9046faa085a1