---
title: Hybrid SMOTETomek Resampling Strategy
url: https://www.emergentmind.com/topics/hybrid-smotetomek-resampling-strategy
type: topic
---

# Hybrid SMOTETomek Resampling Strategy

The hybrid SMOTETomek resampling strategy is a sequential data preprocessing method that directly targets the twin challenges of class imbalance and noise near class boundaries in supervised learning. By combining the Synthetic Minority Over-sampling Technique (SMOTE) and Tomek link under-sampling, this approach enables major improvements in classifier sensitivity to minority classes while reducing the impact of ambiguous, hard-to-classify points in the training set. Hybrid SMOTETomek resampling has become integral to high-performance pipelines for imbalanced clinical data, intrusion detection in resource-constrained networks, and multiclass medical risk stratification, and is used extensively in privacy-preserving federated learning and robust ensemble methods [2508.10017][2402.13277][2601.05814].

## 1. Theoretical Underpinnings: SMOTE and Tomek Link Removal

SMOTE generates synthetic minority class samples using linear interpolation. For a set of minority-class samples $X_{\text{min}} = \{x_1, \ldots, x_{N_m}\} \subset \mathbb{R}^d$, and for each $x_i$, its $k$ nearest neighbors $\{x_i^{(1)}, ..., x_i^{(k)}\}$, new samples are formed as
$$
x_{\text{new}} = x_i + \lambda ( x_i^{(j)} - x_i ), \qquad \lambda \sim \text{Uniform}(0,1),\quad j \in \{1,...,k\}
$$
This procedure is repeated until the target minority:majority ratio is achieved. Default settings are $k=5$ and a strategy that fully balances minority and majority classes [2601.05814][2508.10017].

After oversampling, Tomek link removal identifies ambiguous samples near the class boundary. In a dataset $X = X_{\text{min}} \cup X_{\text{maj}}$, samples $(x_a, x_b)$ where $x_a \in X_{\text{min}}$, $x_b \in X_{\text{maj}}$ form a Tomek link if they are mutual nearest neighbors with respect to Euclidean distance:
$$
d(x_a, x_b) = \min_{y \neq x_a} d(x_a, y), \qquad d(x_a, x_b) = \min_{z \neq x_b} d(x_b, z)
$$
All majority-class members participating in Tomek links are removed; the minority partners are retained [2508.10017][2601.05814][2402.13277]. This step sharpens class separation by eliminating overlapping majority samples.

## 2. Algorithmic Pipeline and Implementation

The standard hybrid pipeline applies SMOTE followed by Tomek link removal. Representative pseudocode mirrors the protocol adopted in leading studies:
```python
def HybridSMOTETomek(X_train, y_train):
    # SMOTE Oversampling (k=5, balance all minority classes to target)
    X_sm, y_sm = SMOTE(k_neighbors=5, sampling_strategy='auto').fit_resample(X_train, y_train)
    # Tomek Link Undersampling (remove only majority-class points)
    X_res, y_res = TomekLinks(sampling_strategy='majority').fit_resample(X_sm, y_sm)
    return X_res, y_res
```
Key parameters:
- $k=5$ (SMOTE neighbors)
- Oversampling so all minority classes reach target counts (usually matching majority)
- Tomek removal limited to majority-class participants (to avoid minority class shrinkage)

Computational complexity is $O(N \log N)$ for both $k$NN (via KD-tree) and mutual nearest neighbor search for Tomek links [2508.10017].

## 3. Integration into Machine Learning and Federated Workflows

In federated learning frameworks, hybrid SMOTETomek is applied at the client level as a preprocessing step before gradient computation and privacy mechanisms, such as DP-SGD (per-sample gradient clipping and noise addition), are invoked. This ordering ensures augmentation affects the underlying dataset but not the privacy accounting [2508.10017]. 

In ensemble and dual-pipeline architectures, SMOTETomek is inserted after initial normalization and feature filtering but before dimensionality reduction or model fitting. Placement is model-dependent: for tree/nearest-neighbor learners, SMOTETomek is most effective after feature selection; for linear models, it may require tailored insertion to avoid diminishing returns [2601.05814].

## 4. Empirical Impact on Class Distribution and Downstream Performance

The hybrid SMOTETomek strategy consistently equalizes class priors and sharpens the class boundary. Empirical case studies illustrate its impact:

| Domain                   | Majority:Minority Distribution (Before) | After SMOTETomek     | Test Accuracy | Minority Recall |
|--------------------------|----------------------------------------|----------------------|---------------|----------------|
| Cardiovascular FL [2508.10017]  |  Highly imbalanced                  | Nearly balanced      | 72.8–77.0%    | 74–77%         |
| WSN Intrusion [2402.13277] |  340,066:34,595 (binary)              | 340,056:339,610      | 99.78–99.92%  | 99.78% (bin.)  |
| Sleep Disorder [2601.05814]      |  175:62:62 (majority:minorities)    | ~173:171:175         | 98.67%        | 97.78–97.92%   |

In federated clinical prediction, naïve learning on imbalanced data yielded recall of 0.0%, whereas hybrid SMOTETomek alone increased recall to 74% (with some loss in overall accuracy), and further algorithmic enhancement (FedProx + DP) delivered recall of 77% under reasonable privacy guarantees ($\epsilon\approx9.0$) [2508.10017].

Intrusion detection for WSNs demonstrated AUC improvements to nearly 1.0, major reductions in false negatives/positives, and elimination of underfitting/overfitting artifacts [2402.13277].

In multiclass biomedical prediction, accuracy increased by 2.7 to >6 percentage points, with minority recall (sensitivity) improving sharply (e.g., KNN: from 91.2% to 97.92%) [2601.05814].

## 5. Mitigating Overfitting, Underfitting, and Class Overlap

SMOTE’s synthetic sample generation mitigates under-representation of the minority class while reducing overfitting compared to simple duplication. Tomek link removal eliminates ambiguous, overlapped majority samples, sharpening the decision boundary and reducing noise [2402.13277][2601.05814].

Best practices include:
- Not removing minority-class members during Tomek processing (set `sampling_strategy='majority'`).
- Applying the hybrid procedure after feature filtering but before projection/dimensionality reduction in high-dimensional or deep pipelines, to minimize the risk of synthetic points falling outside the relevant subspace [2601.05814].
- Retuning $k$ and rebalancing targets per dataset.
- Strict cross-validation with resampling confined to the training set only, especially on small sample sizes.

A plausible implication is that optimal performance gains are model- and pipeline-dependent, and misapplication (e.g., “over-cleaning” the boundary or inappropriate resampling placement) may degrade performance, particularly for linear classifiers.

## 6. Limitations and Recommendations

Authors caution that model gains with SMOTETomek are largest for classifiers with local decision boundaries (e.g., KNN, tree-based models), but can be neutral or negative for pure linear models without complementary feature filtering. Small sample regimes are particularly susceptible to overfitting from excessive oversampling; robust cross-validation is necessary [2601.05814].

Placement within the pipeline should be informed by empirical validation, and Tomek link removal should be restricted to majority-class points unless addressing extreme imbalances. Parameter choices, especially $k$ and oversampling strategy, should be dataset-specific.

In summary, the hybrid SMOTETomek resampling strategy is empirically validated across domains as an essential step in constructing robust, sensitive classifiers for imbalanced data, sharply reducing class bias while controlling for noise at class boundaries [2508.10017][2402.13277][2601.05814].

Source: https://www.emergentmind.com/topics/hybrid-smotetomek-resampling-strategy