PseudoColorViT-Alz: ViT with Pseudo-color MRI for AD

• The paper demonstrates that pseudo-color enhancement integrated with a ViT-Base backbone boosts four-class Alzheimer’s MRI classification, achieving 99.79% accuracy and 100% AUC.
• It employs a jet colormap to transform grayscale MRI scans into RGB images, amplifying anatomical textures and contrast cues for effective transfer learning.
• The framework harmonizes enhanced feature discrimination with interpretability, enabling stage-sensitive detection and robust performance in Alzheimer's diagnosis.

Searching arXiv for the specified paper and closely related Alzheimer's MRI ViT work to ground the article in current literature. PseudoColorViT-Alz is a colormap-enhanced Vision Transformer framework for MRI-based multiclass Alzheimer’s disease classification that maps grayscale brain MRI scans into pseudo-color RGB representations and processes them with a pretrained ViT-Base backbone. It was introduced for four-class classification on OASIS-1—non-demented, moderate dementia, mild dementia, and very mild dementia—with the stated aim of amplifying anatomical texture and contrast cues that are otherwise subdued in standard grayscale MRI scans, while also enabling effective transfer learning from RGB-pretrained Vision Transformers (Ahmed, 18 Dec 2025).

1. Conceptual basis and problem setting

The framework is motivated by a specific limitation of MRI-based Alzheimer’s disease analysis: brain MRI scans are typically grayscale and often exhibit subtle structural variations that can be challenging for conventional deep learning models to extract discriminative features effectively. In the formulation associated with PseudoColorViT-Alz, this issue is especially salient under limited data and annotation scenarios, where training large-capacity models from scratch is impractical (Ahmed, 18 Dec 2025).

A central premise is that Vision Transformers have shown excellent performance in image classification tasks, but are pretrained on RGB natural images rather than grayscale medical images. The paper explicitly contrasts pseudo-color enhancement with channel replication, noting that methods like channel replication (greyscale→pseudo-RGB) do not fully exploit MRI structural information. Pseudo-color integration is presented instead as a mechanism for mapping grayscale MRIs into three-channel RGB images that highlight anatomical textures, local contrasts, and subtle intensity variations. This is intended to boost feature discrimination, enhance interpretability, and support transfer learning from large-scale, non-medical ViT pretraining (Ahmed, 18 Dec 2025).

Within the reported task definition, the model addresses a four-class classification problem corresponding to disease staging. The study describes the classes as non-demented, very mild dementia, mild dementia, and moderate dementia, while the dataset-construction step assigns labels as non-demented (0), mild dementia (1), moderate dementia (2), and very mild dementia (3). This establishes PseudoColorViT-Alz as a stage-sensitive classifier rather than a binary screening model.

2. Pseudo-color preprocessing and data representation

The preprocessing pipeline begins with raw brain MRI in grayscale, resized to $224 \times 224$ pixels, followed by a jet colormap transformation and normalization to $[0,1]$. The transformation is described as follows:

$$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$

The resulting tensor is then normalized, and the channel order is rearranged into channel-first format $(C, H, W)$ for model input (Ahmed, 18 Dec 2025).

This preprocessing step is not an incidental visualization operation; it is part of the model definition. The jet pseudo-color mapping is intended to make subtle anatomical and boundary differences more visually discernible. The associated figures are described as a preprocessing overview from raw MRI to grayscale, pseudo-color, normalized tensor, and a full pipeline diagram from input through transformer-based prediction. The paper also states that pseudo-color mapping is applied before all model input steps and that no data augmentation is used, with the rationale that ViT plus pseudo-color boosts robustness (Ahmed, 18 Dec 2025).

The dataset used is OASIS-1. The reported cohort contains 416 adult subjects aged 18–96 years, with approximately 1300 control and approximately 400 AD images. For the specific four-class study, the class counts are listed as non-demented ($n=5000$), very mild dementia ($n=5000$), mild dementia ($n=5002$), and moderate dementia ($n=488$). The paper states that the rationale is class balance for robust training, while also noting that moderate dementia is rare, reflecting real-world class imbalance. A plausible implication is that the reported task couples an effort toward robust training with a class distribution still shaped by the rarity of moderate dementia.

3. Vision Transformer architecture and learning objective

PseudoColorViT-Alz uses pretrained ViT-Base ($\texttt{vit-base-patch16-224}$) as its backbone. Each input image has shape $3 \times 224 \times 224$ and is divided into $[0,1]$0 non-overlapping $[0,1]$1 patches. Patch embeddings are defined by

$[0,1]$2

and the token sequence is initialized by adding a learnable $[0,1]$3 token and positional encodings:

$[0,1]$4

The transformer encoder is described as a stack of multi-head self-attention and feed-forward layers, with attention computed by

$[0,1]$5

and the output processed with residual connections and layer normalization:

$[0,1]$6

The final $[0,1]$7 token embedding is passed to a fully connected layer with Softmax activation for four-way classification:

$[0,1]$8

Training uses categorical cross-entropy,

$[0,1]$9

with Adam, learning rate $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$0, batch size $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$1, and early stopping with patience $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$2 (Ahmed, 18 Dec 2025).

The architectural rationale given in the paper is that the colormap-enhanced input can make MRI structure more compatible with RGB-pretrained ViT representations, while the transformer contributes global feature learning capabilities. This suggests that PseudoColorViT-Alz should be understood as a joint input-model adaptation strategy rather than as a backbone substitution alone.

4. Experimental protocol and reported performance

The evaluation uses an 80:20 train/test split on OASIS-1. The reported metrics are accuracy, macro-averaged precision, macro-averaged recall, and multi-class AUC under a one-vs-rest strategy with macro-averaging. Additional evaluation outputs include confusion matrices and per-class ROC curves (Ahmed, 18 Dec 2025).

The core numerical result is a reported accuracy of $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$3 with an AUC of $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$4. The paper describes this as state-of-the-art relative to recent 2024–2025 methods, including CNN-based and Siamese-network approaches whose accuracies are reported as ranging from $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$5 to $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$6 (Ahmed, 18 Dec 2025).

Method	Dataset / Split	Accuracy / AUC
Deep Multi-scale CNN (Femmam et al.)	OASIS / 90:10	98.00% / 99.33%
CNN (w/ Augmentation, Dardouri et al.)	OASIS / 70:30	99.68% / --
Novel CNN (ElAssy et al.)	OASIS / 80:20	98.92% / --
Four-way Siamese CNN (Adil et al.)	OASIS-3 / 80:20	96.10% / 97.20%
PseudoColorViT-Alz	OASIS-1 / 80:20	99.79% / 100%

The paper attributes the improvement to superior global context modeling by Transformers and to the enhanced texture and contrast cues unveiled by pseudo-coloring. At the same time, the comparison table includes different datasets and train:test ratios. This suggests that direct numerical comparison should be read together with dataset choice and split protocol, especially where OASIS, OASIS-1, and OASIS-3 are not interchangeable experimental settings.

5. Interpretability and clinical relevance

Interpretability is treated as a substantive property of the pipeline rather than a secondary diagnostic aid. The paper states that pseudo-color images make subtle anatomical and boundary differences more visually discernible not only to the network but also to clinicians reviewing model outputs or attention maps. It also states that Vision Transformers’ self-attention mechanisms allow explicit mapping of where the model is focusing, and that these cues align well with regions accentuated by colormap enhancement (Ahmed, 18 Dec 2025).

The clinical significance is framed around stage-sensitive detection. Early and accurate detection of Alzheimer’s stages is described as critical for intervention, and four-way classification is presented as enabling nuanced interpretation and monitoring of disease progression. The method is further characterized as having enhanced model robustness without augmentation, superior generalization on moderate-sized datasets, and compatibility with clinician intuition through colorized outputs (Ahmed, 18 Dec 2025).

A common misconception would be to interpret the pseudo-color step as merely cosmetic. The paper’s position is more specific: the colormap transformation is intended to alter feature salience in a way that better exposes anatomical textures, local contrasts, and subtle intensity variations to an RGB-pretrained transformer. Another potential misconception is that interpretability follows automatically from high accuracy; the paper instead links interpretability to the conjunction of pseudo-color emphasis and attention-based localization.

6. Position within ViT-based Alzheimer’s MRI research

PseudoColorViT-Alz belongs to a broader line of work that applies Vision Transformers to Alzheimer’s disease classification, but its distinguishing emphasis is the use of pseudo-color enhancement as a front-end representation strategy. A useful comparator is the metaheuristic-based ViT study for early detection of Alzheimer’s disease, which preprocesses 3D brain MRI images from ADNI using Statistical Parametric Mapping (SPM12), extracts 2D MRI slices resized to $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$7, and optimizes ViT hyper-parameters with Differential Evolution, Genetic Algorithm, Particle Swarm Optimization, and Ant Colony Optimization (Sen et al., 2024).

That comparative study explicitly states that it does not specifically mention the use of pseudo-coloring as a preprocessing step; the focus is on patch extraction and standard intensity-based image slices. Its best reported result is a DE-based ViT with accuracy $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$8, precision $$\mathbf{I}_{\text{rgb}} = \text{Colormap}\left(\frac{\mathbf{I}_{\text{gray}}}{255}\right)$$9, recall $(C, H, W)$0, and F1-score $(C, H, W)$1, compared with a baseline ViT accuracy of $(C, H, W)$2 on ADNI data partitioned as $(C, H, W)$3 train, $(C, H, W)$4 test, and $(C, H, W)$5 validation (Sen et al., 2024). In contrast, PseudoColorViT-Alz preserves a standard pretrained ViT-Base backbone and centers the methodological novelty on colormap-enhanced representation together with the global feature learning capabilities of Vision Transformers.

This comparison helps delimit what PseudoColorViT-Alz is and is not. It is not a generic ViT optimization framework and not a hyper-parameter search study. Its core claim is that pseudo-color augmentation combined with Vision Transformers can significantly enhance MRI-based Alzheimer’s disease classification. A plausible implication is that the method occupies a distinct design space in which input-space transformation, rather than optimizer-space search, is the main lever for performance and interpretability.