Drivers of high similarity scores and criteria for a “good” score

Determine the factors that drive high similarity scores and specify criteria for what constitutes a “good” similarity score when comparing model representations to neural data using measures such as Centered Kernel Alignment (CKA), angular Procrustes distance, Normalized Bures Similarity (NBS), and linear or ridge regression.

Background

Representational similarity measures are widely used to compare artificial models with neural data, yet the interpretation of their scores is ambiguous. The paper motivates this by noting uncertainty about both what drives high similarity scores and what thresholds should be considered good, then introduces a methodology to differentiate through these measures and empirically probe their behavior.

Clarifying the determinants of high scores and establishing interpretable criteria for score quality is essential for meaningful model–brain alignment claims, since different measures may emphasize different aspects of the data (e.g., high-variance principal components).