Effect of baseline language choice in parallel-data tokenizer comparisons

Determine whether using baseline languages other than English when comparing tokenizers trained on parallel data changes the observed compression outcomes and conclusions about token premium effects.

Background

Due to data availability, the paper compares each target language only against an English baseline for parallel-data-trained tokenizers, noting this constraint may limit cross-language comparability.

Understanding whether baseline choice affects observed compression differences would strengthen conclusions about the efficacy of training on parallel data.