Need for label value standardization across labelers

Investigate whether standardization of label values across Bluesky Labelers is necessary to avoid inconsistencies and misinterpretations as the labeling ecosystem grows, and, if needed, specify a shared taxonomy and semantics for label values and behaviors.

Background

Labelers in Bluesky can emit custom labels, with only a small set of reserved values having predefined behaviors. The paper finds little overlap among labelers’ vocabularies and highlights potential issues with coherence and user trust.

The authors explicitly state uncertainty about whether some degree of standardization will be required as the system scales, given the diversity of label values and semantics.