---
title: Universal Dependencies Dataset
url: https://www.emergentmind.com/topics/universal-dependencies-dataset
type: topic
---

# Universal Dependencies Dataset

Universal Dependencies (UD) Dataset

Universal Dependencies (UD) is a cross-linguistically consistent framework for syntactic annotation, designed to provide a high-quality and extensible set of human- and machine-annotated treebanks for a wide variety of languages and registers. UD aims to facilitate multilingual natural language processing (NLP), syntactic typology, cross-lingual transfer, and both theoretical and practical linguistic research through unified part-of-speech (POS) tagging, morphological feature annotation, and universal dependency relations.

## 1. Design Principles and Annotation Schema

The UD annotation schema is organized around three primary elements: universal POS tags (UPOS), universal morphological features, and a defined set of dependency relations. These elements are specified for both written and spoken language, and annotation guidelines require consistent treatment of sentence segmentation, tokenization, and relation assignment even in the presence of language-specific or genre-specific phenomena.

- **Universal POS tags**: The standard UD set comprises 17 categories (e.g., NOUN, VERB, ADP, ADV, DET, PRON, ADJ, PROPN, AUX, CCONJ, SCONJ, NUM, PART, INTJ, SYM, X, PUNCT). All annotated corpora map their native POS inventories to this set [2405.07586], [2009.10205], [2102.11152].
- **Dependency relations**: UD uses a defined set of approximately 37 core relations (e.g., nsubj, obj, iobj, obl, amod, advmod, case, aux, cop, conj, cc, det, compound, flat, fixed, mark, root, parataxis, appos, dislocated, discourse, reparandum, goeswith, orphan, etc.), with extensions for language- or genre-specific phenomena [2405.07586], [2403.10293], [2102.11152], [1909.03317].
- **Morphological features**: Feature inventories are extended on a language-by-language basis, but only overtly marked features are annotated, and all features comply with the universal inventory (e.g., Case, Number, Gender, Tense, Person, Aspect, Politeness, etc.) [2204.12633].

Annotation proceeds in CoNLL-U format, encoding token-level fields (ID, FORM, LEMMA, UPOS, XPOS, FEATS, HEAD, DEPREL, DEPS, MISC), supporting integration with the complete UD ecosystem.

## 2. Treebank Coverage and Diversity

The UD project encompasses a vast range of languages, registers, and linguistic phenomena.

- **Language breadth**: UD covers more than 90 languages, each documented by at least one treebank. Datasets such as the Persian UD treebank (29,107 sentences, 509,000 tokens) [2009.10205], Thai UD treebank (3,627 sentences, ≈90,000 tokens) [2405.07586], and datasets for low-resource languages like Magahi (945 sentences) and Braj (500 sentences) [2204.12633] exemplify this range.
- **Register and domain**: UD includes resources for formal texts (news, Wikipedia, academic writing [2405.07586]), conversational and spoken language (CHILDES—child-caregiver interactions, ConvBank—human-machine dialogue, radio broadcast speech [2504.20304], [1909.03317], [2102.11152]), dialectal and non-standard varieties (Bavarian [2403.10293], code-switched Frisian–Dutch [2102.11152]), and learner corpora (ESL TLE [1605.04278]).
- **Synthetic and typological extension**: The Galactic Dependencies resource synthesizes more than 50,000 artificial treebanks by reordering dependents from real UD sources to simulate typological diversity, enabling robust analysis of low-resource and typologically distant languages [1710.03838]. Typology datasets built from UD derive continuous-valued word-order metrics across dozens of languages [2402.01513].

| Dataset/Lang.         | #Sents    | #Tokens     | Domain   | Special Feature                            |
|-----------------------|-----------|-------------|----------|--------------------------------------------|
| Thai UD [2405.07586]  | 3,627     | ~90,000     | text     | Covers Wikipedia, news, essays             |
| Persian UD [2009.10205]| 29,107   | 509,000     | text     | Conversion from PerDT, high UD-compat.     |
| CHILDES-English [2504.20304]| 48,183 (gold) | 236,941 | speech   | Children/caregivers; +1M silver           |
| MaiBaam Bavarian [2403.10293]| 1,070   | 15,023    | text/speech| Multi-dialect, five genres                |
| Magahi [2204.12633]   | 945       | 13,343      | text     | Low-resource, Indo-Aryan                   |

These facts show the cross-linguistic and cross-domain breadth of the UD corpus, an essential property for multilingual parsing and typological generalization.

## 3. Annotation Workflows and Quality Control

UD treebanks are produced either by manual annotation (from scratch or atop existing resources), conversion from pre-existing dependency/constituent corpora, or through a hybrid approach.

- **Manual annotation**: Involves iterative, multi-rater workflows. Annotators label sentence batches, measure inter-annotator agreement (IAA) (metrics: POS κ, LAS, UAS), and adjudicate disagreements, refining the guidelines as needed [2102.11152], [2405.07586]. For example, in the spoken Frisian–Dutch dataset, three rounds of annotation on 150 utterances increased POS accuracy from 69.5% to 89.7%, UAS from 72.3% to 80.1%, and LAS from 60.9% to 71.4%, with improvement statistically validated (McNemar test, \(p<0.01\)) [2102.11152].
- **Conversion**: Gold-standard resources (Stanford Dependencies, Penn Treebank, PerDT, Alpino, LassySmall) are mapped to UD through deterministic rules and/or machine learning, with corpus-specific corrections for function word mapping, non-projectivity, compound/flat, and relation assignment (see [2009.10205], [1909.00522], [2403.10293]).
- **Quality assessment**: Inter-annotator agreement is explicitly reported using Cohen’s κ (UPOS κ=0.92, relations κ=0.84 in TUD) [2405.07586]. LAS and UAS metrics are standard for measuring parser- or annotator-level agreement:

  $$
  \mathrm{UAS} = \frac{1}{N}\sum_{i=1}^N \mathbf{1}(\hat h_i = h_i), \quad
  \mathrm{LAS} = \frac{1}{N}\sum_{i=1}^N \mathbf{1}(\hat h_i = h_i \wedge \hat\ell_i = \ell_i)
  $$
  where $N$ excludes punctuation roots [2102.11152].

- **Genre adaptation**: Dedicated schemes such as SCUD for spoken dialog [1909.03317] or explicit adaptation for code-switching hinge on both schema extension and robust workflow design.

## 4. Special Challenges and Solutions in UD annotation

UD annotation must address diverse issues arising from language- and domain-specific phenomena:

- **Spoken and disfluent speech**: Discourse markers, fillers, false starts, and repairs are coded using relations such as discourse, reparandum, flat, and goeswith; placeholder nodes mark ellipsis [1909.03317]. In code-switched utterances, cross-language coreference and disfluent segmentation are systematically treated via UD-native relations (expl, dislocated, discourse) [2102.11152].
- **Non-canonical varieties and learner data**: Treebanks for learner or dialectal data (e.g., TLE, MaiBaam) adhere to a literal surface annotation principle—errors are annotated as realized, not corrected, unless a token is so malformed as to lose syntactic plausibility [1605.04278]. Dialect annotation calls for both customized guidelines and flexible tokenization, favoring preservation of orthographic and morphological idiosyncrasies [2403.10293].
- **Low-resource and code-switched languages**: Small datasets require iterative annotation, leveraging pre-existing monolingual UD treebanks for guideline drafting but remaining open to adaptation [2102.11152], [2204.12633]. Cross-lingual coreference is handled using expl/ref rather than new relation labels.
- **Multilayer annotation and conversion**: Incorporating entity, coreference, and disfluency layers improves the accuracy of conversion to UD (from ≈98% to >99.5% accuracy in GUM), ensuring correct assignment of complex relations (flat, compound, dislocated, reparandum) [1909.00522].

## 5. Downstream Applications and Impact

UD datasets underpin a broad spectrum of computational linguistics and NLP research:

- **Supervised and cross-lingual parsing**: UD treebanks are the de facto standard for training, evaluating, and benchmarking dependency parsers, particularly for low-resource and cross-lingual transfer scenarios [2405.07586], [1710.03838], [2009.10205].
- **Typology and linguistic research**: Large-scale typological investigations, including gradient word-order typology, are enabled directly from UD annotations via continuous-valued feature extraction [2402.01513].
- **Child and learner language modeling**: Datasets like UD-English-CHILDES and TLE support research in child language acquisition, developmental syntax, L2 parsing, and syntax-aware grammatical error correction [2504.20304], [1605.04278].
- **Automated conversion and benchmarking**: Comparison of rule-based and neural approaches to enhanced dependency conversion (e.g., for coordinate propagation) demonstrate the utility of machine learning over fixed heuristics for higher-recall, semantically faithful UD graphs [2103.08955].
- **Synthetic data augmentation**: Resources such as Galactic Dependencies augment data for supervised grammar induction, transfer learning, and typological gap-filling, providing treebanks for thousands of “unearthly” languages [1710.03838].

## 6. Licensing, Format, and Reuse Practices

All official UD treebanks follow open-source licensing (typically CC BY-SA 4.0), are distributed in CoNLL-U UTF-8 format, and include scripts for manipulation, parsing, and basic statistics [2405.07586], [2204.12633], [2504.20304]. Repository URLs and accompanying documentation are standard. Researchers are encouraged to cite datasets appropriately, contribute new resources, and to validate annotation using established guidelines and validators.

Consistent structure and robust licensing have enabled broad adoption, repeatable experiments, and the integration of UD resources into most mainstream NLP libraries (UDPipe, Stanza, spaCy, etc.).


## 7. Recommendations and Best Practices

- Inherit segmentation, orthography, and boundary conventions from the source corpus when possible, and annotate tokens and relations as realized, not as intended [2102.11152], [2403.10293], [1605.04278].
- Explicitly label speech phenomena (fillers, repairs, discourse markers) with dedicated relations to prevent misanalysis by parsers, especially when adapting to spoken data [1909.03317], [2102.11152].
- Use small, iterative annotation batches interleaved with IAA measurement and adjudication to drive guideline refinement and annotation consistency [2102.11152], [2405.07586].
- Leverage existing monolingual UD treebanks for annotation schema, but adapt as required for new language varieties, dialectal forms, and genres [2403.10293], [2102.11152].
- For conversions, employ multilayer information (NER, coreference, disfluency) wherever possible to ensure correct relation assignment and minimize annotation errors [1909.00522].
- Always report IAA and parsing metrics (UAS, LAS) with standard formulas and, when possible, validate improvements statistically [2102.11152], [2405.07586].

The Universal Dependencies dataset ecosystem, by harmonizing annotation across over 90 languages and diverse genres, provides a foundational standard for syntactic parsing, typology, and computational linguistics, and continues to expand via community-driven multilingual and multi-domain resource creation.

Source: https://www.emergentmind.com/topics/universal-dependencies-dataset