UD_German-HDT
Treebank card from UD release 2.18: metadata and texts come from UD_German-HDT/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_German-HDT; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_German-HDT |
| Language | German (de) |
| Family | IE |
| Treebank code | de_hdt |
| UD page | universaldependencies.org/treebanks/de hdt/index.html |
| License | CC BY-SA 4.0 |
| Genres | news, nonfiction, web |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.4 |
| Authors | Emanuel Borges Völker; Felix Hennig; Arne Köhn; Maximilan Wendt; Verena Blaschke; Nina Böbel; Leonie Weissweiler |
| Contact | nina.boebel@hhu.de |
| Development | in the UD repo (here) |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | converted from manual |
| UPOS | converted from manual |
| XPOS | automatic with corrections |
| Features | converted from manual |
| Relations | converted with corrections |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 153 035 | 2 753 627 | 2 799 069 | 45 442 | 0 |
| dev | 18 434 | 319 513 | 324 848 | 5 335 | 0 |
| test | 18 459 | 326 250 | 331 663 | 5 413 | 0 |
| total | 189 928 | 3 399 390 | 3 455 580 | 56 190 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.
Summary
UD German-HDT is a conversion of the Hamburg Dependency Treebank, created at the University of Hamburg through manual annotation in conjunction with a standard for morphologically and syntactically annotating sentences as well as a constraint-based parser.
Introduction
The Hamburg Dependency Treebank consists of 261,821 sentences (4.8M tokens). The sentences were all sourced from the German news site heise.de, from articles published between 1996 and 2001. The content of the articles ranges from formulaic periodic updates on new BIOS revisions and processor models or quarterly earnings of tech companies over features about general trends in the hardware and software market to general coverage of social, legal and political issues in cyberspace, sometimes in the form of extensive weekly editorial comments. The creation of the treebank through manual annotation was largely interleaved with the creation of a standard for morphologically and syntactically annotating sentences as well as a constraint-based parser.
For UD_German-HDT, 206,794 sentences (3.8M tokens) from the original HDT were converted with TrUDucer, a treebank conversion tool created by Felix Hennig and extended by Maximilian Wendt and Emanuel Borges Völker. The conversion has a very high accuracy of 97% (checked on a manually converted subset of the treebank). Annotation information not captured in the original annotation was resolved by using external data sources (Wiktionary) and manual input from annotators.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/de/hdt/