UD_Arabic-PADT
Treebank card from UD release 2.18: metadata and texts come from UD_Arabic-PADT/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Arabic-PADT; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_Arabic-PADT |
| Language | Arabic (ar) |
| Family | Afro-Asiatic |
| Treebank code | ar_padt |
| UD page | universaldependencies.org/treebanks/ar padt/index.html |
| License | CC BY-NC-SA 3.0 |
| Genres | news |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v1.2 |
| Authors | Daniel Zeman; Zdeněk Žabokrtský; Shadi Saleh |
| Contact | zeman@ufal.mff.cuni.cz |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | converted from manual |
| UPOS | converted from manual |
| XPOS | manual native |
| Features | converted from manual |
| Relations | converted from manual |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 6 075 | 191 869 | 223 881 | 30 459 | 44 |
| dev | 909 | 25 986 | 30 239 | 4 010 | 11 |
| test | 680 | 24 201 | 28 264 | 3 864 | 3 |
| total | 7 664 | 242 056 | 282 384 | 38 333 | 58 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.
Summary
The Arabic-PADT UD treebank is based on the Prague Arabic Dependency Treebank (PADT), created at the Charles University in Prague.
Introduction
universaldependencies.github.io/docs/ar/overview/introduction.html
The treebank consists of 7,664 sentences (282,384 tokens) and its domain is mainly newswire. The annotation is licensed under the terms of CC BY-NC-SA 3.0 and its original (non-UD) version can be downloaded from http://hdl.handle.net/11858/00-097C-0000-0001-4872-3.
The morphological and syntactic annotation of the Arabic UD treebank is created through conversion of PADT data. The conversion procedure has been designed by Dan Zeman. The main coordinator of the original PADT project was Otakar Smrž.
Source of annotations
This table summarizes the origins and checking of the various columns of the CoNLL-U data.
Column Status ID Sentence-level units in PADT often correspond to entire paragraphs and they were obtained automatically. Low-level tokenization (whitespace and punctuation) was done automatically and then hand-corrected. Splitting of fused tokens into syntactic words in Arabic is part of morphological analysis. ElixirFM was used to provide context-independent options, then these results were disambiguated manually. FORM The unvocalized surface form is used. Fully vocalized counterpart can be found in the MISC column as Vform attribute. LEMMA Plausible analyses provided by ElixirFM, manual disambiguation. Lemmas are vocalized. Part of the selection of lemmas was also word sense disambiguation of the lexemes, providing English equivalents (see the Gloss attribute of the MISC column). UPOSTAG Converted automatically from XPOSTAG (via Interset); human checking of patterns revealed by automatic consistency tests. XPOSTAG Manual selection from possibilities provided by ElixirFM. FEATS Converted automatically from XPOSTAG (via Interset); human checking of patterns revealed by automatic consistency tests. HEAD Original PADT annotation is manual. Automatic conversion to UD; human checking of patterns revealed by automatic consistency tests. DEPREL Original PDT annotation is manual. Automatic conversion to UD; human checking of patterns revealed by automatic consistency tests. DEPS — (currently unused) MISC Information about token spacing taken from PADT annotation. Additional word attributes provided by morphological analysis (i.e. ElixirFM rules + manual disambiguation): Vform (fully vocalized Arabic form), Translit (Latin transliteration of word form), LTranslit (Latin transliteration of lemma), Root (word root), Gloss (English translation of lemma).
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/ar/padt/