UD_Kazakh-KTB
Treebank card from UD release 2.18: metadata and texts come from UD_Kazakh-KTB/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Kazakh-KTB; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_Kazakh-KTB |
| Language | Kazakh (kk) |
| Family | Turkic |
| Treebank code | kk_ktb |
| UD page | universaldependencies.org/treebanks/kk ktb/index.html |
| License | CC BY-SA 4.0 |
| Genres | wiki, fiction, news |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v1.3 |
| Authors | Aibek Makazhanov; Jonathan North Washington; Francis Tyers |
| Contact | aibek.makazhanov@nu.edu.kz, jonathan.north.washington@gmail.com, ftyers@prompsit.com |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | manual native |
| UPOS | converted from manual |
| XPOS | manual native |
| Features | converted from manual |
| Relations | manual native |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 31 | 520 | 529 | 9 | 0 |
| test | 1 047 | 9 975 | 10 007 | 32 | 0 |
| total | 1 078 | 10 495 | 10 536 | 41 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph. Splits dev are absent from the release.
Summary
The UD Kazakh treebank is a combination of text from various sources including Wikipedia, some folk tales, sentences from the UDHR, news and phrasebook sentences. Sentences IDs include partial document identifiers.
Introduction
The tokenisation in the Kazakh UD treebank follows the principles of Turkic lexica in Apertium. Morphological processing in the Kazakh UD treebank follows the principles of Turkic lexica in Apertium. The file designated as “train” is just a small sample to show how the data looks like to shared task participants. The treebank is too small to provide for a standard training-development-test split. Instead, users are advised to merge both files, then jack-knife and report results of ten-fold cross-validation.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/kk/ktb/