UD_Yiddish-YiTB

Treebank card from UD release 2.18: metadata and texts come from UD_Yiddish-YiTB/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Yiddish-YiTB; seeds: seeds/; converter: convert.md.

Annotation layers

UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.

Size

Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.

Summary

YiTB is a treebank of linguistically annotated Yiddish data in the Universal Dependencies framework, created via a bootstraping machine learning method. A total of 27,872 tokens are currently in the treebank from a variety of sources and textual genres.

Introduction

Yiddish is classified as a West Germanic language, although it includes many elements from Semitic and Slavic languages as well. It is written in a modified Hebrew alphabet. Yiddish is structurally similiar to German, but it also consists of many interesting structures not found in other Germanic languages, such as periphrastic verbs.

There are a total of 27,872 tokens in the treebank. Roughly 60% of these stem from the Tatoeba source and consist of short sentences provided by both native and non-native speakers of Yiddish. It must be noted that there are occasional grammatical errors in these sentences, such as the use of the auxiliary zayn 'be' instead of hobn 'have' in past tense constructions of periphrastic verbs formed with the verb zayn, as well as incorrect syntax of periphrastic verbs which have an underlying complement-head (OV) order and do not follow the typical order expected of an SVO language like Yiddish. This appears to be a common mistake of intermediate L2 Yiddish speakers. The remainder 40% of tokens stem from a variety of native speaker texts and genres. The various source texts and genres are shown below.

Lemmas and transliterations into Latin script are provided as well by self-made models but are not 100% accurate. The transliteration model, which can be accessed here, was trained on wiktionary and transliterated Bible data. The lemmatization model was trained on wiktionary data and can be found here. Rough translations have been provided using a model trained on Tatoeba sentences and parallel Bible verses that is accessible here. Many of these translations need manual correction, and that process is underway. Morphological features are also not included at this time.

Source	Author	Genre	Added	Split
tatoeba.org	Various	grammar/learner	2.17	all
Book of Exodus	Yehoyesh translation	bible	2.17	all
Beethoven's Moonlight Sonata	Shloyme Bas­tom­s­ki	fiction	2.17	train
Yiddish proverbs	Various	proverb	2.17	all
Haggadahs and Elijah the Prophet	Proste Yiddish	web	2.17	test
Bulletin No. 3: At the Border	Various	nonfiction	2.17	test
A Story with a Cat and Yiddish Dialects	Proste Yiddish	web	2.17	dev
Sholem Aleichem	Proste Yiddish	web	2.17	train
Hirshke Glik	Shmerke Kaczerginski	nonfiction	2.17	dev
Book of Proverbs	Yehoyesh translation	bible	2.17	test
Shavuot and an Old Joke	Proste Yiddish	web	2.17	test
Bankrupt	Katie Brown	fiction	2.17	train
Jews and Yiddish	Nokhem Shtif	nonfiction	2.17	train
Fathers and Children	Chaim Malitz	nonfiction	2.17	train
Wikipedia	Various	nonfiction	2.17	train
A Foolish Child	Jacob Dinezon	fiction	2.17	test
From the Land of Consumption	Shloyme Gilbert	fiction	2.17	dev
The Four Questions	Traditional	liturgical	2.17	test
A Bit of Clarity and Simplicity Regarding the Language Question	Hillel Zeitlin	nonfiction	2.17	train
Song of Songs	Yehoyesh translation	bible	2.17	train
Yiddish: Volume 1	Sheva Zucker	grammar	2.18	train

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/yi/yitb/