UD_Hebrew-IAHLTwiki

Treebank card from UD release 2.18: metadata and texts come from UD_Hebrew-IAHLTwiki/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Hebrew-IAHLTwiki; seeds: seeds/; converter: convert.md.

Annotation layers

UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.

Size

Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.

Summary

Publicly available subset of the IAHLT UD Hebrew Treebank's Wikipedia section (iahlt.org)

Introduction

The UD Hebrew-IAHLTWiki treebank consists of 5,000 contemporary Hebrew sentences representing a variety of texts originating from Wikipedia entries, compiled by the Israeli Association of Human Language Technology. It includes various text domains, such as: biography, law, finance, health, places, events and miscellaneous. The schema for the UD Hebrew-IAHLT treebank, from which the publicly available UD Hebrew-IAHLTWiki subset is derived, is based on the conversion of the Hebrew Treebank (HTB) into the latest UD V2 and is checked against the Universal Dependencies validator as of UD release V2.10, in addition to a range of additional validations using the grewv tool.

Compatible datasets

The HTB version used in the project was initially converted automatically, then a subset of the converted data was manually validated and adopted as a gold standard for training the model for UD parsing used in Hebrew-IAHLT. The entire parsed data has been manually edited to correct parsing errors, and was automatically QA'ed to apply corrections following updates in the schema. For a fork of UD_Hebrew-HTB (Ha'aretz newswire data) using the same annotation scheme, see:

github.com/IAHLT/UD Hebrew

For an additional UD_Hebrew corpus with the same annotation scheme (spoken parliament proceedings), see:

github.com/UniversalDependencies/UD Hebrew-IAHLTknesset

NER annotations

The data additionally contains nested Named Entity annotations in the IAHLT scheme in the MISC annotation Entity=, illustrated in the following excerpt:

# sent_id = iahltwiki_piskat-hitgabrut-27
# text = ההצעה תאמה את עמדתו של נשיא בית המשפט העליון אהרן ברק, היא נדונה בוועדת חוקה חוק ומשפט של הכנסת אך לא קודמה.
1-2	ההצעה	_	_	_	_	_	_	_	_
1	ה	ה	DET	DET	Definite=Def|PronType=Art	2	det	_	_
2	הצעה	הצעה	NOUN	NOUN	Gender=Fem|Number=Sing	3	nsubj	_	_
3	תאמה	תאם	VERB	VERB	Gender=Fem|HebBinyan=PAAL|Number=Sing|Person=3|Tense=Past|Voice=Act	0	root	_	_
4	את	את	ADP	ADP	_	5	case	_	_
5-6	עמדתו	_	_	_	_	_	_	_	_
5	עמדת	עמדה	NOUN	NOUN	Gender=Fem|Number=Sing	3	obj	_	_
6	ו	הוא	PRON	PRON	Case=Gen|Definite=Def|Gender=Masc|Number=Sing|Person=3|Poss=Yes|PronType=Prs	5	nmod:poss	_	_
7	של	של	ADP	ADP	Case=Gen	8	case	_	_
8	נשיא	נשיא	NOUN	NOUN	Definite=Cons|Gender=Masc|Number=Sing	5	nmod:poss	_	Entity=(TTL
9	בית	בית	NOUN	NOUN	Definite=Cons|Gender=Masc|Number=Sing	8	compound	_	Entity=(ORG
10-11	המשפט	_	_	_	_	_	_	_	_
10	ה	ה	DET	DET	Definite=Def|PronType=Art	11	det	_	_
11	משפט	משפט	NOUN	NOUN	Gender=Masc|Number=Sing	9	compound	_	_
12-13	העליון	_	_	_	_	_	_	_	_
12	ה	ה	DET	DET	Definite=Def|PronType=Art	13	det	_	_
13	עליון	עליון	ADJ	ADJ	Gender=Masc|Number=Sing	9	amod	_	Entity=ORG)TTL)
14	אהרן	אהרן	PROPN	PROPN	_	8	appos	_	Entity=(PER
15	ברק	ברק	PROPN	PROPN	_	14	flat	_	Entity=PER)|SpaceAfter=No

Entity types cover the following categories:

• ANG - language
• DUC - product
• EVE - event
• FAC - facility
• GPE - geo-political entity
• LOC - location
• ORG - organization
• PER - person
• TIMEX - time expression
• TTL - title
• WOA - work of art
• MISC - miscellaneous

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/he/iahltwiki/