UD_Italian-PoSTWITA
Treebank card from UD release 2.18: metadata and texts come from UD_Italian-PoSTWITA/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Italian-PoSTWITA; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_Italian-PoSTWITA |
| Language | Italian (it) |
| Family | IE |
| Treebank code | it_postwita |
| UD page | universaldependencies.org/treebanks/it postwita/index.html |
| License | CC BY-NC-SA 4.0 |
| Genres | social |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.1 |
| Authors | Cristina Bosco; Manuela Sanguinetti |
| Contact | msanguin@di.unito.it |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | automatic with corrections |
| UPOS | converted with corrections |
| XPOS | automatic with corrections |
| Features | automatic with corrections |
| Relations | automatic with corrections |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 5 368 | 95 389 | 99 531 | 4 121 | 0 |
| dev | 670 | 11 823 | 12 308 | 481 | 0 |
| test | 674 | 12 122 | 12 676 | 551 | 0 |
| total | 6 712 | 119 334 | 124 515 | 5 153 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.
Summary
PoSTWITA-UD is a collection of Italian tweets annotated in Universal Dependencies that can be exploited for the training of NLP systems to enhance their performance on social media texts.
Introduction
PoSTWITA-UD has been created by enriching the dataset used for the EVALITA 2016 task of Part-of-Speech tagging of Social Media (see (Bosco et al. 2016)). The original corpus consists of 6,438 tweets of the development set (114,967 tokens) and 300 tweets of the test set (4,759 tokens), annotated at POS level only. The conversion and syntactic annotation process was carried out through alternating steps of automatic scripting and manual revision, and finally with some out-of-domain parsing experiments. Parsing results also underwent a manual revision by two independent annotators.
New since v2.3: In order to meet the requirements of the EU General Data Protection Regulation (GDPR), entered into force on May 2018, the resource content has been pseudonymized, by substituting original tweet IDs and user names.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/it/postwita/