UD_Irish-TwittIrish
Treebank card from UD release 2.18: metadata and texts come from UD_Irish-TwittIrish/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Irish-TwittIrish; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_Irish-TwittIrish |
| Language | Irish (ga) |
| Family | IE |
| Treebank code | ga_twittirish |
| UD page | universaldependencies.org/treebanks/ga twittirish/index.html |
| License | CC BY-SA 4.0 |
| Genres | social |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.8 |
| Authors | Lauren Cassidy; Teresa Lynn; Jennifer Foster; Sarah McGuinness |
| Contact | lauren.cassidy@adaptcentre.ie; teresa.lynn@adaptcentre.ie |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | manual native |
| UPOS | manual native |
| XPOS | not available |
| Features | not available |
| Relations | manual native |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 866 | 15 777 | 15 777 | 0 | 0 |
| dev | 864 | 16 580 | 16 580 | 0 | 0 |
| test | 866 | 15 433 | 15 433 | 0 | 0 |
| total | 2 596 | 47 790 | 47 790 | 0 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.
Summary
A Universal Dependencies treebank of 2596 tweets in modern Irish.
Introduction
The TwittIrish treebank contains 2596 Irish language tweets from two corpora: 1297 tweets from the New Twitter Corpus [NTC] and 1299 tweets from the Lynn Twitter Corpus [LTC].
- NTC consists of 25000 tweets posted between 2010 and 2019 randomly sampled from a database of 14111 users who have tweeted in Irish.
- LTC consists of 1493 tweets posted between 2009 and 2014 randomly sampled from 950000 tweets by 8000 users. Lemmas and POS-tags were added to LTC a part of a PhD research project by Dr. Teresa Lynn at Dublin City University, Ireland (Lynn, 2016) (Lynn, Scannell and Maguire, 2015). The LTC data was further annotated with Code-Switching information (Lynn and Scannell, 2019). The LTC data can be found here: github.com/tlynn747/IrishTwitterPOS.
Irish language tweets were identified by Kevin Scannell as part of the Indigenous Tweets website project indigenoustweets.com. Non-Irish tweets were filtered out using a simple character-trigram language identifier.
The conversion from the LTC annotation scheme to the UD annotation scheme was designed by Lauren Cassidy as part of an PhD project, supervised by Dr. Teresa Lynn and Dr. Jennifer Foster at Dublin City University, Ireland. The conversion was automatic, with manual review, in consultation with other researchers working on UD annotation of User Generated Content (Sanguinetti et al., 2020).
Trees were parsed automatically using the Irish UD Treebank [IUDT] (Lynn and Foster, 2016) as training data, followed by manual review. The IUDT can be found here github.com/UniversalDependencies/UD Irish-IDT.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/ga/twittirish/