UD_Icelandic-Modern

Treebank card from UD release 2.18: metadata and texts come from UD_Icelandic-Modern/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Icelandic-Modern; seeds: seeds/; converter: convert.md.

Annotation layers

UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.

Size

Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.

Summary

UD_Icelandic-Modern is a conversion of the modern additions to the Icelandic Parsed Historical Corpus (IcePaHC) to the Universal Dependencies scheme.

Introduction

The conversion was done using UDConverter.

Note that the treebank data in versions 2.8-2.10 is flawed in that various sentences are duplicated, resulting in an overlap between train / dev / test. This issue has been fixed as of version 2.11.

The modern additions to the Icelandic Parsed Historical Corpus (IcePaHC) is a corpus which includes 21st-century texts NOT found in IcePaHC. These texts were manually parsed according to the Penn Parsed Corpora of Historical English (PPCHE) annotation scheme as used for IcePaHC. These parsed texts were then automatically converted to the Universal Dependencies scheme to create UD_Icelandic-Modern. The corpus consists of 80 thousand tokens in total. The texts are unprepared parliament speeches by four Icelandic members of parliament in the period 2011–2015 and sports news texts from two reporters at the Icelandic National Broadcasting Service (RÚV) from 2016 and – as of version 2.11 – from 2017. These 21st-century additions are not found in IcePaHC (which, however, contains two narrative texts from the 21st century).

Each sentence ID (sent_id) in UD_Icelandic-Modern carries the following information:

ALTHINGI_BO_2015_G-33-4647803,.1

• Text origin (ALTHINGI)
• Speaker (BO)
• Publication year of the text (2015)
• Name of original file (G-33-4647803)
• Sentence index within file (.1)

Along with sentence IDs within the UD corpus, each sentence contains an X_ID flag, indicating the original sentence(s) in IcePaHC. This is useful as some sentences in the UD scheme have more than one original sentence in IcePaHC. As sentence IDs are currently not represented in the original parsed corpus found here, this flag is left blank, as ID_MISSING for each original sentence.

Manually corrected portion

A subset of the UD corpus has been manually corrected after the automatic conversion, 15,151 words in total. The portion corrected belonged to the following files, as shown in each sentence's ID:

• ALTHINGI_BO_2013
  • All files
• ALTHINGI_BO_2014
  • All files
• ALTHINGI_HHG_2013
  • Files G-33-4492074, G-33-4497471, G-33-4500256, G-33-4525575, G-33-4528305, G-33-4534200, G-33-4542329
• ALTHINGI_SJS_2013
  • Files G-33-4493268, G-33-4496708, G-33-4496709, G-33-4496710, G-33-4500290, G-33-4500291, G-33-4503791, G-33-4510804, G-33-4517845, G-33-4517846, G-33-4524841, G-33-4528340, G-33-4542311, G-33-4542313, G-33-4545749, G-33-4545750, G-33-4545751, G-33-4556342, G-33-4556344, G-33-4563267, G-33-4565680

Data split

Training data

61,817 words in total

• ALTHINGI_BO_2013 - 16 sentences
• ALTHINGI_BO_2014 - 174 sentences
• ALTHINGI_BO_2015 - 284 sentences
• ALTHINGI_HHG_2013 - 621 sentences
• ALTHINGI_SJS_2013 - 658 sentences
• ALTHINGI_TKG_2011 - 449 sentences
• RUV_ESP_2016 - 238 sentences
• RUV_TGS_2016 - 263 sentences

Development data

8,431 words in total

• ALTHINGI_BO_2013 - 16 sentences
• ALTHINGI_BO_2014 - 43 sentences
• ALTHINGI_BO_2015 - 32 sentences
• ALTHINGI_HHG_2013 - 54 sentences
• ALTHINGI_SJS_2013 - 75 sentences
• ALTHINGI_TKG_2011 - 53 sentences
• RUV_ESP_2016 - 66 sentences
• RUV_TGS_2016 - 55 sentences

Testing data

10,147 words in total

• ALTHINGI_BO_2013 - 14 sentences
• ALTHINGI_BO_2014 - 46 sentences
• ALTHINGI_BO_2015 - 34 sentences
• ALTHINGI_HHG_2013 - 45 sentences
• ALTHINGI_SJS_2013 - 67 sentences
• ALTHINGI_TKG_2011 - 41 sentences
• RUV_ESP_2016 - 38 sentences
• RUV_ESP_2017 - 43 sentences
• RUV_TGS_2016 - 76 sentences
• RUV_TGS_2017 - 34 sentences

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/is/modern/