UD_Indonesian-CSUI
Treebank card from UD release 2.18: metadata and texts come from UD_Indonesian-CSUI/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_Indonesian-CSUI; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_Indonesian-CSUI |
| Language | Indonesian (id) |
| Family | Austronesian |
| Treebank code | id_csui |
| UD page | universaldependencies.org/treebanks/id csui/index.html |
| License | CC BY-SA 4.0 |
| Genres | nonfiction, news |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.7 |
| Authors | Ika Alfina; Jessica Naraiswari Arwidarasti; Muhammad Yudistira Hanifmuti; Arawinda Dinakaramani; Ruli Manurung; Fam Rashel; Andry Luthfi |
| Contact | ika.alfina@cs.ui.ac.id |
| Development | in the UD repo (here) |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | automatic with corrections |
| UPOS | converted with corrections |
| XPOS | converted with corrections |
| Features | automatic with corrections |
| Relations | converted with corrections |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 656 | 17 904 | 18 222 | 318 | 0 |
| test | 374 | 9 867 | 10 041 | 174 | 0 |
| total | 1 030 | 27 771 | 28 263 | 492 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph. Splits dev are absent from the release.
Summary
UD Indonesian-CSUI is a conversion from an Indonesian constituency treebank in the Penn Treebank format named Kethu that was also a conversion from a constituency treebank built by Dinakaramani et al. (2015). We named this treebank Indonesian-CSUI, since all the three versions of the treebanks were built at Faculty of Computer Science, Universitas Indonesia.
Introduction
UD Indonesian-CSUI treebank was converted automatically from the Kethu treebank, an Indonesian constituency treebank in the Penn Treebank format. The Kethu treebank itself was converted from a consituency treebank built by Dinakaramani et al. (2015).
Other characteristics of the treebank:
- Genre: news in formal Indonesian (the majority is economic news)
- This treebank consists of 1030 sentences and 28K words. We divide CSUI treebank into testing and training dataset:
- Testing dataset consists of around 10K words
- Training dataset consists of around 18K words
- Average sentence length is around 27.4 words per-sentence, which is very high compare to the Indonesian-PUD treebank that has average sentence length of 19.4.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/id/csui/