UD_French-GSD
Treebank card from UD release 2.18: metadata and texts come from UD_French-GSD/README.md; size is counted by streaming the .conllu files and checked against the release stats.xml. Generated by tools/treebanks build; do not edit by hand. Papers: Papers: UD_French-GSD; seeds: seeds/; converter: convert.md.
| Field | Value |
|---|---|
| UD name | UD_French-GSD |
| Language | French (fr) |
| Family | IE |
| Treebank code | fr_gsd |
| UD page | universaldependencies.org/treebanks/fr gsd/index.html |
| License | CC BY-SA 4.0 |
| Genres | blog, news, reviews, wiki |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v1.0 |
| Authors | Marie-Catherine de Marneffe; Bruno Guillaume; Ryan McDonald; Alane Suhr; Joakim Nivre; Matias Grioni; Carly Dickerson; Guy Perrier |
| Contact | demarneffe.1@osu.edu, bruno.guillaume@inria.fr |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |
Annotation layers
| Layer | Origin |
|---|---|
| Lemmas | automatic with corrections |
| UPOS | converted with corrections |
| XPOS | not available |
| Features | automatic with corrections |
| Relations | converted with corrections |
UD scale: manual native — annotated by hand directly in UD; converted from manual — converted from manual annotation in another scheme; converted with corrections — converted and partly corrected by hand; automatic with corrections — automatic, with partial manual corrections; automatic — automatic; not available — the layer is absent.
Size
| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
|---|---|---|---|---|---|
| train | 14 450 | 344 961 | 354 647 | 9 686 | 0 |
| dev | 1 476 | 34 664 | 35 721 | 1 057 | 0 |
| test | 416 | 9 738 | 10 017 | 279 | 0 |
| total | 16 342 | 389 363 | 400 385 | 11 022 | 0 |
Tokens are surface tokens (Spanish vámonos is one), words are syntactic words (vamos + nos); multiword tokens are those split into several words; empty nodes are the N.M nodes of the enhanced graph.
Summary
The UD_French-GSD was converted in 2015 from the content head version of the universal dependency treebank v2.0 (github.com/ryanmcd/uni-dep-tb). It is updated since 2015 independently from the previous source.
Introduction
The UD_French-GSD is converted from the content head version of the universal dependency treebank v2.0 (github.com/ryanmcd/uni-dep-tb). The README for the original project is available below.
The version 2.7 of UD_French-GSD data consists of 400,399 words (16,341 sentences). No sentence id were available in the original resource, so new
sent_idwere automatically introduced in the converted corpus with prefixesfr-ud-train,fr-ud-devandfr-ud-teston the corresponding original files, followed by a 5 digit number following the order of sentences in the original files.:warning: to meet the size requirements of test data of 10K words, a part of the dev original file was moved to the test file! Since version 2.0, the splitting of data is:
- file
fr-ud-train.conll: 14,449 sentences; 354,662 wordsfr-ud-train_00001tofr-ud-train_14554- file
fr-ud-dev.conll: 1,476 sentences; 35,718 wordsfr-ud-dev_00001tofr-ud-dev_01478- file
fr-ud-test.conll: 416 sentences; 10,019 wordsfr_ud-test_00001tofr_ud-test_00298fr-ud-dev_01479tofr-ud-dev_01596Sentences are shuffled and there is no way to know what is the source or the genre of a given sentence.
Probably due to some bug in a conversion program, version 1.2 contains many truncated sentences (date missing for instance). Almost every truncated sentence are from Wikipedia, so it was possible to recover the original text. Most of the truncated sentences were completed in version 1.3. Some sentences were completed later. There are probably still some truncated sentences.
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/treebanks/fr/gsd/