Annotation guidelines of UD and SUD treebanks for spoken corpora: A proposal

What it is about

The paper gives practical guidelines for spoken-language treebanks in UD and SUD, based on the authors' treebanks of spoken French, Naija and Beja. It covers text-sound alignment (AlignBegin and AlignEnd in MISC, speaker and overlap features), segmentation of speech into illocutionary units instead of written sentences, and the use of boundary symbols such as // for assertions and ?// for questions. It proposes one uniform treatment for paradigmatic lists (conj:coord, conj:dicto, conj:appos), a repair relation for disfluencies, and a split of the UD parataxis relation into seven situations, among them dislocation, parenthesis, incise, clausal modifiers and juxtaposed clauses (parataxis:conj). The paper reports no scores; the guidelines are argued from examples.

Ideas

• I1. Split parataxis in the mova dialect (The Mova dialect: a UD metadialect, treebanks, and converters): tag the seven situations in the ESLSpok and CHILDES training data by rule where the surface cue is clear, and measure LAS on the parataxis relation on the ESLSpok test set.
• I2. Verbal discourse markers in en/seeds/lexicon: treat I mean, I guess and you know as discourse, not parataxis, as the paper proposes, and measure LAS on the discourse relation in the ESLSpok test set.
• I3. Illocutionary boundaries in en/src/tok.rs: recognize //, ?// and !// as sentence-final markers in spoken transcripts and measure sentence-level F1 on the ESLSpok test set with and without the rule.
• I4. Disfluency reparandum: in en/src/parse.rs features, add a flag for a repeated or repaired word, and measure LAS on the disfluent sentences of the ESLSpok dev set.

For Mova

The spoken-language path is the tokenizer en/src/tok.rs, the parser en/src/parse.rs, the converters in en/src/convert.rs and the dialect in The Mova dialect: a UD metadialect, treebanks, and converters. The chapters that the ideas touch are 38. Dialogue, discourse markers and reported speech, 37-register-and-variation.md and 29-ellipsis-word-order-information-structure.md. Measure first: the sentence F1 on spoken transcripts with the illocutionary boundary rule on and off.

Topics: Universal Dependencies · Treebanks

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{kahane2021annotation,
  title = {{Annotation guidelines of UD and SUD treebanks for spoken corpora: A proposal}},
  author = {Kahane, Sylvain and Caron, Bernard and Strickland, Emmett and Gerdes, Kim},
  booktitle = {Proceedings of the 20th International Workshop on Treebanks and Linguistic Theories (TLT, SyntaxFest 2021)},
  year = {2021},
  url = {https://aclanthology.org/2021.tlt-1.4/}
}

References

30 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Batchelor C. (2019). Universal dependencies for Scottish Gaelic: syntax. In Proceedings of CLTW2019 at Machine Translation Summit XVII. find
2. Bawden R., Botalla M.-A., Gerdes K., Kahane S. (2014) Correcting and Validating Syntactic Dependency in the Spoken French Treebank Rhapsodie. In Proceedings of the 9th Language Resources and Evaluation Conference (LREC). find
3. The auxiliary con marks the consecutivity of two events. find
4. Beliao J., Lacheret A., & Kahane S. (2015) Interface intono-syntaxique en français parlé : compter quoi, compter comment, compter pourquoi ?. In S. Loiseau (ed), La fréquence textuelle [Langage, 197], 129-153, Larousse. find
5. Berrendonner A. (1990). Pour une macro-syntaxe. In Données orales et théorie linguistique [Travaux de linguistique (Gent), 21], 25-36. find
6. Blanche-Benveniste C. (1990). Le français parlé (études grammaticales). find
7. Editions du CNRS. Bonami O., & Godard D. (2008). On the syntax of direct quotation in French. In Proceedings of the 15th International Conference on HPSG, CSLI Publications, 358-377. find
8. Braggaar A. & van der Goot R. (2021). Challenges in Annotating and Parsing Spoken, Code-switched, Frisian-Dutch Data. In Proceedings of the Second Workshop on Domain Adaptation for NLP Caron, B, Courtin, M., Gerdes, K., & Kahane, S. (2019) A Surface-Syntactic UD Treebank for Naija. In Proceedings of… find
9. Cresti E. (1995). Speech act units and informational units. In E. Fava (ed), Speech Acts and Linguistic Research, Proceedings of the Workshop. Center for Cognitive Science, SUNY at Buffalo, 89-107. find
10. Deulofeu, J. (1999). Recherches sur les formes de la prédication dans les énoncés assertifs en français contemporain (le cas des énoncés introduits par le morphème que). Thèse d’état, Université Paris 3. de Marneffe M.-C., Manning, C. D., Nivre, J., & Zeman, D. (2021). Universal Dependencies. Comput… find
11. Dister A., Goldman J.-P., & Marlet R. (2019) Orthographic and phonetic transcriptions of Rhapsodie recording. In Lacheret-Dujour et al. (2019), 21-34. find
12. Dobrovoljc, K. & Nivre, J. (2016). The Universal Dependencies treebank of spoken Slovenian. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC), 1566-1573. find
13. Gerdes K., Guillaume B., Kahane S., & Perrier G. (2018) SUD or Surface-Syntactic Universal Dependencies: An annotation scheme near-isomorphic to UD. In Proceedings of the Universal Dependencies Workshop (UDW), EMNLP. find
14. Gerdes K., Guillaume B., Kahane S., & Perrier G. (2019) Improving Surface-syntactic Universal Dependencies (SUD): surface-syntactic functions and deep-syntactic features. In Proceedings of the 18th international conference on Treebanks and Linguistic Theories (TLT), SyntaxFest. find
15. Gerdes K. & Kahane S. (2009) Speaking in piles: Paradigmatic annotation of French spoken corpus. In Proceedings of the 5 th Corpus Linguistics Conference, Liverpool, http://ucrel.lancs.ac.uk/publications/cl2009. ↗
16. Kahane S., & Lacheret A. (2019) Syntax and prosody mapping: What and how? The case of intonational periods and illocutionary units. In Lacheret-Dujour et al. (2019), 339-363. find
17. Kahane S., Pietrandrea P. (2009) Les parenthétiques comme « Unités Illocutoires Associées » : une perspective macrosyntaxique, in M. Avanzi & J. Glikman (eds), Les Verbes Parenthétiques : Hypotaxe, Parataxe ou Parenthèse ? [Linx, 61], 49-70. find
18. Kahane S., Vanhove M., & Ziane R. (2021) A morph-based and a word-based treebank for Beja. In Proceeding of the 20 th Proceedings of the 18th international conference on Treebanks and Linguistic Theories (TLT), SyntaxFest. find
19. Lacheret A., Kahane S., Beliao J., Dister A., Gerdes K., Goldman J.-P., Obin N., Pietrandrea P., & Tchobanov A. (2014) Rhapsodie: un Treebank annoté pour l’étude de l’interface syntaxe-prosodie en français parlé. In Actes du 4 ème congrès mondial de linguistique française (CMLF), SHS Web of Conferen… find
20. MacWhinney, B. (2000). The CHILDES Project: Tools for Analyzing Talk. 3rd Edition. find
21. Mahwah, NJ: Lawrence Erlbaum Associates. Øvrelid L., Kåsen A., Hagen K., Nøklestad A., Solberg P. E., & Johannessen J. B. (2018). The LIA treebank of spoken Norwegian dialects. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC), 4482-4488. find
22. Patejuk A. & Przepiórkowski A. (2018). From Lexical Functional Grammar to Enhanced Universal Dependencies: Linguistically informed treebanks of Polish. Institute of Computer Science, Polish Academy of Sciences, Warsaw. Downloadable from http://nlp.ipipan.waw.pl/Bib/pat:prz:18:book.pdf. ↗
23. Pietrandrea P. & Kahane S. (2019) Macrosyntactic annotation. In Lacheret-Dujour et al. (2019), 97-125. find
24. Pietrandrea P., Kahane S., Lacheret A., & Sabio F. (2014) The notion of sentence and other discourse units in corpus annotation. In T. Raso, H. Mello, M. Pettorino, Spoken Corpora and Linguistic Studies, Benjamins. find
25. Pretkalniņa L., Rituma L., Saulīte B. (2018) Deriving enhanced Universal Dependencies from a hybrid dependency-constituency treebank. In Proceedings of the 21sh International Conference Text, Speech, and Dialogue, LNCS, Vol. 11107, Springer Link, 95-105. find
26. Shriberg E. E. (1994). Preliminaries to a theory of speech disfluencies. Doctoral dissertation, University of California, Berkeley. find
27. Tyers, F. M. and Mishchenkova, K. (2020) Dependency annotation of noun incorporation in polysynthetic languages. In Proceedings of the Fourth Workshop on Universal Dependencies (UDW), 195-204. find
28. Vanhove M. 2014. The Beja Corpus. In Mettouchi, A. and C. Chanard (eds.). The CorpAfroAs Corpus of Spoken AfroAsiatic Languages. http://dx.doi.org/ 10.1075/scl.68.website. — [doi:10.1075/scl.68.website](https://doi.org/10.1075/scl.68.website) find
29. Wong T., Gerdes K., Leung H. & Lee J. S. (2017) Quantitative comparative syntax on the Cantonese-Mandarin parallel dependency treebank. In Proceedings of the Fourth International Conference on Dependency Linguistics (Depling), 266-275. find
30. Zeldes, A. (2017) The GUM Corpus: Creating Multilayer Resources in the Classroom. Language Resources and Evaluation, 51(3), 581–612. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/ud-2021-kahane-annotation-guidelines-ud-sud-treebanks/