MWEs in Treebanks: From Survey to Guidelines
What it is about
The PARSEME working group surveyed how multiword expressions (MWEs) are annotated in treebanks through a wiki table filled in by people who know each treebank. The survey shows wide variation: light verb constructions are either given a special label or treated as ordinary verbs, and VP idioms are handled by several different strategies, across dependency, constituency and HPSG or LFG treebanks. The authors examine six treebanks in detail, including the UZH Alpine German, Prague, Persian UD, Szeged and NorGramBank treebanks. From this they propose four general principles: mark MWEs so they can be found without heuristics (A), keep non-compositional MWEs apart from compositional ones (B), normalize each MWE occurrence to a canonical form (C), and make each MWE type retrievable as a set (D).
Ideas
- I1. Light-verb marking in the
enlexicon: mark light verb constructions (take a shower, make a wish, have a nap) withcompound:lvcin themovadialect, check thaten/src/udreg.rsaccepts the relation for English, and measure LAS on EWT test restricted to the tokens of those constructions. - I2. Canonical MWE lemma in
en/src/morph.rs: map particle verbs and light-verb phrases to one canonical form (shut down, take a shower) and measure how many EWT tokens of the same MWE share one canonical form before and after, against the current lemma accuracy of 99.3 to 99.5 percent. - I3. Principle D as a query: have
enwrite the MWE type as a MISC feature and check that every idiom inen/seeds/lexiconis retrievable as one set; measure the share of EWT and GUM idioms that the rule finds (test only for GUM). - I4. Idioms in
prag: a VP idiom (let the cat out of the bag) must not create a literal event inprag/world; measure the share of idiomatic sentences that produce a false event on a hand-checked set of 100.
For Mova
The lexical side is en/seeds/lexicon and en/src/morph.rs, the tagger and parser are en/src/ptag.rs and en/src/parse.rs, and the event side is prag and world. The chapter that the ideas touch is 19. The lexicon: vocabulary, multiword expressions and register. Measure first: the share of EWT light-verb constructions that the current en output labels as ordinary verbs.
Cite
@inproceedings{rosen2016mwes,
title = {{MWEs in Treebanks: From Survey to Guidelines}},
author = {Rosén, Victoria and Smedt, Koenraad De and Losnegaard, Gyri Smørdal and Bejček, Eduard and Savary, Agata and Osenova, Petya},
booktitle = {Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)},
year = {2016},
url = {https://aclanthology.org/L16-1368/}
}References
- Abeillé, A., Clément, L., and Toussenel, F. (2003). Building a treebank for French. In Anne Abeillé, editor, Treebanks: Building and Using Parsed Corpora, volume 20 of Text, speech and language technology. Kluwer Academic Publishers, Dordrecht. find
- Baldwin, T. and Su Nam Kim. (2010). Multiword expressions. In Nitin Indurkhya et al., editors, Handbook of Natural Language Processing, chapter 12. CRC Press, Boca Raton, FL, USA, 2nd edition. find
- Bejček, E. and Straňák, P. (2010). Annotation of multiword expressions in the prague dependency treebank. Language Resources and Evaluation, 44(1):7–21. find
- Bejček, E., Hajičová, E., Hajič, J., Jínová, P., Kettnerová, V., Kolářová, V., Mikulová, M., Mírovský, J., Nedoluzhko, A., Panevová, J., Poláková, L., Ševčíková, M., Štěpánek, J., and Šárka Zikánová. (2013). Prague Dependency Treebank 3.0. Data. Data, http://hdl. handle.net/11858/00-097C-0000-0023-1… find
- Branco, A., Costa, F., Silva, J., Silveira, S., Castro, S., Avelãs, M., Pinto, C., and Graça, J. (2010). Developing a deep linguistic databank supporting a collection of treebanks: the CINTIL DeepGramBank. In LREC. find
- Brants, S., Dipper, S., Eisenberg, P., Hansen-Schirra, S., König, E., Lezius, W., Rohrer, C., Smith, G., and Uszkoreit, H. (2004). TIGER: Linguistic interpretation of a German corpus. Research on Language and Computation, 2(4):597–620. find
- Dalrymple, M. (2001). Lexical Functional Grammar, volume 34 of Syntax and Semantics. Academic Press, San Diego, CA. find
- Dyvik, H., Meurer, P., Rosén, V., De Smedt, K., Haugereid, P., Losnegaard, G. S., Lyse, G. I., and Thunes, M. (2016). NorGramBank: A ‘Deep’ Treebank for Norwegian. In Proceedings of LREC 2016, Portorož, Slovenia, May. ELRA. find
- Erjavec, T., Fiser, D., Krek, S., and Ledinek, N. (2010). The JOS linguistically tagged corpus of Slovene. In Nicoletta Calzolari (Conference Chair), et al., editors, Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), page 1806–1809, Valletta, Malta,… find
- Flickinger, D., Zhang, Y., and Kordoni, V. (2012). Deepbank: A dynamically annotated treebank of the Wall Street Journal. In Proceedings of the 11th International Workshop on Treebanks and Linguistic Theories, pages 85–96. find
- Grégoire, N. (2010). DuELME: a Dutch electronic lexicon of multiword expressions. Language Resources and Evaluation, 44(1):23–39. find
- Głowińska, K. and Przepiórkowski, A. (2010). The Design of Syntactic Annotation Levels in the National Corpus of Polish. In Nicoletta Calzolari (Conference Chair), et al., editors, Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta, Ma… find
- Losnegaard, G. S., Lyse, G. I., Gjesdal, A. M., De Smedt, K., Meurer, P., and Rosén, V. (2013). Linking Northern European infrastructures for improving the accessibility and documentation of complex resources. In Koenraad De Smedt, et al., editors, Proceedings of the workshop on Nordic language rese… find
- Muischnek, K., Müürisep, K., Puolakainen, T., Aedmaa, E., Kirt, R., and Särg, D. (2014). Estonian dependency treebank and its annotation scheme. In Proceedings of 13th Workshop on Treebanks and Linguistic Theories (TLT13), pages 285–291. find
- Odijk, J. (2013). DUELME: Dutch electronic lexicon of multiword expressions. In Gil Francopoulo, editor, LMF -Lexical Markup Framework, page 133–144. ISTE/Wiley, London/Hoboken. find
- Piskorski, J., Sydow, M., and Kupść, A. (2007). Lemmatization of Polish Person Names. In ACL 2007. Proceedings of the Workshop on Balto-Slavonic NLP 2007, pages 27– 34. Association for Computational Linguistics. find
- Pollard, C. and Sag, I. A. (1994). Head-driven phrase structure grammar. University of Chicago Press. find
- Pretkalnina, L. and Rituma, L. (2012). Syntactic issues identified developing the Latvian treebank. In Baltic HLT, pages 185–192. find
- Rosén, V., Losnegaard, G. S., De Smedt, K., Bejček, E., Savary, A., Przepiórkowski, A., Osenova, P., and Barbu Mititelu, V. (2015). A survey of multiword expressions in treebanks. In Markus Dickinson, et al., editors, Proceedings of the Fourteenth Workshop on Treebanks and Linguistic Theories (TLT14… find
- Sag, I., Baldwin, T., Bond, F., Copestake, A., and Flickinger, D. (2002). Multiword expressions: A pain in the neck for NLP. In Lecture Notes in Computer Science. Proceedings of the Third International Conference on Computational Linguistics and Intelligent Text Processing, volume 2276, pages 189–20… find our card
- Savary, A., Waszczuk, J., and Przepiórkowski, A. (2010). Towards the Annotation of Named Entities in the Polish National Corpus. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC). European Language Resources Association, 17-23 May. find
- Simov, K., Osenova, P., Simov, A., and Kouylekov, M. (2005). Design and implementation of the Bulgarian HPSG-based treebank. Journal of Research on Language and Computation, Special Issue:495–522. van Noord, G. (2009). Huge parsed corpora in LASSY. In Frank Van Eynde, et al., editors, Proceedings of… find
- Vincze, V., Szauter, D., Almási, A., Móra, G., Alexin, Z., and Csirik, J. (2010). Hungarian dependency treebank. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC), pages 1855–1862. ELRA. find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/bank-2016-rosen-mwes-treebanks-survey-guidelines/