Identifying Complex Phenomena in a Corpus via a Treebank Lens

What it is about

The paper counts how often linguistic phenomena occur in a corpus by mapping the annotations of a Redwoods-style treebank to phenomena. The corpus is the 90,000-word English section of the LOGON development corpus. Of 6,407 items, 5,738 received at least one parse with the English Resource Grammar. For 650 of these no correct parse existed, which left 5,088 treebanked items. A phenomenon can map to one grammar rule, to a group of rules, to a lexical type, or to a configuration in the tree. The profiles are meant to set priorities for grammar work in the MT project, and a coverage table by token length shows how coverage varies with sentence length.

Ideas

• I1. en/src/explain.rs with en parse-eval: label each EWT test arc with a phenomenon, for example an obl with a PP head as PP attachment and a ccomp as complementation, and report the error rate per label.
• I2. Group the labels by the structure of languages/en/, so that the profile lines up with the grammar chapters (clause types, relative clauses, coordination).
• I3. Frequency order: count the phenomena in EWT test and GUM test (GUM is test only), and order the examples of the next chapter by their frequency.

For Mova

The code is en/src/explain.rs; the chapters are the ones under languages/en/ for clauses and relative clauses (21-clause-structure.md, 25-relative-clauses.md). The paper uses an ERG treebank, which is not UD, and the LOGON data are outside our licence list. Its coverage numbers are not English UD numbers.

Topics: Treebanks

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{flickinger2006identifying,
  title = {{Identifying Complex Phenomena in a Corpus via a Treebank Lens}},
  author = {Flickinger, Dan},
  booktitle = {Proceedings of the 11th Annual Conference of the European Association for Machine Translation},
  year = {2006},
  url = {https://aclanthology.org/2006.eamt-1.16/}
}

References

16 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Bouma, G., Noord, G. van, & Malouf, R. (2001). Alpino. Wide-coverage computational analysis of Dutch. In W. Daelemans, K. Sima-an, J. Veenstra, & J. Zavrel (Eds.), Computational linguistics in the Netherlands (pp. 45 – 59). Amsterdam, The Netherlands: Rodopi. find
2. Callmeier, U. (2000). PET — A platform for experimentation with efficient HPSG processing techniques. Natural Language Engineering, 6 (1) (Special Issue on Efficient Processing with HPSG), 99 – 108. find
3. Carter, D. (1997). The TreeBanker. A tool for supervised training of parsed corpora. In Proceedings of the Workshop on Computational Environments for Grammar Development and Linguistic Engineering. Madrid, Spain. find
4. Copestake, A., Flickinger, D., Pollard, C., & Sag, I. A. (To appear). Minimal Recursion Semantics. An introduction. Journal of Research in Language and Computation. find
5. Flickinger, D. (2000). On building a more efficient grammar by exploiting types. Natural Language Engineering, 6 (1), 15 – 28. find our card
6. Lezius, W. (2002). Ein suchwerkzeug für syntaktisch annotierte textkorpora. Unpublished doctoral dissertation, University of Stuttgart, Stuttgart, Germany. find
7. Lønning, J. T., Oepen, S., Beermann, D., Hellan, L., Carroll, J., Dyvik, H., Flickinger, D., Johannessen, J. B., Meurer, P., Nordgård, T., Rosén, V., & Velldal, E. (2004). LOGON. A Norwegian MT effort. In Proceedings of the Workshop in Recent Advances in Scandinavian Machine Translation. Uppsala,… find
8. Oepen, S., & Carroll, J. (2000). Performance profiling for parser engineering. Natural Language Engineering, 6 (1) (Special Issue on Efficient Processing with HPSG), 81 – 97. find
9. Oepen, S., Toutanova, K., Shieber, S., Manning, C., Flickinger, D., & Brants, T. (2002). The LinGO Redwoods Treebank. Motivation and preliminary applications. In Proceedings of the 19th International Conference on Computational Linguistics. Taipei, Taiwan. find our card
10. Pito, R. (1993). Tgrepdoc man page (Technical Report). Philadelphia, PA: University of Pennsylvania. find
11. Pollard, C., & Sag, I. A. (1994). Head-Driven Phrase Structure Grammar. Chicago, IL and Stanford, CA: The Univeristy of Chicago Press and CSLI Publications. find
12. Randall, B. (2000). Corpussearch user’s manual (Technical Report). Philadelphia, PA: University of Pennsylvania. find
13. Rohde, D. (2001). Tgrep2 (Technical Report). Pittsburgh, PA: Carnegie Mellon University. find
14. Sag, I. A. (1997). English relative clause constructions. Journal of Linguistics, 33 (2), 431 – 484. find
15. Wahlster, W. (2000). Verbmobil: Foundations of speech-to-speech translation. Springer–Verlag Berlin Heidelberg New York. find
16. Wallis, S., & Nelson, G. (2000). Knowledge discovery in grammatically analysed corpora. Data Mining and Knowledge Discovery, 5 (4), 305 – 336. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2006-flickinger-identifying-complex-phenomena-corpus-treebank/