The Penn Parsed Corpus of Modern British English: First Parsing Results and Analysis

What it is about

The PPCMBE is a historical treebank of British English from 1700 to 1914. After seven legal files are left out, 94 files with 1,018,736 tokens remain. Its annotation is close to the Penn Treebank but has flatter clauses (no VP level) and different coordination and NP structure. The authors train the Berkeley parser on several versions of the corpus, with and without added NP and VP brackets. The best version reaches an F-score of 84.7 on dev and 85.5 on test, a little below the PTB. Sentences up to 40 words score 2.4 points higher than all sentences. Parser errors include IP nodes that the gold trees do not have, and clauses with two main verbs.

Ideas

• I1. en parse-eval: report LAS and root accuracy for sentences up to 40 words and for all sentences, as the paper does. Measure on EWT test with two identical runs before claiming any change.
• I2. en ud-check: add a rule that flags a clause with two finite main verbs, the parser error type the paper finds. Count the flags on the en output for EWT test, and check a sample by hand.
• I3. en/src/parse.rs: compare parses made with gold tags and with own tags, and report the gap per corpus. The paper finds the gap larger on the test section; check whether EWT shows the same pattern.

For Mova

The chapters are 21. The simple clause and 22. Phrases: noun, adjective, adverb and prepositional phrases (NP and coordination). The code is en/src/parse.rs, en parse-eval and en ud-check. The PPCMBE is LDC data under NC terms: use it for tests only. The English figures must come from EWT test.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.3115/v1/p14-2108

@inproceedings{kulick2014penn,
  title = {{The Penn Parsed Corpus of Modern British English: First Parsing Results and Analysis}},
  author = {Kulick, Seth and Kroch, Anthony and Santorini, Beatrice},
  booktitle = {Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)},
  year = {2014},
  doi = {10.3115/v1/p14-2108},
  url = {https://doi.org/10.3115/v1/p14-2108}
}

References

14 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ann Bies, Justin Mott, Colin Warner, and Seth Kulick. 2012. English Web Treebank. LDC2012T13. Linguistic Data Consortium. find
2. Charlotte Galves and Pabol Faria. 2010. Tycho Brahe Parsed Corpus of Historical Portuguese. http://www.tycho.iel.unicamp.br/˜tycho/corpus/en/index.html. ↗
3. Anthony Kroch and Ann Taylor. 2000. Penn-Helsinki Parsed Corpus of Middle English, second edition. http://www.ling.upenn.edu/hist-corpora/PPCME2-RELEASE-3/index.html. ↗
4. Anthony Kroch, Beatrice Santorini, and Ariel Diertani. 2004. Penn-Helsinki Parsed Corpus of Early Modern English. http://www.ling.upenn.edu/hist-corpora/PPCEME-RELEASE-2/index.html. ↗
5. Anthony Kroch, Beatrice Santorini, and Ariel Diertani. 2010. Penn Parsed Corpus of Modern British English. http://www.ling.upenn.edu/hist-corpora/PPCMBE-RELEASE-1/ index.html. ↗
6. Yuri Lin, Jean-Baptiste Michel, Erez Aiden Lieberman, Jon Orwant, Will Brockman, and Slav Petrov. 2012. Syntactic annotations for the google books ngram corpus. In Proceedings of the ACL 2012 System Demonstrations, pages 169–174, Jeju Island, Korea, July. Association for Computational Linguistics. find
7. Mitchell P. Marcus, Beatrice Santorini, Mary Ann Marcinkiewicz, and Ann Taylor. 1999. Treebank-3. LDC99T42, Linguistic Data Consortium, Philadelphia. find
8. France Martineau et al. 2009. Modéliser le changement: les voies du français, a Parsed Corpus of Historical French. find
9. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In Proceedings of COLING-ACL, pages 433–440, Sydney, Australia, July. Association for Computational Linguistics. find our card
10. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2008. The Berkeley Parser. https://code.google.com/p/berkeleyparser/. ↗
11. Satoshi Sekine and Michael Collins. 2008. Evalb. http://nlp.cs.nyu.edu/evalb/. ↗
12. Ann Taylor, Anthony Warner, Susan Pintzuk, and Frank Beths. 2003. The York-Toronto-Helsinki Parsed Corpus of Old English Prose. Distributed through the Oxford Text Archive. http://www-users.york.ac.uk/˜lang22/YCOE/YcoeHome.htm. ↗
13. Ann Taylor, Arja Nurmi, Anthony Warner, Susan Pintzuk, and Terttu Nevalainen. 2006. Parsed Corpus of Early English Correspondence. Compiled by the CEEC Project Team. York: University of York and Helsinki: University of Helsinki. Distributed through the Oxford Text Archive. http://www-users.york.ac.uk/˜lang22/PCEEC-manual/index.htm. ↗
14. Joel Wallenberg, Anton Karl Ingason, Einar Freyr Sigursson, and Eirkur Rgnvaldsson. 2011. Icelandic Parsed Historical Corpus (IcePaHC) version 0.4. http://www.linguist.is/icelandic_treebank. ↗

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2014-kulick-penn-parsed-corpus-modern-british/