A Gold Standard Corpus of Early Modern German

What it is about

The paper describes a hand-annotated gold standard sample of Early Modern German, taken from the GerManC corpus (1650–1800). It has 57,845 tokens from the North German region, one sample per genre and per 50-year period. Each token has a POS tag, a lemma and a normalised spelling. Two annotators worked on it. Agreement is 96.9% on normalised forms, 95.5% on lemmas and 91.6% on POS tags. POS agreement is lower in the earliest period (89.3%) than in the latest (93.1%). The authors plan to use the corpus to test modern tools on historical data, including the normalised layer.

Ideas

I1. en/src/morph.rs: keep the normalised spelling as its own layer next to the lemma, as this corpus does, so that the archaic mapping can be tested apart from the lemma step. Measure the lemma accuracy on the test split of an early-English set with and without this layer.
I2. en tag-eval: report tagging accuracy per period and per genre, not only overall, as the paper's period breakdown does. Use the same split on tools/gutenberg lessons from different centuries, and note the date of each run.
I3. Agreement ceiling: double-annotate about 500 archaic tokens and compute agreement on POS and lemma before tuning en morph-eval on them. This gives a ceiling for each historical test set.

For Mova

The chapters are 09. Early Modern and archaic forms and 06. Spelling rules: inflection, derivation, compounds and national standards. The code is en/src/morph.rs and the en tag-eval command. The corpus is German and NC, so no number from it can be used as an English figure, and it is for tests only.

Topics: Part-of-speech tagging

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{scheible2011gold,
  title = {{A Gold Standard Corpus of Early Modern German}},
  author = {Scheible, Silke and Whitt, Richard J. and Durrell, Martin and Bennett, Paul},
  booktitle = {Proceedings of the 5th Linguistic Annotation Workshop},
  year = {2011},
  url = {https://aclanthology.org/W11-0415/}
}

References

14 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

Alistair Baron and Paul Rayson. 2008. VARD 2: A tool for dealing with spelling variation in historical corpora. Proceedings of the Postgraduate Conference in Corpus Linguistics, Birmingham, UK. find our card
Douglas Biber and Edward Finegan. 1989. Drift and the evolution of English style: a history of three genres. Language 65. 487-517. find
Torsten Brants. 2000a. Inter-annotator agreement for a German newspaper corpus. Second International Conference on Language Resources and Evaluation (LREC 2000), Athens, Greece. find
Torsten Brants. 2000b. TnT – a statistical part-of-speech tagger. Proceedings of the 6th Applied NLP Conference, ANLP-2000, Seattle, WA. find our card
Hamish Cunningham, Diana Maynard, Kalina Bontcheva, and Valentin Tablan. 2002. GATE: A framework and graphical development environment for robust NLP tools and applications. Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics. find
Stefanie Dipper. 2010. POS-Tagging of historical language data: First experiments in semantic approaches in Natural Language Processing. Proceedings of the 10th Conference on Natural Language Processing (KONVENS-10). Saarbrücken, Germany. 117-121. find
Andrea Ernst-Gerlach and Norbert Fuhr. 2006. Generating search term variants for text collections with historic spellings. Proceedings of the 28th European Conference on Information Retrieval Research (ECIR 2006), London, UK. find
Vera Fasshauer. 2011. http://www.indogermanistik.uni-jena.de/index.php?auswahl=184 Accessed 30/03/2011. ↗
Bryan Jurish. 2010. Comparing canonicalizations of historical German text. Proceedings of the 11th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology (SIGMORPHON), Uppsala, Sweden. 72-77. find
Thomas Pilz and Wolfram Luther. 2009. Automated support for evidence retrieval in documents with non-standard orthography. The Fruits of Empirical Linguistics. Sam Featherston and Susanne Winkler (eds.). 211–228. find
Paul Rayson, Dawn Archer, Alistair Baron, Jonathan Culpeper, and Nicholas Smith. 2007. Tagging the Bard: Evaluating the accuracy of a modern POS tagger on Early Modern English corpora. Proceedings of the Corpus Linguistics Conference (CL2007), University of Birmingham, UK. find
Silke Scheible, Richard J. Whitt, Martin Durrell, and Paul Bennett. 2010. Annotating a Historical Corpus of German: A Case Study. Proceedings of the LREC 2010 Workshop on Language Resources and Language Technology Standards, Valletta, Malta. find
Anne Schiller, Simone Teufel, Christine Stöckert, and Christine Thielen. 1999. Guidelines für das Tagging deutscher Textcorpora mit STTS. Technical Report. Institut für maschinelle Sprachverarbeitung, Stuttgart. find
Helmut Schmid. 1994. Probabilistic part-of-speech tagging using decision trees. International Conference on New Methods in Language Processing, Manchester, UK. 44–49. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2011-scheible-gold-standard-corpus-early-modern/