Part-of-Speech Tagging for Middle English through Alignment and Projection of Parallel Diachronic Texts
What it is about
The paper builds a Middle English tagger without hand-tagged data. Modern English text is tagged by a maximum-entropy tagger trained on the Wall Street Journal. The tags are projected to Middle English Wycliffe Bible text through word alignments of parallel verses. A bigram tagger cleans the projected tags, and a second maximum-entropy tagger is trained on the WSJ text and the cleaned Middle English text. On Biblical test text it reaches 84.8% accuracy for coarse tags, against a baseline of 63.4%. Other Middle English texts stay in the 60s. About 600 hand-labelled sentences were needed to match the best bootstrapped line.
Ideas
- I1.
en/src/ptag.rsandtools/treeagree: project tags fromenonto a verse-aligned parallel text (for example, a translation of a tools/gutenberg lesson), then train the perceptron on the projected tags. Measure accuracy on held-out lessons against the baseline of the current tagger. - I2. Noise filter: keep only projected tags where the alignment and a bigram check agree, as the paper's cleanup does. Decide by
en folds, not by one run. - I3. Learning curve as a planning tool: plot tagging accuracy against the number of hand-labelled sentences, as the paper does, before adding a new historical book to tools/gutenberg. Run it first on the EWT dev section to test the method.
For Mova
The chapters are 09. Early Modern and archaic forms and 10. Word classes. The code is en/src/ptag.rs and tools/treeagree. The PPCME data is NC: use it only for tests. Measure first how many tokens of a verse-aligned lesson keep the same tag after projection.
Cite
@inproceedings{moon2007part,
title = {{Part-of-Speech Tagging for Middle English through Alignment and Projection of Parallel Diachronic Texts}},
author = {Moon, Taesun and Baldridge, Jason},
booktitle = {Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)},
year = {2007},
url = {https://aclanthology.org/D07-1041/}
}References
- Eric Brill. 1995. Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging. Computational Linguistics, 21(4):543–565. find
- Helena Britto, Marcelo Finger, and Charlotte Galves, 2002. Computational and linguistic aspects of the construction of The Tycho Brahe Parsed Corpus of Historical Portuguese. Tübingen: Narr. find
- Peter A. Chew, Steve J. Verzi, Travis L. Bauer, and Jonathan T. McClain. 2006. Evaluation of the bible as a resource for cross-language information retrieval. In Proceedings of the Workshop on Multilingual Language Resources and Interoperability, Sydney, July 2006, pages 68–74. find
- James R Curran and Stephen Clark. 2003. Investigating gis and smoothing for maximum entropy taggers. In Proceedings of the 11th Meeting of the European Chapter of the Association for Computational Linguistics (EACL-03). find
- Lee R. Dice. 1945. Measures of the amount of ecologic association between species. Journal of Ecology, 26:297–302. find
- Elliott Franco Drábek and David Yarowsky. 2005. Induction of fine-grained part-of-speech taggers via classifier combination and crosslingual projection. In Proceedings of the ACL Workshop on Building and Using Parallel Texts, pages 49–56, Ann Arbor, Michigan, June. Association for Computational Linguistics. find
- Barbara A. Fennell. 2001. A History of English: A Sociolinguistic Approach. Blackwell, Oxford. find
- Chung-Hye Han, 2000. The Evolution of Do-Support In English Imperatives, pages 275–295. Oxford University Press. find
- Martin Kay and Martin Röscheisen. 1993. Text-translation alignment. Computational Linguistics, 19(1):121–142. find
- Anthony Kroch and Ann Taylor. 2000. Penn-helsinki parsed corpus of middle english, second edition. find
- Anthony Kroch, Ann Taylor, and Donald Ringe. 2000. The middle english verb-second constraint: A case study in language contact and language change. Amsterdam Studies in the Theory and History of Linguistic Science Series, 4:353–392. find
- Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1994. Building a large annotated corpus of english: The penn treebank. Computational Linguistics, 19(2):313–330. find our card
- Dan I. Melamed. 1998. Manual annotation of translation equivalence: The blinker project. In Technical Report 98-07, Institute for Research in Cognitive Science, Philadelphia. find
- Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19–51. find
- Sylwia Ozdowska. 2006. Projecting pos tags and syntactic dependencies from english and french to polish in aligned corpora. In EACL 2006 Workshop on Cross-Language Knowledge Induction. find
- Adwait Ratnaparkhi. 1996. A maximum entropy model for part-of-speech tagging. In Eric Brill and Kenneth Church, editors, Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 133–142. Association for Computational Linguistics, Somerset, New Jersey. find
- Philip Resnik, Mari Broman Olsen, and Mona Diab. 1999. The bible as a parallel corpus: Annotating the ”book of 2000 tongues”. Computers and the Humanities, 33(1–2):129–153. find
- David Yarowsky and Grace Ngai. 2001. Inducing multilingual pos taggers and np bracketers via robust projection across aligned corpora. In NAACL ’01: Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001, pages 1–8, Morristown, NJ, USA. Association for Computational Linguistics. find
- David Yarowsky, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In HLT ’01: Proceedings of the first international conference on Human language technology research, pages 1–8, Morristown, NJ, USA. Association for Computational Linguistics. find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2007-moon-part-speech-tagging-middle-english/