HELFI: a Hebrew-Greek-Finnish Parallel Bible Corpus with Cross-Lingual Morpheme Alignment
What it is about
A morpheme-level alignment between Hebrew, Greek and Finnish Bible text was first made by hand in 1991–1997 for a commercial Finnish concordance. The paper describes how the authors replaced its proprietary parts (the Hebrew morphology, the Greek text, the Finnish text analysis) with open resources, and released the alignment under CC BY 4.0 in 2018–2020. The alignment guidelines allow alignment across verse boundaries, non-contiguous groups, and an epsilon link for tokens that have no counterpart. Morphological glosses (person, suffix, modus, tense-aspect) are linked separately from lexical content by extractors. The main practical problem was tokenisation: the Hebrew morphologies split prefixes, suffixes and article differently, so Table 1 lists the mismatches and they were harmonised by hand.
Ideas
- I1. The tokenisation table is a list of the splits that differ between morphologies: the vav-consecutive prefix, the article, prepositions, and suffixes. Use the same cases as a gold test for the prefix and suffix tables (
pre,lex) of the segmenter intools/hbo. - I2. The epsilon link (no counterpart in the translation) is cleaner than forcing a gloss. Mova's Hebrew-to-English bridge should allow an explicit null link.
- I3. Keep morphological glosses separate from the lexical gloss, as the extractors do, so that the Hebrew verb analysis can be checked feature by feature.
For Mova
I1 is a test for tools/hbo (segmenter), where the mismatch cases are the first set to check. I2 and I3 go into 13. Biblical Hebrew in Mova: the tools (alignment between Hebrew and English) and The verb (verb glosses). The licence is NC, so the Finnish alignment is for reading only and never goes into a Mova release.
Cite
@inproceedings{ylijyra2020helfi,
title = {{HELFI: a Hebrew-Greek-Finnish Parallel Bible Corpus with Cross-Lingual Morpheme Alignment}},
author = {Yli-Jyrä, Anssi and Purhonen, Josi and Liljeqvist, Matti and Antturi, Arto and Nieminen, Pekka and Räntilä, Kari M. and Luoto, Valtter},
booktitle = {Proceedings of the Twelfth Language Resources and Evaluation Conference},
year = {2020},
url = {https://aclanthology.org/2020.lrec-1.522/}
}References
- Ahrenberg, L., Andersson, M., and Merkel, M. (2002). A system for incremental and interactive word linking. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02), pages 485– 490, Las Palmas, Canary Islands - Spain, May. European Language Resources Association (ELRA). find
- Ahrenberg, L., Merkel, M., and Petterstedt, M. (2003). Interactive word alignment for language engineering. In 10th Conference of the European Chapter of the Association for Computational Linguistics, Budapest, Hungary, April. Association for Computational Linguistics. find
- Ahrenberg, L. (2007). LinES: an English-Swedish parallel treebank. In Joakim Nivre, et al., editors, NODALIDA 2007 Conference Proceedings, pages 270–273. find our card
- Bow, C., Hughes, B., and Bird, S. (2003). Towards a general model of interlinear text. In Proc. EMELD 2003 (Workshop on Digitizing & Annotating Texts and Field Recordings), LSA Institute, Michigan State University. find
- Brown, P. F., Della Pietra, S. A., Della Pietra, V. J., and Mercer, R. L. (1993). The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263–311. find
- Carlson, K., Riddell, A., and Rockmore, D. N. (2018). Evaluating prose style transfer with the Bible. In Royal Society open science. find our card
- Christodouloupoulos, C. and Steedman, M. (2015). A massively parallel corpus: The Bible in 100 languages. Language Resources and Evaluation, 49(2):375–395, June. find
- Collins, B. J., Buller, B., and Kutsko, J. F. (2014). The SBL Handbook of Stule: for biblical studies and related disciplines. SBL Press, 2nd edition. find
- Comrie, B., Haspelmath, M., Bickel, B., and for Evolutional Anthropology, M. P. I. (2008). The Leipzig Glossing Rules: Conventions for Interlinear Morpheme-by-morphene Glosses. Max Planck Institute for Evolutionary Anthropology. find
- Cysouw, M. and Wälchli, B. (2007). Parallel texts: using translational equivalents in linguistic typology. STUF - language typology and universals, 60(2):95–99. find
- Cysouw, M., Biemann, C., and Ongyerth, M. (2007). Using Strong’s numbers in the Bible to test an automatic alignment of parallel texts. STUF - language typology and universals, 60(2):95–99. find
- Irene Doval et al., editors. (2019). Parallel Corpora for Contrastive and Translation Studies. John Benjamins. find
- Holmqvist, M. and Ahrenberg, L. (2011). A gold standard for English-Swedish word alignment. In Proceedings of the 18th Nordic Conf. of Computational Linguistics (NODAL-IDA 2011), pages 106–113, Riga, Latvia. Northern European Association for Language Technology (NEALT). find
- Jawaid, B. and Zeman, D. (2010). English-Urdu religious parallel corpus. LINDAT/CLARIN digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. find
- Lambert, P., De Gispert, A., Banchs, R., and Mariño, J. B. (2005a). Guidelines for word alignment evaluation and manual alignment. Language Resources and Evaluation, 39(4):267–285, Dec. find
- Lambert, P., de Gispert, A., Banchs, R. E., and Mariño, J. B. (2005b). Guidelines for word alignment evaluation and manual alignment. Language Resources and Evaluation, 39(4):267–285. find
- Lehmann, C. (1982). Directions for interlinear morphemic translations. Folia Linguistica, 16(1-4):199–224. find
- Li, J.-J., Kim, D.-I., and Lee, J.-H. (2008). Annotation guidelines for Chinese-Korean word alignment. In Proceedings of the Sixth International Conf. on Language Resources and Evaluation (LREC’08), Marrakech, Morocco. European Language Resources Association (ELRA). find
- Li, X., Ge, N., and Strassel, S. (2014). Guidelines for BOLT Chinese-English word alignment (version 2.0). Linguistic Data Consortium. Downloaded 21 February 2020 from https://www.ldc.upenn.edu/sites/www.ldc.upenn.edu/files/bolt-chinese-alignment-guidelines-v2.pdf. ↗
- Melamed, I. D. (1998a). Annotation style guide for the blinker project. Technical Report IRCS-98-06, University of Pennsylvania Inst. for Research in Cognitive Science. find
- Melamed, I. D. (1998b). Manual annotation of translational equivalence: The Blinker project. Technical Report IRCS-98-07, Institute for Research in Cognitive Science, University of Pennsylvania. find
- Merkel, M. (1999). Annotation style guide for the PLUG link annotator (version 1.0). Linköping University. find
- Mihalcea, R. and Pedersen, T. (2003). An evaluation exercise for word alignment. In Proc. HLT-NAACL 2003 Workshop on Building and Using Parallel Texts: Data Driven Machine Translation and Beyond, pages 1–10. find
- Nerbonne, J. (2000). Parallel texts in computer-assisted language learning. In Jean Véronis, editor, Parallel Text Processing: Alignment and Use of Translation Corpora, pages 299–311, Dordrecht. Springer Netherlands. find
- Nida, E. A. and Taber, C. R. (2003). The Theory and Practice of Translation. Brill, Leiden. find
- Resnik, P., Olsen, M. B., and Diab, M. (1998). Creating a parallel corpus from the ”Book of 2000 Tongues”. In Proc. Text Encoding Initiative Tenth Anniversary User Conference, Brown University, pages 33–129. find
- Samardžić, T., Schikowski, R., and Stoll, S. (2015). Automatic interlinear glossing as two-level sequence classification. In Proc. 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH), pages 68–72, Beijing, China, July. Association for Computational Linguistics. find
- Saphra, N. and Lopez, A. (2015). AMRICA: an AMR inspector for cross-language alignments. In Proc. 2015 Conf. of the North American Chapter of the Assoc. for Computational Linguistics: Demonstrations, pages 36–40, Denver, Colorado, June. Assoc. for Computational Linguistics. find
- Szymanski, T. (2012). Morphological Inference from Bitext for Resource-Poor Languages. Ph.D. thesis, University of Michigan. find
- Tiedemann, J. (2011). Bitext Alignment. Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers. find
- Tiedemann, J. (2012). Parallel data, tools and interfaces in OPUS. In Proc. 8th International Conference on Language Resources and Evaluation (LREC’2012). find
- Véronis, J. and Langlais, P. (2000). Evaluation of parallel text alignment systems. In Jean Véronis, editor, Parallel Text Processing: Alignment and Use of Translation Corpora, pages 369–388. Springer Netherlands, Dordrecht. find
- Xia, P. and Yarowsky, D. (2017). Deriving consensus for multi-parallel corpora: an English Bible study. In Proc. 8th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 448– 453, Taipei, Taiwan, November. Asian Federation of Natural Language Processing. find
- Yli-Jyrä, A. (1993). Towards alignment of bilingual texts. Presented at the 1993 NORFA Symposium, Copenhagen. find
- Yli-Jyrä, A. (1995). LinkPlus-ohjelman (versio 3.4) käyt-töohje. Unpublished. find
- Language Resources Elliger, K. and Rudolph, W. (1977). Biblia Hebraica Stuttgartensia. Deutsche Bibelgesellschaft, Stuttgart. find
- Gilbrant, T., Luoto, V., Polfus, D. A., and Nieminen, Pekka, editors. (1988). Iso Raamatun Tietosanakirja (The Finnish Bible Encyclopedia), volume s 1–10. Raamatun Tietokirja, Aika Oy Kristilliset Kirjat, Keuruu, Finland. find
- Kittel, R. (1913). Biblia Hebraica. J. C. Hinrichs, Leipzig. find
- Louw, J. P. and Nida, E. A. (1989). Greek-English Lexicon of the New Testament Based on Semantic Domains. United Bible Societies, New York, 2nd edition. find
- Luoto, V. and Liljeqvist, M., editors. (1998). Iso Raamatun Sanahakemisto, volume 3: kreikka-suomi sanakirja (Greek-Finnish Lexicon). Raamatun Tietokirja. find
- Luoto, V. and Liljeqvist, M., editors. (1999). Iso Raamatun Sanahakemisto, volume 4: heprea-suomi aramea-suomi sanakirja (Hebrew-Finnish Aramaic-Finnish Lexicon). Raamatun Tietokirja. find
- Luoto, V., Liljeqvist, M., Yli-Jyrä, A., Antturi, A., Nieminen, P., and Räntilä, K.M., editors. (1997). Iso Raamatun Sanahakemisto (The Finnish Analytical Bible Concordance), volumes 1–2. Raamatun Tietokirja, Aika Oy Kristilliset Kirjat, Keuruu, Finland. find
- Nestle, E. and Aland, K. (1979). The 26th Edition of the Nestle-Aland Novum Testamentum Graece. Deutche Bibelstiftung, Stuttgart. find
- Nestle, E. (1904). H Kainη ∆iaϑηkη (Greek New Testament); Text with Critical Apparatus. British and Foreign Bible Society. find
- Nestle, E. (1927). Novum Testamentum Graece / cum ap-paratu critico curavit D. Eberhard Nestle. Editionem ter-tiam decimam novis curis elaboravit Erwin Nestle. Privi-legierte Württembergische Bibelanstalt, Stuttgart. find
- Strong, J. (1890). The Exhaustive Concordance of the Bible. Jennings & Graham, Cincinnati. find
- Young, R. (1879). Analytical Concordance to the Bible. George Adam Young and Company, Edinburgh. find
- Kuno Åberg, editor. (1982). Bibelkonkordans till Nya Testamentet 1981. SkeabVerbum, Stockholm. find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2020-jyra-helfi-hebrew-greek-finnish-parallel/