A Finite-State Morphological Grammar of Hebrew

What it is about

The paper presents HAMSAH, a bidirectional morphological analyser and generator for Modern Hebrew, written as an XFST grammar over a lexicon of about 20,000 entries. The rules cover prefix particles, root-and-pattern stems, the weak paradigms, the feminine and plural suffixes and the spelling variants of undotted script. Irregular items are written as lexicon additions, replacements and removals, which are compiled into one network. On a sample of about 960 tokens of newspaper text, 91.9% received a correct analysis, 3.9% had no analysis and 4.3% had analyses but none correct; most missing analyses are out-of-lexicon proper names. The compiled network is about 4 MB and analyses 50–100 words per second.

Ideas

• I1. Irregular entries as overrides: keep a general lexicon and separate add, replace and remove lists, combined as (general minus remove), plus add, with replace taking priority. For irregular nouns and verbs in languages/hbo this gives one visible place for exceptions that the general rules should not see.
• I2. Idiosyncratic forms are listed rather than derived; the paper gives an adjective whose feminine does not follow the default h rule and records it as an exception. tools/hbo could keep such exceptions as explicit entries with a stated reason, so the analysis can say why it departs from the rule.
• I3. Reuse the paper's evaluation design: a random sample of about 1000 tokens, two human checkers, and three counts (no analysis, analysed but none correct, correct). Run it on the unpointed mode of tools/hbo and report the same three numbers with a date.

For Mova

I1 and I2 apply to irregular nouns in The Noun, the Adjective and the Numeral, to irregular verbs in The verb, and to the lexicon handling of tools/hbo. I3 is a measurement for tools/hbo in unpointed mode. The undotted ambiguity examples in the paper (the form ebth with its several parses) are a test set for 2. Script and spelling.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.3115/1621787.1621790

@inproceedings{yona2005finite,
  title = {{A Finite-State Morphological Grammar of Hebrew}},
  author = {Yona, Shlomo and Wintner, Shuly},
  booktitle = {Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages},
  year = {2005},
  doi = {10.3115/1621787.1621790},
  url = {https://doi.org/10.3115/1621787.1621790}
}

References

25 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Meni Adler. 2004. Word-based statistical language modeling: Two-dimensional approach. Thesis proposal, Ben Gurion University, Beer Sheva, April. find
2. Emmanuel Alon. 1995. Unvocalized Hebrew Writing: The Structure of Hebrew Words in Syntactic Context. Ben-Gurion University of the Negev Press. In Hebrew. find
3. Roy Bar-Haim. 2005. Part-of-speech tagging for Hebrew and other Semitic languages. Master’s thesis, Computer Science Department, Technion, Haifa, Israel. find
4. Shaul Barkali. 1962. Lux HaP’alim HaShalem (The Complete Verbs Table). Reuven Mass, Jerusalem. In Hebrew. find
5. Kenneth R. Beesley and Lauri Karttunen. 2003. Finite-State Morphology: Xerox Tools and Techniques. CSLI, Stanford. find
6. Kenneth R. Beesley. 1996. Arabic finite-state morphological analysis and generation. In Proceedings of COLING-96, the 16th International Conference on Computational Linguistics, Copenhagen. find
7. Kenneth R. Beesley. 1998. Arabic morphology using only finite-state operations. In Michael Rosner, editor, Proceedings of the Workshop on Computational Approaches to Semitic languages, pages 50–57, Montreal, Quebec, August. COLING-ACL’98. find our card
8. Kenneth R. Beesley. 2001. Finite-state morphological analysis and generation of Arabic at Xerox Research: Status and plans in 2001. In ACL Workshop on Arabic Language Processing: Status and Perspective, pages 1–8, Toulouse, France, July. find
9. Esther Bentur, Aviella Angel, Danit Segev, and Alon Lavie. 1992. Analysis and generation of the nouns inflection in Hebrew. In Uzzi Ornan, Gideon Arieli, and Edit Doron, editors, Hebrew Computational Linguistics, chapter 3, pages 36–38. Ministry of Science and Technology. In Hebrew. find
10. Yaacov Choueka. 1980. Computerized full-text retrieval systems and research in the humanities: The Responsa project. Computers and the Humanities, 14:153–169. find
11. Yaacov Choueka. 1990. MLIM - a system for full, exact, on-line grammatical analysis of Modern Hebrew. In Yehuda Eizenberg, editor, Proceedings of the Annual Conference on Computers in Education, page 63, Tel Aviv, April. In Hebrew. find
12. Haim A. Cohen. 1996. klalei ha-ktiv xasar ha-niqqud. leshonenu la&am, special edition, May. In Hebrew. find
13. Laura Kataja and Kimmo Koskenniemi. 1988. Finite-state description of Semitic morphology: A case study of Ancient Akkadian. In COLING, pages 313–315. find
14. George Anton Kiraz. 2000. Multitiered nonlinear morphology using multitape finite automata: a case study on Syriac and Arabic. Computational Linguistics, 26(1):77–105, March. find our card
15. Kimmo Koskenniemi. 1983. Two-Level Morphology: a General Computational Model for Word-Form Recognition and Production. The Department of General Linguistics, University of Helsinki. find
16. Alon Lavie, Alon Itai, Uzzi Ornan, and Mori Rimon. 1988. On the applicability of two-level morphology to the inflection of Hebrew verbs. In Proceedings of the International Conference of the ALLC, Jerusalem, Israel. find
17. Alon Lavie, Shuly Wintner, Yaniv Eytani, Erik Peterson, and Katharina Probst. 2004. Rapid prototyping of a transfer-based Hebrew-to-English machine translation system. In Proceedings of TMI-2004: The 10th International Conference on Theoretical and Methodological Issues in Machine Translation, Baltimore, MD, October. find our card
18. Uzzi Ornan and Wadim Kazatski. 1986. Analysis and synthesis processes in Hebrew morphology. In Proceedings of the 21 National Data Processing Conference. In Hebrew. find
19. Uzzi Ornan. 2003. The Final Word. University of Haifa Press, Haifa, Israel. In Hebrew. find
20. Ora Schwarzwald. 2001. Moden Hebrew, volume 127 of Languages of the World/Materials. LINCOM EU-ROPA. find
21. Ora Schwarzwald. 2002. Studies in Hebrew Morphology. The Open University of Israel. find
22. Erel Segal. 1997. Morphological analyzer for unvocalized hebrew words. Unpublished work, available from http://www.cs.technion.ac.il/-˜erelsgl/hmntx.zip. ↗
23. Erel Segal. 1999. Hebrew morphological analyzer for Hebrew undotted texts. Master’s thesis, Technion, Israel Institute of Technology, Haifa, October. In Hebrew. find
24. Shuly Wintner. 2004. Hebrew computational linguistics: Past and future. Artificial Intelligence Review, 21(2):113–138. find
25. Yizxaq Zdaqa. 1974. Luxot HaPoal (The Verb Tables). Kiryath Sepher, Jerusalem. In Hebrew. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2005-yona-finite-state-morphological-grammar-hebrew/