Arabic Morphological Analyzer with Agglutinative Affix Morphemes and Fusional Concatenation Rules

What it is about

Concatenative Arabic analyzers list every prefix and suffix, including every combination of clitics, and their lexicons contain much redundancy and inconsistency. The authors treat each Arabic affix as fusional and agglutinative: a compound affix is a sequence of atomic affixes, and small rules say how two affixes combine. They add rules for affix-affix concatenation, including orthographic fusion (one character shorter than the concatenation) and gloss and POS substitution. Their refined lexicons, for the BAMA and SAMA analyzers, need 226 and 323 entries to replace 917 and 2,270 entries, after correcting 197 and 208 inconsistencies. Because the tags are attached per atomic affix, the correspondence between segments and tags is solved automatically, with 99.991% agreement with the ATB segmentation.

Ideas

• I1. Store affixes as atomic units plus a combination rule, not as a list of every compound. A Hebrew prefix chain (conjunction, preposition, article, then a stem) can be written as a few atomic prefixes, and the allowed chains follow from a short rule set, in place of an enumerated pre table in tools/hbo.
• I2. Keep fusion as data: each rule maps two atomic prefixes to one orthographic form and one gloss, with a wildcard for the stem. Any Hebrew fusion in the prefix chain (checked against the treebank first) goes into a small rule table with its examples.
• I3. Derive the segment-to-tag correspondence from the morpheme tags instead of aligning them by hand: the output tag for each segment comes from its atomic affix. Measure the agreement of tools/hbo output with the MACULA segmentation, the way the paper reports 99.991%, and count the mismatches.

For Mova

I1 and I2 apply to the prefix tables of tools/hbo and to Pronouns, particles and prepositions (the particle and clitic chain). I3 is a measure for macula compare and tools/hbo. The Arabic affix inventory itself does not transfer; only the design (atomic affixes, fusion as data) does.

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{zaraket2012arabic,
  title = {{Arabic Morphological Analyzer with Agglutinative Affix Morphemes and Fusional Concatenation Rules}},
  author = {Zaraket, Fadi and Makhlouta, Jad},
  booktitle = {Proceedings of COLING 2012: Demonstration Papers},
  year = {2012},
  url = {https://aclanthology.org/C12-3065/}
}

References

27 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Al-Jumaily, H., Martà nez, P., Martà nez-Fernà andez, J., and Van der Goot, E. (2011). A real time named entity recognition system for Arabic text mining. Language Resources and Evaluation, pages 1–21. find
2. Al-Sughaiyer, I. A. and Al-Kharashi, I. A. (2004). Arabic morphological analysis techniques: a comprehensive survey. American Society for Information Science and Technology, 55(3):189–213.  AlRajehi, A. (2000a). ø ñj JË @ ‡J J.¢ JË @ āltt.ibyq alnh.wy (The syntactical practice). Renaissance (nahda), first edition.  AlRajehi, A. (2000b). ú ¯ Qå ”Ë @ ‡J J.¢ JË @ āltt.ibyq als.arfy (The morphological practice). Renaissance (An-nahda), first edition. find
3. Aoe, J.-i. (1989). An efficient digital search algorithm by using a double-array structure. IEEE Transactions on Software Engineering, 15(9):1066–1077. find
4. Attia, M. A. (2006). An ambiguity-controlled morphological analyzer for modern standard arabic modelling finite state networks. In The Challenge of Arabic for NLP/MT Conference. The British Computer Society. find
5. Beesley, K. R. (2001). Finite-state morphological analysis and generation of Arabic at xerox research: Status and plans. In Workshop Proceedings on Arabic Language Processing: Status and Prospects, pages 1–8, Toulouse, France. find
6. Beesley, K. R. and Karttunen, L. (2003). Finite-State Morphology: Xerox Tools and Techniques. CSLI, Stanford. find
7. Benajiba, Y., Rosso, P., and Benedíruiz, J. (2007). ANERsys: An Arabic named entity recognition system based on maximum entropy. pages 143–153. find
8. Buckwalter, T. (2002). Buckwalter Arabic morphological analyzer version 1.0. Technical report, LDC catalog number LDC2002L49. find
9. Darwish, K. (2002). Building a shallow Arabic morphological analyzer in one day. In Proceedings of the ACL-02 workshop on Computational approaches to semitic languages. find
10. Grefenstette, G., Semmar, N., and Elkateb-Gara, F. (2005). Modifying a natural language processing system for european languages to treat arabic in information processing and information retrieval applications. In ACL Workshop on Computational Approaches to Semitic Languages, pages 31–37. find
11. Habash, N., Rambow, O., and Kiraz, G. (2005). Morphological analysis and generation for Arabic dialects. In Semitic ’05: Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages, pages 17–24, Morristown, NJ, USA. find our card
12. Habash, N., Rambow, O., and Roth, R. (2009). Mada+tokan: A toolkit for Arabic tokenization, diacritization, morphological disambiguation, pos tagging, stemming and lemmatization. In Choukri, K. and Maegaard, B., editors, Proceedings of the Second International Conference on Arabic Language Resources and Tools, Cairo, Egypt. The MEDAR Consortium. find
13. Habash, N. and Sadat, F. (2006). Arabic preprocessing schemes for statistical machine translation. In Proceedings of the North American Chapter of the Association for Computational Linguistics(NAACL), pages 49–52. find
14. Hajič, J. and Zemànek, P. (2004). Prague arabic dependency treebank: Development in data and tools. In NEMLAR International Conference on Arabic Language Resources and Tools, pages 110–117. find
15. Hunspell (2012). Hunspell manual page. find
16. Kulick, S., Bies, A., and Maamouri, M. (2010a). Consistent and flexible integration of morphological annotation in the Arabic treebank. In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC’10), Valletta, Malta. find
17. Kulick, S., Bies, A., and Maamouri, M. (2010b). Consistent and flexible integration of morphological annotation in the arabic treebank. In International Conference on Language Resources and Evaluation. European Language Resources Association. find
18. Lee, Y. K., Haghighi, A., and Barzila, R. (2011). Modeling Syntactic Context Improves Morphological Segmentation. In Conference on Computational Natural Language Learning (CoNLL). find
19. Lee, Y.-S., Papineni, K., Roukos, S., Emam, O., and Hassan, H. (2003). Language model based arabic word segmentation. In Association for Computational Linguistics, pages 399–406. find
20. Maamouri, M. and Bies, A. (2004). Developing an Arabic treebank: methods, guidelines, procedures, and tools. In Semitic ’04: Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages, pages 2–9. find our card
21. Maamouri, M., Bies, A., Kulick, S., Krouna, S., Gaddeche, F., and Zaghouani, W. (2010). Arabic treebank: Part 3 version 3.2. In Linguistic Data Consortium,LDC2010T08. find
22. Maamouri, M., Kulick, S., and Bies, A. (2008). Diacritic annotation in the arabic treebank and its impact on parser evaluation. In International Conference on Language Resources and Evaluation. find our card
23. Mosaad, Z. (2009). ¬Qå ”Ë @ ú ¯ Q g. ñË @ alwaǧyz fy als.arf (The Briefing of Morphology). As-Sahwa, first edition. find
24. Semmar, N., Meriama, L., and Fluhr, C. (2008). Evaluating a natural language processing approach in arabic information retrieval. In ELRA Workshop on Evaluation. find
25. Shaalan, K. F., Magdy, M., and Fahmy, A. (2010). Morphological analysis of ill-formed arabic verbs in intelligent language tutoring framework. In Applied Natural Language Processing, Florida Artificial Intelligence Research Society Conference. AAAI Press. find
26. Smrž, O. (2007). Elixirfm: implementation of functional Arabic morphology. In Semitic ’07: Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages, pages 1–8, Prague, Czech Republic. find our card
27. Spencer, A. (1991). Blackwell Textbooks in Linguistics. Vajda, E. J. Typology. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2012-zaraket-arabic-morphological-analyzer-agglutinative-affix/