Morphological Annotation of Quranic Arabic

What it is about

The paper describes how the Quranic Arabic Corpus got its morphological layer: segmentation of each word into stem and affixes, with a part-of-speech tag and inflectional features per segment, following the traditional Arabic grammar tradition. The text is fully vowelized, which the authors use: they extend the Buckwalter analyzer (BAMA) with spelling variants, rank its candidate analyses by the edit distance between their diacritics and the Quranic diacritics, and take the closest one. Annotation then goes in stages: two manual passes by annotators (one full-time paid reviewer, then a linguist), and finally online corrections by volunteers, about 2,000 of them. The automatic step gives an analysis for 67,516 of 77,430 words; measured against the reviewed result it reaches about 72% recall, 83% precision and 77% F-measure. The first manual pass changed 21,550 words (28%), the second 1,014 (1.3%).

Ideas

• I1. Diacritic edit-distance ranking as a filter for pointed text: among the analyses an analyzer returns for a word, keep those whose vowel points are closest to the input points, after normalizing spelling variants. Test in the pointed mode of tools/hbo on held-out MACULA chapters, with and without the filter, and report both numbers.
• I2. Measure the annotation effort, not only accuracy: report, per stage, how many words each stage changed (automatic, first reviewer, second reviewer, community). Use the same table for every new tools/hbo or macula output, so a gain is read as "fewer words revised", as in the paper's Figure 8.
• I3. Segment-level tags with a traditional-grammar label set: each prefix, stem and suffix gets its own tag (conjunction, preposition, article, pronoun), and the word tag is the combination. The same split is useful for the Hebrew clitics w-, h-, l-, b-, k-, m- in macula compare and in the segmenter's tables.

For Mova

I1 goes into tools/hbo (pointed mode) and 1. Script and pointing (the points and their variants). I2 is a measure for tools/hbo and a row in 13. Biblical Hebrew in Mova: the tools. I3 belongs in tools/macula (segment tags) and Pronouns, particles and prepositions (clitic particles).

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.63317/4b87kwj4mt83

@inproceedings{dukes2010morphological,
  title = {{Morphological Annotation of Quranic Arabic}},
  author = {Dukes, Kais and Habash, Nizar},
  booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
  year = {2010},
  doi = {10.63317/4b87kwj4mt83},
  url = {https://doi.org/10.63317/4b87kwj4mt83}
}

References

24 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Joyce Akesson (2001). Arabic Morphology and Phonology: Based on the Marah Al-Arwah by Ahmad b. 'Ali Mas'ud. Brill. find
2. Tim Buckwalter (2002). Buckwalter Arabic Morphological Analyzer version 1.0. Linguistic Data Consortium, University of Pennsylvania. find
3. Judith Dror, Dudu Shaharabani, Rafi Talmon and Shuly Wintner (2004). Morphological Analysis of the Qur'an. Literary and Linguistic Computing, 19(4):431-452, 2004. find
4. Kais Dukes, Eric Atwell and Abdul-Baquee M. Sharaf (2010). Syntactic Annotation Guidelines for the Quranic Arabic Treebank. In Proceedings of the Language Resources and Evaluation Conference (LREC 2010). Valletta, Malta. find
5. Kais Dukes and Tim Buckwalter (2010). A Dependency Treebank of the Quran using Traditional Arabic Grammar. In Proceedings of the 7th international conference on Informatics and Systems. Cairo, Egypt. find
6. Geert-Jan Kruijff (2006). Dependency grammar. The Encyclopedia of Language and Linguistics 2nd edition, Elsevier Publishers. find
7. Moustafa Elshafei, Husni Al-Muhtaseb, and Mansour Alghamdi (2006). Machine Generation of Arabic Diacritical Marks. In Proceedings of the International Conference on Machine Learning; Models, Technologies & Applications. find
8. Wolfdietrich Fischer and Jonathan Rodgers (2002). A Grammar of Classical Arabic: Third Revised Edition. Yale University Press. find
9. Nizar Habash. (2007) “Arabic Morphological Representations for Machine Translation.” Book Chapter. In Arabic Computational Morphology: Knowledge-based and Empirical Methods. Editors Antal van den Bosch and Abdelhadi Soudi. find
10. Nizar Habash and Owen Rambow. (2005) Arabic Tokenization, Morphological Analysis, and Part-of-Speech Tagging in One Fell Swoop. In Proceedings of the Conference of the Association for Computational Linguistics (ACL’05), Ann Arbor, MI. find
11. Nizar Habash and Ryan Roth (2009). CATiB: the Columbia Arabic Treebank. In Proceedings of (ACL’09), Suntec, Singapore. find our card
12. John A. Haywood and H. M. Nahmad (2005). A New Arabic Grammar of the Written Language. Lund Humphries Publishers. find
13. Alan Jones (2005). Arabic Through the Qur'an. Islamic Texts Society. find
14. Mohamed Maamouri, Ann Bies and Tim Buckwalter (2004). The Penn Arabic Treebank: Building a large-scale annotated Arabic corpus. In NEMLAR Conference on Arabic Language Resources and Tools, Cairo, Egypt. find
15. Ebrahim Muhammad (2007). From the Treasures of Arabic Morphology. Zam Zam Publishers. find
16. Abdullah Abbas Nadwi (2006). Vocabulary of the Holy Quran. Millat Book Centre. find
17. Abdul Mannan Omar (2005). Dictionary of the Holy Quran. Noor Foundation International. find
18. Jamal-Un-Nisa Bint Rafai (1998). Basic Quranic Arabic Grammar. Ta-Ha Publishers Ltd. find
19. Jonathan Owens (1988) The Foundations of Grammar: An Introduction to Medieval Arabic Grammatical Theory. John Benjamins Publishers. find
20. Karin C. Ryding (2008). A reference grammar of Modern Standard Arabic. Cambridge University Press. find
21. Abdur Rashid Siddiqui (2008). Quranic Keywords: A Reference Guide. The Islamic Foundation. find
22. Otakar Smrž and Jan Hajič (2006). The Other Arabic Treebank: Prague Dependencies and Functions. In Arabic Computational Linguistics: Current Implementations, CSLI Publications. find
23. Jane Wightwick and Mahmoud Gaafar (2008). Arabic Verbs and Essentials of Grammar. McGraw-Hill. find
24. Shuly Wintner (2008). Strengths and weaknesses of finite-state technology: a case study in morphological grammar development. Natural Language Engineering 14(4):457-469. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2010-dukes-morphological-annotation-quranic-arabic/