Mova0.5 pre-release⌕
☰
home / docs / papers / Semitic languages / Fine-Grain Morphological Analyzer and Part-of-Speech Tagger for Arabic Text

Fine-Grain Morphological Analyzer and Part-of-Speech Tagger for Arabic Text

What it is about

The authors argue that a tagger for Arabic should use a very fine-grained tag set, since many features (person, number, gender, case, mood, voice, definiteness, and more) help both analysis and later use of the corpus. They define a fixed-length tag of 22 positions: each position is one feature, a dash marks a feature that does not apply, and a question mark marks one that is relevant but unknown. The analyzer splits each word into proclitics and prefixes, stem, and suffixes and enclitics, using lists of 220 prefix and 341 suffix entries; it finds the root and pattern (2,730 verb and 985 noun patterns), restores the vowels, and combines the morpheme tags into a word tag. A broad-coverage lexicon built from 23 traditional Arabic dictionaries is used for roots. The lemmatizer was run on a 100-million-word web corpus on a grid, with a spelling check based on valid letter and diacritic combinations. About 85% of words found a lexicon entry on a 1-million-word sample, the Quran and a contemporary corpus. A gold standard of 78,004 Quran words was built for the MorphoChallenge 2009 evaluation. The text gives no tagging accuracy figure.

Ideas

For Mova

I1 goes into 1. Script and pointing and tools/hbo (pointed mode). I2 is an output format for tools/macula and tools/hbo, recorded in 13. Biblical Hebrew in Mova: the tools. I3 is a table for the segmenter in tools/hbo, with its coverage measured as a test.

Topics: Part-of-speech tagging

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{sawalha2010fine,
  title = {{Fine-Grain Morphological Analyzer and Part-of-Speech Tagger for Arabic Text}},
  author = {Sawalha, Majdi and Atwell, Eric},
  booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
  year = {2010},
  url = {https://aclanthology.org/L10-1196/}
}

References

28 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Alqrainy, S. (2008). A Morphological-Syntactical Analysis Approach for Arabic Textual Tagging, by Shihadeh Alqrainy. School of Computing, De Montfort University. Doctor of Philosophy in Computer Science: 197. find
  2. Al-Shamsi, F., Guessoum, A. (2006). A Hidden Markov Model-Based POS Tagger for Arabic. 8es Journees internationales d'Analyse statistique des Donnees Textuelles. find
  3. Al-Suliti, L., Atwell, E. (2006). The design of a corpus of contemporary Arabic. International Journal of Corpus Linguistics 11, pp.135--171. find
  4. Atwell, E. (2008). Development of tag sets for part-of-speech tagging. In Anke Ludeling and Merja Kyto (eds.), Corpus Liuistics: An International Handbook Volume 1 501-526 Mouton de Gruyter. find
  5. Atwell, E., Demetriou, G., Hughes, J., Schiffrin, A., Souter, C., Wilcock, S. (2000). A comparative evaluation of modern English corpus grammatical annotation schemes. ICAME Journal, International Computer Archive of Modern and medieval English, Bergen 24, pp. 7--23. find
  6. Benajiba, Y., Diab, M., Rosso, P. (2008) Arabic named entity recognition using optimized feature sets. EMNLP '08: Proceedings of the Conference on Empirical Methods in Natural Language Processing, Honolulu, Hawaii: Association for Computational Linguistics, pp.284--293 find
  7. Brill, E. (1995). Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging. Computational Linguistics 21, pp.543--565. find
  8. Diab, M. (2007). Towards an Optimal POS Tag Set for Arabic Processing. Proc RANLP. find
  9. Diab, M., Hacioglu, K., Jurafsky, D. (2004). Automatic Tagging of Arabic Text: From raw text to Base Phrase Chunks. Proceedings of HLT-NAACL Diwan, A. (2004) al-mu‘ğam an-naḥwῑ li-mufradāt al-luḡa h al- ‘arabiyya h ﺔﻴﺑﺮﻌﻟﺍ ﺔﻐﻠﻟﺍ ﺕﺍﺩﺮﻔﳌ ﻱﻮﺤﻨﻟﺍ ﻢﺠﻌﳌﺍ , Aleppo, Syria: fusselat lil-dirasāt wa at-tarğamah wa an-našir. find
  10. Dror, J., Shaharabani, D., Talmon, R., Wintner, S. (2004). Morphological Analysis of the Qur'an. Literary and Linguistic Computing 19, 431-452. find
  11. Duh, K., Kirchhoff, K. (2005). POS Tagging of Dialectal Arabic: A Minimally Approach. ACL-05, Computational Approaches to Semitic Languages Workshop Proceedings, pp.55--62. University of Michigan Ann Arbor, Michigan, USA. find
  12. Elliott, J., Atwell, E. (2000) Is anybody out there?: the detection of intelligent and generic language-like features. Journal of the British Interplanetary Society, 53, pp.13--22. find
  13. Freeman, A. (2001). Brill's POS Tagger and a Morphology Parser for Arabic. NAACL 2001 Student Rersearch Workshop. find
  14. Habash, N., Rambow, O. (2005). Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics. Ann Arbor, Michigan, Association for Computational Linguistics. find our card
  15. Harmain, H. (2004). Arabic Part-of-Speech Tagging. The Fifth Annual U.A.E. University Research Conference. United Arab Emirats. find
  16. Khoja, S. (2001). APT: Arabic Part-of-Speech Tagger. Student Workshop at the Second Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL2001), Carnegie Mellon University, Pittsburgh, Pennsylvania. find
  17. Marsi, E., Bosch, A., Soudi, A. (2005). Memory-based morphological analysis generation and part-of-speech tagging of Arabic. Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages 1-8. Ann Arbor: Association for Computational Linguistics. find our card
  18. Sawalha, M., Atwell, E. (2010). Constructing and Using Broad-Coverage Lexical Resource for Enhancing Morphological Analysis of Arabic. find
  19. Language Resource and Evaluation Conference LREC 2010 Valleta, Malta: 19-21 May 2010. find
  20. Sawalha, M., Atwell, E. (2009a). Linguistically Informed and Corpus Informed Morphological Analysis of Arabic. Proceedings of the 5th International Corpus Linguuistics Conference CL2009 Liverpool, UK. find
  21. Sawalha, M., Atwell, E. (2009b). فرصلاو وحنلا دعاوق فيظوت ةيبرعلا ةغلل يفرص للحم ءانب يف (Adapting Language Grammar Rules for Building Morphological Analyzer for Arabic Language). Proceedings of the workshop of morphological analyzer experts for Arabic language, organized by Arab League Educational, Cultural and Scientific Organization (ALECSO), King Abdul-Aziz City of Technology ( KACT) and Arabic Language Academy. Damascus, Syria. find
  22. Sawalha, M., Atwell, E. (2008). Comparative evaluation of Arabic language morphological analysers and stemmers. Proceedings of COLING 2008 22nd International Conference on Comptational Linguistics. find
  23. Schmid, H., Laws, F. (2008). Estimation of Conditional Probabilities with Decision Trees and an Application to Fine-Grained POS Tagging. COLING'08 Manchester, UK. find
  24. Talmon, R., Wintner, S. (2003). Morphological Tagging of the Qur'an. In Proceedings of the Workshop on Finite-State Methods in Natural Language Processing, an EACL'03 Workshop Budapest, Hungary: April 2003. find
  25. Teahan, B. (1998). Modelling English Text. PhD Thesis, Department of Computer Science, University of Waikato, New Zealand. find
  26. Tlili-Guiassa, Y. (2006). Hybrid Method for Tagging Arabic Text. Journal of Computer Science 2(3): pp.245--248 find
  27. Voutilainen, Atro (2003). Part-of-Speech Taging. In Ruslan Mitkov (Ed.), The Oxford Handbook of Computational Linguistics. Oxford University Press. pp. 219--232 find
  28. Zibri, C., Torjmen, A., Ahmad, M. (2006). An Efficient Multi-agent system Combining POS-Taggers for Arabic Texts. CICLing 2006, LNCS 3878. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2010-sawalha-fine-grain-morphological-analyzer-part/