Improving Arabic Dependency Parsing with Lexical and Inflectional Morphological Features
What it is about
Marton, Habash and Rambow test which morphological and lexical features help a transition-based parser (MaltParser) on the Columbia Arabic Treebank (CATiB, converted from PATB part 3, gold segmentation). They compare POS tagsets from 6 to 430 tags and add inflectional features (definiteness, person, number, gender, case, state and others) and lexical features (undiacritized lemma, root, pattern) as separate parser attributes. With gold tags the richest tagset is best, but with predicted tags it loses most of its advantage (its tagging accuracy is 81.8%). The best result on predicted input comes from definiteness, the phi-features (person, number, gender) and the undiacritized lemma. On the test split it gives 79.06 labeled attachment against 77.29 for the CORE 12 baseline, a gain of 1.77 points. On gold input, case and state help most.
Ideas
- I1. Keep morphology out of the tag: pass definiteness and the phi-features as separate parser attributes, not as larger tags. Test this as an extra input to
gparse. - I2. For unpointed text, use the lemma without niqqud as a lexical feature. The paper finds this helps most on predicted input, which is the situation Mova is in.
- I3. Choose tag richness by its predicted accuracy and the parse gain together, not by gold scores. Run every tagset variant on predicted input and report both numbers.
- I4. Report error reduction per relation (subject, object, genitive, modifier), as the paper does, so that a feature is credited where it helps.
For Mova
I1 goes into The Noun, the Adjective and the Numeral (the article ה and the phi-features) and into the gparse input of tools/hbo. I2 goes into The lexicon and the unpointed mode of tools/hbo. I3 is a measurement rule for tools/hbo. I4 is the report format for tools/hbo evaluations.
Cite
@inproceedings{marton2010improving,
title = {{Improving Arabic Dependency Parsing with Lexical and Inflectional Morphological Features}},
author = {Marton, Yuval and Habash, Nizar and Rambow, Owen},
booktitle = {Proceedings of the NAACL HLT 2010 First Workshop on Statistical Parsing of Morphologically-Rich Languages},
year = {2010},
url = {https://aclanthology.org/W10-1402/}
}References
- Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of Computational Natural Language Learning (CoNLL), pages 149–164. find our card
- Timothy A. Buckwalter. 2004. Buckwalter Arabic Morphological Analyzer Version 2.0. Linguistic Data Consortium, University of Pennsylvania, 2002. LDC Cat alog No.: LDC2004L02, ISBN 1-58563-324-0. find
- Michael Collins, Jan Hajic, Lance Ramshaw, and Christoph Tillmann. 1999. A statistical parser for czech. In Proceedings of the 37th Annual Meeting of the the Association for Computational Linguistics (ACL), College Park, Maryland, USA, June. find
- Brooke Cowan and Michael Collins. 2005. Morphology and reranking for the statistical parsing of spanish. In Proceedings of Human Language Technology (HLT) and the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 795–802. find
- Mona Diab and Yassine BenAjiba. 2010. From raw text to base phrase chunks: The new generation of AMIRA Tools for the processing of Modern Standard Arabic. In (to appear). Spring LNCS, Special Jubilee edition. find
- Mona Diab. 2007. Towards an optimal pos tag set for modern standard arabic processing. In Proceedings of Recent Advances in Natural Language Processing (RANLP), Borovets, Bulgaria. find
- Gülsen Eryigit, Joakim Nivre, and Kemal Oflazer. 2008. Dependency parsing of turkish. Computational Linguistics, 34(3):357–389. find
- Nizar Habash and Owen Rambow. 2005. Arabic Tokenization, Part-of-Speech Tagging and Morphological Disambiguation in One Fell Swoop. In Proceedings of the 43rd Annual Meeting of the the Association for Computational Linguistics (ACL), Ann Arbor, Michigan, June. find our card
- Nizar Habash and Ryan Roth. 2009. Catib: The columbia arabic treebank. In Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pages 221– 224, Suntec, Singapore, August. find our card
- Nizar Habash, Abdelhadi Soudi, and Tim Buckwalter. 2007. On Arabic Transliteration. In A. van den Bosch and A. Soudi, editors, Arabic Computational Morphology: Knowledge-based and Empirical Methods. Springer. find
- Jan Hajič and Barbora Vidová-Hladká. 1998. Tagging Inflective Languages: Prediction of Morphological Categories for a Rich, Structured Tagset. In Proceedings of the International Conference on Computational Linguistics (COLING)- the Association for Computational Linguistics (ACL), pages 483–490. find
- Sandra Kübler, Ryan McDonald, and Joakim Nivre. 2009. Dependency Parsing. Synthesis Lectures on Human Language Technologies. Morgan and Claypool Publishers. find
- Seth Kulick, Ryan Gabbard, and Mitch Marcus. 2006. Parsing the Arabic Treebank: Analysis and improvements. In Proceedings of the Treebanks and Linguistic Theories Conference, pages 31–42, Prague, Czech Republic. find
- Mohamed Maamouri, Ann Bies, Timothy A. Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic Treebank: Building a Large-Scale Annotated Arabic Corpus. In Proceedings of the NEMLAR Conference on Arabic Language Resources and Tools, pages 102–109, Cairo, Egypt. find
- Ryan McDonald and Fernando Pereira. 2006. Online learning of approximate dependency parsing algorithms. In Proceedings of the 11th Conference of the the European Chapter of the Association for Computational Linguistics (EACL). find our card
- Joakim Nivre, Johan Hall, Jens Nilsson, Atanas Chanev, Gulsen Eryigit, Sandra Kubler, Svetoslav Marinov, and Erwin Marsi. 2007. MaltParser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(2):95–135. find
- Joakim Nivre, Igor M. Boguslavsky, and Leonid K. Iomdin. 2008. Parsing the SynTagRus Treebank of Russian. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 641–648. find
- Joakim Nivre. 2003. An efficient algorithm for projective dependency parsing. In Proceedings of the 8th International Conference on Parsing Technologies (IWPT), pages 149–160, Nancy, France. find our card
- Joakim Nivre. 2008. Algorithms for Deterministic Incremental Dependency Parsing. Computational Linguistics, 34(4). find our card
- Joakim Nivre. 2009. Parsing Indian languages with MaltParser. In Proceedings of the ICON09 NLP Tools Contest: Indian Language Dependency Parsing, pages 12–18. find
- Otakar Smrž. 2007. Functional Arabic Morphology. Formal System and Implementation. Ph.D. thesis, Charles University, Prague. find
- Reut Tsarfaty and Khalil Sima’an. 2007. Three-dimensional parametrization for parsing morphologically rich languages. In Proceedings of the 10th International Conference on Parsing Technologies (IWPT), pages 156–167, Morristown, NJ, USA. find
- Imed Zitouni, Jeffrey S. Sorensen, and Ruhi Sarikaya. 2006. Maximum Entropy Based Restoration of Arabic Diacritics. In Proceedings of the 21st International Conference on Computational Linguistics (COLING) and the 44th Annual Meeting of the the Association for Computational Linguistics (ACL), pages 577–584, Sydney, Australia. find our card
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2010-marton-improving-arabic-dependency-parsing-lexical/