Dependency Parsing of Modern Standard Arabic with Lexical and Inflectional Features
What it is about
The paper asks which morphological features help dependency parsing of MSA, using CATiB trees and two transition-based parsers (MaltParser and Easy-First). Each feature set is tested under gold tags and under predicted tags. Finer tag sets help with gold tags but hurt when the tags are predicted; the coarse six-tag CATiB set is predicted most accurately and wins in that condition. Definiteness, person, number, gender and the undiacritized lemma help with predicted input. Functional gender and number (broken plurals, which are over half of the plurals in their training data) and rationality beat the form-based values. Case helps with gold tags but is the worst feature when predicted, because it is rarely written. Training on gold plus predicted features (g+p) improves parsing with predicted input, and the findings hold for both parsers.
Ideas
- I1. Undiacritized lemma as the lexical feature in unpointed mode. For
gparseinput fromtools/hbo, use the consonantal lemma rather than the pointed one, and test both in the predicted condition. The paper's best lexical feature has half the error rate of the diacritized lemma. - I2. Functional number and gender for Hebrew nouns with irregular plurals or with a suffix that does not match the form. Keep a table in The Noun, the Adjective and the Numeral and let adjectives agree with the functional values. Test: adjective-noun agreement on
treebanks/hbo/ptnk. - I3. Train on gold and predicted tags together. The
gparsetraining set adds thetools/hbopredictions for the same sentences. Compare it with gold-only training under predicted input; run twice to show the result is deterministic. - I4. Choose the tag set by measured accuracy and relevance together. Do not use case vowels, which are absent from unpointed text, as a feature in predicted mode. Compare a coarse and a fine tag set on predicted input in
tools/hbo.
For Mova
I1 goes into tools/hbo (unpointed mode) and the gparse features. I2 is a table in The Noun, the Adjective and the Numeral. I3 is a training run of gparse, and I4 is a comparison of tag sets in tools/hbo, reported with The verb for the verb features.
Cite
@article{marton2013dependency,
title = {{Dependency Parsing of Modern Standard Arabic with Lexical and Inflectional Features}},
author = {Marton, Yuval and Habash, Nizar and Rambow, Owen},
journal = {Computational Linguistics},
year = {2013},
doi = {10.1162/coli\_a\_00138},
url = {https://doi.org/10.1162/coli_a_00138}
}References
- Alkuhlani, Sarah and Nizar Habash. 2011. A corpus for modeling morpho-syntactic agreement in Arabic: Gender, number and rationality. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL), pages 357–362, Portland, OR. find our card
- Alkuhlani, Sarah and Nizar Habash. 2012. Identifying broken plurals, irregular gender, and rationality in Arabic text. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 675–685, Avignon. find our card
- Buchholz, Sabine and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of Computational Natural Language Learning (CoNLL), pages 149–164, New York, NY. find our card
- Buckwalter, Timothy A. 2004. Buckwalter Arabic Morphological Analyzer Version 2.0. Linguistic Data Consortium, University of Pennsylvania, 2002. LDC Catalog No.: LDC2004L02, ISBN 1-58563-324-0. find
- Collins, Michael, Jan Hajic, Lance Ramshaw, and Christoph Tillmann. 1999. A statistical parser for Czech. In Proceedings of the 37th 23 Available for downloading at http://www1.ccls.columbia.edu/ CATiB/parser. Annual Meeting of the Association for Computational Linguistics (ACL), pages 505–512, College Park, MD. ↗
- Cowan, Brooke and Michael Collins. 2005. Morphology and reranking for the statistical parsing of Spanish. In Proceedings of Human Language Technology (HLT) and the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 795–802, Morristown, NJ. find
- Dada, Ali. 2007. Implementation of Arabic numerals and their syntax in GF. In Proceedings of the Workshop on Computational Approaches to Semitic Languages, pages 9–16, Prague. find
- Diab, Mona. 2007. Towards an optimal POS tag set for modern standard Arabic processing. In Proceedings of Recent Advances in Natural Language Processing (RANLP), pages 91–96, Borovets. Diab, Mona and Yassine Benajiba. (in preparation). From raw text to base phrase chunks: The new generation of AMIRA Tools for the processing of Modern Standard Arabic. find
- Diab, Mona, Kadri Hacioglu, and Daniel Jurafsky. 2004. Automatic tagging of Arabic text: From raw text to base phrase chunks. In Proceedings of the 4th Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL) - Human Language Technology (HLT), pages 149–152, Boston, MA. find
- Eryigit, Gülsen, Joakim Nivre, and Kemal Oflazer. 2008. Dependency parsing of Turkish. Computational Linguistics, 34(3):357–389. find
- Goldberg, Yoav and Michael Elhadad. 2010. An efficient algorithm for easy-first non-directional dependency parsing. In Proceedings of Human Language Technology (HLT): The North American Chapter of the Association for Computational Linguistics (NAACL), pages 742–750, Los Angeles, CA. find
- Green, Spence and Christopher D. Manning. 2010. Better Arabic parsing: Baselines, evaluations, and analysis. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING), pages 394–402, Beijing. find our card
- Habash, Nizar. 2010. Introduction to Arabic Natural Language Processing. Morgan & Claypool Publishers. find
- Habash, Nizar, Reem Faraj, and Ryan Roth. 2009. Syntactic Annotation in the Columbia Arabic Treebank. In Proceedings of MEDAR International Conference on Arabic Language Resources and Tools, pages 125–135, Cairo. find
- Habash, Nizar, Ryan Gabbard, Owen Rambow, Seth Kulick, and Mitch Marcus. 2007. Determining case in Arabic: Learning complex linguistic behavior requires complex linguistic features. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 1,084–1,092, Prague. find
- Habash, Nizar and Owen Rambow. 2005. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL), pages 573–580, Ann Arbor, MI. find our card
- Habash, Nizar, Owen Rambow, and Ryan Roth. 2012. MADA+TOKAN Manual. Technical Report CCLS-12-01, Columbia University, New York, NY. find
- Habash, Nizar and Ryan Roth. 2009. CATiB: The Columbia Arabic treebank. In Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pages 221–224, Suntec. find our card
- Habash, Nizar, Abdelhadi Soudi, and Tim Buckwalter. 2007. On Arabic transliteration. In A. van den Bosch and A. Soudi, editors, Arabic Computational Morphology: Knowledge-based and Empirical Methods, pages 15–22. Springer, Berlin. find
- Hajič, Jan and Barbora Vidová-Hladká. 1998. Tagging inflective languages: Prediction of morphological categories for a rich, structured tagset. In Proceedings of the International Conference on Computational Linguistics (COLING) - the Association for Computational Linguistics (ACL), pages 483–490, Stroudsburg, PA. find
- Hohensee, Matt and Emily M. Bender. 2012. Getting more from morphology in multilingual dependency parsing. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 315–326, Montréal. find
- Kübler, Sandra, Ryan McDonald, and Joakim Nivre. 2009. Dependency Parsing. Synthesis Lectures on Human Language Technologies. Morgan and Claypool Publishers. find
- Kulick, Seth, Ryan Gabbard, and Mitch Marcus. 2006. Parsing the Arabic Treebank: Analysis and improvements. In Proceedings of the Treebanks and Linguistic Theories Conference, pages 31–42, Prague. find
- Maamouri, Mohamed, Ann Bies, Timothy A. Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic Treebank: Building a large-scale annotated Arabic corpus. In Proceedings of the NEMLAR Conference on Arabic Language Resources and Tools, pages 102–109, Cairo. find
- Marton, Yuval, Nizar Habash, and Owen Rambow. 2010. Improving Arabic dependency parsing with inflectional and lexical morphological features. In Proceedings of Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL) at the 11th Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL) - Human Language Technology (HLT), pages 13–21, Los Angeles, CA. find
- Marton, Yuval, Nizar Habash, and Owen Rambow. 2011. Improving Arabic dependency parsing with lexical and inflectional surface and functional features. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL), pages 1,586–1,596, Portland, OR. find
- McClosky, David, Eugene Charniak, and Mark Johnson. 2006. Effective self-training for parsing. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL) - Human Language Technology (HLT), pages 152–159, Brooklyn, New York. find our card
- Nilsson, Jens and Joakim Nivre. 2008. MaltEval: An evaluation and visualization tool for dependency parsing. In Proceedings of the sixth Conference on Language Resources and Evaluation (LREC), pages 161–166, Marrakech. find
- Nivre, Joakim. 2003. An efficient algorithm for projective dependency parsing. In Proceedings of the 8th International Conference on Parsing Technologies (IWPT), pages 149–160, Nancy. find our card
- Nivre, Joakim. 2008. Algorithms for deterministic incremental dependency parsing. Computational Linguistics, 34(4):513–553. find our card
- Nivre, Joakim. 2009. Parsing Indian languages with MaltParser. In Proceedings of the ICON09 NLP Tools Contest: Indian Language Dependency Parsing, pages 12–18, Hyderabad, India. find
- Nivre, Joakim, Igor M. Boguslavsky, and Leonid K. Iomdin. 2008. Parsing the SynTagRus Treebank of Russian. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 641–648, Manchester. find
- Nivre, Joakim, Johan Hall, Jens Nilsson, Atanas Chanev, Gulsen Eryigit, Sandra Kubler, Svetoslav Marinov, and Erwin Marsi. 2007. MaltParser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(2):95–135. find
- Petrov, Slav, Dipanjan Das, and Ryan McDonald. 2012. A universal part-of-speech tagset. In Proceedings of the Conference on Language Resources and Evaluation (LREC), pages 2,089–2,096. find
- Rambow, Owen, Bonnie Dorr, David Farwell, Rebecca Green, Nizar Habash, Stephen Helmreich, Eduard Hovy, Lori Levin, Keith J. Miller, Teruko Mitamura, Florence Reeder, and Siddharthan Advaith. 2006. Parallel syntactic annotation of multiple languages. In Proceedings of the Fifth Conference on Language Resources and Evaluation (LREC), pages 559–564, Genoa. find
- Smrž, Otakar. 2007. Functional Arabic Morphology. Formal System and Implementation. Ph.D. thesis, Charles University, Prague. find
- Tsarfaty, Reut and Khalil Sima’an. 2007. Three-dimensional parametrization for parsing morphologically rich languages. In Proceedings of the 10th International Conference on Parsing Technologies (IWPT), pages 156–167, Morristown, NJ. find
- Zitouni, Imed, Jeffrey S. Sorensen, and Ruhi Sarikaya. 2006. Maximum entropy based restoration of Arabic diacritics. In Proceedings of the 21st International Conference on Computational Linguistics (COLING) and the 44th Annual Meeting of the Association for Computational Linguistics (ACL), pages 577–584, Sydney. find our card
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/cl-2013-marton-dependency-parsing-modern-standard-arabic/