I3rab: A New Arabic Dependency Treebank Based on Arabic Grammatical Theory
What it is about
The authors ask whether an Arabic treebank built on the traditional grammar (i'rab, "theory of the governor") parses better than treebanks that copy English or Czech conventions. The I3rab pilot makes two changes. First, the head of a sentence is the first word, so a nominal sentence is headed by its noun, not by a verb placed later; the verb stays the head when the sentence starts with one. Second, joined and covert (dropped) subject pronouns get an explicit node. The grammar also distinguishes verbal from nominal sentences by the first word. The new treebank is compared with a subset of the Prague Arabic Dependency Treebank that has a comparable level of detail, and the authors report a parsing improvement of up to 7.5% in UAS and 18.8% in LAS. The paper's own tables are small hand-worked examples of i'rab for a few sentences.
Ideas
- I1. Head choice for verbless clauses: where a clause has no verb, take its first word (the topic) as head, and compare with the predicate-as-head convention on MACULA trees with
macula compare. Report the number of trees that change. - I2. Explicit subject node for the person-number-gender suffix of the Hebrew verb (qatal, yiqtol): a joined pronoun that is the agent, not a feature of the verb. Test the attachment accuracy on the pointed MACULA verbs.
- I3. Stratified evaluation by sentence type (verbal or nominal), as the paper's split suggests, so that a gain on one type does not hide a loss on the other.
For Mova
I1 is a rule for macula prag and Syntax: the clause and the sentence, tested with macula compare. I2 goes into Pronouns, particles and prepositions and The verb, with the verb-suffix analysis in treebanks/hbo/ptnk as the check. I3 is a reporting rule for every macula compare run.
Cite
@misc{halabi2020i3rab,
title = {{I3rab: A New Arabic Dependency Treebank Based on Arabic Grammatical Theory}},
author = {Halabi, Dana and Fayyoumi, Ebaa and Awajan, Arafat},
year = {2020},
eprint = {2007.05772},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2007.05772}
}References
- Al-Sughaiyer, Imad A and Ibrahim A Al-Kharashi. 2004. Arabic morphological analysis techniques: A comprehensive survey. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 55(3):189–213. find
- Alosh, Mahdi. 2005. Using Arabic: A guide to contemporary usage. Cambridge University Press Cambridge. find
- Alotaiby, Fahad, Salah Foda, and Ibrahim Alkharashi. 2010. Clitics in Arabic language: a statistical study. In Proceedings of the 24th Pacific Asia Conference on Language, Information and Computation. find our card
- Ambati, Vamshi. 2008. Dependency structure trees in syntax based machine translation. In Adv. MT Seminar Course Report, volume 137. find
- Attia, Mohammed and Harold Somers. 2008. Handling Arabic morphological and syntactic ambiguity within the LFG framework with a view to machine translation, volume 279. University of Manchester Manchester. find
- Attia, Mohammed A. 2007. Arabic tokenization system. In Proceedings of the 2007 workshop on computational approaches to Semitic languages: Common issues and resources, pages 65–72, Association for Computational Linguistics. find
- Awajan, Arafat. 2007. Arabic text preprocessing for the natural language processing applications. Arab Gulf Journal of Scientific Research, 25(4):179–189. find
- Awajan, Arafat. 2015. Keyword extraction from Arabic documents using term equivalence classes. ACM Transactions on Asian and Low-Resource Language Information Processing, 14(2):7. find
- Awajan, Arafat. 2016. Semantic similarity based approach for reducing Arabic texts dimensionality. International Journal of Speech Technology, 19(2):191–201. find
- Bengoetxea, Kepa and Koldo Gojenola. 2010. Application of different techniques to dependency parsing of basque. In Proceedings of the NAACL HLT 2010 First Workshop on Statistical Parsing of Morphologically-Rich Languages, pages 31–39, Association for Computational Linguistics. find
- Bharati, Akshar, Vineet Chaitanya, Rajeev Sangal, and KV Ramakrishnamacharyulu. 1995. Natural language processing: a Paninian perspective. Prentice-Hall of India New Delhi. find
- Bikel, Daniel M. 2004. On the parameter space of generative lexicalized statistical parsing models. Citeseer. Böhmová, Alena, Jan Hajiˇc, Eva Hajiˇcová, and Barbora Hladká. 2003. The Prague dependency treebank. In Treebanks. Springer, pages 103–127. find
- Bouma, Gosse, Jori Mur, Gertjan Van Noord, Lonneke Van Der Plas, and Jörg Tiedemann. 2005. Question answering for dutch using dependency relations. In Workshop of the Cross-Language Evaluation Forum for European Languages, pages 370–379, Springer. find
- Buchholz, Sabine and Erwin Marsi. 2006. Conll-x shared task on multilingual dependency parsing. In Proceedings of the tenth conference on computational natural language learning, pages 149–164, Association for Computational Linguistics. find our card
- Chomsky, Noam. 1993. Lectures on government and binding: The Pisa lectures. 9. Walter de Gruyter. find
- Chomsky, Noam and DavidW Lightfoot. 2002. Syntactic structures. Walter de Gruyter. find
- Civit, M, N Bufí, and P Valverde. 2004. Cat3lb: a treebank for Catalan with word sense annotation. In 3rd Workshop on Treebanks and Linguistic Theories. Tuebingen, Germany. find
- Civit, Montserrat and Ma Antònia Martí. 2004. Building cast3lb: A Spanish treebank. Research on Language and Computation, 2(4):549–574. find
- Collins, Michael. 2003. Head-driven statistical models for natural language parsing. Computational linguistics, 29(4):589–637. find our card
- Comas, Pere R, Jordi Turmo, and Lluís Márquez. 2010. Using dependency parsing and machine learning for factoid question answering on spoken documents. In Eleventh Annual Conference of the International Speech Communication Association. find
- Dukes, Kais. 2015. Statistical parsing by machine learning from a classical Arabic treebank. arXiv preprint arXiv:1510.07193. ↗ our card
- Dukes, Kais and Tim Buckwalter. 2010. A dependency treebank of the Quran using traditional Arabic grammar. In 2010 the 7th International Conference on Informatics and Systems (INFOS), pages 1–7, IEEE. find
- Dukes, Kais and Nizar Habash. 2011. One-step statistical parsing of hybrid dependency-constituency syntactic representations. In Proceedings of the 12th International Conference on Parsing Technologies, pages 92–103, Association for Computational Linguistics. find
- Farghaly, Ali and Khaled Shaalan. 2009. Arabic natural language processing: Challenges and solutions. ACM Transactions on Asian Language Information Processing (TALIP), 8(4):14. find
- Frank, Anette, Annie Zaenen, and Erhard Hinrichs. 2012. Treebanks: Linking linguistic theory to computational linguistics. Linguistic Issues in Language Technology, 7(1). find
- Galley, Michel and Christopher D Manning. 2009. Quadratic-time dependency parsing for machine translation. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2, pages 773–781, Association for Computational Linguistics. find
- Gillenwater, Jennifer, Xiaodong He, Jianfeng Gao, and Li Deng. 2013. End-to-end learning of parsing models for information retrieval. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 3312–3316, IEEE. find
- Habash, Nizar and Ryan M Roth. 2009. CATiB: The Columbia Arabic treebank. In Proceedings of the ACL-IJCNLP 2009 conference short papers, pages 221–224, Association for Computational Linguistics. find our card
- Hajic, Jan, Otakar Smrz, Petr Zemánek, Jan Šnaidauf, and Emanuel Beška. 2004. Prague arabic dependency treebank: Development in data and tools. In Proc. Of the NEMLAR Intern. Conf. on Arabic Language Resources and Tools, pages110–117. find
- Halabi, Dana, Arafat Awajan, and Ebaa Fayyoumi. 2017. Arabic lfg-inspired dependency treebank. In 2017 International Conference on New Trends in Computing Sciences (ICTCS), pages 207–215, IEEE. find
- Han, Chung-hye, Na-Rae Han, Eon-Suk Ko, Martha Palmer, and Heejong Yi. 2002. Penn korean treebank: Development and evaluation. In Proceedings of the 16th Pacific Asia Conference on Language, Information and Computation, pages 69–78. find
- Johan Hall, Jens Nilsson and Joakim Nivre. 2013. Malteval. http://www.maltparser.org/malteval.html. ↗
- Katz-Brown, Jason, Slav Petrov, Ryan McDonald, Franz Och, David Talbot, Hiroshi Ichikawa, Masakazu Seno, and Hideto Kazawa. 2011. Training a parser for machine translation reordering. In Proceedings of the conference on empirical methods in natural language processing, pages 183–192, Association for Computational Linguistics. find
- Kübler, Sandra, Ryan McDonald, and Joakim Nivre. 2009. Dependency parsing. Synthesis Lectures on Human Language Technologies, 1(1):1–127. find
- Kulick, Seth, Ryan Gabbard, and Mitchell Marcus. 2006. Parsing the Arabic treebank: Analysis and improvements. In Proceedings of the Treebanks and Linguistic Theories Conference, pages 31–42. find
- LDC. 2004a. Buckwalter Arabic morphological analyzer version. https://catalog.ldc.upenn.edu/LDC2004L02. ↗
- LDC. 2004b. Prague Arabic dependency treebank 1.0. https://catalog.ldc.upenn.edu/docs/LDC2004T23/. ↗
- LDC. 2007. Prague Arabic dependency treebank ++. http://padt-online.blogspot.com/2007/01/conll-shared-task-2007.html. ↗
- LDC. 2018. 2007 CoNLL shared task – Arabic and English. https://catalog.ldc.upenn.edu/LDC2018T08. ↗
- Li, Huiying and Feifei Xu. 2016. Question answering with dbpedia based on the dependency parser and entity-centric index. In 2016 International Conference on Computational Intelligence and Applications (ICCIA), pages 41–45, IEEE. find
- Lynn, Teresa et al. 2016. Irish dependency treebanking and parsing. find
- Maamouri, Mohamed, Ann Bies, Tim Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic treebank: Building a large-scale annotated Arabic corpus. In NEMLAR conference on Arabic language resources and tools, volume 27, pages 466–467, Cairo. find
- Maamouri, Mohamed, Ann Bies, Sondos Krouna, Fatma Gaddeche, and Basma Bouziri. 2009. Penn Arabic treebank guidelines. Linguistic Data Consortium. Marcus, Mitchell, Beatrice Santorini, and Mary Marcinkiewicz. 2006. Building a large annotated corpus of English: The Penn tree bank" in the distributed Penn tree bank project CD-ROM. Linguistic Data Consortium, University of Pennsylvania. find
- McCaffery, Martin and Mark-Jan Nederhof. 2016. Dted: evaluation of machine translation structure using dependency parsing and tree edit distance. In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, volume 2, pages 491–498. find our card
- Nilsson, Jens and Joakim Nivre. 2008. MaltEval: an evaluation and visualization tool for dependency parsing. In LREC. Nivre. 2018. MaltParser. http://www.maltparser.org/. ↗
- Nivre, Joakim. 2005. Dependency grammar and dependency parsing. MSI report, 5133(1959):1–32. find
- Nivre, Joakim. 2009. Parsing Indian languages with MaltParser. Proceedings of the ICON09 NLP Tools Contest: Indian Language Dependency Parsing, pages 12–18. find
- Nivre, Joakim, Johan Hall, Sandra Kübler, Ryan McDonald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007a. The conll 2007 shared task on dependency parsing. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL). find
- Nivre, Joakim, Johan Hall, and Jens Nilsson. 2006. Maltparser: A data-driven parser-generator for dependency parsing. In LREC, volume 6, pages 2216–2219. find
- Nivre, Joakim, Johan Hall, Jens Nilsson, Atanas Chanev, Gül¸sen Eryigit, Sandra Kübler, Svetoslav Marinov, and Erwin Marsi. 2007b. Maltparser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(2):95–135. find
- Owczarzak, Karolina, Josef Van Genabith, and AndyWay. 2007. Dependency-based automatic evaluation for machine translation. In Proceedings of the NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical Translation, pages 80–87, Association for Computational Linguistics. find
- Owens, Jonathan. 1988. The foundations of grammar: an introduction to medieval Arabic grammatical theory, volume 45. John Benjamins Publishing. find
- Owens, Jonathan. 1990. Early Arabic grammatical theory: heterogeneity and standardization, volume 53. John Benjamins Publishing. find
- Ryding, Karin C. 2005. A reference grammar of modern standard Arabic. Cambridge university press. find
- Sima’an, Khalil, Alon Itai, YoadWinter, Alon Altman, and Noa Nativ. 2001. Building a tree-bank of modern hebrew text. Traitement Automatique des Langues, 42(2):247–380. find
- Smrz, Otakar, Viktor Bielicky, and Jan Hajic. 2008. Prague Arabic dependency treebank: A word on the million words. find
- Smrz, Otakar and Petr Pajas. 2004. MorphoTrees of Arabic and their annotation in the Tred environment. In Proceedings of the NEMLAR International Conference on Arabic Language Resources and Tools, pages 38–41. find
- Smrz, Otakar, Jan Šnaidauf, and Petr Zemánek. 2002. Prague dependency treebank for arabic: Multi-level annotation of Arabic corpus. In Proc. of the Intern. Symposium on Processing of Arabic, pages 147–155. find
- Solberg, Per Erik, Arne Skjærholt, Lilja Øvrelid, Kristin Hagen, and Janne Bondi Johannessen. 2014. The Norwegian dependency treebank. find
- Tratz, Stephen C. 2016. Arl Arabic dependency treebank. Technical report, US Army Research Laboaratory Adelphi United States. find
- Volk, Martin, Sofia Gustafson-Capková, David Hagstrand, and Heli Uibo. 2005. Teaching treebanking. Nordisk Sprogteknologi 2004: 2004: Aarbog for Nordisk Sprogteknologisk Forskningsprogram 2000-2004, page 143. find
- Xia, Fei and Martha Palmer. 2001. Converting dependency structures to phrase structures. In Proceedings of the first international conference on Human language technology research, pages 1–5, Association for Computational Linguistics. find
- Xue, Nianwen, Xiuhong Zhang, Zixin Jiang, Martha Palmer, Fei Xia, Fu-Dong Chiou, and Meiyu Chang. 2013. Chinese treebank 8.0 ldc2013t21. Linguistic Data Consortium, Philadelphia. find
- Yu, Hui, Xiaofeng Wu, Wenbin Jiang, Qun Liu, and Shouxun Lin. 2015. An automatic machine translation evaluation metric based on dependency parsing model. arXiv preprint arXiv:1508.01996. ↗
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/langstream-2020-halabi-i3rab-new-arabic-dependency-treebank/