Universal Dependencies for Arabic
What it is about
The paper presents NUDAR, a Universal Dependencies treebank for Modern Standard Arabic of 738,889 tokens in 19,738 sentences, made by converting the Penn Arabic Treebank (parts 1–3). The conversion runs in two steps: the phrase trees become the richer CATiB++ dependency format, with dashtags and morphology, and then rules map labels and structure to UD. The paper lists the main decisions: coordination is flat with the first conjunct as head; numbers are headed by the noun they count (nummod), with compound for numerals inside large numbers; proper names are flat:name; prepositions attach low as case; a copula attaches to its predicate; and the possessive construct is nmod:poss. On a manually checked sample the conversion scores LAS 98.0 and UAS 99.1 on test. A MaltParser trained on NUDAR reaches LAS 81.9, below the CATiB parser on its own space (83.1), and converting the CATiB parser's output to NUDAR loses more (LAS 75.3), since the converted output lacks the dashtags the conversion needs.
Ideas
- I1. Flat coordination as a tree rule: the first conjunct heads the whole coordination, later conjuncts attach with conj and the conjunction with cc. Check that the Hebrew and Aramaic trees from
worldandpraguse the same shape, and count the cases where they do not. - I2. Number constructs by a small table: the noun heads a numeral of three and above, and a multi-word number such as "thousand and forty" is compound inside one headed noun. Use the numeral table of the Hebrew lexicon to write these rules in The lexicon and Nouns, adjectives, pronouns and numerals.
- I3. Keep the intermediate annotation: the paper finds that converting a parser's output loses accuracy because the richer intermediate tags are missing. For Mova's
tools/hboandmacula prag, keep the rule features in the intermediate tree, and do not convert from bare UD output. - I4. Conversion validation: check a random set of converted trees against a hand-checked gold subset (the paper uses 17 sentences to tune and 82 to test, reporting LAS, UAS and label accuracy). Use the same protocol for
macula compare.
For Mova
I1 is a check in world and prag, and a rule in Syntax: the clause and the sentence. I2 goes into The lexicon and Nouns, adjectives, pronouns and numerals. I3 is a design rule for tools/hbo and macula prag. I4 is a test protocol for macula compare and for any Arabic conversion in treebanks/ar.
Cite
@inproceedings{taji2017universal,
title = {{Universal Dependencies for Arabic}},
author = {Taji, Dima and Habash, Nizar and Zeman, Daniel},
booktitle = {Proceedings of the Third Arabic Natural Language Processing Workshop},
year = {2017},
doi = {10.18653/v1/w17-1320},
url = {https://doi.org/10.18653/v1/w17-1320}
}References
- In this paper, we presented a fully automated converter from PATB to the UD syntactic representation. The conversion includes converting the POS Željko Agić and Nikola Ljubešić. 2015. Universal dependencies for croatian (that work for serbian, too). find
- In The 5th Workshop on Balto-Slavic Natural Language Processing (BSNLP 2015). find
- Sarah Alkuhlani, Nizar Habash, and Ryan Roth. 2013. Automatic morphological enrichment of a morphologically underspecified treebank. In HLT-NAACL, pages 460–470. find
- Héctor Martínez Alonso and Daniel Zeman. 2016. Universal dependencies for the ancora treebanks. Procesamiento del Lenguaje Natural, 57:91–98. find
- Miguel Ballesteros and Joakim Nivre. 2012. Maltoptimizer: an optimization tool for maltparser. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 58–62. Association for Computational Linguistics. find
- Nizar Habash and Ryan M. Roth. 2009. CATiB: The Columbia Arabic Treebank. In Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pages 221–224. Association for Computational Linguistics. find our card
- Daša Berović, Željko Agić, and Marko Tadić. 2012. Croatian dependency treebank: Recent development and initial experiments. In Seventh International Conference on Language Resources and Evaluation (LREC 2012). find
- Tim Buckwalter. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. Linguistic Data Consortium, University of Pennsylvania, 2002. LDC Catalog No.: LDC2002L49. find
- Tim Buckwalter. 2004. Buckwalter Arabic Morphological Analyzer Version 2.0. LDC catalog number LDC2004L02, ISBN 1-58563-324-0. find
- Marie-Catherine De Marneffe and Christopher D. Manning. 2008. The stanford typed dependencies representation. In Coling 2008: proceedings of the workshop on cross-framework and cross-domain parser evaluation, pages 1–8. Association for Computational Linguistics. find our card
- Marie-Catherine De Marneffe, Bill MacCartney, Christopher D. Manning, et al. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of LREC, volume 6, pages 449–454. Genoa. find our card
- Marie-Catherine De Marneffe, Timothy Dozat, Natalia Silveira, Katri Haverinen, Filip Ginter, Joakim Nivre, and Christopher D. Manning. 2014. Universal stanford dependencies: A cross-linguistic typology. In LREC, volume 14, pages 4585–92. find our card
- Mona Diab, Nizar Habash, Owen Rambow, and Ryan Roth. 2013. LDC Arabic treebanks and associated corpora: Data divisions manual. arXiv preprint arXiv:1309.5652. ↗
- Kais Dukes and Nizar Habash. 2010. Morphological Annotation of Quranic Arabic. In Proceedings of the Language Resources and Evaluation Conference (LREC), Malta. find our card
- Sašo Džeroski, Tomaž Erjavec, Nina Ledinek, Petr Pajas, Zdenek Žabokrtsky, and Andreja Žele. 2006. Towards a slovene dependency treebank. In Proc. of the Fifth Intern. Conf. on Language Resources and Evaluation (LREC). find
- David Graff, Ke Chen, Junbo Kong, and Kazuaki Maeda. 2006. Arabic Gigaword. Linguistic Data Consortium, Philadelphia, second edition. find
- Nizar Habash, Reem Faraj, and Ryan Roth. 2009. Syntactic Annotation in the Columbia Arabic Treebank. In Proceedings of MEDAR International Conference on Arabic Language Resources and Tools, Cairo, Egypt. find
- Nizar Habash, Ryan Gabbard, Owen Rambow, Seth Kulick, and Mitchell P. Marcus. 2007a. Determining case in Arabic: Learning complex linguistic behavior requires complex linguistic features. In EMNLP-CoNLL, pages 1084–1092. find
- Nizar Habash, Abdelhadi Soudi, and Tim Buckwalter. 2007b. On Arabic Transliteration. In A. van den Bosch and A. Soudi, editors, Arabic Computational Morphology: Knowledge-based and Empirical Methods. Springer. find
- Nizar Habash. 2010. Introduction to Arabic natural language processing, volume 3. Morgan & Claypool Publishers. find
- Jan Hajič, Eva Hajičová, Petr Pajas, Jarmila Panevová, Petr Sgall, and Barbora Vidová-Hladká. 2001. Prague Dependency Treebank 1.0. LDC catalog number LDC2001T10, ISBN 1-58563-212-0. find
- Jan Hajič, Otakar Smrž, Petr Zemánek, Petr Pajas, Jan Šnaidauf, Emanuel Beška, Jakub Kráčmar, and Kamila Hassanová. 2004. Prague Arabic dependency treebank 1.0. LDC2004T23. web download. find
- Anders Johannsen, Héctor Martínez Alonso, and Barbara Plank. 2015. Universal dependencies for danish. In International Workshop on Treebanks and Linguisic Theories (TLT14), page 157. find
- Mohamed Maamouri, Ann Bies, Tim Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic Treebank: Building a Large-Scale Annotated Arabic Corpus. In NEMLAR Conference on Arabic Language Resources and Tools, pages 102–109, Cairo, Egypt. find
- Mohamed Maamouri, Ann Bies, Sondos Krouna, Fatma Gaddeche, and Basma Bouziri, 2009. Penn Arabic Treebank Guidelines. Linguistic Data Consortium. find
- Mohamed Maamouri, Ann Bies, Seth Kulick, Fatma Gaddeche, Wigdan Mekki, Sondos Krouna, Basma Bouziri, and Wadji Zaghouani. 2010a. Arabic treebank: Part 1 v 4.1 ldc2010t13. find
- Mohamed Maamouri, Ann Bies, Seth Kulick, Sondos Krouna, Fatma Gaddeche, and Wadji Zaghouani. 2010b. Arabic treebank: Part 3 v 3.2 ldc2010t08. find
- Mohamed Maamouri, Ann Bies, Seth Kulick, Fatma Gaddeche, Wigdan Mekki, Sondos Krouna, Basma Bouziri, and Wadji Zaghouani. 2011. Arabic treebank: Part 2 v 3.1 ldc2011t09. find
- Mohamed Maamouri, Sondos Krouna, Dalila Tabessi, Nadia Hamrouni, and Nizar Habash. 2012. Egyptian Arabic Morphological Annotation Guidelines. and Evaluation Conference (LREC), Reykjavik, Iceland. find
- Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn treebank. Computational Linguistics, 19(2):313–330, June. find our card
- Slav Petrov, Dipanjan Das, and Ryan McDonald. 2011. A universal part-of-speech tagset. arXiv preprint arXiv:1104.2086. ↗
- Yuval Marton, Nizar Habash, and Owen Rambow. 2013. Dependency parsing of modern standard Arabic with lexical and inflectional features. Computational Linguistics, 39(1):161–194. find our card
- Sampo Pyysalo, Jenna Kanerva, Anna Missilä, Veronika Laippala, and Filip Ginter. 2015. Universal dependencies for finnish. In Proceedings of the 20th Nordic Conference of Computational Linguistics, NODALIDA 2015, May 11-13, 2015, Vilnius, Lithuania, number 109, pages 163–172. Linköping University Electronic Press. find
- Ryan T. McDonald, Joakim Nivre, Yvonne Quirmbach-Brundage, Yoav Goldberg, Dipanjan Das, Kuzman Ganchev, Keith B Hall, Slav Petrov, Hao Zhang, Oscar Täckström, et al. 2013. Universal dependency annotation for multilingual parsing. In ACL (2), pages 92–97. find
- Rudolf Rosa, Jan Mašek, David Mareček, Martin Popel, Daniel Zeman, and Zdeněk Žabokrtský. 2014. HamleDT 2.0: Thirty dependency treebanks stanfordized. In Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, and Joseph Mariani, editors, Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC 2014), pages 2334–2341, Reykjavík, Iceland. European Language Resources Association. find
- Kadri Muischnek, Kaili Müürisep, Tiina Puolakainen, Eleri Aedmaa, Riin Kirt, and Dage Särg. 2014. Estonian dependency treebank and its annotation scheme. In Proceedings of 13th Workshop on Treebanks and Linguistic Theories (TLT13), pages 285– 291. find
- Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007. The conll 2007 shared task on dependency parsing. In Proceedings of the CoNLL shared task session of EMNLP-CoNLL, pages 915–932. sn. find
- Mojgan Seraji, Filip Ginter, and Joakim Nivre. 2016. Universal dependencies for persian. find
- Anas Shahrour, Salam Khalifa, Dima Taji, and Nizar Habash. 2016. Camelparser: A system for arabic syntactic analysis and morphological disambiguation. find our card
- Joakim Nivre, Johan Hall, and Jens Nilsson. 2006. MaltParser: A data-driven parser-generator for dependency parsing. In In Proc. of LREC-2006, pages 2216–2219. find
- Otakar Smrž, Jan Šnaidauf, and Petr Zemánek. 2002. Prague Dependency Treebank for Arabic: Multi-Level Annotation of Arabic Corpus. In Proceedings of the International Symposium on Processing of Arabic, pages 147–155, Manouba, Tunisia. find
- Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Yoav Goldberg, Jan Hajic, Christopher D. Manning, Ryan McDonald, Slav Petrov, Sampo Pyysalo, Natalia Silveira, Reut Tsarfaty, and Daniel Zeman. 2016. Universal dependencies v1: A multilingual treebank collection. In Nicoletta Calzolari (Conference Chair), Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, and Stelios Piperidis, editors, Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Paris, France, may. European Language Resources Association (ELRA). find our card
- Otakar Smrž, Viktor Bielický, Iveta Kouřilová, Jakub Kráčmar, Jan Hajič, and Petr Zemánek. 2008. Prague Arabic dependency treebank: A word on the million words. In Proceedings of the Workshop on Arabic and Local Languages (LREC 2008), pages 16–23, Marrakech, Morocco. European Language Resources Association. find
- Naiwen Xue, Fei Xia, Fu-Dong Chiou, and Marta Palmer. 2005. The penn chinese treebank: Phrase structure annotation of a large corpus. Natural language engineering, 11(02):207–238. find
- Joakim Nivre. 2014. Universal dependencies for Swedish. In Proceedings of the Swedish Language Technology Conference (SLTC). find
- Daniel Zeman. 2008. Reusable tagset conversion using tagset drivers. In LREC. find
- Joakim Nivre. 2016. Universal dependencies: Dubious linguistics and crappy parsing? COLING Keynote Talk. find
- Petya Osenova and Kiril Simov. 2015. Universalizing bultreebank: a linguistic tale about glocalization. BSNLP 2015, page 81. find
- Lilja Øvrelid and Petter Hohle. 2016. Universal dependencies for norwegian. find
- Arfath Pasha, Mohamed Al-Badrashiny, Mona Diab, Ahmed El Kholy, Ramy Eskander, Nizar Habash, Manoj Pooleery, Owen Rambow, and Ryan M. Roth. 2014. MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic. In Proceedings of the Language Resources find our card
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/ud-2017-taji-universal-dependencies-arabic/