Coarse Lexical Semantic Annotation with Supersenses: An Arabic Case Study

What it is about

The authors reuse WordNet's supersense labels (the coarse lexicographer classes) as a light scheme for lexical semantics, and apply it to Arabic. They write guidelines for nominal expressions and annotate 2,219 sentences (65,452 tokens, 23,239 mentions) from Arabic Wikipedia articles in four domains, without needing a full semantic lexicon. Two annotators agreed on 87 sentences: mention-level F1 was 70%, token-level agreement 71% with Cohen's kappa 0.69, and soft F1 (any overlap counts) 79%. Eight of the ten most frequent labels reached 73 to 80% mention F1; QUANTITY (63%) and COGNITION (49%) were the weak ones. About half of all tokens are covered by a nominal supersense. Boundary decisions, such as a city and its country as one span, cause much of the disagreement.

Ideas

• I1. onto lexfile layer: tag nouns of English running text with their WordNet supersense from the first-sense lexfile, with no disambiguation, and measure what share of EWT noun tokens is covered. The paper's Arabic figure is about half of all tokens; the English figure is the one to measure.
• I2. Agreement gate for annot: have a second person hand-tag about 80 sentences with the supersense scheme, then compute kappa, mention F1 and soft F1 against the annot silver layer. Use these three numbers as the release gate before the silver layer is used for training.
• I3. Span rule in en/src/tok.rs or en/src/ptag.rs: treat a place name followed by a country as one span (for example "Fez, Morocco") in the supersense layer, and count how often the soft match and the strict match differ on the hand-tagged sample.

For Mova

The touch points are onto (WordNet lexfiles), en/src/ptag.rs and en/src/tok.rs (spans), and the annot teacher side for silver labels. The chapters are 11. Nouns and 19. The lexicon: vocabulary, multiword expressions and register. The paper's Arabic corpus is not used. Its scheme is the reusable part; any English figure must come from Mova's own text. Measure first the lexfile coverage of EWT nouns, with two identical runs.

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{schneider2012coarse,
  title = {{Coarse Lexical Semantic Annotation with Supersenses: An Arabic Case Study}},
  author = {Schneider, Nathan and Mohit, Behrang and Oflazer, Kemal and Smith, Noah A.},
  booktitle = {Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)},
  year = {2012},
  url = {https://aclanthology.org/P12-2050/}
}

References

24 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Giuseppe Attardi, Stefano Dei Rossi, Giulia Di Pietro, Alessandro Lenci, Simonetta Montemagni, and Maria Simi. 2010. A resource and tool for super-sense tagging of Italian texts. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Mike Rosner, and Daniel Tapias, editors, Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta, May. European Language Resources Association (ELRA). find
2. Collin F. Baker, Charles J. Fillmore, and John B. Lowe. 1998. The Berkeley FrameNet project. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics (COLING-ACL ’98), pages 86–90, Montreal, Quebec, Canada, August. Association for Computational Linguistics. find our card
3. D. M. Bikel, R. Schwartz, and R. M. Weischedel. 1999. An algorithm that learns what’s in a name. Machine Learning, 34(1). find
4. Massimiliano Ciaramita and Yasemin Altun. 2006. Broad-coverage sense disambiguation and information extraction with a supersense sequence tagger. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pages 594–602, Sydney, Australia, July. Association for Computational Linguistics. find
5. Massimiliano Ciaramita and Mark Johnson. 2003. Supersense tagging of unknown nouns in WordNet. In Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pages 168– 175, Sapporo, Japan, July. find our card
6. James R. Curran. 2005. Supersense tagging of unknown nouns using semantic similarity. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics (ACL’05), pages 26–33, Ann Arbor, Michigan, June. find our card
7. Bonnie J. Dorr, Rebecca J. Passonneau, David Farwell, Rebecca Green, Nizar Habash, Stephen Helmreich, Eduard Hovy, Lori Levin, Keith J. Miller, Teruko Mitamura, Owen Rambow, and Advaith Siddharthan. 2010. Interlingual annotation of parallel text corpora: a new framework for annotation and evaluation. Natural Language Engineering, 16(03):197–243. find
8. Sabri Elkateb, William Black, Horacio Rodrı́guez, Musa Alkhalifa, Piek Vossen, Adam Pease, and Christiane Fellbaum. 2006. Building a WordNet for Arabic. In Proceedings of The Fifth International Conference on Language Resources and Evaluation (LREC 2006), pages 29–34, Genoa, Italy. find
9. Christiane Fellbaum. 1990. English verbs as a semantic net. International Journal of Lexicography, 3(4):278– 301, December. find
10. Christiane Fellbaum, editor. 1998. WordNet: an electronic lexical database. MIT Press, Cambridge, MA. find
11. Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. 2006. OntoNotes: the 90% solution. In Proceedings of the Human Language Technology Conference of the NAACL (HLT-NAACL), pages 57–60, New York City, USA, June. Association for Computational Linguistics. find
12. Paul Kingsbury and Martha Palmer. 2002. From Tree-Bank to PropBank. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC-02), Las Palmas, Canary Islands, May. find
13. Xin Li and Dan Roth. 2002. Learning question classifiers. In Proceedings of the 19th International Conference on Computational Linguistics (COLING’02), pages 1–7, Taipei, Taiwan, August. Association for Computational Linguistics. find
14. George A. Miller, Claudia Leacock, Randee Tengi, and Ross T. Bunker. 1993. A semantic concordance. In Proceedings of the Workshop on Human Language Technology (HLT ’93), HLT ’93, pages 303–308, Plainsboro, NJ, USA, March. Association for Computational Linguistics. find
15. George A. Miller. 1990. Nouns in WordNet: a lexical inheritance system. International Journal of Lexicography, 3(4):245–264, December. find
16. Behrang Mohit, Nathan Schneider, Rishav Bhowmick, Kemal Oflazer, and Noah A. Smith. 2012. Recall-oriented learning of named entities in Arabic Wikipedia. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2012), pages 162–173, Avignon, France, April. Association for Computational Linguistics. find
17. Gerhard Paaß and Frank Reichartz. 2009. Exploiting semantic constraints for estimating supersenses with CRFs. In Proceedings of the Ninth SIAM International Conference on Data Mining, pages 485–496, Sparks, Nevada, USA, May. Society for Industrial and Applied Mathematics. find
18. Rebecca J. Passonneau, Ansaf Salleb-Aoussi, Vikas Bhardwaj, and Nancy Ide. 2010. Word sense annotation of polysemous words by multiple annotators. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Mike Rosner, and Daniel Tapias, editors, Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta, May. European Language Resources Association (ELRA). find
19. Andrew G. Philpot, Michael Fleischman, and Eduard H. Hovy. 2003. Semi-automatic construction of a general purpose ontology. In Proceedings of the International Lisp Conference, New York, NY, USA, October. find
20. Davide Picca, Alfio Massimiliano Gliozzo, and Massimiliano Ciaramita. 2008. Supersense Tagger for Italian. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, and Daniel Tapias, editors, Proceedings of the Sixth International Language Resources and Evaluation (LREC’08), pages 2386–2390, Marrakech, Morocco, May. European Language Resources Association (ELRA). find
21. Davide Picca, Alfio Massimiliano Gliozzo, and Simone Campora. 2009. Bridging languages by SuperSense entity tagging. In Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009), pages 136–142, Suntec, Singapore, August. Association for Computational Linguistics. find
22. Likun Qiu, Yunfang Wu, Yanqiu Shao, and Alexander Gelbukh. 2011. Combining contextual and structural information for supersense tagging of Chinese unknown words. In Computational Linguistics and Intelligent Text Processing: Proceedings of the 12th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing’11), volume 6608 of Lecture Notes in Computer Science, pages 15– 28. Springer, Berlin. find
23. Satoshi Sekine, Kiyoshi Sudo, and Chikashi Nobata. 2002. Extended named entity hierarchy. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC-02), Las Palmas, Canary Islands, May. find
24. Annie Zaenen, Jean Carletta, Gregory Garretson, Joan Bresnan, Andrew Koontz-Garboden, Tatiana Nikitina, M. Catherine O’Connor, and Tom Wasow. 2004. Animacy encoding in English: why and how. In Bonnie Webber and Donna K. Byron, editors, ACL 2004 Workshop on Discourse Annotation, pages 118–125, Barcelona, Spain, July. Association for Computational Linguistics. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2012-schneider-coarse-lexical-semantic-annotation-supersenses/