A Corpus of Preposition Supersenses
What it is about
The paper presents the first English corpus in which every preposition token is annotated with a hierarchical supersense, and each token is annotated twice to measure agreement. The corpus is English web reviews: 55,579 tokens in 3,812 sentences from 723 documents. It has 4,250 tokens with a preposition supersense, covering 114 prepositions and 63 supersenses. Nine prepositions cover 75% of the tokens. Of the labelled tokens, 1,170 are spatial (location or path), 528 temporal and 452 configurational, so half of them mark other participants and circumstances. Of all tokens, 582 are multiword prepositions or PP idioms. Agreement was 60 to 78% per batch at first, rising to a Cohen's kappa of 0.878 on a 203-sentence set that was adjudicated late. The corpus was also annotated with PropBank structures, which the authors compare with the supersenses.
Ideas
- I1.
en/src/expert.rs: a prior for each preposition: for the nine top prepositions, use their most frequent supersense in the corpus as the default when no rule fires. Measure the default's accuracy on the 4,250 labelled tokens, with the adjudicated labels as gold, and keep the number as the baseline for any rule. - I2. Spatial versus non-spatial test: decide between a spatial and a temporal reading of "in", "on" and "at" from the object's class in
onto(place or time noun). Measure on the corpus (the 1,170 spatial and 528 temporal tokens are the reference) and check the first two runs match. - I3. PropBank bridge: map
world/src/frames.rsrole labels to the preposition supersenses that the paper finds to correspond (for example a location role to the spatial subtree) and count the mismatches as the paper does.
For Mova
The touch points are en/src/expert.rs, onto (noun classes), and world/src/frames.rs (roles). The chapter is 22. Phrases: noun, adjective, adverb and prepositional phrases for the prepositional phrase, and 37. Register and variation for the review genre. The licence is CC BY 4.0, so the corpus can be used in tests; its annotations should still be checked before they enter a build, since the adjudicated labels are the only gold. Measure first the top-prepositions prior against the 4,250 labelled tokens.
Cite
@inproceedings{schneider2016corpus,
title = {{A Corpus of Preposition Supersenses}},
author = {Schneider, Nathan and Hwang, Jena D. and Srikumar, Vivek and Green, Meredith and Suresh, Abhijit and Conger, Kathryn and O'Gorman, Tim and Palmer, Martha},
booktitle = {Proceedings of the 10th Linguistic Annotation Workshop held in conjunction with ACL 2016 (LAW-X 2016)},
year = {2016},
doi = {10.18653/v1/w16-1712},
url = {https://doi.org/10.18653/v1/w16-1712}
}References
- Eneko Agirre, Timothy Baldwin, and David Martinez. 2008. Improving parsing and PP attachment performance with sense information. In Proc. of ACL-HLT, pages 317–325. find
- Columbus, Ohio, USA. Ann Bies, Justin Mott, Colin Warner, and Seth Kulick. 2012. English Web Treebank. Technical Report LDC2012T13, Linguistic Data Consortium, Philadelphia, PA. URL http://www.ldc.upenn.edu/Catalog/ catalogEntry.jsp?catalogId=LDC2012T13 . Claire Bonial, Julia Bonn, Kathryn Conger, J… ↗ our card
- Reykjavík, Iceland. Claire Bonial, Kathryn Conger, Jena D. Hwang, Aous Mansouri, Yahya Aseri, Julia Bonn, Timothy O’Gorman, and Martha Palmer. 2016. Current directions in English and Arabic PropBank. In Nancy Ide and James Pustejovsky, editors, Handbook of Linguistic Annotation. find
- Springer, New York. Claire Bonial, William Corvey, Martha Palmer, Volha V. Petukhova, and Harry Bunt. 2011. A hierarchical unification of LIRICS and VerbNet semantic roles. In Fifth IEEE International Conference on Semantic Computing, pages 483–489. find
- Palo Alto, CA, USA. Claire Bonial, Jena D. Hwang, Julia Bonn, Kathryn Conger, Olga Babko-Malaya, and Martha Palmer. 2012. English propbank annotation guidelines. Center for Computational Language and Education Research Institute of Cognitive Science University of Colorado at Boulder. find
- Claudia Brugman. 1981. The story of ‘over’: polysemy, semantics and the structure of the lexicon. MA thesis, University of California, Berkeley, Berkeley, CA. find
- Published New York: Garland, 1981. find
- Martin Chodorow, Joel R. Tetreault, and Na-Rae Han. 2007. Detection of grammatical errors involving prepositions. In Proc. of the Fourth ACL-SIGSEM Workshop on Prepositions, pages 25–30. find
- Prague, Czech Republic. Jinho D. Choi and Martha Palmer. 2012. Guidelines for the CLEAR style constituent to dependency conversion. Technical Report 01-12, Institute of Cognitive Science, University of Colorado at Boulder, Boulder, Colorado, USA. URL http://www.mathcs.emory.edu/~choi/doc/ clear-depe… ↗
- Sydney, Australia. Daniel Dahlmeier, Hwee Tou Ng, and Tanja Schultz. 2009. Joint learning of preposition senses and semantic roles of prepositional phrases. In Proc. of EMNLP, pages 450–458. Suntec, Singapore. find
- Mark Davies. 2010. The Corpus of Contemporary American English as the first reliable monitor corpus of English. Literary and Linguistic Computing, 25(4):447–464. find
- David Dowty. 1991. Thematic proto-roles and argument selection. Language, pages 547–619. find
- Christiane Fellbaum and Collin F. Baker. 2013. Comparing and harmonizing different verb classifications in light of a semantic annotation task. Linguistics, 51(4):707–728. find
- Homa B. Hashemi and Rebecca Hwa. 2014. A comparison of MT errors and ESL errors. In Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios Piperidis, editors, Proc. of LREC, pages 2696–2700. find
- Reykjavík, Iceland. Annette Herskovits. 1986. Language and spatial cognition: an interdisciplinary study of the prepositions in English. Studies in Natural Language Processing. find
- Cambridge University Press, Cambridge, UK. Nora Hollenstein, Nathan Schneider, and Bonnie Webber. 2016. Inconsistency detection in semantic annotation. In Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios P… find
- Portorož, Slovenia. Dirk Hovy, Stephen Tratz, and Eduard Hovy. 2010. What’s in a preposition? Dimensions of sense disambiguation for an interesting word class. In Coling 2010: Posters, pages 454–462. find
- Beijing, China. Jena D. Hwang. 2014. Identification and representation of caused motion constructions. Ph.D. dissertation, University of Colorado, Boulder, Colorado. find
- Anders Johannsen, Dirk Hovy, Héctor Martínez Alonso, Barbara Plank, and Anders Søgaard. 2014. More or less supervised supersense tagging of Twitter. In Proc. of *SEM, pages 1–11. find
- Dublin, Ireland. George Lakoff. 1987. Women, fire, and dangerous things: what categories reveal about the mind. University of Chicago Press, Chicago. find
- Seth Lindstromberg. 2010. English Prepositions Explained. John Benjamins, Amsterdam, revised edition. find
- Ken Litkowski. 2014. Pattern Dictionary of English Prepositions. In Proc. of ACL, pages 1274–1283. find our card
- Baltimore, Maryland, USA. Ken Litkowski. 2015. Notes on barbecued opakapaka: ontology in preposition patterns. Technical Report 15-01, CL Research, Damascus, MD. URL http://www.clres.com/ online-papers/PDEPOntology.pdf . Ken Litkowski and Orin Hargraves. 2005. The Preposition Project. In Proc. of th… ↗
- Colchester, Essex, UK. Ken Litkowski and Orin Hargraves. 2007. SemEval-2007 Task 06: Word-Sense Disambiguation of Prepositions. In Proc. of SemEval, pages 24–29. find
- Prague, Czech Republic. Héctor Martínez Alonso, Anders Johannsen, Sussi Olsen, Sanni Nimb, Nicolai Hartvig Sørensen, Anna Braasch, Anders Søgaard, and Bolette Sandford Pedersen. 2015. Supersense tagging for Danish. In Beáta Megyesi, editor, Proc. of NODALIDA, pages 21–29. find
- Vilnius, Lithuania. George A. Miller, Richard Beckwith, Christiane Fellbaum, Derek Gross, and Katherine Miller. 1990. Five Papers on WordNet. Technical Report 43, Princeton University, Princeton, NJ. find
- Antje Müller, Claudia Roch, Tobias Stadtfeld, and Tibor Kiss. 2012. The annotation of preposition senses in German. In Britta Stolterfoht and Sam Featherston, editors, Empirical Approaches to Linguistic Theory: Studies in Meaning and Structure, Studies in Generative Grammar, pages 63–82. find
- Walter de Gruyter, Berlin. Elizabeth M. O’Dowd. 1998. Prepositions and particles in English: a discourse-functional account. find
- Oxford University Press, New York. Tom O’Hara and Janyce Wiebe. 2003. Preposition semantic classification via Treebank and FrameNet. In Walter Daelemans and Miles Osborne, editors, Proc. of CoNLL, pages 79–86. find
- Edmonton, Canada. Martha Palmer, Daniel Gildea, and Paul Kingsbury. 2005. The Proposition Bank: an annotated corpus of semantic roles. Computational Linguistics, 31(1):71–106. find our card
- Davide Picca, Alfio Massimiliano Gliozzo, and Massimiliano Ciaramita. 2008. Supersense Tagger for Italian. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, and Daniel Tapias, editors, Proc. of LREC, pages 2386–2390. find
- Marrakech, Morocco. Geoffrey K. Pullum and Rodney Huddleston. 2002. Prepositions and preposition phrases. In Rodney Huddleston and Geoffrey K. Pullum, editors, The Cambridge Grammar of the English Language, pages 579–611. Cambridge University Press, Cambridge, UK. Patrick Saint-Dizier and Nancy Ide,… find our card
- Springer, Dordrecht, The Netherlands. Nathan Schneider, Dirk Hovy, Anders Johannsen, and Marine Carpuat. 2016. SemEval-2016 Task 10: Detecting Minimal Semantic Units and their Meanings (DiMSUM). In Proc. of SemEval. find
- San Diego, California, USA. Nathan Schneider, Behrang Mohit, Chris Dyer, Kemal Oflazer, and Noah A. Smith. 2013. Supersense tagging for Arabic: the MT-in-the-middle attack. In Proc. of NAACL-HLT, pages 661–667. find
- Atlanta, Georgia, USA. Nathan Schneider, Behrang Mohit, Kemal Oflazer, and Noah A. Smith. 2012. Coarse lexical semantic annotation with supersenses: an Arabic case study. In Proc. of ACL, pages 253–258. find our card
- Jeju Island, Korea. Nathan Schneider, Spencer Onuffer, Nora Kazour, Emily Danchik, Michael T. Mordowanec, Henrietta Conrad, and Noah A. Smith. 2014. Comprehensive annotation of multiword expressions in a social web corpus. In Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Ben… find our card
- Reykjavík, Iceland. Nathan Schneider and Noah A. Smith. 2015. A corpus and model integrating multiword expressions and supersenses. In Proc. of NAACL-HLT, pages 1537–1547. find our card
- Denver, Colorado. Nathan Schneider, Vivek Srikumar, Jena D. Hwang, and Martha Palmer. 2015. A hierarchy with, of, and for preposition supersenses. In Proc. of The 9th Linguistic Annotation Workshop, pages 112–123. find our card
- Denver, Colorado, USA. Frédérique Segond, Anne Schiller, Gregory Grefenstette, and Jean-Pierre Chanod. 1997. An experiment in semantic tagging using hidden Markov model tagging. In Piek Vossen, Geert Adriaens, Nicoletta Calzolari, Antonio Sanfilippo, and Yorick Wilks, editors, Automatic Information… find
- Madrid, Spain. Reshef Shilon, Hanna Fadida, and Shuly Wintner. 2012. Incorporating linguistic knowledge in statistical machine translation: translating prepositions. In Proc. of the Workshop on Innovative Hybrid Approaches to the Processing of Textual Data, pages 106–114. find
- Avignon, France. Vivek Srikumar and Dan Roth. 2011. A joint model for extended semantic role labeling. In Proc. of EMNLP, pages 129–139. find
- Edinburgh, Scotland, UK. Vivek Srikumar and Dan Roth. 2013a. An inventory of preposition relations. Technical Report arXiv:1305.5785. URL http://arxiv.org/abs/1305.5785 . Vivek Srikumar and Dan Roth. 2013b. Modeling semantic relations expressed by prepositions. Transactions of the Association for Co… ↗
- Stephen Tratz and Dirk Hovy. 2009. Disambiguation of preposition sense using linguistically motivated features. In Proc. of NAACL-HLT Student Research Workshop and Doctoral Consortium, pages 96–100. find
- Boulder, Colorado. Stephen Tratz and Eduard Hovy. 2011. A fast, accurate, non-projective, semantically-enriched parser. In Proc. of EMNLP, pages 1257–1268. find
- Edinburgh, Scotland, UK. Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, and Chris Dyer. 2015. Evaluation of word vector representations by subspace alignment. In Proc. of EMNLP. find
- Lisbon, Portugal. Yulia Tsvetkov, Elena Mukomel, and Anatole Gershman. 2013. Cross-lingual metaphor detection using common semantic features. In Proc. of the First Workshop on Metaphor in NLP, pages 45–51. find
- Atlanta, Georgia, USA. Yulia Tsvetkov, Nathan Schneider, Dirk Hovy, Archna Bhatia, Manaal Faruqui, and Chris Dyer. 2014. Augmenting English adjective senses with supersenses. In Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Ja… find
- Reykjavík, Iceland. Andrea Tyler and Vyvyan Evans. 2003. The Semantics of English Prepositions: Spatial Scenes, Embodied Meaning and Cognition. find
- Cambridge University Press, Cambridge, UK. Patrick Ye and Timothy Baldwin. 2007. MELB-YB: Preposition sense disambiguation using rich semantic features. In Proc. of SemEval, pages 241–244. Prague, Czech Republic. find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2016-schneider-corpus-preposition-supersenses/