Mova0.5 pre-release⌕
☰
home / docs / papers / English / Comprehensive Annotation of Multiword Expressions in a Social Web Corpus

Comprehensive Annotation of Multiword Expressions in a Social Web Corpus

What it is about

The authors annotate every multiword expression (MWE) in a web corpus of about 55,000 words, sentence by sentence, without limiting the kinds of MWE. Groups of tokens need not be contiguous, and each MWE is either strong (idiomatic) or weak (a collocation). The corpus covers 723 documents and 3,812 sentences. It has 3,483 MWEs, which contain 15% of all tokens, and 87% of them are strong. 73% of the MWEs have two tokens and 21% have three. 15% of MWEs contain a gap, and 57% of sentences contain at least one MWE. Agreement is modest: the average inter-annotator F1 over ten pairs of five annotators is 65% on 200 sentences, and it rises to 77% between two pairs that negotiated their analyses. The guidelines cover verb-particle, verb-preposition and verb-noun expressions and proper names.

Ideas

For Mova

The touch points are en/src/tok.rs (table automaton, multiword units), prag expressions, and annot for silver checks. The chapters are 19. The lexicon: vocabulary, multiword expressions and register and 22. Phrases: noun, adjective, adverb and prepositional phrases. The annotations are CC BY-NC, so the corpus is test-only; nothing from it enters the build. Measure first the gap recall of a gappy-MWE matcher against this corpus on the EWT sentences it covers.

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{schneider2014comprehensive,
  title = {{Comprehensive Annotation of Multiword Expressions in a Social Web Corpus}},
  author = {Schneider, Nathan and Onuffer, Spencer and Kazour, Nora and Danchik, Emily and Mordowanec, Michael T. and Conrad, Henrietta and Smith, Noah A.},
  booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)},
  year = {2014},
  url = {https://aclanthology.org/L14-1433/}
}

References

33 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Abeillé, Anne, Clément, Lionel, and Toussenel, François (2003). Building a treebank for French. In Abeillé, Anne and Ide, Nancy, editors, Treebanks, volume 20 of Text, Speech and Language Technology, pages 165–187. Springer Netherlands. find
  2. Baldwin, Timothy (2005). Looking for prepositional verbs in corpus data. In Proc. of the Second ACL-SIGSEM Workshop on the Linguistic Dimensions of Prepositions and their Use in Computational Linguistics Formalisms and Applications, pages 115–126. Colchester, UK. find
  3. Baldwin, Timothy (2008). A resource for evaluating the deep lexical acquisition of English verb-particle constructions. In Proc. of MWE, pages 1–2. Marrakech, Morocco. find
  4. Baldwin, Timothy and Kim, Su Nam (2010). Multiword expressions. In Indurkhya, Nitin and Damerau, Fred J., editors, Handbook of Natural Language Processing, Second Edition. CRC Press, Taylor and Francis Group, Boca Raton, FL. find
  5. Bies, Ann, Mott, Justin, Warner, Colin, and Kulick, Seth (2012). English Web Treebank. Technical Report LDC2012T13, Linguistic Data Consortium, Philadelphia, PA. find
  6. Bird, Steven, Klein, Ewan, and Loper, Edward (2009). Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. O’Reilly Media, Inc., Sebastopol, CA. find
  7. Carpuat, Marine and Diab, Mona (2010). Task-based evaluation of multiword expressions: a pilot study in statistical Perceived sentiment \# docs ++ strongly positive + positive − negative −− strongly negative 310 214 88 111 machine translation. In Proc. of NAACL-HLT, pages 242– 245. Los Angeles, Calif… find
  8. Ciaramita, Massimiliano and Altun, Yasemin (2006). Broad-coverage sense disambiguation and information extraction with a supersense sequence tagger. In Proc. of EMNLP, pages 594–602. Sydney, Australia. find
  9. Constant, Matthieu and Sigogne, Anthony (2011). MWU-aware part-of-speech tagging with a CRF model and lexical resources. In Proc. of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World, pages 49–56. Portland, Oregon, USA. find
  10. Constant, Matthieu, Sigogne, Anthony, and Watrin, Patrick (2012). Discriminative strategies to integrate multiword expression recognition and parsing. In Proc. of ACL, pages 204–212. Jeju Island, Korea. find
  11. Cook, Paul, Fazly, Afsaneh, and Stevenson, Suzanne (2008). The VNC-Tokens dataset. In Proc. of MWE, pages 19–22. Marrakech, Morocco. find
  12. Ellis, Nick C., Simpson-Vlach, Rita, and Maynard, Carson (2008). Formulaic language in native and second language speakers: psycholinguistics, corpus linguistics, and TESOL. TESOL Quarterly, 42(3):375–396. find
  13. Fellbaum, Christiane, editor (1998). WordNet: an electronic lexical database. MIT Press, Cambridge, MA. find
  14. Green, Spence, de Marneffe, Marie-Catherine, Bauer, John, and Manning, Christopher D. (2011). Multiword expression identification with tree substitution grammars: a parsing tour de force with French. In Proc. of EMNLP, pages 725–735. Edinburgh, Scotland, UK. find
  15. Green, Spence, de Marneffe, Marie-Catherine, and Manning, Christopher D. (2012). Parsing models for identifying multiword expressions. Computational Linguistics, 39(1):195–227. find
  16. Hartmann, Silvana, György Szarvas, and Iryna Gurevych (2012). Mining multiword terms from Wikipedia. In Pazienza, Maria Teresa and Stellato, Armando, editors, Semi-Automatic Ontology Development. IGI Global. find
  17. Hermann, Karl Moritz, Blunsom, Phil, and Pulman, Stephen (2012). An unsupervised ranking model for noun-noun compositionality. In Proc. of *SEM, pages 132–141. Montréal, Canada. find
  18. Kuiper, Koenraad, McCann, Heather, Quinn, Heidi, Aitchison, Therese, and van der Veer, Kees (2003). SAID. Technical Report LDC2003T10, Linguistic Data Consortium, Philadelphia, PA. find
  19. Miller, George A., Leacock, Claudia, Tengi, Randee, and Bunker, Ross T. (1993). A semantic concordance. In Proc. of HLT, pages 303–308. Plainsboro, NJ, USA. find
  20. Moon, Rosamund (1998). Fixed expressions and idioms in English: a corpus-based approach. Oxford Studies in Lexicography and Lexicology. Clarendon Press, Oxford, UK. find
  21. Newman, David, Koilada, Nagendra, Lau, Jey Han, and Baldwin, Timothy (2012). Bayesian text segmentation for index term identification and keyphrase extraction. In Proc. of COLING 2012, pages 2077–2092. Mumbai, India. find
  22. Nunberg, Geoffrey, Sag, Ivan A., and Wasow, Thomas (1994). Idioms. Language, 70(3):491–538. find
  23. Paaß, Gerhard and Reichartz, Frank (2009). Exploiting semantic constraints for estimating supersenses with CRFs. In Proc. of the Ninth SIAM International Conference on Data Mining, pages 485–496. Sparks, Nevada. find
  24. Schneider, Nathan, Danchik, Emily, Dyer, Chris, and Smith, Noah A. (2014). Discriminative lexical semantic segmentation with gaps: running the MWE gamut. Transactions of the Association for Computational Linguistics. To appear. find
  25. Simpson, Rita and Mendis, Dushyanthi (2003). A corpus-based study of idioms in academic speech. TESOL Quarterly, 37(3):419–441. find
  26. Tu, Yuancheng and Roth, Dan (2011). Learning English light verb constructions: contextual or statistical. In Proc. of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World, pages 31–39. Portland, Oregon, USA. find
  27. Tu, Yuancheng and Roth, Dan (2012). Sorting out the most confusing English phrasal verbs. In Proc. of *SEM, pages 65–69. Montréal, Canada. find
  28. Čmejrek, Martin, Cuřín, Jan, Hajič, Jan, and Havelka, Jiří (2005). Prague Czech-English Dependency Treebank: resource for structure-based MT. In Proc. of EAMT, pages 73–78. Budapest, Hungary. find
  29. Vilain, Marc, Burger, John, Aberdeen, John, Connolly, Dennis, and Hirschman, Lynette (1995). A model-theoretic coreference scoring scheme. In Proc. of MUC-6, pages 45–52. Columbia, Maryland. find our card
  30. Vincze, Veronika (2012). Light verb constructions in the SzegedParalellFX English-Hungarian parallel corpus. In Calzolari, Nicoletta, Choukri, Khalid, Declerck, Thierry, Doğan, Mehmet Uğur, Maegaard, Bente, Mariani, Joseph, Odijk, Jan, and Piperidis, Stelios, editors, Proc. of LREC. Istanbul, Turk… find
  31. Vincze, Veronika, Nagy T., István, and Zsibrita, János (2013). Learning to detect English and Hungarian light verb constructions. ACM Transactions on Speech and Language Processing, 10(2):6:1–6:25. find
  32. Wray, Alison (2000). Formulaic sequences in second language teaching: principle and practice. Applied Linguistics, 21(4):463–489. find
  33. Wulff, Stefanie (2008). Rethinking idiomaticity: a usage-based approach. Research in Corpus and Discourse. Continuum International Publishing Group, London. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2014-schneider-comprehensive-annotation-multiword-expressions-social/