CatVar: A Database of Categorial Variations for English

What it is about

CatVar is a database of categorial variations of English lexemes: a noun, a verb and an adjective that share one root, such as "destroy", "destruction" and "destructive". The paper is a system demonstration. It describes the database and a graphical interface, and a second interface for users who propose corrections. Version 2.0 has 62,232 clusters covering 96,368 unique lexemes. Nouns make up 62% of the lexemes, adverbs 4%, and almost half of the clusters contain one word only. The authors argue that such variation matters for machine translation, lexicon building and information retrieval, where queries must match words of different categories.

Ideas

• I1. en/src/lexgen.rs: check the 62,232 clusters against the lemma table data/lemmas.tsv, and count the cluster members that Mova does not link to a common root. Measure the coverage, and list the clusters with a missing member for review.
• I2. Use the clusters as a test set for derivation in en/src/morph.rs: for each pair of a noun and a verb in one cluster, check whether the rule of 17. Derivation II: suffixes gives the noun from the verb. Report the share that the rules get right.
• I3. Keep the single-word clusters as a list of words with no known variant, and count how many EWT test words fall into this list, to find the gaps in the derivation rules.

For Mova

The code is en/src/lexgen.rs and en/src/morph.rs, with en lexicon and en morph-eval. The chapters are 17. Derivation II: suffixes, 18. Compounding, conversion and the minor processes for conversion, and 16. Derivation I: prefixes. The database is NC-SA, so it is for tests and measurements only and never ships in what is built. Measure first: the share of derivation pairs in the clusters that the rules reproduce, twice.

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{habash2003catvar,
  title = {{CatVar: A Database of Categorial Variations for English}},
  author = {Habash, Nizar and Dorr, Bonnie},
  booktitle = {MT Summit IX (System presentations), 2003},
  year = {2003},
  url = {https://aclanthology.org/2003.mtsummit-systems.9/}
}

References

28 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Antworth, E. (1990). PC-KIMMO: A Two-Level Processor for Morphological Analysis. Dallas Summer Institute of Linguistics. find
2. Bangalore, S. and Rambow, O. (2000). Corpus-Based Lexical Choice in Natural Language Generation. In Proceedings of the ACL, Hong Kong. find
3. Boguslavsky, I. (1995). A bi-directional Russian-to-English machine translation system (ETAP-3). In Proceedings of the Machine Translation Summit V., Luxembourg. find
4. Carpuat, M., Ngai, G., Fung, P., and Church, K. (2002). Creating a Bilingual Ontology: A Corpus-Based Approach for Aligning WordNet and HowNet. In Proceedings of the 1st Global WordNet Conference, Mysore, India. find
5. Cruse, D. (1986). Lexical Semantics. Cambridge University Press. find
6. Dong, Z. (2000). HowNet Chinese-English Conceptual Database. Technical Report Online Software Database, Released at ACL. http://www.keenage.com. ↗
7. Dorr, B. J. (2001). LCS Verb Database. Technical Report Online Software Database, University of Maryland, College Park, MD. http://www.umiacs.umd.edu/ ˜bonnie/LCS Database Docmentation.html. ↗
8. Dorr, B. J., Levow, G.-A., and Lin, D. (2000). Building a Chinese-English Mapping between Verb Concepts for Multilingual Applications. In Proceedings of the Fourth Conference of the Association for Machine Translation in the Americas (AMTA), Cuernavaca, Mexico, pages 1–12. find
9. Fellbaum, C. (1998). WordNet: An Electronic Lexical Database. MIT Press. http://www.cogsci.princeton.edu/˜wn [2000, September 7]. ↗
10. Green, R., Pearl, L., Dorr, B. J., and Resnik, P. (2001). Mapping WordNet Senses to a Lexical Database of Verbs. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, pages 244–251, Toulouse, France. find
11. Habash, N. (2002). Generation-Heavy Machine Translation. In Proceedings of the International Natural Language Generation Conference (INLG’02) Student Session, New York. find
12. Habash, N. and Dorr, B. (2003). A Categorial Variation Database for English. In North American Association for Computational Linguistics, Edmonton, Canada. find
13. Habash, N. and Dorr, B. J. (2002). Handling Translation Divergences: Combining Statistical and Symbolic Techniques in Generation-Heavy Machine Translation. In Fifth Conference of the Association for Machine Translation in the Americas, AMTA-2002, Tiburon, California. find
14. Hearst, M. (1998). Automated Discovery of WordNet Relations. In Fellbaum, C., editor, WordNet: an Electronic Lexical Database. MIT Press. find
15. Hull, D. A. and Grefenstette, G. (1996). Experiments in Multilingual Information Retrieval. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. http://www.xerox.fr/people/grenoble/hull/papers/sigir96.ps. ↗
16. Knight, K. and Luk, S. (1994). Building a Large Knowledge Base for Machine Translation. In Proceedings of AAAI-94. find
17. Krovetz, R. (1993). Viewing Morphology as an Inference Process,. In Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 191–203. find
18. Langkilde, I. and Knight, K. (1998). Generation that Exploits Corpus-Based Statistical Knowledge. In ACL/COLING 98, Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics (joint with the 17th International Conference on Computational Linguistics), pages 704–710, Montreal, Canada. find
19. Light, M. (1996). Morphological Cues for Lexical Semantics. In Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics. find
20. Macleod, C., Grishman, R., Meyers, A., Barrett, L., and Reeves, R. (1998). NOMLEX: A Lexicon of Nominalizations. In Proceedings of EURALEX’98, Liege, Belgium. find
21. Marcus, M., Santorini, B., and Marcinkiewicz, M. A. (1993). Building a Large Annotated Corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313–330. find our card
22. Mel’čuk, I. (1988). Dependency Syntax: Theory and Practice. State University of New York Press, New York. find
23. Polguère, A. (2000). Towards a theoretically-motivated general public dictionary of semantic derivations and collocations for French. In Proceedings of EURALEX-2000, Stuttgart. find
24. Porter, M. (1980). An algorithm for suffix stripping. Program, 14(3):130–137. find
25. Procter, P. (1983). Longman Dictionary of Contemporary English: Computer Codes for the Definition Space Other than the Subject Field. Longman Group LTD. find
26. Ramos, M. A., Tutin, A., and Lapalme, G. (1994). Lexical Functions of the Explanatory Combinatorial Dictionary for Lexicalization in Text Generation. In Saint-Dizier, P. and Viegas, E., editors, Computational Lexical Semantics. Cambridge University Press. find
27. Resnik, P. (1999). Disambiguating Noun Groupings with Respect to WordNet Senses. In Armstrong, S., Church, K., Isabelle, P., Manzi, S., Tzoukermann, E., and Yarowsky, D., editors, Natural Language Processing Using Very Large Corpora, pages 77–98. Kluwer Academic, Dordrecht. find
28. Xu, J. and Croft, W. B. (1998). Corpus-based stemming using cooccurrence of word variants. ACM Transactions on Information Systems, 16(1):61–81. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lex-2003-habash-catvar/