A Freely Available Syntactic Lexicon for English

What it is about

The paper describes a syntactic lexicon for English built for the XTAG parser. It starts from the Oxford Advanced Learner's Dictionary and the Oxford Dictionary of Current Idiomatic English, then corrects and extends the entries by hand. It has about 37,000 entries across eight parts of speech. Each entry has an index (the uninflected form), an entry, a part of speech, a frame (the syntactic environment, for example transitive, sentential complement, or pre-verb-phrase adverb), and a feature field that restricts the frame (for example plural only, wh-word, or infinitive complement). The lexicon is stored as a flat file and as a hashed database, with C and Lisp access. Coverage is measured on four tagged corpora: 80.2% of word occurrences in WSJ, 80.7% in Brown, 88.6% in IBM and 73.6% in ATIS. Most missing items are nouns and proper nouns (66.8% to 81.4% of the misses by corpus).

Ideas

• I1. world/src/dictionary.rs and en/src/dict.rs: add a frame field to the pupil dictionary, so that each verb records its complement pattern (intransitive, transitive, with a sentential complement). Use it to check the verb-argument structure of a parse and to flag clauses that break the pattern, with the reason written out.
• I2. A determiner feature for nouns: mark each noun as "determiner required", "determiner not required", or "plural only", and use it as a hard constraint in the dependency parser (en/src/parse.rs), so that "a jealousy" is penalised and "a man" is not.
• I3. Coverage report by part of speech, as in the paper's Table 6: for en/src/tok.rs plus en/src/morph.rs, report the share of unknown tokens by tag on UD EWT dev, to show where the lexicon is thin (the paper finds nouns and adjectives, not verbs).
• I4. Negative control: remove the frame field for a random subset of verbs and show the parser's arc accuracy on those verbs falls, so the gain from the frame is measured and not assumed.

For Mova

The chapters are 19. The lexicon: vocabulary, multiword expressions and register (lexicon design), 13. Verbs (complement frames) and 11. Nouns (determiner features). The code is en/src/dict.rs, world/src/dictionary.rs and en/src/parse.rs. Measures: per-POS coverage on a fixed corpus, and LAS on UD EWT dev with and without the frame constraint. Because the source licence is not stated, use the paper for ideas only and build any frame data from Mova's own rules.

Topics: Part-of-speech tagging

Cite

The paper itself, not this card. BibTeX from the library's record of the work. arXiv cmp-lg/9410014

@misc{egedi1994freely,
  title = {{A Freely Available Syntactic Lexicon for English}},
  author = {Egedi, Dania and Martin, Patrick},
  year = {1994},
  eprint = {cmp-lg/9410014},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/cmp-lg/9410014}
}

References

12 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Carroll, J. and Grover, C. (1989). The Derivation of a Large Computational Lexicon for English from LDOCE. In B. Boguraev and E. Briscoe (eds.) Computational Lexicography for Natural Language Processing, Harlow, UK: Longman, 177-134. find
2. Conlon, S. Pin-Hgern. (1994). The IIT Lexical Database: Dream and Reality. In A. Zampolli, N. Calzolari, M. Palmer (eds.), Current Issues in Computational Linguistics: In Honour of Don Walker, Giardini with Kluwer. find
3. Cowie, A.P. and Mackin, R., eds. (1975). Oxford Dictionary of Current Idiomatic English, Volume 1, Oxford University Press, London. find
4. Doran, C., Egedi, D., Hockey, B.A., Srinivas, B., Zaidel, M. (1994). XTAG System - A Wide Coverage Grammar for English. In Proceedings of the 16 th International Conference on Computational Linguistics (COLING ’94), Kyoyo, Japan, August. find
5. Guthrie, L., Rauls, V., Luo, T., Bruce, R. (1993). LEXI-CAD/CAM. Technical Report MCCS-93-259, Computing Research Laboratory, New Mexico State University. find
6. Hornby A. S., ed. (1974). Oxford Advanced Learner’s Dictionary of Current English, Third Edition, Oxford University Press, London. find
7. Joshi, A., Levy, L. and Takahashi, M. (1975). Tree Adjunct Grammars. Journal of Computer and System Sciences. find
8. Karp, D., Schabes, Y., Zaidel, M., Egedi, D. (1992). A Freely Available Wide Coverage Morphological Analyzer for English. In Proceedings of the 15 th International Conference on Computational Linguistics (COLING ’92), Nantes, France, August. find
9. Macleod, C., Grishman, R. and Meyers, A. (1994). Creating a Common Syntactic Dictionary of English. In Proceedings of the International Workshop on Sharable Natural Language Resources, Nara, Japan, August. find
10. Santorini, B. (1990). Part-of-Speech Tagging Guidelines for the Penn TreeBank Project. Technical report MS-CIS-90-47, Department of Computer and Information Science, University of Pennsylvania. find
11. Seltzer, M. and Yigit, O. (1991). A new hashing package for UNIX. In USENIX, Winter. find
12. The XTAG Project (1994). A Feature-Based, Lexicalized Tree Adjoining Grammar (FB-LTAG) for English. Manuscript, University of Pennsylvania. In Progress. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/egedi-1994-freely-available-syntactic-lexicon-english/